Commit Graph

38 Commits

Author SHA1 Message Date
Nic 57351fac23 SERVER-111846: Log more information when backing up files in jstests (#42113)
GitOrigin-RevId: a4aa71f952c4c6deb16f928dbdeee0a2d8ca564b
2025-10-06 23:05:21 +00:00
Zac 591928c619 SERVER-108478 JS formatted by prettier and remove clang-format (#39656)
GitOrigin-RevId: 6c8f6aded47f260aa4f7c231b17dae3302cb1e04
2025-08-21 17:27:09 +00:00
Gregory Wlodarek 5a7380e116 SERVER-105079 Additional diagnostics for backup/restore testing for journal files (#36153)
GitOrigin-RevId: ba6b5ef4be0f32f143acb51fa9cce72bef57ee57
2025-05-19 23:08:14 +00:00
clarissecheah 7780060928 SERVER-103515 Re-add retry on exception in backup_utils jstest library (#34733)
GitOrigin-RevId: b577abcbbdf029961b653305faf29ed12d3b1256
2025-04-10 05:43:54 +00:00
clarissecheah 3088f51d00 SERVER-81208 Use checkpoint cursor timestamp when opening backup cursor (#31485)
GitOrigin-RevId: 334019b9256c0ea2c97c5302cfdf47d1d3260cbd
2025-04-10 02:14:56 +00:00
Gregory Wlodarek cc9de8109b SERVER-98818 Clear journal files between incremental backups in sharded_backup_restore.js library (#30640)
GitOrigin-RevId: 4b12fb7ec05d10daba812037128528781d676d65
2025-01-01 22:26:26 +00:00
Ali Mir 9483188b6c SERVER-91914 Move magic restore test utility logic out of backup_utils.js (#25302)
GitOrigin-RevId: 75543ef1b81bf07d2ef78a5f4eac88addde9499c
2024-11-20 23:26:28 +00:00
Ali Mir c9ab00f1af SERVER-91914 Refactor MagicRestoreUtils to manage restore for all nodes in a replica set (#25299)
GitOrigin-RevId: 1b3ece3a0e24e2a05494ad73f803b8b18e29712e
2024-11-20 23:26:12 +00:00
Frederic Vitzikam (fredvitz) 4b0486604e SERVER-90356 Support PIT restore without entries after the checkpoint timestamp (#23957)
GitOrigin-RevId: 31c9b80cbc121f0e331ab4058271c30725a0c122
2024-11-20 23:25:59 +00:00
clarissecheah 58f49a639a SERVER-89919 Add testing matrix to backup and restore (#26687)
GitOrigin-RevId: 46595982c0fd94e7ec60723373876ff3cf7358e4
2024-09-28 13:02:17 +00:00
Ali Mir 97d51e34b9 SERVER-90338 Refactor magic restore assertions into one post-restore check (#22764)
GitOrigin-RevId: 767165256b269aaaa47bc4577304930cbb70f692
2024-06-03 21:46:26 +00:00
Frederic Vitzikam (fredvitz) 64f2f36094 SERVER-87407 Create targeted jstest for PIT sharded cluster magic restore (#22591)
GitOrigin-RevId: fab5c9e02199402c105f7c2cecd4641eab1b31a0
2024-05-30 22:57:30 +00:00
seanzimm 0b01746f1a SERVER-90343: Add incremental backup test for magic restore (#22645)
GitOrigin-RevId: 854a9f2588995ee9eee56d609a4ebd3ba339292a
2024-05-30 19:49:29 +00:00
Ali Mir f4951fb9ab SERVER-82908 Create magic restore log component and add additional debug logging (#22704)
GitOrigin-RevId: 3c011c38af5741b13efcbc0f39d5dc220314d154
2024-05-30 15:41:19 +00:00
Frederic Vitzikam (fredvitz) 8894d636ac SERVER-87406 Create targeted jstest for non-PIT sharded cluster magic restore (#21644)
GitOrigin-RevId: aad4d6974aa719801e0319b14dffa012cfc32a05
2024-05-24 19:06:17 +00:00
Ali Mir 08f43e7b43 SERVER-90516 Require magic restore node to run with --replSet and set parameter in targeted tests (#22230)
This PR addresses the issue where we weren't running magic restore nodes
with `--replSet` in our targeted tests. I've now made it a requirement
to pass in the parameter when we run magic restore. Cloud confirmed they
don't support backing up standalones, and we already implicitly require
the node being restored to be a replica set (`--replSetConfig` is a
required restore configuration parameter).

I want to note that the automation credentials test were breaking with
an error `no timestamp provided for an update to a table configured to
always use timestamps`. This was occurring when we tried to do an
untimestamped write to a restored table that had existing timestamped
writes. Turns out we hit this issue in the legacy restore procedure as
well ([HELP-45192](https://jira.mongodb.org/browse/HELP-45192)), so I
needed to add a line of code that skipped the WT timestamp check for
magic restore. This is safe because we're only taking unstable
checkpoints during the restore process, and all timestamps are set
correctly at the end. We also aren't concerned with resumability of the
restore procedure at the moment. The linked HELP ticket has a reference
to the `wiredTigerSkipTableLoggingChecksOnStartup` parameter, but that's
not relevant for magic restore since we're not doing restarts.

[evergreen](https://evergreen.mongodb.com/version/66450586b4a29f0007ba0417)
(all magic restore targeted tests are passing except
`magic_restore_oidc_replica_set.js`, but [that's a known
issue](https://jira.mongodb.org/browse/BF-33184).

---------

Co-authored-by: Alex Neben <alex.neben@mongodb.com>
GitOrigin-RevId: 6b7adfd56c3a8b5a7c6f48a342305015575c2e95
2024-05-21 15:38:15 +00:00
Ali Mir cc3c078212 SERVER-88169 Use systemUuids for creating internal replicated collections in magic restore (#21963)
GitOrigin-RevId: 2fe30ba7dee9b086b511e1cf395f2527e1cd0a2f
2024-05-09 21:49:27 +00:00
Gregory Wlodarek 1451c52d66 SERVER-89989 Extend sharded_backup_restore.js to perform incremental backups (#21946)
GitOrigin-RevId: 9bf43882ed085152fddd757190156f02a9255239
2024-05-08 11:04:46 +00:00
Matt Kneiser 54c1e16939 SERVER-89625 Add more backup and restore test coverage (#21525)
GitOrigin-RevId: 4785133fbb84ee42ee6fa431798d059cbc6cb35f
2024-05-07 01:31:42 +00:00
Ali Mir e865478f40 SERVER-88527 Create MagicRestoreUtils utility class for testing magic restore (#21051)
GitOrigin-RevId: c37a39bb338390bfd1eefcd3b8ab126987a2cb64
2024-04-11 22:09:58 +00:00
auto-revert-processor 3319be50e4 Revert "SERVER-88527 Create MagicRestoreUtils utility class for testing magic restore (#20796)"
This reverts commit 1e603e524deb3e6df5498f865518fbbee48bdd6f.

GitOrigin-RevId: 59a88e68acfb0938df2c2ebef94b74c6c8bf465f
2024-04-11 03:10:18 +00:00
Ali Mir a934f31ca1 SERVER-88527 Create MagicRestoreUtils utility class for testing magic restore (#20796)
GitOrigin-RevId: 1e603e524deb3e6df5498f865518fbbee48bdd6f
2024-04-10 19:47:47 +00:00
Cheahuychou Mao 5b734e09c2 SERVER-87299 Make replica set endpoint support $backupCursor and $backupCursorExtend (#20498)
GitOrigin-RevId: ee9234a76660b84fbb9e53e2f04f04575c4b6f0d
2024-04-08 20:25:44 +00:00
Ali Mir ad975e57c3 SERVER-89096 Disable persisting named pipe by default in backup_utils.js (#20883)
GitOrigin-RevId: 39f07ebca2045635f530bca9d132ddc017f0cc99
2024-04-08 18:45:59 +00:00
seanzimm c84c33fa64 SERVER-87411: Add PIT Restore Support to Magic Restore Hooks (#20616)
GitOrigin-RevId: 99d10c9556183eddf661be1fa7214bd067434360
2024-04-05 23:40:51 +00:00
seanzimm 569dd253d0 SERVER-87635: Add sharded passthrough suite for magic restore (#19930)
GitOrigin-RevId: 10eb71cb1055c04d063fff6d6007e6a570baa717
2024-03-19 14:48:45 +00:00
Ali Mir 981c4783d4 SERVER-85665 Move magic restore JavaScript helper functions into backup_utils.js
GitOrigin-RevId: b1f11c84b70ed6e0d796d2641a95885d41822ca5
2024-02-16 02:26:54 +00:00
Etienne Petrel 0ffed150b1 SERVER-83477 Extend backup utils functions 2023-11-28 23:56:09 +00:00
Matt Broadstone a4f458fe4d SERVER-79735 Convert jstest corpus to use es modules 2023-08-06 20:48:04 +00:00
Gregory Wlodarek 46268920bb SERVER-63790 Write end-to-end tests for sharded cluster selective backups/restores 2022-03-10 16:24:48 +00:00
Gregory Wlodarek 791ee094ed Revert "SERVER-63790 Write end-to-end tests for sharded cluster selective backups/restores"
This reverts commit fa269a9468.
2022-03-10 14:29:44 +00:00
Gregory Wlodarek fa269a9468 SERVER-63790 Write end-to-end tests for sharded cluster selective backups/restores 2022-03-10 01:58:05 +00:00
Matthew Russotto d3dcf079e3 SERVER-47497 backup_lib for backup cursors must create subdirectories if they do not exist 2020-04-13 16:09:43 +00:00
Mathew Robinson ef9f9b461e
SERVER-41177 Remove Javascript ScopedThread class 2019-08-12 17:28:18 -04:00
Xiangyu Yao 423e78f790 SERVER-39377 Make efficient hot backup work with enableMajorityReadConcern=false 2019-03-06 20:56:13 -05:00
Xiangyu Yao 7edc50cf21 SERVER-38958 Add heartbeating mechanism to sharded_backup_restore.js 2019-01-17 11:10:05 -05:00
Xiangyu Yao 844f5a77c5 SERVER-38255 Write efficient sharded backup tests 2018-12-21 15:59:41 -05:00
Daniel Gottlieb ae2e78ff63 SERVER-36270: Add test combining backup cursors and manipulating the truncate after point. 2018-10-08 11:54:17 -04:00