Commit Graph

183 Commits

Author SHA1 Message Date
Trevor Guidry 753588632e SERVER-79845 make burn_in_tests output valid yaml 2023-08-09 01:45:45 +00:00
Trevor Guidry fd837c1c90 SERVER-77436 remove all_feature_flags.txt and calculate feature flags on the fly 2023-08-07 21:00:50 +00:00
Alexander Neben 73a62e2f16 SERVER-79642 Added some type hinting to resmoke 2023-08-03 03:28:01 +00:00
Tausif Rahman 8896ca5278 SERVER-79553 Add Support for Config Fuzzer in Antithesis (pt 1) 2023-08-02 03:18:59 +00:00
Joy Wang 571dbc6170 SERVER-78240 Programmatically generate a docker-compose.yml for concurrency_sharded_with_stepdowns_and_balancer 2023-07-28 15:46:53 +00:00
Trevor Guidry 53837263e1 SERVER-72923 add multiversion reproduce steps to evergreen 2023-06-20 14:53:13 +00:00
Trevor Guidry 3b4b7fd820 SERVER-77376 fully_disabled_feature_flags.yml does not affect tagged jstests 2023-06-05 21:06:38 +00:00
Louis Williams 75a0950752 SERVER-70759 Fuzz sharding parameters in config_fuzzer 2023-04-26 10:33:28 +00:00
Jack Mulrow e3e4b4d6a5 SERVER-76310 Use config shard terminology instead of catalog shard 2023-04-24 01:33:22 +00:00
Namaz Gurbanov 5facb9a7c4 SERVER-66927 remove references to silentFail 2023-04-11 03:58:24 +00:00
Trevor Guidry ae16cf75e3 SERVER-72924 add --shellSeed argument to resmoke 2023-04-10 22:25:02 +00:00
Tausif Rahman 2dbc2a40b8 SERVER-73479 resmoke should error locally when attempting to run tests that are disabled 2023-03-21 20:07:24 +00:00
auto-revert-processor 6938e93030 Revert "SERVER-73479 resmoke should error locally when attempting to run tests that are disabled"
This reverts commit 9efb38d64c.
2023-03-19 03:54:47 +00:00
Tausif Rahman 9efb38d64c SERVER-73479 resmoke should error locally when attempting to run tests that are disabled 2023-03-17 12:27:20 +00:00
Pavi Vetriselvan 65b2e740d1 SERVER-67472 Disallow emptycapped command from running with the config fuzzer 2023-03-03 20:08:43 +00:00
Louis Williams 1c9cb26ee2 SERVER-70695 Add config fuzzer sharding tests
This commit also reorganizes the config fuzzer so that stressful tests
run less frequently and with a higher task timeout and run in more
places, like UBSAN.
2023-01-26 11:00:25 +00:00
Kshitij Gupta e489daae84 SERVER-71448: Add resmoke option for optional config server. 2022-11-18 21:13:11 +00:00
Trevor Guidry 22f38cf147 SERVER-63104 add resmoke argument for generating all_feature_flags.txt locally 2022-11-16 18:42:54 +00:00
Haley Connelly a4a3eba2a0 SERVER-69850 Prevent compact command from running when the config fuzzer is enabled 2022-09-28 13:24:47 +00:00
Alexander Neben 97ac02fa50 SERVER-68593 Disable low value python warnings 2022-09-02 22:55:09 +00:00
Daniel Moody f0fe2f924d SERVER-65508 detect existing resmoke processes which could cause issues for tests 2022-07-28 20:16:16 +00:00
Daniel Gottlieb c4ba4a3e07 Revert "SERVER-65508 don't run resmoke tests if existing mongo processes exist"
This reverts commit 39f9ba8ff3.
2022-06-16 04:15:45 +00:00
Daniel Moody 39f9ba8ff3 SERVER-65508 don't run resmoke tests if existing mongo processes exist 2022-06-15 18:36:57 +00:00
Mikhail Shchatko ff67413773 SERVER-65781 Run the symbolizer on CI output 2022-05-18 15:03:20 +00:00
Robert Guo 9563cadc7d SERVER-65071 remove resmoke gRPC integration 2022-04-24 01:45:17 +00:00
Richard Samuels a4aa57a45b SERVER-62992 Don't validate resmoke.ini and install_dir when using subcommands other than run 2022-04-18 15:22:33 +00:00
Richard Samuels fdd96b07d7 SERVER-62992 Fix error message when user has multiple testable installations and hasn't specified which one to use 2022-04-11 16:41:49 +00:00
Richard Samuels 0d9705653d SERVER-62992 Remove need for resmoke.ini 2022-04-08 14:27:40 +00:00
Richard Samuels 2ab888c8fe Revert "SERVER-62992 Remove need for resmoke.ini"
This reverts commit d4206bdeb1.
2022-03-30 18:38:31 +00:00
Richard Samuels d4206bdeb1 SERVER-62992 Remove need for resmoke.ini 2022-03-30 14:08:19 +00:00
Mikhail Shchatko 971f88711e SERVER-62180 Enable signal processing (or red/green) checks for Google Microbenchmark 2022-01-20 10:28:46 +00:00
Robert Guo 7bff1ee135 SERVER-61225 fix feature flag definition for standalone fixtures 2021-11-04 11:23:33 +00:00
Mikhail Shchatko ac364ad8d4 SERVER-60458 Add a resmoke run flag to limit number of tests being run 2021-11-04 08:30:37 +00:00
Robert Guo 84c2c6eb8a SERVER-60927 run non-fuzzer multiversion suites against last-lts and last-continuous 2021-11-03 04:03:04 +00:00
Robert Guo aab079584e SERVER-54420 don't run feature flag tests on the multiversion ff variant 2021-10-28 00:25:36 +00:00
Gregory Wlodarek 3b074f83fc SERVER-59833 Expand WT config fuzzing in mongod for collections and indexes 2021-10-18 15:25:19 +00:00
Benety Goh dd8a706377 Revert "SERVER-59833 Expand WT config fuzzing in mongod for collections and indexes"
This reverts commit 05212043b1.
2021-10-18 01:00:30 +00:00
Reo Kimura 05212043b1 SERVER-59833 Expand WT config fuzzing in mongod for collections and indexes 2021-10-15 19:55:24 +00:00
Robert Guo ba5cf359d8 SERVER-55857 remove NAMED_SUITES from resmoke config 2021-10-02 04:55:02 +00:00
Robert Guo 7f67f62cd9 SERVER-60004 archive all files on all mainline variants 2021-09-17 15:26:23 +00:00
Mikhail Shchatko 3675df9065 SERVER-58934 Don't pass any feature flag parameters to old fixture in multiversion 2021-09-01 10:53:04 +00:00
80741223+jlap199@users.noreply.github.com 8b4baa2234 SERVER-59430 Parse list of additional feature flags 2021-08-18 20:47:45 +00:00
Robert Guo 3a8d0fb26f SERVER-56289 All generated tasks depend on archive_dist_test instead of archive_dist_test_debug 2021-08-05 02:26:14 +00:00
Mikhail Shchatko a2cc442afc SERVER-54419 Support last-lts and last-continuous in generating multiversion_exclude_tags.yml file 2021-07-30 16:54:57 +00:00
Robert Guo bc5f939071 SERVER-58172 run multiversion tests on master with 5.0 and disable incompatible tests 2021-07-22 14:50:12 +00:00
Robert Guo 4a26a20b12 SERVER-57937 support loading generated suites in resmoke.py suite definitions 2021-07-20 14:21:02 +00:00
Yoonsoo Kim 2181d579ff SERVER-58198 Remove shellReadMode/shellWriteMode command-line params from resmoke.py 2021-07-02 18:36:21 +00:00
Robert Guo 1eb48009eb SERVER-58086 set debug symbols download URL for shell-invoked hang analyzer 2021-07-01 18:37:18 +00:00
Robert Guo 5d9e1907cc SERVER-57873 support multiple tag files resmoke 2021-06-23 03:24:24 +00:00
Robert Guo 424e574251 SERVER-57778 add QE and QO patch build variants 2021-06-18 15:38:39 +00:00
Siran Wang 75f9277a30 SERVER-55296 support enhanced multiversion api 2021-06-10 15:56:54 +00:00
Robert Guo e500e9d4fc SERVER-56528 fix debug symbol downloader 2021-05-21 13:53:34 +00:00
Robert Guo 00c3b89b64 SERVER-56744 list feature flags for local usage 2021-05-13 16:37:28 +00:00
Siran Wang 0edbd2fe51 SERVER-54086 support download debug symbol from patch build 2021-04-21 14:50:55 +00:00
Robert Guo 0526807879 SERVER-55249 fix resmoke end to end test 2021-04-06 17:26:19 +00:00
Robert Guo 39fc7fd24d SERVER-55249 archive all data on required mainline builders 2021-04-06 13:25:46 +00:00
Robert Guo 8a8bebcb50 SERVER-55720 Improve the error message for the all feature flags file 2021-04-06 13:05:44 +00:00
Robert Guo d9761413b9 SERVER-51883 don't run feature flag tests if --runAllFeatureFlagTests arg is not specified 2021-03-30 12:09:02 +00:00
Robert Guo 8e8af7bb44 SERVER-51883 Add all feature flags by default to the all feature flags
builders
2021-03-27 04:11:04 +00:00
Mikhail Shchatko 8c303d8fa5 SERVER-54002 Evergreen task documentation 2021-03-16 17:18:22 +00:00
julianedwards e2702b9a7e SERVER-54663: Pass group id to evergreen when running with resmoke with jasper. 2021-03-15 14:54:05 +00:00
Mikhail Shchatko 8022d8830d SERVER-54723 Shorten resmoke log prefixes 2021-03-04 21:05:37 +00:00
Carl Raiden Worley 8082beefe8 SERVER-54617 Create a resmoke configuration management helper 2021-03-02 04:25:25 +00:00
Hana Pearlman 3fadec4ccd SERVER-34927: allow localField and foreignField with more expressive $lookup pipeline 2021-01-07 23:12:03 +00:00
julianedwards fff7a4baa0 SERVER-49504: Allow resmoke's mongo shell to log to Jasper 2020-12-14 18:27:30 +00:00
Robert Guo 2c50126f91 Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
This reverts commit 3c179e4935.
2020-12-07 19:21:59 +00:00
Brian DeLeonardis 9e258a74a0 SERVER-41020 Ensure that config fuzzer configurations are reproducible 2020-11-19 21:19:08 +00:00
julianedwards 3c179e4935 SERVER-49504: Revert "Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"" 2020-11-06 17:23:31 +00:00
Brian DeLeonardis a53d94e484 SERVER-41020 Add tests that fuzz storage engine parameters 2020-11-06 02:27:25 +00:00
Robert Guo e62f90245b Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
This reverts commit e9e1635d6c.
2020-10-15 13:38:36 +00:00
julianedwards e9e1635d6c SERVER-49504: Allow resmoke's mongo shell to log to Jasper 2020-10-14 19:12:24 +00:00
Ben Caimano 8468e69c2e Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
This reverts commit 308cc2fa21.
2020-10-12 23:00:38 +00:00
julianedwards 308cc2fa21 SERVER-49504: Allow resmoke's mongo shell to log to Jasper 2020-10-12 20:59:36 +00:00
Daniel Gottlieb d774ce166f SERVER-50188: Allow multiple setParameters for the same key if their value is also identical. 2020-08-10 13:56:23 +00:00
Daniel Gottlieb 52f4d4d869 SERVER-47509: Have resmoke better cope with multiple set parameters. 2020-08-05 20:11:11 +00:00
Daniel Gottlieb 19dd40b181 SERVER-48951: Add usability options for resmoke output.
--mrlog will pipe all stdout through mrlog.

--userFriendlyOutput=<file> will `tee` all output to <file>. It will filter
stdout with a grep to highlight test progress and possible failures.
2020-07-23 23:28:54 +00:00
Daniel Gottlieb c0be456afe SERVER-48953: Allow resmoke test files to be listed in a replay file. 2020-07-20 19:23:49 +00:00
Richard Samuels c37aaac069 SERVER-49041 Check if live-record binary exists when specified in resmoke.py invocation 2020-07-09 13:29:35 +00:00
Mikhail Shchatko f46630dd3a SERVER-48112 Use Absolute Imports in Resmoke 2020-06-18 10:21:48 +00:00
Daniel Gottlieb 704131ba7e SERVER-48782: On request, backup datafiles when restarting test mongod instances. 2020-06-16 20:39:39 +00:00
Richard Samuels 38b125fc08 SERVER-47312 hang_analyzer: enable on ASAN builders without running gcore 2020-06-05 13:24:34 +00:00
Robert Guo 9b1ed5d3ac SERVER-47589 add option for undo recorder 2020-06-03 14:00:53 +00:00
vrachev 9227199e1c SERVER-46769 Migrate from optparse to argparse 2020-04-30 14:25:56 +00:00