Commit Graph

197 Commits

Author SHA1 Message Date
Robert Guo 1eb48009eb SERVER-58086 set debug symbols download URL for shell-invoked hang analyzer 2021-07-01 18:37:18 +00:00
Robert Guo 5d9e1907cc SERVER-57873 support multiple tag files resmoke 2021-06-23 03:24:24 +00:00
Robert Guo 424e574251 SERVER-57778 add QE and QO patch build variants 2021-06-18 15:38:39 +00:00
Siran Wang 75f9277a30 SERVER-55296 support enhanced multiversion api 2021-06-10 15:56:54 +00:00
Robert Guo 00c3b89b64 SERVER-56744 list feature flags for local usage 2021-05-13 16:37:28 +00:00
Siran Wang 0edbd2fe51 SERVER-54086 support download debug symbol from patch build 2021-04-21 14:50:55 +00:00
Robert Guo 39fc7fd24d SERVER-55249 archive all data on required mainline builders 2021-04-06 13:25:46 +00:00
Robert Guo d9761413b9 SERVER-51883 don't run feature flag tests if --runAllFeatureFlagTests arg is not specified 2021-03-30 12:09:02 +00:00
Robert Guo 8e8af7bb44 SERVER-51883 Add all feature flags by default to the all feature flags
builders
2021-03-27 04:11:04 +00:00
Mikhail Shchatko 8c303d8fa5 SERVER-54002 Evergreen task documentation 2021-03-16 17:18:22 +00:00
julianedwards e2702b9a7e SERVER-54663: Pass group id to evergreen when running with resmoke with jasper. 2021-03-15 14:54:05 +00:00
Mikhail Shchatko 8022d8830d SERVER-54723 Shorten resmoke log prefixes 2021-03-04 21:05:37 +00:00
Carl Raiden Worley 8082beefe8 SERVER-54617 Create a resmoke configuration management helper 2021-03-02 04:25:25 +00:00
Pavi Vetriselvan 7a1bb02d3a SERVER-53247 disable enableMajorityReadConcern=false for non-test storage engines 2021-01-19 18:48:35 +00:00
Hana Pearlman 3fadec4ccd SERVER-34927: allow localField and foreignField with more expressive $lookup pipeline 2021-01-07 23:12:03 +00:00
julianedwards fff7a4baa0 SERVER-49504: Allow resmoke's mongo shell to log to Jasper 2020-12-14 18:27:30 +00:00
Robert Guo 2c50126f91 Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
This reverts commit 3c179e4935.
2020-12-07 19:21:59 +00:00
A. Jesse Jiryu Davis e618ffe3d8 SERVER-51877 Check all API V1 commands are defined in IDL 2020-11-10 18:52:28 +00:00
julianedwards 3c179e4935 SERVER-49504: Revert "Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"" 2020-11-06 17:23:31 +00:00
Brian DeLeonardis a53d94e484 SERVER-41020 Add tests that fuzz storage engine parameters 2020-11-06 02:27:25 +00:00
Robert Guo e62f90245b Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
This reverts commit e9e1635d6c.
2020-10-15 13:38:36 +00:00
julianedwards e9e1635d6c SERVER-49504: Allow resmoke's mongo shell to log to Jasper 2020-10-14 19:12:24 +00:00
Ben Caimano 8468e69c2e Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
This reverts commit 308cc2fa21.
2020-10-12 23:00:38 +00:00
Cheahuychou Mao d7f220af70 SERVER-50493 Make tenant_migration_jscore_passthrough simulate a complete migration between two real replica sets that aborts 2020-10-12 22:26:05 +00:00
julianedwards 308cc2fa21 SERVER-49504: Allow resmoke's mongo shell to log to Jasper 2020-10-12 20:59:36 +00:00
Daniel Gottlieb 52f4d4d869 SERVER-47509: Have resmoke better cope with multiple set parameters. 2020-08-05 20:11:11 +00:00
Daniel Gottlieb 19dd40b181 SERVER-48951: Add usability options for resmoke output.
--mrlog will pipe all stdout through mrlog.

--userFriendlyOutput=<file> will `tee` all output to <file>. It will filter
stdout with a grep to highlight test progress and possible failures.
2020-07-23 23:28:54 +00:00
Daniel Gottlieb c0be456afe SERVER-48953: Allow resmoke test files to be listed in a replay file. 2020-07-20 19:23:49 +00:00
Daniel Gottlieb 704131ba7e SERVER-48782: On request, backup datafiles when restarting test mongod instances. 2020-06-16 20:39:39 +00:00
Richard Samuels 38b125fc08 SERVER-47312 hang_analyzer: enable on ASAN builders without running gcore 2020-06-05 13:24:34 +00:00
Robert Guo 9b1ed5d3ac SERVER-47589 add option for undo recorder 2020-06-03 14:00:53 +00:00
Carl Raiden Worley c90e5cbaab SERVER-48145 Extract resmoke logging configurations 2020-05-27 16:50:40 +00:00
vrachev 3e45e8b645 SERVER-47919 remove --suites arg from find-suites 2020-05-08 19:33:35 +00:00
vrachev 9227199e1c SERVER-46769 Migrate from optparse to argparse 2020-04-30 14:25:56 +00:00
vrachev 79809da04a SERVER-46688 Use TestData.inEvergreen to determine if data files should be archived 2020-04-13 17:16:36 +00:00
vrachev f792615792 SERVER-46827 Resmoke end2end tests for timeouts and archival 2020-04-08 21:10:39 +00:00
Henrik Edin 9f18533491 SERVER-46415 Remove logFormat option and the ability to select the text formatter 2020-02-28 15:07:03 +00:00
Robert Guo e89c041616 SERVER-45884 don't run the hang analyzer on ASAN builds 2020-02-12 22:06:46 +00:00
Carl Raiden Worley 8f9e17ee4b SERVER-45491 Add resmoke.py option to save mongod.log and mongos.log files 2020-01-28 14:32:34 +00:00
Henrik Edin 78c3875c67 SERVER-45062 Add evergreen builder for JSON log format 2019-12-18 23:44:10 +00:00
Mathew Robinson db97467f43 SERVER-44420 Add --install-dir flag to Resmoke 2019-12-12 15:10:12 +00:00
Andrew Morrow be05c9ea62 SERVER-44546 Remove mobile variants and embedded benchmarks 2019-12-09 19:22:42 +00:00
Jason Chan 5c86d41207 SERVER-44702 Add ability to configure num replica set nodes and linear chaining through command line. 2019-11-25 19:48:23 +00:00
Mathew Robinson e5c1e0b8da SERVER-43088 Make test suite and logger configuration directories configurable in resmoke 2019-09-23 19:58:15 +00:00
Jason Chan eda7a26ec0 SERVER-42761 Allow resmoke and the shell to initiate a replica set with "latest" version primary and "last-stable" secondaries 2019-09-09 14:09:29 +00:00
Jason Chan 920169417e SERVER-42759 Allow resmoke to search for executables on the PATH by default 2019-08-15 13:59:28 +00:00
Roxane a5b2b781c6 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-23 12:56:16 -04:00
Ian Boros 72f18524e2 Revert "SERVER-41796 Create Evergreen variant for libfuzzer targets"
This reverts commit 51a218fb13.
2019-07-19 13:37:05 -04:00
Roxane 51a218fb13 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-18 15:58:45 -04:00
Maria van Keulen b8c1225327 SERVER-41241 Add testing tasks with Flow Control aggressively engaged 2019-05-31 15:27:06 -04:00
Maria van Keulen 4a02896895 SERVER-41340 Enable Flow Control by default 2019-05-31 13:27:37 -04:00
Maria van Keulen 4cfe7bd176 SERVER-40823 Enable Flow Control in testing 2019-05-08 15:00:26 -04:00
Mathew Robinson 8dd6d47557 SERVER-32295 Support Python 3 2019-04-08 14:08:49 -04:00
Jonathan Abrahams b494c59557 SERVER-39305 Add --repeatTestsSecs, --repeatTestsMin & --repeatTestsMax options to resmoke 2019-02-14 16:53:42 -05:00
Shreyas Kalyan ca5e2e4e33 SERVER-37664 Add support for doing resmoke.py process management through jasper 2018-11-14 16:54:42 -05:00
Shreyas Kalyan 6351d83521 SERVER-37789 Fix lint 2018-10-29 18:03:11 -04:00
Shreyas Kalyan 32c638f423 SERVER-37789 Add --genny flag to resmoke.py 2018-10-29 14:20:35 -04:00
Shreyas Kalyan eaee7a35c4 SERVER-37663 Add support for running genny via resmoke.py locally 2018-10-25 18:48:36 -04:00
Jonathan Abrahams b665d7a575 SERVER-33853 Define a new test tag, test_disabled, to temporarily disable a test 2018-10-03 15:22:30 -04:00
Tess Avitabile aaa6473362 SERVER-37227 Reintroduce enableMajorityReadConcern:false server parameter 2018-10-02 10:58:05 -04:00
Yves Duhem d92fe6cd92 SERVER-34593 New resmoke option to repeat tests 2018-08-29 10:35:43 -04:00
Jonathan Abrahams 4d21b46427 SERVER-36077 Create new resmoke.py test suite for running mongoebench on an Android device 2018-08-20 11:38:07 -04:00
Jonathan Abrahams a444720202 SERVER-36076 Create new resmoke.py test suite for running mongoebench on a desktop 2018-08-13 12:23:29 -04:00
Geert Bosch 711c076ef5 SERVER-35715 Remove nopreallocj and smallfiles options from tests 2018-07-05 08:20:56 -04:00
Jonathan Abrahams c50c68fef1 SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy 2018-04-05 14:41:58 -04:00
Jonathan Abrahams 36148ad8bb SERVER-23312 Format Python files with yapf 2018-03-26 13:04:25 -04:00
Robert Guo d0c7c03ee0 SERVER-33746 pipe additional evergreen options into resmoke.py 2018-03-20 10:06:42 -04:00
Robert Guo e372a68483 SERVER-33202 add hook to generate data file for the perf dashboard 2018-03-12 16:22:26 -04:00
Robert Guo a47c30b73e SERVER-33201 add resmoke.py testcase for Benchmark tests 2018-03-07 12:28:47 -05:00
Robert Guo 9016e62cf3 SERVER-33497 remove support for options file in resmoke.py 2018-02-26 20:44:16 -05:00
Robert Guo f19ec3f130 SERVER-33438 ignore benchmarks in burn_in_tests.py 2018-02-22 12:46:29 -05:00
Jonathan Abrahams 4cc459b6ee SERVER-26884 Support archiving data files in Evergreen on test failure 2018-02-08 12:19:04 -05:00
Max Hirschhorn 046a5a01c1 SERVER-31470 Move "run tests" logic into evergreen_run_tests.py. 2017-10-18 01:45:51 -04:00
Henrik Edin c79b69d1ea SERVER-31095 Adding an evergreen builder to test the legacy transport layer. Fix so resmoke.py can passthrough the --transportLayer option. 2017-09-22 17:16:02 -04:00
Robert Guo b136dbce0f SERVER-19541 supporting connecting to an external cluster in resmoke.py 2017-08-21 10:30:59 -04:00
Jonathan Reams 1622c6b7a7 SERVER-29402 Implement ServiceExecutor and fixed-size test executor 2017-07-14 16:19:40 -04:00
Robert Guo 4d8d1745c9 SERVER-28636 replace --executor with --suite in resmoke.py 2017-06-22 18:29:34 -04:00
may ea8402f7ff SERVER-21299 resmoke should default to --shuffle 2017-06-09 10:20:23 -04:00
Jonathan Abrahams 6b44ad3ae2 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 14:09:52 -04:00
Jonathan Abrahams 97691221bc Revert "SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file"
This reverts commit e0c09edaf7.
2017-04-05 12:15:20 -04:00
Jonathan Abrahams e0c09edaf7 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 11:18:50 -04:00
Jonathan Abrahams abeacd9572 SERVER-28439 Add "silentfail" test status and --reportFailureStatus option to resmoke.py 2017-04-03 11:33:09 -04:00
Eddie Louie bc5c3286fb SERVER-26224 Add --staggerJobs option to resmoke.py 2017-03-27 16:57:58 -04:00
Eddie Louie 422a7e6ddd SERVER-27770 Remove other references to EXCLUDE_WITH_ALL_TAGS and
INCLUDE_WITH_ALL_TAGS
2017-03-27 14:33:21 -04:00
Eddie Louie 5e47fab7c9 SERVER-27770 Remove resmoke.py's includeWithAllTags and excludeWithAllTags options 2017-03-27 12:35:11 -04:00
Yves Duhem e94d22e967 SERVER-23818 Send Evergreen task Id to logkeeper 2017-02-16 09:39:23 -05:00
iwysiu 76fb4530a1 SERVER-24328 modify resmoke for concurrent testcases 2016-07-01 11:52:15 -04:00
Mike Grundy 7af6573341 SERVER-24537 Create a new and modified test running task 2016-06-15 16:50:15 -04:00
Mike Grundy dd3d9e3077 SERVER-22204 Tests should lower WT cache size 2016-06-13 16:33:56 -04:00
Mike Grundy 686bd5e0ab SERVER-21841 Add mode to resmoke.py to list under what suites a test runs 2016-05-10 09:51:17 -04:00
Mike Grundy e7e0ef104b SERVER-22198 resmoke.py should obey order of tests specified via command line 2016-04-28 09:58:31 -04:00
Charlie Swanson caf1dfe036 SERVER-21417 Add command line options to resmoke.py to include or exclude tags 2015-11-13 11:30:16 -05:00
Max Hirschhorn 53f0b88ef9 SERVER-20475 Add --preallocJournal option to resmoke.py.
Defaults to off.
2015-09-21 09:06:22 -04:00
Charlie Swanson ff6326e5ab SERVER-18273 Compute ranges of ports for each job in resmoke.py 2015-09-03 09:15:11 -04:00
David Storch 967422b380 SERVER-19571 configure regression loop to use --readMode commands in suites that don't start mongos
Adds --shellReadMode flag to resmoke.py and changes Evergreen / resmoke configuration files to pass
--readMode commands where appropriate.
2015-07-30 14:56:45 -04:00
Adam Midvidy cf1a2f6d70 SERVER-19299 add the ability to pass --setParameter arguments on the command line to resmoke.py 2015-07-21 18:14:13 -04:00
Max Hirschhorn 424314f65e SERVER-1424 Rewrite smoke.py.
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.

Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.

Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00