Robert Guo
1eb48009eb
SERVER-58086 set debug symbols download URL for shell-invoked hang analyzer
2021-07-01 18:37:18 +00:00
Robert Guo
5d9e1907cc
SERVER-57873 support multiple tag files resmoke
2021-06-23 03:24:24 +00:00
Robert Guo
424e574251
SERVER-57778 add QE and QO patch build variants
2021-06-18 15:38:39 +00:00
Siran Wang
75f9277a30
SERVER-55296 support enhanced multiversion api
2021-06-10 15:56:54 +00:00
Robert Guo
00c3b89b64
SERVER-56744 list feature flags for local usage
2021-05-13 16:37:28 +00:00
Siran Wang
0edbd2fe51
SERVER-54086 support download debug symbol from patch build
2021-04-21 14:50:55 +00:00
Robert Guo
39fc7fd24d
SERVER-55249 archive all data on required mainline builders
2021-04-06 13:25:46 +00:00
Robert Guo
d9761413b9
SERVER-51883 don't run feature flag tests if --runAllFeatureFlagTests arg is not specified
2021-03-30 12:09:02 +00:00
Robert Guo
8e8af7bb44
SERVER-51883 Add all feature flags by default to the all feature flags
...
builders
2021-03-27 04:11:04 +00:00
Mikhail Shchatko
8c303d8fa5
SERVER-54002 Evergreen task documentation
2021-03-16 17:18:22 +00:00
julianedwards
e2702b9a7e
SERVER-54663: Pass group id to evergreen when running with resmoke with jasper.
2021-03-15 14:54:05 +00:00
Mikhail Shchatko
8022d8830d
SERVER-54723 Shorten resmoke log prefixes
2021-03-04 21:05:37 +00:00
Carl Raiden Worley
8082beefe8
SERVER-54617 Create a resmoke configuration management helper
2021-03-02 04:25:25 +00:00
Pavi Vetriselvan
7a1bb02d3a
SERVER-53247 disable enableMajorityReadConcern=false for non-test storage engines
2021-01-19 18:48:35 +00:00
Hana Pearlman
3fadec4ccd
SERVER-34927: allow localField and foreignField with more expressive $lookup pipeline
2021-01-07 23:12:03 +00:00
julianedwards
fff7a4baa0
SERVER-49504: Allow resmoke's mongo shell to log to Jasper
2020-12-14 18:27:30 +00:00
Robert Guo
2c50126f91
Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
...
This reverts commit 3c179e4935 .
2020-12-07 19:21:59 +00:00
A. Jesse Jiryu Davis
e618ffe3d8
SERVER-51877 Check all API V1 commands are defined in IDL
2020-11-10 18:52:28 +00:00
julianedwards
3c179e4935
SERVER-49504: Revert "Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper""
2020-11-06 17:23:31 +00:00
Brian DeLeonardis
a53d94e484
SERVER-41020 Add tests that fuzz storage engine parameters
2020-11-06 02:27:25 +00:00
Robert Guo
e62f90245b
Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
...
This reverts commit e9e1635d6c .
2020-10-15 13:38:36 +00:00
julianedwards
e9e1635d6c
SERVER-49504: Allow resmoke's mongo shell to log to Jasper
2020-10-14 19:12:24 +00:00
Ben Caimano
8468e69c2e
Revert "SERVER-49504: Allow resmoke's mongo shell to log to Jasper"
...
This reverts commit 308cc2fa21 .
2020-10-12 23:00:38 +00:00
Cheahuychou Mao
d7f220af70
SERVER-50493 Make tenant_migration_jscore_passthrough simulate a complete migration between two real replica sets that aborts
2020-10-12 22:26:05 +00:00
julianedwards
308cc2fa21
SERVER-49504: Allow resmoke's mongo shell to log to Jasper
2020-10-12 20:59:36 +00:00
Daniel Gottlieb
52f4d4d869
SERVER-47509: Have resmoke better cope with multiple set parameters.
2020-08-05 20:11:11 +00:00
Daniel Gottlieb
19dd40b181
SERVER-48951: Add usability options for resmoke output.
...
--mrlog will pipe all stdout through mrlog.
--userFriendlyOutput=<file> will `tee` all output to <file>. It will filter
stdout with a grep to highlight test progress and possible failures.
2020-07-23 23:28:54 +00:00
Daniel Gottlieb
c0be456afe
SERVER-48953: Allow resmoke test files to be listed in a replay file.
2020-07-20 19:23:49 +00:00
Daniel Gottlieb
704131ba7e
SERVER-48782: On request, backup datafiles when restarting test mongod instances.
2020-06-16 20:39:39 +00:00
Richard Samuels
38b125fc08
SERVER-47312 hang_analyzer: enable on ASAN builders without running gcore
2020-06-05 13:24:34 +00:00
Robert Guo
9b1ed5d3ac
SERVER-47589 add option for undo recorder
2020-06-03 14:00:53 +00:00
Carl Raiden Worley
c90e5cbaab
SERVER-48145 Extract resmoke logging configurations
2020-05-27 16:50:40 +00:00
vrachev
3e45e8b645
SERVER-47919 remove --suites arg from find-suites
2020-05-08 19:33:35 +00:00
vrachev
9227199e1c
SERVER-46769 Migrate from optparse to argparse
2020-04-30 14:25:56 +00:00
vrachev
79809da04a
SERVER-46688 Use TestData.inEvergreen to determine if data files should be archived
2020-04-13 17:16:36 +00:00
vrachev
f792615792
SERVER-46827 Resmoke end2end tests for timeouts and archival
2020-04-08 21:10:39 +00:00
Henrik Edin
9f18533491
SERVER-46415 Remove logFormat option and the ability to select the text formatter
2020-02-28 15:07:03 +00:00
Robert Guo
e89c041616
SERVER-45884 don't run the hang analyzer on ASAN builds
2020-02-12 22:06:46 +00:00
Carl Raiden Worley
8f9e17ee4b
SERVER-45491 Add resmoke.py option to save mongod.log and mongos.log files
2020-01-28 14:32:34 +00:00
Henrik Edin
78c3875c67
SERVER-45062 Add evergreen builder for JSON log format
2019-12-18 23:44:10 +00:00
Mathew Robinson
db97467f43
SERVER-44420 Add --install-dir flag to Resmoke
2019-12-12 15:10:12 +00:00
Andrew Morrow
be05c9ea62
SERVER-44546 Remove mobile variants and embedded benchmarks
2019-12-09 19:22:42 +00:00
Jason Chan
5c86d41207
SERVER-44702 Add ability to configure num replica set nodes and linear chaining through command line.
2019-11-25 19:48:23 +00:00
Mathew Robinson
e5c1e0b8da
SERVER-43088 Make test suite and logger configuration directories configurable in resmoke
2019-09-23 19:58:15 +00:00
Jason Chan
eda7a26ec0
SERVER-42761 Allow resmoke and the shell to initiate a replica set with "latest" version primary and "last-stable" secondaries
2019-09-09 14:09:29 +00:00
Jason Chan
920169417e
SERVER-42759 Allow resmoke to search for executables on the PATH by default
2019-08-15 13:59:28 +00:00
Roxane
a5b2b781c6
SERVER-41796 Create Evergreen variant for libfuzzer targets
2019-07-23 12:56:16 -04:00
Ian Boros
72f18524e2
Revert "SERVER-41796 Create Evergreen variant for libfuzzer targets"
...
This reverts commit 51a218fb13 .
2019-07-19 13:37:05 -04:00
Roxane
51a218fb13
SERVER-41796 Create Evergreen variant for libfuzzer targets
2019-07-18 15:58:45 -04:00
Maria van Keulen
b8c1225327
SERVER-41241 Add testing tasks with Flow Control aggressively engaged
2019-05-31 15:27:06 -04:00
Maria van Keulen
4a02896895
SERVER-41340 Enable Flow Control by default
2019-05-31 13:27:37 -04:00
Maria van Keulen
4cfe7bd176
SERVER-40823 Enable Flow Control in testing
2019-05-08 15:00:26 -04:00
Mathew Robinson
8dd6d47557
SERVER-32295 Support Python 3
2019-04-08 14:08:49 -04:00
Jonathan Abrahams
b494c59557
SERVER-39305 Add --repeatTestsSecs, --repeatTestsMin & --repeatTestsMax options to resmoke
2019-02-14 16:53:42 -05:00
Shreyas Kalyan
ca5e2e4e33
SERVER-37664 Add support for doing resmoke.py process management through jasper
2018-11-14 16:54:42 -05:00
Shreyas Kalyan
6351d83521
SERVER-37789 Fix lint
2018-10-29 18:03:11 -04:00
Shreyas Kalyan
32c638f423
SERVER-37789 Add --genny flag to resmoke.py
2018-10-29 14:20:35 -04:00
Shreyas Kalyan
eaee7a35c4
SERVER-37663 Add support for running genny via resmoke.py locally
2018-10-25 18:48:36 -04:00
Jonathan Abrahams
b665d7a575
SERVER-33853 Define a new test tag, test_disabled, to temporarily disable a test
2018-10-03 15:22:30 -04:00
Tess Avitabile
aaa6473362
SERVER-37227 Reintroduce enableMajorityReadConcern:false server parameter
2018-10-02 10:58:05 -04:00
Yves Duhem
d92fe6cd92
SERVER-34593 New resmoke option to repeat tests
2018-08-29 10:35:43 -04:00
Jonathan Abrahams
4d21b46427
SERVER-36077 Create new resmoke.py test suite for running mongoebench on an Android device
2018-08-20 11:38:07 -04:00
Jonathan Abrahams
a444720202
SERVER-36076 Create new resmoke.py test suite for running mongoebench on a desktop
2018-08-13 12:23:29 -04:00
Geert Bosch
711c076ef5
SERVER-35715 Remove nopreallocj and smallfiles options from tests
2018-07-05 08:20:56 -04:00
Jonathan Abrahams
c50c68fef1
SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy
2018-04-05 14:41:58 -04:00
Jonathan Abrahams
36148ad8bb
SERVER-23312 Format Python files with yapf
2018-03-26 13:04:25 -04:00
Robert Guo
d0c7c03ee0
SERVER-33746 pipe additional evergreen options into resmoke.py
2018-03-20 10:06:42 -04:00
Robert Guo
e372a68483
SERVER-33202 add hook to generate data file for the perf dashboard
2018-03-12 16:22:26 -04:00
Robert Guo
a47c30b73e
SERVER-33201 add resmoke.py testcase for Benchmark tests
2018-03-07 12:28:47 -05:00
Robert Guo
9016e62cf3
SERVER-33497 remove support for options file in resmoke.py
2018-02-26 20:44:16 -05:00
Robert Guo
f19ec3f130
SERVER-33438 ignore benchmarks in burn_in_tests.py
2018-02-22 12:46:29 -05:00
Jonathan Abrahams
4cc459b6ee
SERVER-26884 Support archiving data files in Evergreen on test failure
2018-02-08 12:19:04 -05:00
Max Hirschhorn
046a5a01c1
SERVER-31470 Move "run tests" logic into evergreen_run_tests.py.
2017-10-18 01:45:51 -04:00
Henrik Edin
c79b69d1ea
SERVER-31095 Adding an evergreen builder to test the legacy transport layer. Fix so resmoke.py can passthrough the --transportLayer option.
2017-09-22 17:16:02 -04:00
Robert Guo
b136dbce0f
SERVER-19541 supporting connecting to an external cluster in resmoke.py
2017-08-21 10:30:59 -04:00
Jonathan Reams
1622c6b7a7
SERVER-29402 Implement ServiceExecutor and fixed-size test executor
2017-07-14 16:19:40 -04:00
Robert Guo
4d8d1745c9
SERVER-28636 replace --executor with --suite in resmoke.py
2017-06-22 18:29:34 -04:00
may
ea8402f7ff
SERVER-21299 resmoke should default to --shuffle
2017-06-09 10:20:23 -04:00
Jonathan Abrahams
6b44ad3ae2
SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file
2017-04-05 14:09:52 -04:00
Jonathan Abrahams
97691221bc
Revert "SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file"
...
This reverts commit e0c09edaf7 .
2017-04-05 12:15:20 -04:00
Jonathan Abrahams
e0c09edaf7
SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file
2017-04-05 11:18:50 -04:00
Jonathan Abrahams
abeacd9572
SERVER-28439 Add "silentfail" test status and --reportFailureStatus option to resmoke.py
2017-04-03 11:33:09 -04:00
Eddie Louie
bc5c3286fb
SERVER-26224 Add --staggerJobs option to resmoke.py
2017-03-27 16:57:58 -04:00
Eddie Louie
422a7e6ddd
SERVER-27770 Remove other references to EXCLUDE_WITH_ALL_TAGS and
...
INCLUDE_WITH_ALL_TAGS
2017-03-27 14:33:21 -04:00
Eddie Louie
5e47fab7c9
SERVER-27770 Remove resmoke.py's includeWithAllTags and excludeWithAllTags options
2017-03-27 12:35:11 -04:00
Yves Duhem
e94d22e967
SERVER-23818 Send Evergreen task Id to logkeeper
2017-02-16 09:39:23 -05:00
iwysiu
76fb4530a1
SERVER-24328 modify resmoke for concurrent testcases
2016-07-01 11:52:15 -04:00
Mike Grundy
7af6573341
SERVER-24537 Create a new and modified test running task
2016-06-15 16:50:15 -04:00
Mike Grundy
dd3d9e3077
SERVER-22204 Tests should lower WT cache size
2016-06-13 16:33:56 -04:00
Mike Grundy
686bd5e0ab
SERVER-21841 Add mode to resmoke.py to list under what suites a test runs
2016-05-10 09:51:17 -04:00
Mike Grundy
e7e0ef104b
SERVER-22198 resmoke.py should obey order of tests specified via command line
2016-04-28 09:58:31 -04:00
Charlie Swanson
caf1dfe036
SERVER-21417 Add command line options to resmoke.py to include or exclude tags
2015-11-13 11:30:16 -05:00
Max Hirschhorn
53f0b88ef9
SERVER-20475 Add --preallocJournal option to resmoke.py.
...
Defaults to off.
2015-09-21 09:06:22 -04:00
Charlie Swanson
ff6326e5ab
SERVER-18273 Compute ranges of ports for each job in resmoke.py
2015-09-03 09:15:11 -04:00
David Storch
967422b380
SERVER-19571 configure regression loop to use --readMode commands in suites that don't start mongos
...
Adds --shellReadMode flag to resmoke.py and changes Evergreen / resmoke configuration files to pass
--readMode commands where appropriate.
2015-07-30 14:56:45 -04:00
Adam Midvidy
cf1a2f6d70
SERVER-19299 add the ability to pass --setParameter arguments on the command line to resmoke.py
2015-07-21 18:14:13 -04:00
Max Hirschhorn
424314f65e
SERVER-1424 Rewrite smoke.py.
...
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.
Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.
Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00