Commit Graph

115 Commits

Author SHA1 Message Date
Maria van Keulen b8c1225327 SERVER-41241 Add testing tasks with Flow Control aggressively engaged 2019-05-31 15:27:06 -04:00
Maria van Keulen 4a02896895 SERVER-41340 Enable Flow Control by default 2019-05-31 13:27:37 -04:00
Maria van Keulen 4cfe7bd176 SERVER-40823 Enable Flow Control in testing 2019-05-08 15:00:26 -04:00
Max Hirschhorn 98eebc9356 SERVER-40801 Fix local resmoke invocation for action="append" arguments. 2019-04-24 13:59:37 -04:00
Mathew Robinson 8dd6d47557 SERVER-32295 Support Python 3 2019-04-08 14:08:49 -04:00
Max Hirschhorn 5acc5f3ef4 SERVER-40241 Log resmoke.py invocation for local usage. 2019-03-27 22:43:28 -04:00
Jonathan Abrahams b494c59557 SERVER-39305 Add --repeatTestsSecs, --repeatTestsMin & --repeatTestsMax options to resmoke 2019-02-14 16:53:42 -05:00
Shreyas Kalyan ca5e2e4e33 SERVER-37664 Add support for doing resmoke.py process management through jasper 2018-11-14 16:54:42 -05:00
Shreyas Kalyan 32c638f423 SERVER-37789 Add --genny flag to resmoke.py 2018-10-29 14:20:35 -04:00
Max Hirschhorn e5c39e225e SERVER-35852 Require --shellConnString to use mongodb:// URI scheme. 2018-10-13 19:19:55 -04:00
Jonathan Abrahams b665d7a575 SERVER-33853 Define a new test tag, test_disabled, to temporarily disable a test 2018-10-03 15:22:30 -04:00
Tess Avitabile aaa6473362 SERVER-37227 Reintroduce enableMajorityReadConcern:false server parameter 2018-10-02 10:58:05 -04:00
Yves Duhem d92fe6cd92 SERVER-34593 New resmoke option to repeat tests 2018-08-29 10:35:43 -04:00
Jonathan Abrahams 4d21b46427 SERVER-36077 Create new resmoke.py test suite for running mongoebench on an Android device 2018-08-20 11:38:07 -04:00
Jonathan Abrahams a444720202 SERVER-36076 Create new resmoke.py test suite for running mongoebench on a desktop 2018-08-13 12:23:29 -04:00
Geert Bosch 711c076ef5 SERVER-35715 Remove nopreallocj and smallfiles options from tests 2018-07-05 08:20:56 -04:00
Jonathan Abrahams 7d90be2b5b SERVER-35190 resmoke.py runs lists of tests in alphabetical order by default 2018-05-31 11:35:50 -04:00
Jonathan Abrahams 68005e0ffc SERVER-23312 Enable Python formatting/linting for buildscripts & pytests files 2018-04-11 16:29:32 -04:00
Yves Duhem 2962ff014a SERVER-34356 Reorganize resmoke.py 2018-04-11 13:49:41 -04:00
Jonathan Abrahams c50c68fef1 SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy 2018-04-05 14:41:58 -04:00
Jonathan Abrahams 36148ad8bb SERVER-23312 Format Python files with yapf 2018-03-26 13:04:25 -04:00
Robert Guo d0c7c03ee0 SERVER-33746 pipe additional evergreen options into resmoke.py 2018-03-20 10:06:42 -04:00
Robert Guo e372a68483 SERVER-33202 add hook to generate data file for the perf dashboard 2018-03-12 16:22:26 -04:00
Robert Guo a47c30b73e SERVER-33201 add resmoke.py testcase for Benchmark tests 2018-03-07 12:28:47 -05:00
Robert Guo 9016e62cf3 SERVER-33497 remove support for options file in resmoke.py 2018-02-26 20:44:16 -05:00
Yves Duhem 649502fd59 SERVER-33397 New suitesconfig module 2018-02-23 18:23:48 -05:00
Robert Guo f19ec3f130 SERVER-33438 ignore benchmarks in burn_in_tests.py 2018-02-22 12:46:29 -05:00
Jonathan Abrahams 4cc459b6ee SERVER-26884 Support archiving data files in Evergreen on test failure 2018-02-08 12:19:04 -05:00
Jonathan Abrahams 9c6381687e SERVER-30755 KeyError "selector" is raised when no tests or test suites specified to resmoke.py 2017-11-21 09:32:13 -05:00
Siyuan Zhou c8fbc9a231 SERVER-31671 Cancel running elections if the term changes after writing my last vote 2017-11-07 16:38:43 -05:00
Jonathan Abrahams 7d39fcc31b SERVER-30802 Add "with_external_server" to excluded executor_only set in resmoke parser get_named_suites(). 2017-10-25 17:29:19 -04:00
Max Hirschhorn 046a5a01c1 SERVER-31470 Move "run tests" logic into evergreen_run_tests.py. 2017-10-18 01:45:51 -04:00
Ian Boros 65d4cdd857 SERVER-29607 resmoke prints available suites when an invalid one is specified 2017-10-06 13:13:31 -04:00
Yves Duhem 02e1ac97d8 SERVER-30980 Add tag selector expressions support 2017-09-27 11:11:35 -04:00
Henrik Edin c79b69d1ea SERVER-31095 Adding an evergreen builder to test the legacy transport layer. Fix so resmoke.py can passthrough the --transportLayer option. 2017-09-22 17:16:02 -04:00
Robert Guo b136dbce0f SERVER-19541 supporting connecting to an external cluster in resmoke.py 2017-08-21 10:30:59 -04:00
Jonathan Reams 1622c6b7a7 SERVER-29402 Implement ServiceExecutor and fixed-size test executor 2017-07-14 16:19:40 -04:00
Robert Guo 4d8d1745c9 SERVER-28636 replace --executor with --suite in resmoke.py 2017-06-22 18:29:34 -04:00
Yves Duhem af35f24b56 SERVER-29486 Filter test membership map by test_kind 2017-06-21 18:02:39 -04:00
Robert Guo f3b60130e2 SERVER-25293 log hook testcases only to logkeeper 2017-06-14 19:57:10 -04:00
may ea8402f7ff SERVER-21299 resmoke should default to --shuffle 2017-06-09 10:20:23 -04:00
Yves Duhem 0347baa06a SERVER-29192 Prevent 'silentfail' status for dynamic tests 2017-06-05 14:13:07 -04:00
Jonathan Abrahams b6c1b6b6a9 SERVER-28302 resmoke.py parser should accept files that don't end in .js 2017-05-26 13:59:32 -04:00
Jonathan Abrahams 6b44ad3ae2 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 14:09:52 -04:00
Jonathan Abrahams 97691221bc Revert "SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file"
This reverts commit e0c09edaf7.
2017-04-05 12:15:20 -04:00
Jonathan Abrahams e0c09edaf7 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 11:18:50 -04:00
Jonathan Abrahams abeacd9572 SERVER-28439 Add "silentfail" test status and --reportFailureStatus option to resmoke.py 2017-04-03 11:33:09 -04:00
Eddie Louie bc5c3286fb SERVER-26224 Add --staggerJobs option to resmoke.py 2017-03-27 16:57:58 -04:00
Eddie Louie 422a7e6ddd SERVER-27770 Remove other references to EXCLUDE_WITH_ALL_TAGS and
INCLUDE_WITH_ALL_TAGS
2017-03-27 14:33:21 -04:00
Eddie Louie 5e47fab7c9 SERVER-27770 Remove resmoke.py's includeWithAllTags and excludeWithAllTags options 2017-03-27 12:35:11 -04:00
Yves Duhem e94d22e967 SERVER-23818 Send Evergreen task Id to logkeeper 2017-02-16 09:39:23 -05:00
Robert Guo a1363d00d0 SERVER-27408 Allow resmoke to take more than one tag-related arguments.
Each tag argument can also be specified more than once and in both the
YAML suite definition and on the command line.

Tag argments will be agnostic to ordering, with each argument narrowing
down test files to be run. No tag is allowed to override another tag.
2017-01-26 15:49:59 -05:00
iwysiu 76fb4530a1 SERVER-24328 modify resmoke for concurrent testcases 2016-07-01 11:52:15 -04:00
Mike Grundy 7af6573341 SERVER-24537 Create a new and modified test running task 2016-06-15 16:50:15 -04:00
Mike Grundy dd3d9e3077 SERVER-22204 Tests should lower WT cache size 2016-06-13 16:33:56 -04:00
Mike Grundy 686bd5e0ab SERVER-21841 Add mode to resmoke.py to list under what suites a test runs 2016-05-10 09:51:17 -04:00
Mike Grundy e7e0ef104b SERVER-22198 resmoke.py should obey order of tests specified via command line 2016-04-28 09:58:31 -04:00
Charlie Swanson caf1dfe036 SERVER-21417 Add command line options to resmoke.py to include or exclude tags 2015-11-13 11:30:16 -05:00
David Storch df2a33f997 SERVER-20067 SERVER-19572 set readMode in shell based on wire version
"compatibility" readMode now causes the shell to detect whether or not
to use find/getMore commands based on wire version. "commands" mode
forces use of the find/getMore commands, and "legacy" mode forces uses
of legacy OP_QUERY/OP_GET_MORE reads.

Also configures tests to force use of "commands" or "legacy" mode as
appropriate.
2015-09-30 13:25:15 -04:00
Max Hirschhorn 53f0b88ef9 SERVER-20475 Add --preallocJournal option to resmoke.py.
Defaults to off.
2015-09-21 09:06:22 -04:00
Charlie Swanson ff6326e5ab SERVER-18273 Compute ranges of ports for each job in resmoke.py 2015-09-03 09:15:11 -04:00
David Storch 967422b380 SERVER-19571 configure regression loop to use --readMode commands in suites that don't start mongos
Adds --shellReadMode flag to resmoke.py and changes Evergreen / resmoke configuration files to pass
--readMode commands where appropriate.
2015-07-30 14:56:45 -04:00
Adam Midvidy cf1a2f6d70 SERVER-19299 add the ability to pass --setParameter arguments on the command line to resmoke.py 2015-07-21 18:14:13 -04:00
Max Hirschhorn 2fb814c60c SERVER-18834 Add --executor command line option to resmoke.py.
Exposes a way to specify how jstests passed in on the command line
should be run. Defaults to starting a standalone mongod.

    --executor=core_small_oplog_rs

is equivalent to smoke.py's --small-oplog-rs

    --executor=no_server

is equivalent to smoke.py's --dont-start-mongod
2015-06-22 20:18:10 -04:00
Max Hirschhorn 424314f65e SERVER-1424 Rewrite smoke.py.
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.

Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.

Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00