Commit Graph

73 Commits

Author SHA1 Message Date
Jonathan Abrahams c50c68fef1 SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy 2018-04-05 14:41:58 -04:00
Jonathan Abrahams 36148ad8bb SERVER-23312 Format Python files with yapf 2018-03-26 13:04:25 -04:00
Yves Duhem 6618ad3025 SERVER-33396 Update fixture teardown to throw ServerFailure 2018-03-02 12:14:51 -05:00
Yves Duhem 4a69dcaf78 SERVER-33476 Rename CustomBehavior to Hook 2018-02-27 11:29:46 -05:00
Jonathan Abrahams 4cc459b6ee SERVER-26884 Support archiving data files in Evergreen on test failure 2018-02-08 12:19:04 -05:00
Max Hirschhorn 2c451638c2 SERVER-32474 Fix double logging when using --log=buildlogger.
Exposes an additional logger that uses the test's root logger as the
parent for any TestCase instances constructor by the hook. The fixture
logger still continues to be the parent of the hook logger.

Also changes the CleanEveryN hook to explicitly get marked as a failure
if a ServerFailure exception is thrown, rather than relying on
TestReport.combine() to do so implicitly.
2018-01-10 14:15:35 -05:00
Max Hirschhorn 611220640b SERVER-31556 Use fixture logger as parent of hook logger.
This enables the hook logger to log messages to logkeeper when
--log=buildlogger is specified without needing to start a new dynamic
test case.
2017-11-26 12:14:00 -05:00
Max Hirschhorn 046a5a01c1 SERVER-31470 Move "run tests" logic into evergreen_run_tests.py. 2017-10-18 01:45:51 -04:00
Ian Boros 9f8084f2c8 SERVER-30578 resmoke no longer starts more servers than tests 2017-09-07 12:12:22 -04:00
Robert Guo b136dbce0f SERVER-19541 supporting connecting to an external cluster in resmoke.py 2017-08-21 10:30:59 -04:00
Robert Guo f3b60130e2 SERVER-25293 log hook testcases only to logkeeper 2017-06-14 19:57:10 -04:00
Max Hirschhorn a4d2c52dba SERVER-28991 Eliminate having an AlarmClock thread for each test.
Changes resmoke.py to use its FlushThread for managing all calls to
flush() buildlogger handlers.
2017-05-16 12:10:14 -04:00
Yves Duhem c8a2af0706 SERVER-28477 Resmoke logging refactoring 2017-03-29 10:48:25 -04:00
Eddie Louie bc5c3286fb SERVER-26224 Add --staggerJobs option to resmoke.py 2017-03-27 16:57:58 -04:00
Max Hirschhorn 83f31ef26e SERVER-21539 Write report.json file when resmoke.py receives a SIGUSR1. 2017-03-09 13:06:29 -05:00
Robert Guo 6ec5d44bc3 SERVER-27158 teardown_flag does not exist except for the final iteration 2017-02-23 17:43:28 -05:00
Robert Guo 18be5b3302 SERVER-27158 shutdown fixtures when a job finishes 2017-02-22 10:34:47 -05:00
iwysiu 0c9a7a497a SERVER-24729 stagger the launching of resmoke jobs 2016-07-20 12:15:14 -04:00
Max Hirschhorn 00c8c64f6c SERVER-22142 join() FlushThread in resmoke.py after running all tests.
This prevents the FlushThread from running while the interpreter is
shutting down and the import machinery is uninitialized.

Also fixed an issue where a KeyboardInterrupt while running multiple
suites with --continueOnFailure would skip to the next suite, rather
than exiting resmoke.py.
2016-01-15 09:30:39 -05:00
Max Hirschhorn 8c8ee18403 SERVER-18756 Write all executions to the report.json file.
Makes it so that a link to the logs for every test that ran is present
in the sidebar of the Evergreen UI. Multiple entries will appear for
the same test file when --repeat is used.

This also fixes an issue where the number of tests skipped would be
incorrect if the same test file was included multiple times in the
"roots" key.
2015-06-22 20:18:10 -04:00
Charlie Swanson 263299464c SERVER-18843 resmoke.py should not summarize all previous executions until it finishes 2015-06-18 10:49:50 -04:00
Charlie Swanson 15a5fcc644 SERVER-18390 Check dbhash of all databases during small_oplog suites 2015-05-20 11:55:55 -04:00
Max Hirschhorn 424314f65e SERVER-1424 Rewrite smoke.py.
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.

Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.

Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00