Commit Graph

87 Commits

Author SHA1 Message Date
Zack Winter 5c24a13a7d SERVER-111295 Set python as formatter in format_multirun (#41677)
GitOrigin-RevId: fd3c58d1f5a9230a9fb728d2678c8c614c20437f
2025-09-24 17:41:24 +00:00
Steve McClure c0d93b1374 SERVER-108972: Support loading resmoke libs and suites from module directories (#40272)
GitOrigin-RevId: c95ce37e0fa67f2626874c61ec076d740f184b8c
2025-08-19 21:25:48 +00:00
auto-revert-app[bot] b3e6f2b128 Revert "SERVER-108972 Support modules in resmoke (#40139)" (#40237)
Co-authored-by: auto-revert-processor <devprod-si-team@mongodb.com>
GitOrigin-RevId: a58475e2d23263d59fee58497b612fc0c1679271
2025-08-19 05:11:16 +00:00
Trevor Guidry 345737a806 SERVER-108972 Support modules in resmoke (#40139)
GitOrigin-RevId: 830a0dcd118ec4c67561fbc7766e871d531fa40c
2025-08-18 22:22:04 +00:00
Sean Lyons 27deff87f3 SERVER-102653 Add a bazel test target for a multiversion suite (#35837)
GitOrigin-RevId: b9f5aaede696a9e6231064f0b8bebe012642b681
2025-05-06 21:49:46 +00:00
Matt Olma 668bda7f5d SERVER-95143: Delete lingering code for old MQL Model (#35131)
GitOrigin-RevId: 85909348d9eec12671927b579a3c2ac714f99fd5
2025-04-17 22:28:05 +00:00
Juan Gu 7209d62b77 SERVER-99522 Delete dead py linters (#31760)
GitOrigin-RevId: 3aedfa559dda734d4d89fefe0fe1154a5a3cf04d
2025-04-09 19:33:45 +00:00
Naafiyan Ahmed 853ee2f1e6 SERVER-97276: Added evergreen and resmoke integration for running query-correctness-tests using query_tester (#29465)
GitOrigin-RevId: 6e11f118bcbce96449ce2d3762c36c68e1aef525
2025-01-08 17:05:33 +00:00
auto-revert-app[bot] d055ae4ba6 Revert "SERVER-97037: Added evergreen integration and updated names and filepaths (#29123)" (#29325)
GitOrigin-RevId: 2e1e319f2975a4b5194e75f42a6af7197b5419bc
2024-11-19 07:11:43 +00:00
Naafiyan Ahmed 9ec0f7953a SERVER-97037: Added evergreen integration and updated names and filepaths (#29123)
GitOrigin-RevId: 8e705accaa85aa573a49b10d1f3f1c1b6c29db6e
2024-11-18 21:54:25 +00:00
Naafiyan Ahmed eeb14cc1bd SERVER-96676 Added QueryTester self tests to resmoke (#28419)
GitOrigin-RevId: f6fd7eee10d63d3cdf6d320d8b9a2530c1940d7d
2024-11-04 21:59:38 +00:00
auto-revert-app[bot] d2737821a1 Revert "SERVER-94853 Add runtime check to resmoke that ensures selector patte… (#28019)" (#28133)
GitOrigin-RevId: df9383343870baa4cda38a7d85b443797699592b
2024-10-16 10:38:22 +00:00
Juan Gu 57cd2db552 SERVER-94853 Add runtime check to resmoke that ensures selector patte… (#28019)
GitOrigin-RevId: 749d6c5961d58fac966ec553fd6ecdc972daf423
2024-10-15 18:11:02 +00:00
Juan Gu 855dfadef0 SERVER-94077 Use isort in Ruff configs (#27865)
GitOrigin-RevId: e793d662774ccd3ab6c3f356c2287cf1f7ff9805
2024-10-10 19:33:49 +00:00
Trevor Guidry 62b78a4fcd SERVER-90409 Use test filtering api in resmoke (#22116)
GitOrigin-RevId: 0cc452c3e98ff63b08b592e1772367fe8fd7c57c
2024-05-23 09:00:27 +00:00
seanzimm 49aec070b5 SERVER-89647 Override drop and assert for magic restore testing (#22460)
GitOrigin-RevId: 34a2d0d2e06953c39c6c10d872cb640100256927
2024-05-22 21:41:52 +00:00
auto-revert-app[bot] e8e0c79927 Revert "SERVER-89647 Override drop and assert for magic restore testing (#22321)" (#22414)
Co-authored-by: auto-revert-processor <devprod-si-team@mongodb.com>
GitOrigin-RevId: a1ff9bb7595224593c9eff610f5a4e12f0d4cf54
2024-05-21 22:55:37 +00:00
seanzimm 275639fdb1 SERVER-89647 Override drop and assert for magic restore testing (#22321)
[evg
patch](https://spruce.mongodb.com/version/663e5832b144dd0007172e5c/tasks?page=0&sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)

This PR overrides drops and asserts to make sure we get more coverage
for magic restore testing since the magic restore hook relies on data
existing on the nodes to restore. We found before this PR we were
getting lackluster coverage since most jstests drop their data when the
test ends which leads to little data remaining in nodes when the hook
runs.

GitOrigin-RevId: 2423d1cfd2be22639b1439c3f550bb866d202178
2024-05-21 14:47:46 +00:00
Steve McClure b4b23946cd SERVER-90570: Enable formatting checks for buildscripts directory, excluding idl (#22254)
GitOrigin-RevId: 9d997a9f44cd43a8dec7c2a17fa2dbcd875e92f6
2024-05-16 22:07:36 +00:00
Alexander Neben 774d062184 SERVER-90498 Allow a single js suite to be run with multiple js files (#22168)
GitOrigin-RevId: b601ddb52bb21681975618429d94ba95384958fe
2024-05-14 18:16:43 +00:00
David Percy 70da849086 SERVER-90138 Speed up resmoke.py find-suites
Profiling showed a lot of the time was spent in two helper functions:
  - glob() which scans the filesystem for filenames that match a pattern
  - get_tags() which parses the "@tags" section of a jstest

Printing the arguments of these functions showed that a lot of the calls
are duplicates, because many suites use the same glob pattern, and many
suites want to know what tags a given test contains.

Since we already assume the resmokeconfig is not changing out from under
us, it makes sense to cache these. I don't think memory usage is a
concern because resmoke is either short-lived (as in find-suites) or it
runs subprocesses that already use a lot of memory (mongod, or a whole
sharded cluster).

On my machine these two changes brought the time down from around
1m 20s to 10s.

GitOrigin-RevId: f4538e44aaca8c1ae11c38cc48b6ec76d2a85d1b
2024-05-03 05:27:58 +00:00
auto-revert-processor e111f6817e Revert "SERVER-86852 Add support for requires_fcv_tag_latest resmoke suite tag (#19971)"
This reverts commit dd77915a25fdbbd9c015729ebcbf3806642ac197.

GitOrigin-RevId: dc287509f0cdb0be79caf90add1774289dd76124
2024-03-30 07:28:57 +00:00
Trevor 4a3043f4b3 SERVER-86852 Add support for requires_fcv_tag_latest resmoke suite tag (#19971)
GitOrigin-RevId: dd77915a25fdbbd9c015729ebcbf3806642ac197
2024-03-30 03:16:02 +00:00
Juan Gu 6bfd43eda4 SERVER-83592 Add resmoke flag --enable_enterprise_tests enable enterp… (#17169)
(cherry picked from commit d463d338460a26792c33e173c7cd475535842812)

GitOrigin-RevId: a02b6d310bad23cbbdf7edeef7895714b76f6d07
2023-12-08 19:30:23 +00:00
Mikhail Shchatko c019228589 SERVER-68699 Check that resmoke suite selector config has valid test paths 2023-10-11 13:49:33 +00:00
Steve Gross 3c737e56b6 SERVER-79168 Allow missing excluded file 2023-08-25 22:08:39 +00:00
seanzimm 2d5ecf6ae2 SERVER-76668 multiple cluster fixture bulk write 2023-07-24 23:30:37 +00:00
Trevor Guidry 53837263e1 SERVER-72923 add multiversion reproduce steps to evergreen 2023-06-20 14:53:13 +00:00
Daniel Moody 1450624c71 SERVER-76740 SERVER-69843 added pretty printer tests framework 2023-05-19 18:19:56 +00:00
Tausif Rahman 2dbc2a40b8 SERVER-73479 resmoke should error locally when attempting to run tests that are disabled 2023-03-21 20:07:24 +00:00
Alexander Neben 97ac02fa50 SERVER-68593 Disable low value python warnings 2022-09-02 22:55:09 +00:00
Robert Guo a3a87f936f SERVER-65672 upgrade python packages to support 3.10 2022-04-24 02:12:33 +00:00
Robert Guo 9c46c72e17 SERVER-55857 Use explicit task definitions for implicit multiversion tasks 2021-10-12 04:46:33 +00:00
Robert Guo ba5cf359d8 SERVER-55857 remove NAMED_SUITES from resmoke config 2021-10-02 04:55:02 +00:00
Mikhail Shchatko fcdbc97ec7 SERVER-55858 Enforce transition to requires-fcv after feature flag is changed from disabled to enabled by default 2021-07-23 07:30:05 +00:00
Robert Guo 5d9e1907cc SERVER-57873 support multiple tag files resmoke 2021-06-23 03:24:24 +00:00
Robert Guo 424e574251 SERVER-57778 add QE and QO patch build variants 2021-06-18 15:38:39 +00:00
Carl Raiden Worley c318aff369 SERVER-48048 Use resmoke tag files for multiversion blacklisting 2020-08-17 17:07:22 +00:00
Daniel Gottlieb c0be456afe SERVER-48953: Allow resmoke test files to be listed in a replay file. 2020-07-20 19:23:49 +00:00
Mikhail Shchatko f46630dd3a SERVER-48112 Use Absolute Imports in Resmoke 2020-06-18 10:21:48 +00:00
jannaerin 76823e76d5 SERVER-43333 Ingest drivers server selection tests 2020-04-24 16:10:48 +00:00
A. Jesse Jiryu Davis 6018c34bd2 SERVER-45416 Model-check TLA+ specs in Evergreen 2020-04-06 19:45:52 +00:00
Andrew Morrow be05c9ea62 SERVER-44546 Remove mobile variants and embedded benchmarks 2019-12-09 19:22:42 +00:00
Lamont Nelson 54ffea6c75 SERVER-43333 Ingest driver SDAM tests 2019-12-05 20:32:53 +00:00
Annie Black 27cf911c3f Revert "SERVER-43333 Ingest driver SDAM tests"
This reverts commit 25d1843463.
2019-12-02 18:36:44 +00:00
Lamont Nelson 25d1843463 SERVER-43333 Ingest driver SDAM tests 2019-11-27 17:40:41 +00:00
Billy Donahue c8b9b377df SERVER-43659 better diagnostics on resmoke subprocess errors 2019-09-30 06:52:38 +00:00
Roxane a5b2b781c6 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-23 12:56:16 -04:00
Ian Boros 72f18524e2 Revert "SERVER-41796 Create Evergreen variant for libfuzzer targets"
This reverts commit 51a218fb13.
2019-07-19 13:37:05 -04:00
Roxane 51a218fb13 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-18 15:58:45 -04:00