Carl Worley
f7ca0cc452
SERVER-44832 Modify HookTestArchival to reset fixtures
2019-12-13 18:34:40 +00:00
Carl Worley
6c803a6704
SERVER-19895 resmoke failures should self-document
2019-11-22 20:16:40 +00:00
Roxane
a5b2b781c6
SERVER-41796 Create Evergreen variant for libfuzzer targets
2019-07-23 12:56:16 -04:00
Ian Boros
72f18524e2
Revert " SERVER-41796 Create Evergreen variant for libfuzzer targets"
...
This reverts commit 51a218fb13
2019-07-19 13:37:05 -04:00
Roxane
51a218fb13
SERVER-41796 Create Evergreen variant for libfuzzer targets
2019-07-18 15:58:45 -04:00
Robert Guo
f747b54773
SERVER-40702 wait for processes to exit on KeyboardInterrupt in resmoke
2019-07-03 13:07:10 -04:00
David Bradford
66fcbb20e5
SERVER-40671 : Fix parallel execution in resmoke
2019-04-24 09:22:53 -04:00
Mathew Robinson
8dd6d47557
SERVER-32295 Support Python 3
2019-04-08 14:08:49 -04:00
Jonathan Abrahams
b494c59557
SERVER-39305 Add --repeatTestsSecs, --repeatTestsMin & --repeatTestsMax options to resmoke
2019-02-14 16:53:42 -05:00
Jonathan Abrahams
b04cc1e53b
SERVER-35852 Convert FSM client to use a resmoke suite for easy test blackisting in backup_restore
2018-10-12 10:37:41 -04:00
Yves Duhem
1e026f75dc
SERVER-28940 Test cases for fixture setups and teardowns
2018-10-04 09:51:05 -04:00
Yves Duhem
d92fe6cd92
SERVER-34593 New resmoke option to repeat tests
2018-08-29 10:35:43 -04:00
Jonathan Abrahams
980e650068
SERVER-24924 Fix lint
2018-04-18 07:16:54 -04:00
Jonathan Abrahams
f1dce2d193
SERVER-24924 Fix Exceptions during resmoke.py execution do not cause task failures
2018-04-17 23:21:30 -04:00
Jonathan Abrahams
366f5aea02
Revert " SERVER-24924 Resmoke raises an exception if the number of tests run is less than expected for a successful suite execution"
...
This reverts commit 2b20c142c7
2018-04-17 17:32:04 -04:00
Jonathan Abrahams
2b20c142c7
SERVER-24924 Resmoke raises an exception if the number of tests run is less than expected for a successful suite execution
2018-04-17 16:33:35 -04:00
Jonathan Abrahams
c50c68fef1
SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy
2018-04-05 14:41:58 -04:00
Jonathan Abrahams
36148ad8bb
SERVER-23312 Format Python files with yapf
2018-03-26 13:04:25 -04:00
Yves Duhem
6618ad3025
SERVER-33396 Update fixture teardown to throw ServerFailure
2018-03-02 12:14:51 -05:00
Yves Duhem
4a69dcaf78
SERVER-33476 Rename CustomBehavior to Hook
2018-02-27 11:29:46 -05:00
Jonathan Abrahams
4cc459b6ee
SERVER-26884 Support archiving data files in Evergreen on test failure
2018-02-08 12:19:04 -05:00
Max Hirschhorn
2c451638c2
SERVER-32474 Fix double logging when using --log=buildlogger.
...
Exposes an additional logger that uses the test's root logger as the
parent for any TestCase instances constructor by the hook. The fixture
logger still continues to be the parent of the hook logger.
Also changes the CleanEveryN hook to explicitly get marked as a failure
if a ServerFailure exception is thrown, rather than relying on
TestReport.combine() to do so implicitly.
2018-01-10 14:15:35 -05:00
Max Hirschhorn
611220640b
SERVER-31556 Use fixture logger as parent of hook logger.
...
This enables the hook logger to log messages to logkeeper when
--log=buildlogger is specified without needing to start a new dynamic
test case.
2017-11-26 12:14:00 -05:00
Max Hirschhorn
046a5a01c1
SERVER-31470 Move "run tests" logic into evergreen_run_tests.py.
2017-10-18 01:45:51 -04:00
Ian Boros
9f8084f2c8
SERVER-30578 resmoke no longer starts more servers than tests
2017-09-07 12:12:22 -04:00
Robert Guo
b136dbce0f
SERVER-19541 supporting connecting to an external cluster in resmoke.py
2017-08-21 10:30:59 -04:00
Robert Guo
f3b60130e2
SERVER-25293 log hook testcases only to logkeeper
2017-06-14 19:57:10 -04:00
Max Hirschhorn
a4d2c52dba
SERVER-28991 Eliminate having an AlarmClock thread for each test.
...
Changes resmoke.py to use its FlushThread for managing all calls to
flush() buildlogger handlers.
2017-05-16 12:10:14 -04:00
Yves Duhem
c8a2af0706
SERVER-28477 Resmoke logging refactoring
2017-03-29 10:48:25 -04:00
Eddie Louie
bc5c3286fb
SERVER-26224 Add --staggerJobs option to resmoke.py
2017-03-27 16:57:58 -04:00
Max Hirschhorn
83f31ef26e
SERVER-21539 Write report.json file when resmoke.py receives a SIGUSR1.
2017-03-09 13:06:29 -05:00
Robert Guo
6ec5d44bc3
SERVER-27158 teardown_flag does not exist except for the final iteration
2017-02-23 17:43:28 -05:00
Robert Guo
18be5b3302
SERVER-27158 shutdown fixtures when a job finishes
2017-02-22 10:34:47 -05:00
iwysiu
0c9a7a497a
SERVER-24729 stagger the launching of resmoke jobs
2016-07-20 12:15:14 -04:00
Max Hirschhorn
00c8c64f6c
SERVER-22142 join() FlushThread in resmoke.py after running all tests.
...
This prevents the FlushThread from running while the interpreter is
shutting down and the import machinery is uninitialized.
Also fixed an issue where a KeyboardInterrupt while running multiple
suites with --continueOnFailure would skip to the next suite, rather
than exiting resmoke.py.
2016-01-15 09:30:39 -05:00
Max Hirschhorn
8c8ee18403
SERVER-18756 Write all executions to the report.json file.
...
Makes it so that a link to the logs for every test that ran is present
in the sidebar of the Evergreen UI. Multiple entries will appear for
the same test file when --repeat is used.
This also fixes an issue where the number of tests skipped would be
incorrect if the same test file was included multiple times in the
"roots" key.
2015-06-22 20:18:10 -04:00
Charlie Swanson
263299464c
SERVER-18843 resmoke.py should not summarize all previous executions until it finishes
2015-06-18 10:49:50 -04:00
Charlie Swanson
15a5fcc644
SERVER-18390 Check dbhash of all databases during small_oplog suites
2015-05-20 11:55:55 -04:00
Max Hirschhorn
424314f65e
SERVER-1424 Rewrite smoke.py.
...
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.
Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.
Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00
