linux/tools/testing/kunit
Rae Moar 723c8258c8 kunit: tool: Add command line interface to filter and report attributes
Add ability to kunit.py to filter attributes and report a list of tests
including attributes without running tests.

Add flag "--filter" to input filters on test attributes. Tests will be
filtered out if they do not match all inputted filters.

Example: --filter speed=slow (This filter would run only the tests that are
marked as slow)

Filters have operations: <, >, <=, >=, !=, and =. But note that the
characters < and > are often interpreted by the shell, so they may need to
be quoted or escaped.

Example: --filter "speed>slow" or --filter speed\>slow (This filter would
run only the tests that have the speed faster than slow.

Additionally, multiple filters can be used.

Example: --filter "speed=slow, module!=example" (This filter would run
only the tests that have the speed slow and are not in the "example"
module)

Note if the user wants to skip filtered tests instead of not
running/showing them use the "--filter_action=skip" flag instead.

Expose the output of kunit.action=list option with flag "--list_tests" to
output a list of tests. Additionally, add flag "--list_tests_attr" to
output a list of tests and their attributes. These flags are useful to see
tests and test attributes without needing to run tests.

Example of the output of "--list_tests_attr":
  example
  example.test_1
  example.test_2
  # example.test_2.speed: slow

This output includes a suite, example, with two test cases, test_1 and
test_2. And in this instance test_2 has been marked as slow.

Reviewed-by: David Gow <davidgow@google.com>
Signed-off-by: Rae Moar <rmoar@google.com>
Signed-off-by: Shuah Khan <skhan@linuxfoundation.org>
2023-07-26 13:29:21 -06:00
..
configs kunit: tool: Enable CONFIG_FORTIFY_SOURCE under UML 2023-05-16 14:07:05 -07:00
qemu_configs kunit: qemu_configs: Enable all architectural features for arm64 2023-07-18 15:37:56 -06:00
test_data kunit: tool: parse KTAP compliant test output 2022-12-12 14:13:47 -07:00
.gitignore .gitignore: add SPDX License Identifier 2020-03-25 11:50:48 +01:00
kunit.py kunit: tool: Add command line interface to filter and report attributes 2023-07-26 13:29:21 -06:00
kunit_config.py kunit: tool: fix pre-existing `mypy --strict` errors and update run_checks.py 2023-03-17 12:28:30 -06:00
kunit_json.py kunit: tool: misc cleanups 2022-05-16 13:22:36 -06:00
kunit_kernel.py kunit: tool: Add command line interface to filter and report attributes 2023-07-26 13:29:21 -06:00
kunit_parser.py kunit: tool: Add command line interface to filter and report attributes 2023-07-26 13:29:21 -06:00
kunit_printer.py kunit: tool: add subscripts for type annotations where appropriate 2023-03-17 12:28:18 -06:00
kunit_tool_test.py kunit: tool: Add command line interface to filter and report attributes 2023-07-26 13:29:21 -06:00
mypy.ini kunit: tool: undo type subscripts for subprocess.Popen 2023-05-08 08:39:41 -06:00
qemu_config.py kunit: tool: Add support for overriding the QEMU serial port 2023-04-05 12:51:06 -06:00
run_checks.py kunit: tool: undo type subscripts for subprocess.Popen 2023-05-08 08:39:41 -06:00