zephyr/scripts/tests/twister
Michal Smola 3bf61528cc twister: qemu: add QEMU support on Windows in twister
Twister does not support running tests on QEMU on Windows.
Add a new twister handler called QEMUWinHandler which supports running
tests on Windows. Enable running tests in testinstance, only if
QEMU_BIN_PATH environment variable exists on Windows.
Modify pytest test for testinstance to reflect the change in
runnability of QEMU on Windows.
Tested by running several Ztest and console harness tests.

Signed-off-by: Michal Smola <michal.smola@nxp.com>
2024-03-05 08:20:49 -05:00
..
pytest_integration scripts/pylib/twister/twisterlib: Support multiple --pytest-args 2023-11-30 10:03:01 +01:00
test_data twister: tests: fix tests by mocking platform attributes 2024-03-04 14:05:22 -05:00
conftest.py scripts: tests: Expand environment.py tests 2023-07-18 16:20:54 +02:00
README.md twister: fixups to various files 2022-07-05 12:06:27 -04:00
test_cmakecache.py scripts: tests: twister: CMakeCache test expansion 2023-07-25 09:11:26 +02:00
test_environment.py twister: increase resilience when running outside of git. 2023-08-22 14:42:51 +02:00
test_errors.py scripts: tests: twister: Add error testing 2023-10-30 08:27:43 -04:00
test_handlers.py twister: coverage: Fix device handler coverage collection mode 2024-01-08 09:02:47 -05:00
test_hardwaremap.py scripts: tests: twister: Hardware map unit testing 2023-11-06 10:08:44 +01:00
test_harness.py twister: tests: fix tests by mocking platform attributes 2024-03-04 14:05:22 -05:00
test_jobserver.py scripts: tests: twister: Jobserver tests 2023-10-30 08:28:02 -04:00
test_log_helper.py scripts: tests: twister: Add log_helper tests 2023-10-03 15:22:08 +01:00
test_mixins.py scripts: tests: twister: Mixin test 2023-09-06 09:40:38 -04:00
test_platform.py twister: drop riscv32/64 support 2024-02-26 12:49:06 +01:00
test_quarantine.py twister: Fix quarantine performance issue 2023-10-04 14:49:38 +01:00
test_runner.py twister: support domains when cleaning up binaries 2024-02-14 19:03:39 +01:00
test_scl.py twister: fix utf-8 encoding for device handler 2023-09-19 15:23:52 +01:00
test_testinstance.py twister: qemu: add QEMU support on Windows in twister 2024-03-05 08:20:49 -05:00
test_testplan.py twister: tests: fix tests by mocking platform attributes 2024-03-04 14:05:22 -05:00
test_testsuite.py twister: Add options deciding if paths be included in tests' names 2023-09-29 16:29:16 +02:00
test_twister.py scripts: Twister ConfigurationError Fix 2023-05-26 05:50:20 -04:00

Twister Testing

Running the tests require the environment variable ZEPHYR_BASE to be set.

Twister Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.

Dependencies

Install all the dependencies using

pip install -r $ZEPHYR_BASE/scripts/requirements-build-test.txt

Executing testsuite

The testcases can be executed from the root directory using

pytest $ZEPHYR_BASE/scripts/tests/twister

Twister Coverage

The coverage for all the tests can be run using the command below. This will collect all the tests available.

coverage run -m pytest $ZEPHYR_BASE/scripts/tests/twister/

Then we can generate the coverage report for just twister script using

coverage report -m $ZEPHYR_BASE/scripts/pylib/twister/

To generate the coverage report for twister script use below command

coverage report -m $ZEPHYR_BASE/scripts/twister

The html coverage report for twister can be generated using

coverage html twister

If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).

Organization of tests

  • conftest.py: Contains common fixtures for use in testing the twister tool.
  • test_twister.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.
  • test_testsuite_class.py : Contains testcases for Testsuite class (except reporting functionality) in twisterlib.py.
  • test_testinstance.py : Contains testcases for Testinstance and Testcase class.
  • test_reporting_testsuite.py : Contains testcases for reporting functionality of Testsuite class of twister.