patrick/zephyr
1
0
Fork 0
Code Issues Pull requests Actions 7 Packages Projects Releases Wiki Activity
zephyr/scripts/tests/twister
History
Diego Elio Pettenò d9fe63b188 twister: increase resilience when running outside of git. 
While the code already includes some provisions to allow running outside
of a git checkout, attempting that right now causes a failure to generate
the XML report, as the JSON report creates a null `zephyr_version` field.

The reason for that is that the original code doesn't set `self.version`
when the subprocess returns a non-zero status (and also doesn't log.)

Instead of having to set `self.version` for all failure cases, initialize
it to the failure state, and log if it hasn't changed from that.

Signed-off-by: Diego Elio Pettenò <flameeyes@meta.com>
2023-08-22 14:42:51 +02:00
..
pytest_integration twister: pytest: Parse report file to get testcases 2023-06-25 02:44:49 -04:00
test_data twister: add support for levels and test configuration 2023-03-07 15:49:16 +01:00
conftest.py scripts: tests: Expand environment.py tests 2023-07-18 16:20:54 +02:00
README.md twister: fixups to various files 2022-07-05 12:06:27 -04:00
test_cmakecache.py scripts: tests: twister: CMakeCache test expansion 2023-07-25 09:11:26 +02:00
test_environment.py twister: increase resilience when running outside of git. 2023-08-22 14:42:51 +02:00
test_harness.py twister: Add support for gTest as a harness 2023-05-24 19:39:10 -04:00
test_quarantine.py scripts: tests: Twister test expansion - quarantine 2023-07-13 14:18:27 +02:00
test_runner.py scripts: tests: tests for choosing binaries 2023-04-14 08:01:31 -04:00
test_testinstance.py scripts: Typo in the word 'platform' fix 2023-05-29 14:34:33 -04:00
test_testplan_class.py twister: add support for levels and test configuration 2023-03-07 15:49:16 +01:00
test_testsuite.py Revert "twister: tests: Add unit tests for names of external and module tests" 2023-01-24 20:21:57 -05:00
test_twister.py scripts: Twister ConfigurationError Fix 2023-05-26 05:50:20 -04:00

README.md

Twister Testing

Running the tests require the environment variable ZEPHYR_BASE to be set.

Twister Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.

Dependencies

Install all the dependencies using

pip install -r $ZEPHYR_BASE/scripts/requirements-build-test.txt

Executing testsuite

The testcases can be executed from the root directory using

pytest $ZEPHYR_BASE/scripts/tests/twister

Twister Coverage

The coverage for all the tests can be run using the command below. This will collect all the tests available.

coverage run -m pytest $ZEPHYR_BASE/scripts/tests/twister/

Then we can generate the coverage report for just twister script using

coverage report -m $ZEPHYR_BASE/scripts/pylib/twister/

To generate the coverage report for twister script use below command

coverage report -m $ZEPHYR_BASE/scripts/twister

The html coverage report for twister can be generated using

coverage html twister

If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).

Organization of tests

  • conftest.py: Contains common fixtures for use in testing the twister tool.
  • test_twister.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.
  • test_testsuite_class.py : Contains testcases for Testsuite class (except reporting functionality) in twisterlib.py.
  • test_testinstance.py : Contains testcases for Testinstance and Testcase class.
  • test_reporting_testsuite.py : Contains testcases for reporting functionality of Testsuite class of twister.