known issues: ignore testcases failures

Added new config file to filter the known issues for arduino 101
and quark_se_c1000.
Added filter for known TCF issues like SKIP and BLCK lines

Change-Id: Ie77b0cee2c395b8ea4f6d832023c7207d922c108
Signed-off-by: Javier B Perez <javier.b.perez.hernandez@intel.com>
This commit is contained in:
Javier B Perez 2016-07-22 17:33:19 -05:00 committed by Inaky Perez-Gonzalez
parent 844e21269c
commit 7971f7619d
5 changed files with 34 additions and 0 deletions

View file

@ -0,0 +1,5 @@
#
# Reported in ZEP-757
# FAIL tests/kernel/test_context x86+arc
#
^FAIL0/[-a-z0-9:]+ tests/kernel/test_context/testcase.ini#test @[^/]+/[^:]+:x86\+arc: evaluation failed type:arduino101$

View file

@ -0,0 +1,8 @@
#
# Block line when test case cannot run in the HW due to server or connection issues
#
^BLCK0/[-a-z0-9:]+ (.+)#test @[^/]+/[^:]+:[^:]+: evaluation blocked(.*)$
#
# Block line when there is an issue with the YKUSH serial connection
#
^BLCK0/[-a-z0-9:]+ (.+)#test @[^/]+/(?P<board>[^:]+):[^:]+: exception: 400: (?P=board): Cannot find YKUSH serial '[A-Z0-9]+'$

View file

@ -0,0 +1,12 @@
#
# Makefile message when a test fails
#
^/tmp/tcf-[a-zA-Z0-9]+.mk:[0-9]+: recipe for target ('tcf-jobserver-run'|'sommersault') failed$
#
# Makefile message when a test fails, only appears on some systems
#
^make: \*\*\* \[(tcf-jobserver-run|sommersault)\] Error 1$
#
# FAIL result. There are some testcases failing
#
^FAIL0/[-a-z0-9:]* toplevel: [0-9]+ tests \([0-9]+ passed, [0-9]+ failed, [0-9]+ blocked, [0-9]+ skipped\) - failed$

View file

@ -0,0 +1,5 @@
#
# Reported in ZEP-757
# FAIL tests/kernel/test_context x86+arc
#
^FAIL0/[-a-z0-9:]+ tests/kernel/test_context/testcase.ini#test @[^/]+/[^:]+:x86\+arc: evaluation failed type:ma$

View file

@ -0,0 +1,4 @@
#
# Skip line when test case is eliminated due to filters
#
^SKIP0/[-a-z0-9:]+ (.+)#test: No targets can be used \(all [0-9]+ selected from [0-9]+ available eliminated by testcase filtering\)$