Commit 61baee1
committed
Modify URM Test Runner
- Add support to delete any stale lock files created in previous runs
- Remove log-based result mapping (parse_and_score_log) and solely rely on the return code (0 or 1).
The URM Test Runner already handles the return code, which the script can rely on. Judging pass / fail
based on the logs results in some false positives.
- Modify test skip logic, a suite should only be skipped if it is not in the approved list, of if the
required configs are not found, or if the test executable itself is absent (or is not marked executable).
Skipping of one or more tests part of the testsuite, should not result in an overall SKIP qualification,
it should be either PASS OR FAIL.
Signed-off-by: Kartik Nema <kartnema@qti.qualcomm.com>1 parent eaed3e2 commit 61baee1
1 file changed
Lines changed: 10 additions & 22 deletions
Lines changed: 10 additions & 22 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
48 | 51 | | |
49 | 52 | | |
50 | 53 | | |
51 | 54 | | |
52 | 55 | | |
53 | 56 | | |
54 | 57 | | |
| 58 | + | |
55 | 59 | | |
56 | 60 | | |
57 | 61 | | |
| |||
147 | 151 | | |
148 | 152 | | |
149 | 153 | | |
150 | | - | |
151 | | - | |
152 | | - | |
153 | | - | |
154 | | - | |
155 | | - | |
156 | | - | |
157 | | - | |
158 | | - | |
159 | | - | |
160 | 154 | | |
161 | 155 | | |
162 | 156 | | |
| |||
398 | 392 | | |
399 | 393 | | |
400 | 394 | | |
401 | | - | |
402 | | - | |
403 | | - | |
404 | | - | |
405 | | - | |
406 | | - | |
407 | | - | |
| 395 | + | |
408 | 396 | | |
409 | 397 | | |
410 | 398 | | |
| |||
417 | 405 | | |
418 | 406 | | |
419 | 407 | | |
420 | | - | |
421 | | - | |
422 | | - | |
423 | | - | |
424 | | - | |
| 408 | + | |
| 409 | + | |
| 410 | + | |
| 411 | + | |
| 412 | + | |
425 | 413 | | |
426 | 414 | | |
427 | 415 | | |
| |||
0 commit comments