[cairo] Testsuite changes this week
Bryce W. Harrington
b.harrington at samsung.com
Tue Apr 1 15:07:57 PDT 2014
I'm going to try to do ~weekly test runs and post deltas, in hopes this
helps us spot test regressions more swiftly.
== Current Results Summary ==
cairo git git
1.12 03/17 03/29
-----------------------------------------
Tests run: 22751 24838 24838
Passed: 15809 15884 16725
Passed (%): 69% 64% 67%
Failed: 4198 5383 5529
Failed (%): 18% 22% 22%
Expected Failed: 405 330 332
Error: 1 1 1
Crashed: 227 1017 28
Untested: 2111 2223 2223
Total: 22751 24838 24838
Overall things are looking much better this week, due to Uli's last
couple commits which fixed crashes caused by a couple recent commits.
In absolute terms, there are more passing tests than before, but in
relative terms the failure ratio is 4% higher. If about 1000 failing
tests were fixed, cairo's pass and failure ratios would be back to where
are for the stable branch.
== Changes since last week (03-17 to 03/29) ==
426 CRASHED -> FAIL
561 CRASHED -> PASS
2 CRASHED -> XFAIL
282 FAIL -> PASS
2 PASS -> FAIL
http://www.bryceharrington.org/Cairo/cairo_test_changes_201403017_to_20140329.txt
== Changes since last release (v. 1.12 to 03/29) ==
185 CRASHED -> FAIL
16 CRASHED -> PASS
2 FAIL -> CRASHED
197 FAIL -> PASS
1 FAIL -> UNTESTED
11 FAIL -> XFAIL
703 PASS -> FAIL
11 PASS -> UNTESTED
3 XFAIL -> FAIL
84 XFAIL -> PASS
1 XFAIL -> UNTESTED
http://www.bryceharrington.org/Cairo/cairo_test_changes_version_1_12_to_20140329.txt
More information about the cairo
mailing list