Commit Graph

5 Commits

Author SHA1 Message Date
Andrew Halberstadt
db3fb1fa34 Bug 1403983 - Fix reftest regression where screenshots aren't being output and add a test, r=jmaher
MozReview-Commit-ID: 8ZqmukDtWpO

--HG--
extra : rebase_source : 86544bda6e79e5e35444b4083e76d2cf8642c408
2017-09-28 12:26:51 -04:00
Andrew Halberstadt
35b752c904 Bug 1403325 - Use a single --sandbox-read-whitelist argument in mochitest and reftest, r=Alex_Gaynor
The main bug this fixes is that on reftest, the objdir needs to be added to the
whitelist on Windows. However, this only happens when running on Linux for some
reason.

Changing the --work-path and --obj-path arguments to --sandbox-read-whitelist
was more of a drive-by cleanup than anything necessary.

MozReview-Commit-ID: Dq8ZLETMzeM

--HG--
extra : rebase_source : 3d2cdda125205e76f86235eb373074899fe0789a
2017-09-26 16:36:43 -04:00
Andrew Halberstadt
9ca2dfe204 Bug 1373745 - Fix structured logging problems in reftest, r=jmaher
Currently reftest.jsm uses logger.testEnd(..) to log all kinds of different
potential failures, from proper test failures to harness issues. This means
there are all kinds of edge cases that would cause multiple testEnd messages to
get logged, something the structured log protocol is supposed to prevent.

This modifies the reftest harness to instead use testStatus for everything. The
testEnd call will always be logged with status "OK". This required some changes
to the reftest formatter and reftest selftests.

MozReview-Commit-ID: 8RxsmHW49oy

--HG--
extra : rebase_source : 2f53e63f00bfc5e0e751b0f2bb3dc67477dc07eb
2017-06-16 15:08:45 -04:00
Andrew Halberstadt
ad6bd76281 Bug 1399155 - Add reftest selftests for crashes, assertions, asan and leaks, r=jmaher
This installs specialpowers in the test runs so we can trigger crashes/assertions.

MozReview-Commit-ID: 8878OcHv8hU

--HG--
rename : testing/mochitest/tests/python/files/leaks.log => layout/tools/reftest/selftest/files/leaks.log
extra : rebase_source : cee417db30ff76364fa3212a65b2d537c97cc8bd
2017-09-22 09:48:33 -04:00
Andrew Halberstadt
c3c1749786 Bug 1392390 - Create a reftest selftest harness, r=jmaher
This just adds two basic tests, one for a passing test and another for a
failing one. In mochitest, we use privileged APIs to also tests crashes,
assertions, asan and leaks. But these APIs aren't available to reftests
so I'm not sure how we can test these things.

I figure it's not worth holding the framework up on this though, I'll file
a follow-up to figure out something to do for that.

MozReview-Commit-ID: 59TSbsugT5T

--HG--
extra : rebase_source : 72ecd817017c8b7d55eab879db4f6ad5fecc54c0
2017-09-11 16:08:01 -04:00