silverstripe-framework/dev
Damian Mooyman 69d888b5d1 FIXED: Issue with test reporting not correctly presenting errors that prevent test execution.
In the case of errors arising during setUp or setUpOnce a unit test will fail to run any individual tests. However, this situation was incorrectly being reported as a test pass (as no tests were run, thus no tests had errors). E.g. the output of a test run that raised an error during setUp would be "0 tests run: 0 passes, 0 failures, and 0 incomplete" with a green background.

To rectify this the following fixes were made:
- Non-cleanly ended tests and test suites are now automatically ended at the end of the test run, as well as at the beginning of subsequent test/suites. This should make catching of errors a lot more robust.
- Errors raised during setup are now no longer lost to the mist of time. The test suite itself will record any error status which was generated outside the scope of any individual tests.
- An additional "errors" count is added to the output at the end of test running. For example, in the case where setup failed and no tests could be run the error would be written to the browser (along with stacktrace) with a message similar to "0 tests run: 0 passes, 0 failures, and 0 incomplete with 1 errors". The intent of this is to separate the concepts of failed/succeeded/incomplete tests from any errors which may have arisen. I.e. no tests "failed" due to the error, but the test run itself is highlighted as an error (red background on the output).

This problem has been a severe cause of issue when testing code that interacts with the database, as any database error during setup would refuse to be shown.
2012-09-19 12:25:58 +12:00
..
install BUG: Installer implies empty template used in tutorial 2012-08-22 13:42:53 +12:00
phpunit MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
Backtrace.php ENHANCEMENT: Implement blowfish encryption and use it by default. (#7111) 2012-05-02 13:51:29 +12:00
BuildTask.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
BulkLoader.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
Cli.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
CliDebugView.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
CliTestReporter.php MINOR Removed function_exists() checks which aren't necessary for PHP 5.2+ 2012-04-16 13:15:41 +12:00
CSSContentParser.php MINOR Warning about HTML5 compat in CSSContentParser 2012-06-05 11:38:27 +02:00
CsvBulkLoader.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
CSVParser.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
Debug.php Various minor visual enhancements for Sapphire test report 2012-09-01 11:58:52 +12:00
DebugView.php Various minor visual enhancements for Sapphire test report 2012-09-01 11:58:52 +12:00
Deprecation.php Scoped deprecation messages (fixes #7645) 2012-07-13 11:37:35 +02:00
DevelopmentAdmin.php FIX: restore and update style for DevelopmentAdmin. 2012-06-29 16:52:36 +12:00
FunctionalTest.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
InstallerTest.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
JSTestRunner.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
Log.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
LogEmailWriter.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
LogErrorEmailFormatter.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
LogErrorFileFormatter.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
LogFileWriter.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
MigrationTask.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
Profiler.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
SapphireInfo.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
SapphireREPL.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
SapphireTest.php BUGFIX: Fix loading of fixtures not specified in $fixtures array 2012-09-05 14:26:43 +12:00
SapphireTestReporter.php FIXED: Issue with test reporting not correctly presenting errors that prevent test execution. 2012-09-19 12:25:58 +12:00
SapphireTestSuite.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
SilverStripeListener.php MINOR: Added test listeners to support TeamCity/PHPUnit executions. 2012-05-28 18:31:48 +12:00
SysLogWriter.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
TaskRunner.php FIX: restore and update style for DevelopmentAdmin. 2012-06-29 16:52:36 +12:00
TeamCityListener.php MINOR: Added test listeners to support TeamCity/PHPUnit executions. 2012-05-28 18:31:48 +12:00
TestListener.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
TestMailer.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
TestOnly.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00
TestRunner.php Various minor visual enhancements for Sapphire test report 2012-09-01 11:58:52 +12:00
TestSession.php MINOR Fixing "No current controller available" error when TestSession::__destruct() is called 2012-05-24 16:41:29 +12:00
YamlFixture.php ENHANCEMENT Add YamlFixture String argument support 2012-06-29 00:33:00 +02:00
ZendLog.php MINOR Update @package values to match renaming sapphire 2012-04-15 10:50:19 +12:00