Commit graph

73 commits

Author SHA1 Message Date
Markus Kauppila
ed4e1582bf Made run seed more file name friendly. 2011-07-28 21:35:47 +03:00
Markus Kauppila
9e514b68d3 Logger logs to file on default.
Directory and file name can be changed by using options
--logdir and --logfile. Option --log-stdout forces harness
to log to stdout.
2011-07-28 18:32:27 +03:00
Markus Kauppila
b4a88b8bef Added randomly generated harness seed. 2011-07-27 18:37:47 +03:00
Markus Kauppila
e769714114 Added simple logging levels to logging system.
Added new option: --verbose.
Fixed help for option --version.
2011-07-27 17:48:07 +03:00
Markus Kauppila
6132d65fa6 Changing the execution key generator.
Fixed --iterations option.
2011-07-25 20:32:31 +03:00
Markus Kauppila
46f39ab285 Logger logs harness seed and test execution keys in hex representation. 2011-07-25 19:33:32 +03:00
Markus Kauppila
fc76a5fa6a Fixing the previous commit. 2011-07-24 18:58:36 +03:00
Markus Kauppila
afbf90dc78 Adding elementary support for fuzzing.
New options: --seed [VALUE] --exec-key [EXEC-KEY] --iterations VALUE
2011-07-24 18:21:53 +03:00
Markus Kauppila
47fe168753 Using SDL timer to kill hung tests. 2011-07-20 19:32:34 +03:00
Markus Kauppila
82d0a86964 Refined test skipping. 2011-07-19 21:38:15 +03:00
Markus Kauppila
e16810661d Testing out implementation for skipping unsupported test
automatically.
2011-07-18 22:26:26 +03:00
Markus Kauppila
6ab0dd4945 Fixes to logging system. 2011-07-18 16:37:02 +03:00
Markus Kauppila
6e2972bd81 Added --timeout VALUE command option. 2011-07-18 16:16:41 +03:00
Markus Kauppila
00fc5d8daf Refactored a bit. 2011-07-18 15:25:54 +03:00
Markus Kauppila
0bcc47f4b6 Harness warns about tests that request timeout when it's not
available.
2011-07-18 14:41:01 +03:00
Markus Kauppila
c9ca0a4609 Fixed logging noise coming from unimplemented optional test
suite functions SetUp and TearDown.
2011-07-17 11:17:40 +03:00
Markus Kauppila
66677c0ad1 Fixed AssertEquals. 2011-07-14 20:33:18 +03:00
Markus Kauppila
7de8abe0c4 Harness kills hung tests (won't work with --in-proc option).
Added result description to test logs (tells why test failed,
such as exceeding its timeout).
2011-07-13 19:51:25 +03:00
Markus Kauppila
6d3454e153 If any assert in SetUp function fails that test will be skipped. 2011-07-11 21:09:28 +03:00
Markus Kauppila
3efe0fed79 Added SetUp/TearDown functions for test suites. 2011-07-11 17:55:35 +03:00
Markus Kauppila
48bcede0dc Bunch of little fixes. 2011-07-10 18:42:52 +03:00
Markus Kauppila
c003533b11 Fixed the interface between tests suites and logger.
Note: breaks the linux build.
2011-07-06 16:06:39 +03:00
Markus Kauppila
891b80a6e0 Added command option --version 2011-07-04 20:46:06 +03:00
Markus Kauppila
ec1a464da6 Fixed './runner --xml --show-tests'. 2011-07-04 17:23:20 +03:00
Markus Kauppila
f2553543f6 Help usage missed ] which added. 2011-07-03 20:22:30 +03:00
Markus Kauppila
ad423aceb3 Changed the usage help. 2011-07-03 11:14:52 +03:00
Markus Kauppila
4d41c6069a Fixed doxygen markup error. 2011-07-01 13:29:19 +03:00
Markus Kauppila
4fdb4d47e7 Redefined the usage of --xsl command option. 2011-07-01 12:36:57 +03:00
Markus Kauppila
065297879a Separated test suite name from its directory path. Fixes
usability issues concerning some command line options.
2011-07-01 11:12:35 +03:00
Markus Kauppila
3055057249 Removed directory from test suite names. 2011-06-30 18:11:48 +03:00
Markus Kauppila
5f77401c49 Added user-supplied XSL style sheets for XML-based test reports.
Added new command line option: --xsl.
2011-06-30 17:11:39 +03:00
Markus Kauppila
cdc832d2b9 Cleaned the XSL style a bit. 2011-06-30 16:08:37 +03:00
Markus Kauppila
7d6dcc9376 Fixed the calculation of total runtime for a suite. 2011-06-29 19:05:56 +03:00
Markus Kauppila
896b25911d Fixed test suite start time. 2011-06-27 22:39:38 +03:00
Markus Kauppila
fd3b97e2ff Added time, date and total runtime information to the output by
logging system.
2011-06-27 21:41:34 +03:00
Markus Kauppila
7236f2ab89 Refining the output of XML logger. 2011-06-27 16:41:45 +03:00
Markus Kauppila
2a486b279b Added identation to the output of XML logger. 2011-06-27 11:53:14 +03:00
Markus Kauppila
2e8932b12e Logging system added to harness. Logging system doesn't
yet utilize all the given parameters.
2011-06-26 23:04:37 +03:00
Markus Kauppila
f7397f3579 Added new command line option: --show-tests 2011-06-13 15:38:40 +03:00
Markus Kauppila
3c3953361f Compatibility fix. Apparently all system don't have d_namlen member
in their DIR struct.
2011-06-11 08:11:03 -07:00
Markus Kauppila
ef89823301 Fixed doxygen comments and usage help. 2011-06-09 18:30:06 +03:00
Markus Kauppila
c466d7043f Updated test case filter. 2011-06-09 18:13:46 +03:00
Markus Kauppila
b53f302e9c Added comments and did some cleaning. 2011-06-09 18:07:50 +03:00
Markus Kauppila
821c7d9971 Added test and suite names to the output. 2011-06-09 17:13:33 +03:00
Markus Kauppila
4f8639e449 Creating pipeline for test case selection. Work in progress. 2011-06-09 16:37:51 +03:00
Markus Kauppila
d3b50802bf Removed unnecessary function. 2011-06-08 19:41:12 +03:00
Markus Kauppila
ab42fe5afa Fix: memory allocated for test suite references is freed 2011-06-08 18:38:38 +03:00
Markus Kauppila
4f5d867d8d Initial version of "scan tests/ for test suites" functionality. 2011-06-07 21:11:11 +03:00
Markus Kauppila
736c0e2a65 Minor refactorings. 2011-06-06 18:37:53 +03:00
Markus Kauppila
d9ce7a4a40 Converted libtest to a more proper dummy test suite (libtestdummy). 2011-06-06 18:15:19 +03:00