Commit graph

1030 commits

Author SHA1 Message Date
Markus Kauppila
e6997f706e Fixed an issue with fuzzing seeds. 2011-07-28 22:11:30 +03:00
Markus Kauppila
ed4e1582bf Made run seed more file name friendly. 2011-07-28 21:35:47 +03:00
Markus Kauppila
9e514b68d3 Logger logs to file on default.
Directory and file name can be changed by using options
--logdir and --logfile. Option --log-stdout forces harness
to log to stdout.
2011-07-28 18:32:27 +03:00
Markus Kauppila
b4a88b8bef Added randomly generated harness seed. 2011-07-27 18:37:47 +03:00
Markus Kauppila
e769714114 Added simple logging levels to logging system.
Added new option: --verbose.
Fixed help for option --version.
2011-07-27 17:48:07 +03:00
Markus Kauppila
6132d65fa6 Changing the execution key generator.
Fixed --iterations option.
2011-07-25 20:32:31 +03:00
Markus Kauppila
46f39ab285 Logger logs harness seed and test execution keys in hex representation. 2011-07-25 19:33:32 +03:00
Markus Kauppila
279a841b64 Refining the fuzzer. Adding new functions and fixing the old ones. 2011-07-25 18:51:57 +03:00
Markus Kauppila
fc76a5fa6a Fixing the previous commit. 2011-07-24 18:58:36 +03:00
Markus Kauppila
afbf90dc78 Adding elementary support for fuzzing.
New options: --seed [VALUE] --exec-key [EXEC-KEY] --iterations VALUE
2011-07-24 18:21:53 +03:00
Markus Kauppila
f1e162b811 Merged two heads. 2011-07-21 14:22:17 +03:00
Markus Kauppila
04bcf13dc2 Added count of skipped tests to default xsl style. 2011-07-21 13:57:55 +03:00
Andreas Schiffler
a2c9c4d217 Added test case for power management function; improved assertions in tests 2011-07-20 23:04:55 -07:00
Markus Kauppila
1ba2041d01 Fixed linking issue concerning test suites.
Fixed linux build (it compiles and runs properly).
2011-07-20 23:37:58 +03:00
Markus Kauppila
51d6f10f01 Fixing linking issues using shared object. 2011-07-20 19:57:42 +03:00
Markus Kauppila
47fe168753 Using SDL timer to kill hung tests. 2011-07-20 19:32:34 +03:00
Markus Kauppila
82d0a86964 Refined test skipping. 2011-07-19 21:38:15 +03:00
Markus Kauppila
e16810661d Testing out implementation for skipping unsupported test
automatically.
2011-07-18 22:26:26 +03:00
Markus Kauppila
8190ae317e Refined the string escaping algorithm. 2011-07-18 17:16:38 +03:00
Markus Kauppila
6ab0dd4945 Fixes to logging system. 2011-07-18 16:37:02 +03:00
Markus Kauppila
6e2972bd81 Added --timeout VALUE command option. 2011-07-18 16:16:41 +03:00
Markus Kauppila
00fc5d8daf Refactored a bit. 2011-07-18 15:25:54 +03:00
Markus Kauppila
0bcc47f4b6 Harness warns about tests that request timeout when it's not
available.
2011-07-18 14:41:01 +03:00
Andreas Schiffler
9db859c159 Fixed SDL_SetError() by making NULL fmt a no-op, update test automation 2011-07-17 20:59:34 -07:00
Markus Kauppila
73bd015b16 Merging two heads. 2011-07-17 19:19:35 +03:00
Markus Kauppila
c9ca0a4609 Fixed logging noise coming from unimplemented optional test
suite functions SetUp and TearDown.
2011-07-17 11:17:40 +03:00
Andreas Schiffler
97ae8a553d Expanded and updated testplatform suite. 2011-07-16 20:12:25 -07:00
Markus Kauppila
254a81687d Fixed doxygen markup. 2011-07-14 21:04:31 +03:00
Markus Kauppila
cc7000166f Added timeout for dummycase3 in libtestdummy. 2011-07-14 20:57:16 +03:00
Markus Kauppila
b6d8ee501e Fixed incorrect assertions in surface test suite. 2011-07-14 20:43:32 +03:00
Markus Kauppila
66677c0ad1 Fixed AssertEquals. 2011-07-14 20:33:18 +03:00
Markus Kauppila
7de8abe0c4 Harness kills hung tests (won't work with --in-proc option).
Added result description to test logs (tells why test failed,
such as exceeding its timeout).
2011-07-13 19:51:25 +03:00
Markus Kauppila
4790fd63e3 Plain logger logs the used command line options. 2011-07-12 23:53:57 +03:00
Markus Kauppila
022eceb59a Breaking tests in surface to several smaller tests. 2011-07-12 16:47:50 +03:00
Markus Kauppila
6d3454e153 If any assert in SetUp function fails that test will be skipped. 2011-07-11 21:09:28 +03:00
Markus Kauppila
3efe0fed79 Added SetUp/TearDown functions for test suites. 2011-07-11 17:55:35 +03:00
Markus Kauppila
0eb354cef4 Fixes based on CR. 2011-07-11 17:47:55 +03:00
Markus Kauppila
5ad396d180 Updated assert messages in surface test suite. 2011-07-10 18:48:31 +03:00
Markus Kauppila
48bcede0dc Bunch of little fixes. 2011-07-10 18:42:52 +03:00
Markus Kauppila
d0e9372d99 Ported surface tests. 2011-07-09 17:55:35 +03:00
Markus Kauppila
63d7c3faa6 Ported common directory from automated. It contains common
helpers functions for some test suites.
2011-07-08 19:58:16 +03:00
Markus Kauppila
756be93f60 Made the default XSL style less blocky. 2011-07-06 23:49:36 +03:00
Markus Kauppila
0897dcc54e Fixed doxygen markup. 2011-07-06 17:05:07 +03:00
Markus Kauppila
c003533b11 Fixed the interface between tests suites and logger.
Note: breaks the linux build.
2011-07-06 16:06:39 +03:00
Markus Kauppila
f51d137634 Added audio suite. 2011-07-05 22:11:12 +03:00
Markus Kauppila
58b0cd86d7 Added a skeleton stylesheet that can be used as a base for
developing a new stylesheet for XML test reports.
2011-07-05 21:27:35 +03:00
Markus Kauppila
512c6cb102 Made the output of plain logger more readable. 2011-07-05 21:15:34 +03:00
Markus Kauppila
891b80a6e0 Added command option --version 2011-07-04 20:46:06 +03:00
Markus Kauppila
ec1a464da6 Fixed './runner --xml --show-tests'. 2011-07-04 17:23:20 +03:00
Markus Kauppila
f2553543f6 Help usage missed ] which added. 2011-07-03 20:22:30 +03:00