Help me (and maybe others) to not occasionally forget to run this or that test suite in this or that mode: Have test suites execute all variants by default (patches 5 and 6), make sure their exit codes match Automake expectations (patch 7) and register them with Automake (patch 11). Also fix for running 'make check' as non-root (patches 8 and 9) and calling build test suite from outside its directory (patch 10). The first four patches are fallout from enabling all variants by default in monitor test suite, which includes implementing previously missing JSON echo testing. Changes since v2: - Drop the need for RUN_FULL_TESTSUITE env var by making the "all variants" mode the default in all test suites - Implement JSON echo testing into monitor test suite, stored JSON output matches echo output after minor adjustment Changes since v1: - Also integrate build test suite - Populate TESTS variable only for non-distcheck builds, so 'make distcheck' does not run any test suite Phil Sutter (11): tests: monitor: Label diffs to help users tests: monitor: Fix regex collecting expected echo output tests: monitor: Test JSON echo mode as well tests: monitor: Extend debug output a bit tests: monitor: Excercise all syntaxes and variants by default tests: py: Enable JSON and JSON schema by default tests: Prepare exit codes for automake tests: json_echo: Skip if run as non-root tests: shell: Skip packetpath/nat_ftp in fake root env tests: build: Do not assume caller's CWD Makefile: Enable support for 'make check' Makefile.am | 9 ++ configure.ac | 5 + tests/build/run-tests.sh | 2 + tests/json_echo/run-test.py | 4 + tests/monitor/run-tests.sh | 182 ++++++++++++++--------- tests/py/nft-test.py | 28 ++-- tests/shell/run-tests.sh | 2 +- tests/shell/testcases/packetpath/nat_ftp | 3 + 8 files changed, 155 insertions(+), 80 deletions(-) -- 2.51.0
