bahman/sqlite
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
31,731 Commits 1,672 Branches 385 Tags
master
Commit Graph

127 Commits

Author SHA1 Message Date
dan
4e4962f6b3 Have testrunner.tcl return a non-zero exit status if one or more tests have failed. 
FossilOrigin-Name: 50ddc36d32540b6d98990b5c9a465beb5b68cc31ae3f0ed162f6fe07e7c74e2d
 2026-04-23 15:54:00 +00:00
drh
d6c985ad0b Fix testrunner.tcl so that it does not create directories with names 
ending in "sqlite3.o" or "sqlite3.lo".  Use "sqlite3obj" for those
directory names instead.  Otherwise "make clean" gets confused.

FossilOrigin-Name: a4bf9289c9cdb12b22bfb24e7e2b0243384e9edece12ae3fed14afbfe9b93260
 2026-04-16 19:50:52 +00:00
drh
1696740fdc Improved comments explaining the logic, and improved diagnostic messages 
when testrunner.tcl encounters trouble loading the sqlite3 extension.

FossilOrigin-Name: 8d820b0ccfccff94ed5b7297fa587ac27a74e990f233cfe229da7409ab2e3af8
 2026-04-16 19:33:04 +00:00
drh
2cefd5954a Minor updates to testrunner documentation. 
FossilOrigin-Name: f8507bd5e221783175be2bb7b907c098e0970b1cbcb01817df7217005eab9ab4
 2026-04-16 17:07:23 +00:00
dan
483f0ef13c Ensure c-tests use the locally built sqlite3.h file, not the system copy. 
FossilOrigin-Name: 2d81ee65ffbed30fd98bdda96dc79c1929c73f806cea3c9e4c244b618980b202
 2026-04-14 18:12:09 +00:00
dan
0523cfda5a Fixes for running C tests on windows. 
FossilOrigin-Name: 1fcacdc41ab1bb66a628acdac29412e66decdc2578dd9d084baaffb74679f984
 2026-04-11 18:05:49 +00:00
dan
bc68ec78de Enhance testrunner.tcl to run individual tests written in C from the test/c/ directory. 
FossilOrigin-Name: 6f140f76f47aadb10d3f35358503d91adb43e0c1802326f6e599effe1b08e7aa
 2026-04-11 17:03:27 +00:00
drh
b0d9039c8c Updates to testrunner.tcl: Shorten the prefix on created subdirectories from 
"testrunner_bld_" to just "testrun_".  Do not append ".exe" to the names of
created subdirectories.  Add the "clean" command to recursively remove all
subdirectories and files created by a test run.

FossilOrigin-Name: 450c7edf1247024db4b66f38bf9561c5c6b0c4175c4df8de17019aea6cbde5cf
 2026-04-09 16:08:29 +00:00
drh
7ff8b558e8 Enhance testrunner.tcl so that a PATTERN argument that begins with "~" is 
an "anti-pattern".  Only run tests that match one or more patterns if there
are any patterns *and* do not match any anti-pattern.

FossilOrigin-Name: c313d91bb67b56be2db46194c3baa5a72b469595de3b2abe249612838dc175e4
 2026-04-03 19:48:01 +00:00
drh
d964b8cfa3 Add the new "retest" command to testrunner.tcl, which reruns any tests that 
failed or never completed in the previous invocation.  New makefile target
"retest" for both unix and Windows that runs testrunner.tcl with "retest".

FossilOrigin-Name: 9b668d56bf0eca3eb826df3edd6705cc809d920494c192a9949cafda791d83f9
 2025-12-31 17:21:30 +00:00
drh
634a915132 Enhance testrunner.tcl so that it can always be run from an ordinary tclsh 
as long as that tclsh can load the sqlite3 package.

FossilOrigin-Name: 1a08b85a862e8c9ac56c11e05f76abc25ad98b510fb13ad0716206ba797e53a8
 2025-12-31 14:17:51 +00:00
drh
059b8d9c04 Tweak testrunner.tcl to allow it to use more cores. 
FossilOrigin-Name: 71b916d4de7a4611f6ada597bfd58b59cab18e3a732de17c92b7346ecff31c04
 2025-11-26 00:41:20 +00:00
drh
d1b133cd16 When "testrunner.tcl status -d N" is run but the test database is not yet 
available, it enters a wait loop until the testing begins.

FossilOrigin-Name: 7abc25ff3b24b11c171e715ae96c8e97651d340b7a8bb8125a73902e1ad881ab
 2025-11-25 23:59:31 +00:00
drh
7efded5edc Improved concurrency for "make devtest" by splitting fuzzdata1.db and 
fuzzdata2.db into slices for asan and ubsan testing.

FossilOrigin-Name: 2c31176607f02a73cf2626cda2dd0711ae74bdf0b4520d4c84ff299c860e419e
 2025-11-10 20:01:39 +00:00
dan
f1c37a357e Add new column "cwd" to the jobs table in testrunner.db. For recording the directory in which the test ran or is running. 
FossilOrigin-Name: 334305a469a51ef0d768ba8443d8cab217f45394cc9f720748a489b10703193d
 2025-11-03 15:29:51 +00:00
drh
87f53152ed Fix typo in the previous check-in that prevented the script from running. 
FossilOrigin-Name: 797664700701effefbf4d87a791febae3bb68544bac23470351a11bcb3a87651
 2025-10-06 16:56:12 +00:00
drh
ad7118fa68 Update testrunner.tcl so that the new option is --cases rather than singular 
--case, and so that it is a glob pattern.

FossilOrigin-Name: 9488b4f00c9278de8c03f4a3cbd4f54e48e71c1eff45de4454f8bd49c080a930
 2025-10-06 16:50:37 +00:00
drh
0611aeeed4 New testrunner.tcl option "--case DISPLAYLNAME" only runs the single case 
(and its build dependencies) that exactly matches DISPLAYNAME.

FossilOrigin-Name: 8ea2e097b731514c284f255f12b08e15f63c7f49641a698e61ee7e47cc9d3c45
 2025-10-06 15:53:52 +00:00
drh
566348f68b Fix testrunner.tcl so that --help output goes to stdout, not stderr. 
FossilOrigin-Name: 441a759c225d4e710a693339402624e7ba52852c08aa64439ed4568c193ad529
 2025-10-06 14:30:22 +00:00
drh
625d0b70fe Improve the accuracy of the ETC on both devtest and releasetest. 
FossilOrigin-Name: a3f96cafdc0e1f2eeccc6509f1f9c26d2c48668953550f299cf2805a0a063014
 2025-07-10 20:45:00 +00:00
drh
45bff0ea64 Add the estkey column to the jobs table of testrunner.db. The plan is to 
use this to collect measurements that will help generate improved ETAs for
a test run.

FossilOrigin-Name: 9eccf5267c6423c9dd4da1d61b62bbb6fbba44fb8089da79f89c84e8b77ff0f0
 2025-07-10 17:19:08 +00:00
drh
2ba946b341 Add the "--fuzzdb FILENAME" to testrunner.tcl as an alternative to setting 
the FUZZDB environment variable (as that can be awkward to do on Windows).
Further improvements to the testrunner.tcl documentation.

FossilOrigin-Name: 6fb84156a262ff89d1a2d1df6fbfac4c1a43fb55b9d15205508662e2c9b0894f
 2025-04-29 14:23:21 +00:00
drh
873fc5dff2 Update testrunner.tcl documentation. Fix typo in testrunner.tcl output. 
FossilOrigin-Name: ba8800b4ba0a690c89d9fb96bb9a0d8789d04160ff9c47ea9afb2b403bec7f0b
 2025-04-29 11:35:51 +00:00
drh
c171d7624e Improved --explain display of FUZZDB test plans in testrunner.tcl. 
FossilOrigin-Name: 42bdd7262ec4f8163263e0535c2cc35b526754d77e1f3ccf5b73b0f44d470d9c
 2025-04-29 10:41:16 +00:00
drh
ece7709f18 Do not run FUZZDB on either Windows-Memdebug or Windows-Win32Heap. 
FossilOrigin-Name: 10d8401d59136dda7051af0da398b06a18031560f2734f4fa347d339765d2089
 2025-04-29 10:29:35 +00:00
drh
8a68ab963e Make testrunner.tcl more restrictive about which configurations run 
fuzzcheck-asan and fuzzcheck-ubsan.

FossilOrigin-Name: 785599394dde0fb36ae2e07d611f9523a05a0817dbd8c416582b3b682dbfa4ff
 2025-04-29 01:37:31 +00:00
drh
246dc92354 Testrunner.tcl now runs fuzzcheck-asan and fuzzcheck-ubsan tests. 
FossilOrigin-Name: 3d8f3a255843c063157265702b76d40c38c774d29d658eea2d77efac92ac8789
 2025-04-28 19:15:46 +00:00
drh
d4cc3a42e2 If the FUZZDB environment variable is set when running testrunner.tcl and 
that env-var points to a fuzzcheck database, then suppliment the fuzzcheck
tests with that extra database.

FossilOrigin-Name: c08530dd6a71cb547d164e2313657c917f280e7988211bf199c8776e78a4e2a6
 2025-04-28 17:56:23 +00:00
drh
1365bcffbf Enhance testrunner.tcl so that it does not build testfixture unnecessarily - 
if the pattern does not match any TCL test.

FossilOrigin-Name: 896d767f1cba64bda7b91b0daebd60ebe4457a58d762da443bf61cf5b39ad2d9
 2025-04-28 16:28:00 +00:00
drh
7fec7c96c4 Fix testrunner.tcl so that it honors pattern matches in non-testfixture 
tests, such as fuzzcheck and sessionfuzz.

FossilOrigin-Name: 81857474fe90f50b760c22d61a6ad477642dabe1052390cd1614dcec8adb1376
 2025-04-28 16:17:17 +00:00
drh
738443c523 Remove a stray blank line from the test/testrunner.tcl script. 
FossilOrigin-Name: 7d6005b0d17d86d72757f3578872e82fd12f61ac9160a0277e397df09f6338a9
 2025-04-28 15:00:28 +00:00
jan.nijtmans
1588d3de37 More ==/!= => eq/ne fixes 
FossilOrigin-Name: 2aa6c4fa6c9c47c7a8548ac3493bfb9ed4e4dec1b6dc4f3599a0373086b3e917
 2025-03-27 14:37:07 +00:00
stephan
52e2a79304 Test script patches from Jan Nijtmans: always use -DUSE_TCL_STUBS in buildtclext.tcl and improvements in how TRG is populated in testrunner.tcl. 
FossilOrigin-Name: aa192203aa1aa188866fe00a5d40dc7b7c72b4f38b06da8708ed0a6c8b8638a6
 2025-03-19 13:49:34 +00:00
stephan
1fc7844d40 Teach testrunner.tcl to distinguish Cygwin from Windows. This gets it running but then all downstream tests fail, at least in part because of the build target name discrepancies between the platform which requires .exe and those which do not. 
FossilOrigin-Name: 2861788e479aea12354f2d34d8e6a2706d193642674ef1f4f852f24c877e0140
 2025-03-11 11:24:52 +00:00
stephan
e1e822ca23 Teach testrunner how to run local binaries which have a .exe extension. Also teach it to recognized mingw environments (but actually building the test programs there currently doesn't work). 
FossilOrigin-Name: e2bd23f251359e7a818c4cfacf114aa9fd8c0a9a1cb802654e96fad67b505508
 2025-02-26 19:22:52 +00:00
stephan
94c42564f3 Test testrunner.tcl to identify an msys environment. 
FossilOrigin-Name: e9f777ceda9fca51c37caca0afeadfc3f99b86e945496f52c71adcc520dcee98
 2025-02-26 18:31:42 +00:00
drh
9c8235b1bd Fix minor problems in testrunner.tcl that pop up when the command-line arguments 
are such that no tests are run.

FossilOrigin-Name: 321ded32f67550e964cd64d61aa0cbc0029ce2fdee4588a46b01dbb5aa87150b
 2024-11-18 13:29:16 +00:00
drh
2139c35da0 Ensure that the one-line running status output from testrunner.tcl does not 
exceed the 80-char line width of a standard terminal.

FossilOrigin-Name: 1eae0f9ed3c4530d117a8efc4adaf0b2cc422083f0407830a1a6d2a5b970fa1a
 2024-11-05 11:59:45 +00:00
drh
bce0d04c98 In testrunner.tcl, only show the ETC on the status line if it will fit within 
the 80-character line limit.

FossilOrigin-Name: 45a3213d23f4691732ba2eb54d440355ce5757aad4cec8eb92f53b4bd7e7f5cd
 2024-10-31 18:29:55 +00:00
drh
0064c43a88 Improvements to the PATTERN option of the "testrunner.tcl joblist" command. 
The pattern match is case insensitive and applies to the state and displaytype
in addition to displayname.

FossilOrigin-Name: 63a8f60f98115d4ee6e40de3ae775770aba76e19df6ddde68bccb7967b0200dc
 2024-10-27 10:48:06 +00:00
drh
f896e2bd5b Add the "halt" command to testrunner.tcl 
FossilOrigin-Name: 2cc25d5dbbc729f3b6deb8c6a45b975c535b4d20ad240e4ec0c85b3733a170ed
 2024-10-22 20:09:18 +00:00
drh
0d7ede8d1c In testrunner.tcl: Better estimates for ETC (Estimated Time to Completion). 
Show the ETC even for the single-line status reports.

FossilOrigin-Name: 2a2f5f4e378338951cc2030ffbacd678e6a6eab142e39ee632c61be42345b092
 2024-10-21 22:45:59 +00:00
dan
e2f294a1e5 Add a case to testrunner.tcl so that mdevtest can run on openbsd. 
FossilOrigin-Name: e904b37fb2621e6bd5e761f3ecb75adb34350f2d1d7b229e655e74bc6a2f5321
 2024-10-21 14:24:27 +00:00
drh
c43d16d69a In testrunner.tcl, correctly capture and display information about the 
system under test:  hostname, OS, pointer size, byte-order.

FossilOrigin-Name: ec75cfc5d4b69e4aed64d17748cac15cd62a759a1cbe7feaa4580ad8346b0b95
 2024-09-06 13:13:25 +00:00
drh
dc181d41d5 Fix a testrunner status reporting problem introduced by [aa5f10f21dbfb24e]. 
FossilOrigin-Name: d20c65c3b4256a662ebf7ed024b7b7adaceca90358f58111dc645da322000794
 2024-09-05 23:40:13 +00:00
drh
4987c5c3c2 Testrunner.tcl enhancements: (1) Attempt to build the SQLite tcl extension 
if it is not already available.  (2) testrunner target "devtest" is added as
an alias for "mdevtest".  (3) Try to keep summary information at the end of
a test below 80-characters per line.  (4) Update the Makefile.in so that
the "clean" target removes the tcl extension built by item 1 above.

FossilOrigin-Name: aa5f10f21dbfb24ee54ca96bfb7b013ae29e26fec05b80681f19cc63d9face49
 2024-09-05 15:28:15 +00:00
drh
21e7816e65 Enhance testrunner.tcl to keep track of the platform and SQLite version 
as reported by individual test cases and to report that information in the
summary at the end of each test run.

FossilOrigin-Name: 80ebb7c7e686cd936ac834f2258f585a7004762593e0bc859ecd75d6fb0badfd
 2024-09-05 12:06:45 +00:00
drh
6aedd6d9fc Faster implementation of the aggregate_test_counts procedure inside of 
testrunner.tcl.

FossilOrigin-Name: a01d869520329fb9e786cdc65f359785a95d19d289e4c6b844c758d6e5385aaf
 2024-09-05 11:46:43 +00:00
drh
109025c0a4 Put a proper shebang at the start of the testrunner.tcl script and make the 
script executable.

FossilOrigin-Name: c0c6e9abebf76358625f30a179658319b260baba6eded2a4c5ad356143e36f97
 2024-09-04 13:42:19 +00:00
drh
c81ab76cd9 Add the "joblist" command to testrunner.tcl 
FossilOrigin-Name: f64469f4806d4d5d7103c171a37a542c7aab9db09a226bccd8411e9ccd55353d
 2024-09-04 11:22:47 +00:00