WebStat analyser/src/webstat_logger_main.cpp, branch webstat-0.6WebStat web site access analyserhttp://git.randomdan.homeip.net/repo/webstat/atom?h=webstat-0.62026-06-08T11:31:07ZRemove the purge time limit2026-06-08T11:31:07ZDan Goodliffedan.goodliffe@octal.co.uk2026-06-08T11:31:07Zurn:sha1:ee9517e452376bc4963aa3a43ca90ebb9d710b85
This is a background job, has been for a while, so we can sanely allow
it to run for as long as is required.
Add job to retry insertion of log lines which had previously failed2026-05-18T19:43:51ZDan Goodliffedan@randomdan.homeip.net2026-05-18T19:43:51Zurn:sha1:e1a6654bd5e284842ffbc3b93bd390f3bad7a187
Entities are reparsed and reinserted, removed on success.
Failure to parse updates the entity type to UnparsableLine.
Failure to insert again updates the detail with the reason.
Remove maxBatches2026-05-13T14:01:30ZDan Goodliffedan.goodliffe@octal.co.uk2026-05-13T14:01:30Zurn:sha1:868446ad4d8ba33053b048dd4d82b6d4f5328f07
It's not required; DB insertion occurs only in a background thread now.
Limit the number lines stored at once2026-05-01T09:32:48ZDan Goodliffedan.goodliffe@octal.co.uk2026-05-01T09:32:48Zurn:sha1:1c929e46d8e7b14a74f80a21b5f30c9abbee410f
Limits the number lines inserted per transactions, and the number of
transactions before returning to reading input.
Prevents long running transactions in the case when queued lines has
grown in size.
Add logging :-o2026-03-20T23:48:32ZDan Goodliffedan@randomdan.homeip.net2026-03-20T23:48:32Zurn:sha1:05c47ab65e73b16887b7c7a1eb31acf6d364ef41
Adds virtual log function, real implementation writes to syslog.
Test implementation writes to BOOST_TEST_MESSAGE, perf implementation
discards.
Replaces existing prints to stderr and adds logs to all key points.
Insert log entries in batches2026-03-20T02:23:08ZDan Goodliffedan@randomdan.homeip.net2026-03-20T02:17:04Zurn:sha1:0f5a0a8e2d43774288d4d6ea747278ca6e085a2a
Store log lines in memory until threshold is reach or idle occurs, then
insert all the lines in a single transaction. Save points handle the
case of insertion errors. On success the queue is cleared.
Parked lines also saved in bulk, only necessary if queued lines could
not be inserted on shutdown, else the queue simply grows until ability
to insert is restored. Importing parked lines just adds them to the
queue and the normal process then follows.
Execute jobs even when processing incoming logs2026-03-17T11:48:34ZDan Goodliffedan.goodliffe@octal.co.uk2026-03-17T11:48:34Zurn:sha1:d2ecb7f49c3f3b60e3d1f297fd033071a02cfa9a
Jobs run on background threads now, so we can happily run them even when
we're busy.
Add job for puring old access log entries from the database2025-12-20T15:16:25ZDan Goodliffedan@randomdan.homeip.net2025-12-20T15:16:25Zurn:sha1:30a9d45f5322a63c2adf1de7a248ba3a9a0c3903Add support for configuring frequency of parked line job2025-12-20T15:12:53ZDan Goodliffedan@randomdan.homeip.net2025-12-20T15:12:53Zurn:sha1:4a640858b83120bee217d91339f7bc39175989c1Add point to execute scheduled jobs when idle2025-10-02T22:42:52ZDan Goodliffedan@randomdan.homeip.net2025-10-02T22:42:52Zurn:sha1:5aa9cca0d2ff25c541d7df3b63519c28eb75b656