WebStat analyser/src/sql/selectUninsertableLines.sql, branch webstat-0.7.1WebStat web site access analyserhttp://git.randomdan.homeip.net/repo/webstat/atom?h=webstat-0.7.12026-07-04T19:19:34ZInsert uninsirtable lines using the hostnameId recorded in the bad_lines table2026-07-04T19:19:34ZDan Goodliffedan@randomdan.homeip.net2026-07-04T19:19:34Zurn:sha1:870aa90c005f77a73445f5c39f9fd9bbb7604fe8
Includes the same fix from the previous commit which stops caching
entities until the inserts are complete.
Updates storeLogLine to take an insert command with the hostnameId
already bound.
Include extra details when storing unparsable and uninsertable lines.2026-07-04T18:36:30ZDan Goodliffedan@randomdan.homeip.net2026-07-04T11:11:38Zurn:sha1:61e106fe6a15f76b73125682e91d5c17ee875be2
Now includes the hostnameId, timestamp and optionally error message.
Updates idx_entities_retryinsert to account for details not being NULL.
Also fixes the issue where the entities inserted and rollback would
still be recorded in the entity cache if the access log insert failed.
This would have lead to PK violations later on.
Select uninsertable is for update2026-06-08T22:36:01ZDan Goodliffedan@randomdan.homeip.net2026-06-08T22:36:01Zurn:sha1:856527b65e3c4807cf2bfb9d0e495d9712d56a90
This prevents other instances acting on the same rows in parallel,
potentially duplicating the rows and effort.
Run the retry uninsertable process batched2026-05-18T23:36:50ZDan Goodliffedan@randomdan.homeip.net2026-05-18T23:36:50Zurn:sha1:b298237a297cb70640c85c016b702a35ecafd9b9
Standard sized batch in a transaction, ordered by entity id.
Includes early exit if terminated.
Add job to retry insertion of log lines which had previously failed2026-05-18T19:43:51ZDan Goodliffedan@randomdan.homeip.net2026-05-18T19:43:51Zurn:sha1:e1a6654bd5e284842ffbc3b93bd390f3bad7a187
Entities are reparsed and reinserted, removed on success.
Failure to parse updates the entity type to UnparsableLine.
Failure to insert again updates the detail with the reason.