WebStat analyser/src/schema.sql, branch webstat-0.7WebStat web site access analyserhttp://git.randomdan.homeip.net/repo/webstat/atom?h=webstat-0.72026-07-04T19:19:34ZInsert uninsirtable lines using the hostnameId recorded in the bad_lines table2026-07-04T19:19:34ZDan Goodliffedan@randomdan.homeip.net2026-07-04T19:19:34Zurn:sha1:870aa90c005f77a73445f5c39f9fd9bbb7604fe8
Includes the same fix from the previous commit which stops caching
entities until the inserts are complete.
Updates storeLogLine to take an insert command with the hostnameId
already bound.
Include extra details when storing unparsable and uninsertable lines.2026-07-04T18:36:30ZDan Goodliffedan@randomdan.homeip.net2026-07-04T11:11:38Zurn:sha1:61e106fe6a15f76b73125682e91d5c17ee875be2
Now includes the hostnameId, timestamp and optionally error message.
Updates idx_entities_retryinsert to account for details not being NULL.
Also fixes the issue where the entities inserted and rollback would
still be recorded in the entity cache if the access log insert failed.
This would have lead to PK violations later on.
Partition the entities table2026-06-30T15:49:25ZDan Goodliffedan.goodliffe@octal.co.uk2026-06-30T15:49:25Zurn:sha1:3cc7a1b1c0bf84ffcb149741c9ca2c60d9f00068
Splits up the entities by type, updates the access_log foreign keys to
reference the specific table, removes now redundant indices which
existed only for processing removal of bad lines.
Fix uniqueness of entities2026-06-29T08:33:57ZDan Goodliffedan.goodliffe@octal.co.uk2026-06-29T08:33:57Zurn:sha1:26eda4262fa99888e254e9c19b40c04b2a29a75c
Should be unique for value and type, they're not just strings, they can
be different things with the same value... Albeit rarely.
Fix entity function sometimes returning null/wrong id2026-06-28T17:47:14ZDan Goodliffedan@randomdan.homeip.net2026-06-28T17:47:14Zurn:sha1:ad2a2ff05af8df1ba552d906e377afa345a449a7
Includes tests over the errant behaviour.
Didn't match on type and control flow could return multiple rows.
Increase size field to 64bit and fix scan types2026-06-27T12:05:03ZDan Goodliffedan@randomdan.homeip.net2026-06-27T12:05:03Zurn:sha1:22a85bd4e1f6005455b91bb3edff68d4019526a1
2^31 not big enough for large file downloads, bumped to 64bit.
Replace woolly types with specific uintXX_t in scn call.
Remove the PK id column from access_log2026-06-27T11:52:28ZDan Goodliffedan@randomdan.homeip.net2026-06-27T11:52:28Zurn:sha1:1a7c5329d07d9d961899aa7c85f9bd56fc06cb2d
Not actually required, should we need to reference a specific row, we
can use the ctid column.
Add index for uninsertable lines with no failure detail2026-05-18T23:53:27ZDan Goodliffedan@randomdan.homeip.net2026-05-18T23:53:27Zurn:sha1:cabd894779c2d2e453c8ed7771fdbd17c881bc2c
This index would be empty under normal conditions.
Be specific about values from entities table2026-05-09T23:41:56ZDan Goodliffedan@randomdan.homeip.net2026-05-09T23:41:56Zurn:sha1:5111c39ad9c1665347471da9fc1ae5737e37cde5
Fixes compatibility with PostgreSQL 18 which fails due to ambiguity.
Only call entity insert handler if detail is null2026-05-05T11:24:11ZDan Goodliffedan.goodliffe@octal.co.uk2026-05-05T11:24:11Zurn:sha1:200c3636b600ac2f997316612f1b1321112496cd
Improves handling of entity inserts where the entity already exists and
already has detail; does not call the onInsert handler. This avoids
repeatedly fetching UA detail every time the UA is first seen by a
process.