WebStat analyser, branch webstat-0.2.2WebStat web site access analyserhttp://git.randomdan.homeip.net/repo/webstat/atom?h=webstat-0.2.22025-10-10T01:57:00ZAllows handle curl things if there are any2025-10-10T01:57:00ZDan Goodliffedan@randomdan.homeip.net2025-10-10T01:57:00Zurn:sha1:b17d24ff83c92a9f90eabad8dc996bb26a436f9fFix premature remembering of saved entity ids2025-10-09T14:48:28ZDan Goodliffedan.goodliffe@octal.co.uk2025-10-09T14:48:28Zurn:sha1:1a9440ec3c1669c5e49825dde70b9cbede3f0de0
Don't persist entity ids saved to the DB until the transaction is
committed. Prevents the issue where a later DB operation fails, the
transaction is rolled back, but we still think the entity has been
saved.
Fix up QuotedString/CLFString parsing2025-10-09T13:26:40ZDan Goodliffedan.goodliffe@octal.co.uk2025-10-09T13:26:40Zurn:sha1:a7a082d8d471bc38f9aa1160b0e9f8daf3d35ba3
Refactors CLFString in terms of QuotedString, but with the optional of
being null (nullopt)
Moves the whole decode function into QuotedString's parser, fixing
support for escaping of " which would otherwise prematurely end the
string in the middle.
Add PROPFIND to http_verb list2025-10-09T13:21:30ZDan Goodliffedan.goodliffe@octal.co.uk2025-10-09T13:21:30Zurn:sha1:bc05a99df780313ba3cc298323e98beaa5b0ba54Add parked line import job2025-10-06T19:43:52ZDan Goodliffedan@randomdan.homeip.net2025-10-06T19:43:52Zurn:sha1:63d6bf7395425be73fd6d9f5c89dc48817afffe6
Periodically, on idle, scan for and import previously parked lines.
Add point to execute scheduled jobs when idle2025-10-02T22:42:52ZDan Goodliffedan@randomdan.homeip.net2025-10-02T22:42:52Zurn:sha1:5aa9cca0d2ff25c541d7df3b63519c28eb75b656Switch to PostgreSQL's oid type for entity ids2025-09-29T23:51:54ZDan Goodliffedan@randomdan.homeip.net2025-09-29T23:51:54Zurn:sha1:edfaf671d016f675a3a3b87d58d615a92e84148b
oid is an "unsigned 4 byte integer", which matches our crc32 approach
perfectly, and is half the storage cost of bigint.
Write log lines to files on error2025-09-29T23:50:29ZDan Goodliffedan@randomdan.homeip.net2025-09-29T23:50:29Zurn:sha1:3e99d080b2a3a9b6eae85ae9e3224534744ad7b9
We call this parking, later we can reattempt ingestion after whatever
caused the failure has been fixed.
Create settings structure2025-09-24T20:33:13ZDan Goodliffedan@randomdan.homeip.net2025-09-24T20:28:56Zurn:sha1:897546d596d8d7213cff60146123bb8f97d4d1cc
Holds all the settings and their defaults for use in program_options and
tests. Disables missing-field-initializers in tests because its over
sensitive to structures with defaults where you only provide some values
specifically.
Write unparsable lines to the entity table2025-09-23T12:31:26ZDan Goodliffedan.goodliffe@octal.co.uk2025-09-23T12:31:26Zurn:sha1:71803b97f1c9e31f2027da48bb742353f9c43e62
Diagnostics and the ability to ingest later.