WebStat analyser/test, branch webstat-0.2 WebStat web site access analyser http://git.randomdan.homeip.net/repo/webstat/atom?h=webstat-0.2 2025-10-06T19:43:52Z Add parked line import job 2025-10-06T19:43:52Z Dan Goodliffe dan@randomdan.homeip.net 2025-10-06T19:43:52Z urn:sha1:63d6bf7395425be73fd6d9f5c89dc48817afffe6 Periodically, on idle, scan for and import previously parked lines. Switch to PostgreSQL's oid type for entity ids 2025-09-29T23:51:54Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-29T23:51:54Z urn:sha1:edfaf671d016f675a3a3b87d58d615a92e84148b oid is an "unsigned 4 byte integer", which matches our crc32 approach perfectly, and is half the storage cost of bigint. Write log lines to files on error 2025-09-29T23:50:29Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-29T23:50:29Z urn:sha1:3e99d080b2a3a9b6eae85ae9e3224534744ad7b9 We call this parking, later we can reattempt ingestion after whatever caused the failure has been fixed. Create settings structure 2025-09-24T20:33:13Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-24T20:28:56Z urn:sha1:897546d596d8d7213cff60146123bb8f97d4d1cc Holds all the settings and their defaults for use in program_options and tests. Disables missing-field-initializers in tests because its over sensitive to structures with defaults where you only provide some values specifically. Write unparsable lines to the entity table 2025-09-23T12:31:26Z Dan Goodliffe dan.goodliffe@octal.co.uk 2025-09-23T12:31:26Z urn:sha1:71803b97f1c9e31f2027da48bb742353f9c43e62 Diagnostics and the ability to ingest later. Create and perform UA lookup curl op when new user agent is encountered 2025-09-13T12:24:23Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-13T12:24:23Z urn:sha1:84bd17328a4dc027e689ca7b2a85744d6e2b7cf5 Always pass API URL to curlGetUserAgentDetail 2025-09-13T12:23:36Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-10T23:01:46Z urn:sha1:c8f0fb73e49f6b6b6ac1690c585c25ab7dbd2b88 Add test over mocked user agent fetch 2025-09-09T22:24:35Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-09T22:24:35Z urn:sha1:2eb8897706128f3590a5b4f9ee8f3e755b74f097 Uses a file:// URL to curl fetch a local fixture. Add test over Ingestor::ingestLog 2025-09-08T22:39:09Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-08T22:39:09Z urn:sha1:bdaa314b7eacc7cd41dbf09f8f8ea6d742c3ea37 Use a TestIngestor as a fixture in tests 2025-09-08T22:27:41Z Dan Goodliffe dan@randomdan.homeip.net 2025-09-08T22:24:36Z urn:sha1:c6cc3f08638c6a863dd315b8b5a6b667ae51ee84