| Commit message (Collapse) | Author | Age | |
|---|---|---|---|
| * | Add job for puring old access log entries from the databaseHEADmain | Dan Goodliffe | 2025-12-20 |
| | | |||
| * | Refactor handling of new entity insert | Dan Goodliffe | 2025-10-15 |
| | | | | | | Replaces weird select with one thing with a function pointer stored in the type definition array. | ||
| * | Fix premature remembering of saved entity idswebstat-0.2.1 | Dan Goodliffe | 2025-10-09 |
| | | | | | | | | Don't persist entity ids saved to the DB until the transaction is committed. Prevents the issue where a later DB operation fails, the transaction is rolled back, but we still think the entity has been saved. | ||
| * | Add parked line import jobwebstat-0.2 | Dan Goodliffe | 2025-10-06 |
| | | | | | Periodically, on idle, scan for and import previously parked lines. | ||
| * | Add point to execute scheduled jobs when idle | Dan Goodliffe | 2025-10-02 |
| | | |||
| * | Write log lines to files on error | Dan Goodliffe | 2025-09-30 |
| | | | | | | We call this parking, later we can reattempt ingestion after whatever caused the failure has been fixed. | ||
| * | Create settings structure | Dan Goodliffe | 2025-09-24 |
| | | | | | | | | Holds all the settings and their defaults for use in program_options and tests. Disables missing-field-initializers in tests because its over sensitive to structures with defaults where you only provide some values specifically. | ||
| * | Write unparsable lines to the entity table | Dan Goodliffe | 2025-09-23 |
| | | | | | Diagnostics and the ability to ingest later. | ||
| * | Make DB pool protected for access from unit tests | Dan Goodliffe | 2025-09-23 |
| | | |||
| * | Create and perform UA lookup curl op when new user agent is encountered | Dan Goodliffe | 2025-09-13 |
| | | |||
| * | Perform background curl operations when not processing log input | Dan Goodliffe | 2025-09-13 |
| | | |||
| * | Always pass API URL to curlGetUserAgentDetail | Dan Goodliffe | 2025-09-13 |
| | | |||
| * | Use curl_multi_poll in main ingestLog loop | Dan Goodliffe | 2025-09-10 |
| | | | | | Preparation step for having background curl operations. | ||
| * | Store utsname details in the host's detail field | Dan Goodliffe | 2025-09-02 |
| | | |||
| * | Use a DB connection pool rather than a single connection | Dan Goodliffe | 2025-09-01 |
| | | |||
| * | Insert new entities and log entry in a transaction | Dan Goodliffe | 2025-08-25 |
| | | | | | If no new entities are required, no transaction is created. | ||
| * | Merge storeEntities into a single thing | Dan Goodliffe | 2025-08-25 |
| | | | | | Add visitSum for tuples and makes storeEntities into a single lambda. | ||
| * | Track existing entities, don't attempt reinsert | Dan Goodliffe | 2025-08-25 |
| | | | | | | This is an ever growing set, but in theory should be finite, and is only 4bytes per entity. | ||
| * | Return count of entities passed to the database | Dan Goodliffe | 2025-08-25 |
| | | |||
| * | Store log lines in full using entity ids | Dan Goodliffe | 2025-08-25 |
| | | |||
| * | Store the entities for each log line | Dan Goodliffe | 2025-08-25 |
| | | |||
| * | Provide hostname to Ingestor | Dan Goodliffe | 2025-08-25 |
| | | | | | Store its Entity immediately for later use. | ||
| * | Add helpers and SQL for storing an entity | Dan Goodliffe | 2025-08-25 |
| | | |||
| * | Pass a DB connection to Ingestor | Dan Goodliffe | 2025-08-25 |
| | | |||
| * | Setup moveable/non-copyable special members on Ingestor | Dan Goodliffe | 2025-08-25 |
| | | |||
| * | Add helpers for hashing values extracted from log input | Dan Goodliffe | 2025-08-25 |
| | | | | | | zlib's crc32 used here, the interface is a bit C and as a result a bit casty, but it'll work. | ||
| * | Initial commit; basic Apache log parsing | Dan Goodliffe | 2025-08-25 |
