summaryrefslogtreecommitdiff
path: root/src/ingestor.hpp
Commit message (Collapse)AuthorAge
* Add parked line import jobwebstat-0.2Dan Goodliffe8 days
| | | | Periodically, on idle, scan for and import previously parked lines.
* Add point to execute scheduled jobs when idleDan Goodliffe12 days
|
* Write log lines to files on errorDan Goodliffe2025-09-30
| | | | | We call this parking, later we can reattempt ingestion after whatever caused the failure has been fixed.
* Create settings structureDan Goodliffe2025-09-24
| | | | | | | Holds all the settings and their defaults for use in program_options and tests. Disables missing-field-initializers in tests because its over sensitive to structures with defaults where you only provide some values specifically.
* Write unparsable lines to the entity tableDan Goodliffe2025-09-23
| | | | Diagnostics and the ability to ingest later.
* Make DB pool protected for access from unit testsDan Goodliffe2025-09-23
|
* Create and perform UA lookup curl op when new user agent is encounteredDan Goodliffe2025-09-13
|
* Perform background curl operations when not processing log inputDan Goodliffe2025-09-13
|
* Always pass API URL to curlGetUserAgentDetailDan Goodliffe2025-09-13
|
* Use curl_multi_poll in main ingestLog loopDan Goodliffe2025-09-10
| | | | Preparation step for having background curl operations.
* Store utsname details in the host's detail fieldDan Goodliffe2025-09-02
|
* Use a DB connection pool rather than a single connectionDan Goodliffe2025-09-01
|
* Insert new entities and log entry in a transactionDan Goodliffe2025-08-25
| | | | If no new entities are required, no transaction is created.
* Merge storeEntities into a single thingDan Goodliffe2025-08-25
| | | | Add visitSum for tuples and makes storeEntities into a single lambda.
* Track existing entities, don't attempt reinsertDan Goodliffe2025-08-25
| | | | | This is an ever growing set, but in theory should be finite, and is only 4bytes per entity.
* Return count of entities passed to the databaseDan Goodliffe2025-08-25
|
* Store log lines in full using entity idsDan Goodliffe2025-08-25
|
* Store the entities for each log lineDan Goodliffe2025-08-25
|
* Provide hostname to IngestorDan Goodliffe2025-08-25
| | | | Store its Entity immediately for later use.
* Add helpers and SQL for storing an entityDan Goodliffe2025-08-25
|
* Pass a DB connection to IngestorDan Goodliffe2025-08-25
|
* Setup moveable/non-copyable special members on IngestorDan Goodliffe2025-08-25
|
* Add helpers for hashing values extracted from log inputDan Goodliffe2025-08-25
| | | | | zlib's crc32 used here, the interface is a bit C and as a result a bit casty, but it'll work.
* Initial commit; basic Apache log parsingDan Goodliffe2025-08-25
generated by cgit v1.2.3 (git 2.46.0) at 2025-10-14 21:24:06 +0000