Commit message (Collapse) | Author | Age | |
---|---|---|---|
* | Write unparsable lines to the entity table | Dan Goodliffe | 2025-09-23 |
| | | | | Diagnostics and the ability to ingest later. | ||
* | Make DB pool protected for access from unit tests | Dan Goodliffe | 2025-09-23 |
| | |||
* | Gracefully handle fatal exceptions and display message | Dan Goodliffe | 2025-09-19 |
| | |||
* | Create and perform UA lookup curl op when new user agent is encountered | Dan Goodliffe | 2025-09-13 |
| | |||
* | Perform background curl operations when not processing log input | Dan Goodliffe | 2025-09-13 |
| | |||
* | Always pass API URL to curlGetUserAgentDetail | Dan Goodliffe | 2025-09-13 |
| | |||
* | Simplify storeEntities with bindMany | Dan Goodliffe | 2025-09-10 |
| | |||
* | Use curl_multi_poll in main ingestLog loop | Dan Goodliffe | 2025-09-10 |
| | | | | Preparation step for having background curl operations. | ||
* | Add test over mocked user agent fetch | Dan Goodliffe | 2025-09-09 |
| | | | | Uses a file:// URL to curl fetch a local fixture. | ||
* | Add test over Ingestor::ingestLog | Dan Goodliffe | 2025-09-08 |
| | |||
* | Use a TestIngestor as a fixture in tests | Dan Goodliffe | 2025-09-08 |
| | |||
* | Move fixture log file generator to test util | Dan Goodliffe | 2025-09-08 |
| | |||
* | Change getUserAgentDetail to return a packaged CURL object | Dan Goodliffe | 2025-09-05 |
| | | | | | This will be usable with curl_multi_* instead of being a single synchronous request. | ||
* | Replace DeleteWith lambda with a normal type | Dan Goodliffe | 2025-09-05 |
| | | | | Lambdas have internal linkage. | ||
* | Add function to grab UA details from useragentstring.com | Dan Goodliffe | 2025-09-04 |
| | |||
* | Add libcurl | Dan Goodliffe | 2025-09-04 |
| | |||
* | Move DeleteWith helper in src/util | Dan Goodliffe | 2025-09-04 |
| | |||
* | Store utsname details in the host's detail field | Dan Goodliffe | 2025-09-02 |
| | |||
* | Add bindMany helper | Dan Goodliffe | 2025-09-02 |
| | |||
* | Add entity detail column | Dan Goodliffe | 2025-09-02 |
| | |||
* | Tag entities with their typewebstat-0.1.1 | Dan Goodliffe | 2025-09-01 |
| | |||
* | Reuse same insert entity command | Dan Goodliffe | 2025-09-01 |
| | |||
* | Support configuring the DB pool | Dan Goodliffe | 2025-09-01 |
| | |||
* | Use a DB connection pool rather than a single connection | Dan Goodliffe | 2025-09-01 |
| | |||
* | Add MockDBPool | Dan Goodliffe | 2025-09-01 |
| | | | | Feels like this should be provided by libdbpp, but it isn't. | ||
* | Add basic boost::program_options support | Dan Goodliffe | 2025-09-01 |
| | |||
* | Add install ruleswebstat-0.1 | Dan Goodliffe | 2025-08-25 |
| | |||
* | Add an ingestor performance test | Dan Goodliffe | 2025-08-25 |
| | | | | Generates a random long file of random data and then ingests it. | ||
* | Move common test code to its own library | Dan Goodliffe | 2025-08-25 |
| | |||
* | Use SQL standard identity column | Dan Goodliffe | 2025-08-25 |
| | |||
* | Insert new entities and log entry in a transaction | Dan Goodliffe | 2025-08-25 |
| | | | | If no new entities are required, no transaction is created. | ||
* | Merge storeEntities into a single thing | Dan Goodliffe | 2025-08-25 |
| | | | | Add visitSum for tuples and makes storeEntities into a single lambda. | ||
* | Track existing entities, don't attempt reinsert | Dan Goodliffe | 2025-08-25 |
| | | | | | This is an ever growing set, but in theory should be finite, and is only 4bytes per entity. | ||
* | Return count of entities passed to the database | Dan Goodliffe | 2025-08-25 |
| | |||
* | Store log lines in full using entity ids | Dan Goodliffe | 2025-08-25 |
| | |||
* | Store the entities for each log line | Dan Goodliffe | 2025-08-25 |
| | |||
* | Provide hostname to Ingestor | Dan Goodliffe | 2025-08-25 |
| | | | | Store its Entity immediately for later use. | ||
* | Add helpers and SQL for storing an entity | Dan Goodliffe | 2025-08-25 |
| | |||
* | Pass a DB connection to Ingestor | Dan Goodliffe | 2025-08-25 |
| | |||
* | Setup moveable/non-copyable special members on Ingestor | Dan Goodliffe | 2025-08-25 |
| | |||
* | Add DB schema and setup a mock of it in testing | Dan Goodliffe | 2025-08-25 |
| | |||
* | Pull fixture log lines into shared global vars | Dan Goodliffe | 2025-08-25 |
| | |||
* | Add helpers for hashing values extracted from log input | Dan Goodliffe | 2025-08-25 |
| | | | | | zlib's crc32 used here, the interface is a bit C and as a result a bit casty, but it'll work. | ||
* | Initial commit; basic Apache log parsing | Dan Goodliffe | 2025-08-25 |