Support for InfluxDB Line Protocol (ILP) and (extended) annotated CSV formats

[amotl]

Dear Ivan,

we've unlocked the InfluxDB line protocol in Python on behalf of the influxio program we conceived the other day, building upon the excellent line-protocol-parser package by @Penlect. Support for annotated CSV is in the backlog. Example files are available within a repository at @influxdata.

• https://docs.influxdata.com/influxdb/v1/write_protocols/line_protocol_tutorial/
• https://docs.influxdata.com/influxdb/v2/reference/syntax/line-protocol/
• https://docs.influxdata.com/influxdb/v2/reference/syntax/annotated-csv/
• https://docs.influxdata.com/influxdb/v2/reference/syntax/annotated-csv/extended/

Do you think understanding those formats would be a viable addition to iterabledata and undatum? While I am probably too busy elsewhere, feel free to cherry-pick any code from influxio if this idea resonates with you. ¹

With kind regards,
Andreas.

Footnotes

1. Saying this, I might be able to come up with a patch when I'm lucky and hear positive signals from you, but please don't count on it. In this spirit, I just wanted to present this a pitch today, to find out about general resonance with you and the community. 🌻 ↩

[ivbeg]

Thanks, I will take a look

[ivbeg]

Hi @amotl ! I've added support for ILP https://github.com/datenoio/iterabledata/blob/main/docs/docs/formats/ilp.md and Annotated CSV https://github.com/datenoio/iterabledata/blob/main/docs/docs/formats/annotatedcsv.md

But I don't have test files to be sure that all edge cases covered. It would be greate if you could share a few samples.

[amotl]

Wow, that was fast. 🪂

Example files are available within a repository at @influxdata.

[amotl]

Two more test files, also including umlauts and possibly other specialities compared to standard ILP files.

-- https://github.com/daq-tools/influxio/tree/main/tests/testdata