Thanks @mikemitchell for the extra info, this is very helpful!
Re. getting the data into Influx, I have to admit my knowledge of Telegraf is limited. Since it belongs to the Influx stack, it may be better to get some advice on the Influx forum. There’s a “Collect” category where I’ve seen similar topics being discussed.
Of course if you happened to have a Python script or similar that’s used for data ingestion (like OP @msaenen77), then adding timestamps through that would be pretty straightforward.
Got you - I didn’t fully realize that real-time visualization is the goal here (it didn’t seem to be in OP’s post). This does indeed change the picture a little, though I feel like it should still be workable through Grafana. Maybe consider the following two points:
- Grafana’s support for streaming data has been steadily improving, and I believe is currently quite mature. Check out How to Stream Sensor Data with Grafana and InfluxDB | Grafana Labs and Grafana 7.4 released: Next-generation graph panel with 30 fps live streaming, Prometheus exemplar support, trace to logs, and more | Grafana Labs
- Even without “true” live streaming, you can in practice set the Grafana refresh rate to something super-quick like 0.1s or 0.2s (5-10Hz), which is (a) fast enough to appear as a smooth flow to a human observer, and (b) in many cases something that your server/network/browser can cope with - even if you’re loading the whole chart (~1,000 data points) with each request. YMMV wildly, of course, but might be worth a shot. See Lowest Refresh Rate Now 5s? and Configure Grafana | Grafana documentation about enabling fast refresh rates.
Good luck! Would love to hear how you get on in the end.