How the Grafana Kafka library offset is read data, it will read from the memory or from the temp folder?

Hello,

I am using Grafana v12.1.1.

I am reading data using the Grafana Kafka data source/library, and I want to clarify how it handles offsets:

  • Does the library read offsets from memory, or does it read from kafka temporary folder?

  • I am facing an issue where, after refreshing the dashboard, Grafana does not show previously buffered Kafka data. Instead, it only starts streaming from the live offset, ignoring the earlier messages.

Is this the expected behavior, or is there a configuration to make Grafana also show the recent historical Kafka data when refreshing the dashboard?

Thanks in advance.