hi,
today i found that the exported data from a csv export is not the same which provided by the datasource to the graph panel.
i know that the graph panel make “data tuning” for better visualisation, but my expectation for the CSV export was that the “raw” data will be exported.
Is there a way to achieve this?
kind regards
Bernd
What do you mean by “data tuning”? Grafana mostly just shows the data returned from the query (there are a few exceptions like aggregation options in the SingleStat panel).
sorry, you are right. at the visualisation everything works fine
The problem is actualy just exporting data as columns, here are the datapoint not correctly merged.
I attached a screenshot to clarify it with example data.
At the left side shows a correct export as rows, at the right side you see an incorrect export as columns:
What does that mean exactly? What is wrong with the data exported as columns?
Thanks for the explanation. There is a bug report in Grafana that matches this (as there are no other reports, seems like this feature is not used much or this is an unusual bug):
I took a very small sample of data with just a few data points and exported to columns and it was correct.
If you zoom in on your graph and then do an export is the result still incorrect?
after zooming the result is still incorrect
I paste my data below, maybe you can try it with it ? (upload is only for images available)
Series;Time;Value
Dampfmengen_Abhitze;2017-08-11T07:58:14.000Z;3,428000053
Dampfmengen_Abhitze;2017-08-11T07:59:21.000Z;3,829999924
Dampfmengen_Abhitze;2017-08-11T08:00:54.000Z;3,09214282
Dampfmengen_Abhitze;2017-08-11T08:02:04.000Z;2,360000014
Dampfmengen_Abhitze;2017-08-11T08:03:25.000Z;2,491799974
Dampfmengen_Abhitze;2017-08-11T08:04:34.000Z;3,238333305
Dampfmengen_Abhitze;2017-08-11T08:05:54.000Z;3,624000072
Dampfmengen_Abhitze;2017-08-11T08:07:14.000Z;2,857799959
Dampfmengen_Abhitze;2017-08-11T08:08:48.000Z;2,315000057
Dampfmengen_Abhitze;2017-08-11T08:10:34.000Z;2,89920001
Dampfmengen_Abhitze;2017-08-11T08:11:37.000Z;3,508999983
Dampfmengen_Abhitze;2017-08-11T08:13:14.000Z;3,694499969
Dampfmengen_Abhitze;2017-08-11T08:14:14.000Z;2,80250001
Dampfmengen_Abhitze;2017-08-11T08:15:54.000Z;2,362500072
Dampfmengen_Abhitze;2017-08-11T08:17:24.000Z;2,937749922
Dampfmengen_Abhitze;2017-08-11T08:18:42.000Z;3,626250029
Temperatur_vor_Endkühler;2017-08-11T07:58:15.350Z;107,234834
Temperatur_vor_Endkühler;2017-08-11T07:59:15.727Z;107,2369989
Temperatur_vor_Endkühler;2017-08-11T08:00:16.126Z;107,3015823
Temperatur_vor_Endkühler;2017-08-11T08:01:16.507Z;107,3984541
Temperatur_vor_Endkühler;2017-08-11T08:02:16.902Z;107,6118178
Temperatur_vor_Endkühler;2017-08-11T08:03:17.299Z;107,7841825
Temperatur_vor_Endkühler;2017-08-11T08:04:17.690Z;107,6680005
Temperatur_vor_Endkühler;2017-08-11T08:05:18.087Z;107,6384169
Temperatur_vor_Endkühler;2017-08-11T08:06:18.474Z;107,8606669
Temperatur_vor_Endkühler;2017-08-11T08:07:18.871Z;108,1498337
Temperatur_vor_Endkühler;2017-08-11T08:08:19.265Z;108,4806665
Temperatur_vor_Endkühler;2017-08-11T08:09:19.678Z;108,6970838
Temperatur_vor_Endkühler;2017-08-11T08:10:20.082Z;108,0962499
Temperatur_vor_Endkühler;2017-08-11T08:11:20.469Z;107,2770824
Temperatur_vor_Endkühler;2017-08-11T08:12:25.897Z;106,8882497
Temperatur_vor_Endkühler;2017-08-11T08:13:26.285Z;107,1929175
Temperatur_vor_Endkühler;2017-08-11T08:14:26.679Z;107,6766669
Temperatur_vor_Endkühler;2017-08-11T08:15:27.069Z;107,9150829
Temperatur_vor_Endkühler;2017-08-11T08:16:27.468Z;108,0140012
Temperatur_vor_Endkühler;2017-08-11T08:17:27.867Z;107,908584
Temperatur_vor_Endkühler;2017-08-11T08:18:28.243Z;107,8949165
Temperatur_vor_Endkühler;2017-08-11T08:19:28.631Z;108,1309967
@daniellee How I can add “Export CSV” to a custom panel?
Hi Gustavo,
I haven’t tried this out in a plugin but think this should work.
You can add an action using the init-panel-actions event in the constructor:
this.events.on('init-panel-actions', this.onInitPanelActions.bind(this));
Then add the action:
onInitPanelActions(actions) {
actions.push({ text: 'Export CSV', click: 'ctrl.exportCsv()' });
}
Then use the export csv directive in a modal like this:
exportCsv() {
const scope = this.$scope.$new(true);
scope.tableData = this.renderer.render_values();
scope.panel = 'table';
this.publishAppEvent('show-modal', {
templateHtml: '<export-data-modal panel="panel" data="tableData"></export-data-modal>',
scope,
modalClass: 'modal--narrow',
});
}
or like this if time series data:
exportCsv() {
const scope = this.$scope.$new(true);
scope.seriesList = this.seriesList;
this.publishAppEvent('show-modal', {
templateHtml: '<export-data-modal data="seriesList"></export-data-modal>',
scope,
modalClass: 'modal--narrow',
});
}
We have seen similar problems with data export. We are testing grafana v5.4.2. together with influxdb v1.5.2.
We also tried doing statistical evaluations of measurement time series (10-20s over several weeks). It’s temperature and flow rates (as impulse counts). The flow rate values should be summed up, too.
Our topics:
Basically grafana is an interesting chart tool but getting reliable statistical results is necessary.
Thanks in advance.
Hermann
Hi, is this feature also available on Grafana cloud? How do I go about adding code?
Grafana doesn’t typically export the raw underlying data from the data source - rather the CSV export feature exports “data frames” underlying what goes into visualizations and so on. Much more information here:
To get the raw data you can either query the data source directly without Grafana, or use the query inspector to see the raw results that come back from the query (albeit in a JSON format produced by the data source plugin)
Being able to export data in a convenient way is very important. It is really frustrating when you with Grafana find the data you are interested in, you try to export it according to the blog post linked above, and later you find out that much data is missing in the CSV file.
As I understand:
If the only solution is to query the data source directly without Grafana, one of our clients might even stop using Grafana.
(Could a related problem, which I think I have seen someone else writing about, be that sometimes short spikes in the data might not shown on dashboards, because perhaps only every tenth value is actually shown?)
Is there any working solution or planned solution in Grafana for this?
I have seen the “Grafana Data Exporter” on Github (GitHub - CorpGlory/grafana-data-exporter: Server for fetching data from Grafana datasources), but it does not seem to be maintained any longer, so I have not tried it yet.
I would solve this by linking to the export API of the data source in Grafana using actions if it is from a dashboard. For Prometheus results you would link to /api/1/v1/query or /api/v1/query_range if it is for Victoriametrics specifically there is an export api for raw samples or the Victoriametrics datasource can open the query in vmui where the results can be downloaded
Thank you for the reply, mathias18. I have done some tests with the export API of VictoriaMetrics. It is possible to export data in CSV format with the export API, but difficult to figure out how to get the desired format, for example with timestamps in the desired time zone, etc.
Also, Grafana can use several different data sources, but to teach users a different way to export data for each data source would be really inconvenient.
To do export from inside Grafana would be much more user friendly. And it already works, as described in the blog post, if the time range is not too long and “Max data points” is not too low. For example: If you in Grafana export one year of data but then only get every sixth value in the CSV file, it is possible to in Grafana export about two months of data at the time and that way get all data.
Hope there can be an interest to improve this in Grafana, when Grafana is so close.
Great news! For those of us who use VictoriaMetrics with Grafana, there is now an alternative way to export data from inside Grafana and overcome the “Max data points” limitation: I have recently tried the VictoriaMetrics datasource plugin, version 0.25.0. When editing a panel using that data source, you can use the “Export data” button shown below.
It can be used to export in JSON or CSV format. Just be aware that this CSV format is not exactly the same as with Grafana’s built-in solution (using Inspect Data).
