Source data in json, best way to render dashboard

Grafana InfluxDB
1

Hi,
I’m new to Grafana and its systems around grafana.

Just installed Grafana with influxdb for my proof of concept. It’s Amazing!

My request for today is. I will be receiving source data in json format. What is the best option to get into influxdb (or any other db) so Grafana can read data and render dashboard please?

I know, its more on the database, but would really appreciate if you could give me some suggestions/recommendation please

Thinking of these

  1. what is the best db in my scenario?
  2. or we should have a plugin to covert json to influxbd (going to request influxdb support as well)
  3. What grafana suggest in my scenario

thanks,
ravee

2

I will be receiving source data in json format.
What is the best option to get into influxdb (or any other db) so Grafana
can read data and render dashboard please?

telegraf.

Thinking of these

  1. what is the best db in my scenario?

We don’t know unless you tell us what your scenario is :slight_smile:

For example: what sort of data are you delaing with, how many samples per
second / minute / hour are you expecting to receive, what sort of queries do
you need to do on that data to get Grafana to show it to you?

  1. or we should have a plugin to covert json to influxbd (going to request
    influxdb support as well)

See above - use telegraf.

Just to make things clear (since you mention a “plugin”) - Grafana does not
store data. Grafana helps you to visualise the data which it fetches from a
back-end data store, such as InfluxDB. There are many different data stores
which Grafana supports, and the best one for your needs will be determined by
the type and quantity of data you’re dealing with, the type of queries you
need Grafana to do on it (Grafana can only perform queries supported by the
data store query language) and, to some extent, which you are most familiar
with.

  1. What grafana suggest in my scenario

I have no idea what that question means.

Regards,

Antony.

3

Thanks @pooh / Antony, tor taking time and providing your inputs.
Sorry, I provided only limited info but still you cracked it :slight_smile:

I will come back with more details probably early next week.

thanks again,
ravee

4

Hi @pooh, pls check the sample json produced by a Jenkins job. could you kindly help with help me with the telegraf config file to parse this sample json please?

few more requests

  1. from below sample json, we can to skip “failures”…we dont need to store them in influxdb
  2. how to add custom name value pair using telegraf config? e.g “projects” : “example1.com”

File Location

/tmp/inputJson/inputJson.json

{
“features”: 1,
“ignored”: 0,
“efficiency”: 0.9173416027641461,
“failures”: {
“services.Example.Shakeout.templateShakeout”: “templateShakeout.feature:42}”
},
“totalTime”: 905677.604285,
“threads”: 5,
“scenarios”: 52,
“failed”: 39,
“passed”: 13,
“version”: “0.9.6.RC2”,
“elapsedTime”: 197457
}

5

Sorry, I’m not familiar with using the JSON input format; I just knew it
existed and pointed you at the documentation for it.

I use telegraf, but in a much simpler way than this.

I’m sure there are other people here who know a lot more about it than I do,
and may be able to answer your questions.

Regards,

Antony.

6

no worries antony, thanks again for pointing out those. :slight_smile:

7

Hi @pooh, actually your initial suggestion help. I tried inputs.file (with data_format=“json”) and I can see my json data in the table. I didn’t recognize my own test data…how silly I am :slight_smile:

But I think, its reading the same file again and again and creating duplicates records.

Anyone has a better suggestions to handle json files please?

8

I have used kafka_consumer plugin and output plugin is influxdb and data_format is influx . Data is present in influxdb but not able to see it in grafana.
What is the issue . Is there any time issue . anyone can help here