How to add Regex to a TextBox Variable and use it inside a Query to visualize data from Elasticsearch

[yosiasz]

ok let’s try this approach if you are willing, instead of elastic search datasource you can try using infinity plugin that gives you more flexibility on what you are trying to do with modifying things as you want to.

[roleyroley]

I’ll try the infinity plugin!!
I’ll keep posted here about my progress.

Appreciate everyone’s help, thanks a ton!

[yosiasz]

check this thread out.

Transfrom JSON array to String in table view

What Grafana version and what operating system are you using? 8.1, Mac What are you trying to achieve? In my elasticsearch, I have documents stored in the following format { "start": 1656603585607, "end": 1656613809357, "result": false, "testRuns": [ { "testEnvironment": null, "totalSkipped": 0, "totalFailed": 0, "totalCount": 172, "totalPassed": 172, "totalFlaky": 0, "flakyTests": {}, "failingTests": [], "passed": true, "stopOnFail": true, "name": "Smoke Tests" }, { "testEnvironment": …

and others like it that deal with elastic search and infinity. You can also leverage Dynamic Text to make your es endpoint calls via fetch. etc

[yosiasz]

And another one

Grafana Elastic Failed to display Node graph

Hello, I would like to display node graph in my dashboard using ElasticSearch as the data source. I tried to push into an index with this data that was made based on the documentation in Node graph | Grafana documentation But the thing is, the data is not shown. I am currently using Grafana v9.1.7 and ElasticSearch 8.4.2 This is the sample JSON data that I push to ElasticIndex. Is there any example that I can use? { "nodes": [ { "id": "node1", "title": "Command 1", "subtitle": "Su…

Here it is with opensearch I spun up with sample data flight

[yosiasz]

Continuing this thread. So @roleyroley did you try the above approach and did it not work for you? if you do not want to use the above recommendation or it did not work for you, from your Serial Number what part of it do you want to extract and concatenate

Using Regex/Substring of a Template Variable and adding it to a Query Elasticsearch db

Grafana Version - Grafana v10.0.2 (b2bbe10fbc) Operating System - Windows 11 What are you trying to achieve - I want to use Regex / Substring operation on a Template Variable called $SerialID How are you trying to achieve it - 1. I created a TextBox Template variable with the name SerialID which takes a 16 character user input. 2. The database source is Elasticsearch logs. 3. I need to extract substring from index 5-12 of the 16 character $SerialID value, and then use it to query a field …

[roleyroley]

Installing the plugin is going to take some time by admins(unfortunately I am not authorized to install anything new) -

I am trying to find a workaround until then. I saw this page Variable syntax | Grafana documentation

Which gives a brief about how to use variables with regex - any idea on how I can structure my query using this info?

[yosiasz]

Since you are trying to do conditional formatting of the $SerialID, I am not sure you can accomplish that other than using something else. imo

Also I do not see this approach documented ${SerialID:substring(5.9)} Can you point us to where you got this?

[roleyroley]

This approach is not documented - This is something I would like to try out or hope to achieve. I’m sorry if it was misleading.

[yosiasz]

not misleading, it was just in case I missed some new feature.

[roleyroley]

Hi @yosiasz ,

some updates - I configured the Infinity Data source plugin and tried a query on the Jsonata Excercizer to filter out the results - https://try.jsonata.org/I71uy_vY7

The problem I’m facing right now is that this query doesnt visualize the result in my dashbaord.

Query:

The Response seems to return all the objects in the test data:

Do you happen to know where I could be going wrong?

[roleyroley]

The solution to the above substring problem is:

parse-json
  scope "hits.hits"
  jsonata "*[_id=$string($substring('${BSN_Long}',5,4)&$substring('${BSN_Long}',11,4))][]"