Connection lost with InfluxDB when using particular database

I am using Grafana 7.5.5 on an Ubuntu machine to display data stored in InfluxDB 1.8 in a different Ubuntu machine.

To do that I created a connection pointing to InfluxDB. When saving data source, Half of the time I get this error: InfluxDb Error: database not found : <database_name>, the other half the connection is correctly made.

I tried to use the connection to display some data. However, I faced the same issue, the InfluxQL requests are not always correctly executed.

I did some troubleshooting by executing the requests manually on the instance. I had no problems with that.

I checked Grafana logs, I received nothing suspicious . Same goes for InfluxDb.

I am using Grafana 7.5.5 on an Ubuntu machine to display data stored in
InfluxDB 1.8 in a different Ubuntu machine.

To do that I created a connection pointing to InfluxDB.

Is that specified as an IP address or as a hostname?

If it’s a hostname, can you confirm that it resolves to just the single address
of the InfluxDB server?

When saving data source, Half of the time I get this error: InfluxDb
Error: database not found : <database_name>
, the other half the
connection is correctly made.

Do you have any opportunity to do a packet capture on either the machine
running Grafana or the machine running InfluxDB to look at communications going
to (presumably) TCP port 8086 on the InfluxDB machine, to check whether the
correct DB name is being requested every time, and sometimes failing, or
whether the correct name is only sometimes beign requested?

I tried to use the connection to display some data. However, I faced the
same issue, the InfluxQL requests are not always correctly executed.

Again, a packet capture would help here, I think.

Make sure that there is a communication every time you do a query, and also
look at what the query is - whether it contains the correct, or perhaps some
corrupted, database name.

I did some troubleshooting by executing the requests manually on the
instance. I had no problems with that.

Good, that confirms that the queries work.

Antony.

Unfortunately, I can’t perfor a packet capture on both instance as I am only a user.
For the connection to influx, I am using a load balancer redirecting grafana to it.

“For the connection to influx, I am using a load balancer redirecting grafana
to it.”

That looks interesting (in the light of your problems) to me.

What logging / auditing information do you have for this load balancer to see
what queries it gets and what responses it returns?

Have you checked both/all back-end servers which this load balancer points to,
to ensure that they all have the database you’re looking for?

Antony.

1 Like