Increasing timeout query to loki datasource

melori.arellano · January 11, 2022, 5:44pm

Hi @danielfablius, I did some digging and found that there’s a hardcoded timeout in the loki datasource when the fullRangeLogs_Volume feature flag is enabled in Grafana. From what I’ve found, it looks like it’s set to 10s (10000ms) while the feature is in beta to protect from long running queries:

github.com

grafana/grafana/blob/41b709d08d14457e1977526020d589d57f53b641/public/app/plugins/datasource/loki/datasource.ts#L74

    
      
          import { queryLogsVolume } from 'app/core/logs_model';
          import config from 'app/core/config';
          import { renderLegendFormat } from '../prometheus/legend';
          
          
export type RangeQueryOptions = DataQueryRequest<LokiQuery> | AnnotationQueryRequest<LokiQuery>;
          export const DEFAULT_MAX_LINES = 1000;
          export const LOKI_ENDPOINT = '/loki/api/v1';
          const NS_IN_MS = 1000000;
          
          
/**
           * Loki's logs volume query may be expensive as it requires counting all logs in the selected range. If such query
           * takes too much time it may need be made more specific to limit number of logs processed under the hood.
           */
          const LOGS_VOLUME_TIMEOUT = 10000;
          
          
const RANGE_QUERY_ENDPOINT = `${LOKI_ENDPOINT}/query_range`;
          const INSTANT_QUERY_ENDPOINT = `${LOKI_ENDPOINT}/query`;
          
          
const DEFAULT_QUERY_PARAMS: Partial<LokiRangeQueryRequest> = {
            direction: 'BACKWARD',
            limit: DEFAULT_MAX_LINES,

Topic		Replies	Views
Loki won't excecute large queries Grafana Loki	8	7221	March 1, 2023
Loki queries within grafana dashboards Grafana Loki	1	2622	August 30, 2022
Logging a million lines per minute Grafana Loki	2	3187	February 15, 2022
Error: Status: 504:Message: Get "http://Loki-querier / Get "http://thanos-querier" Configuration	1	466	July 8, 2024
Query error: upstream request timeout Grafana Loki	5	4753	December 4, 2023

Increasing timeout query to loki datasource

Related topics