Currently, we’re experiencing an ingestion rate limit when shipping logs from our applications to Loki:
Exporting failed. The error is not retryable. Dropping data. {"kind": "exporter", "data_type": "traces", "name": "otlp", "error": "Permanent error: rpc error: code = ResourceExhausted desc = RATE_LIMITED: ingestion rate limit (166666 bytes) exceeded while adding 561499 bytes for user 675064
From the error log, the ingestion rate limit is set to 166666
bytes instead of the default 4MB per the docs. There is an exact same issue with the difference that the rate limit appears in Tempo, instead of Loki.
Posting this here as opposed to opening a support ticket which is stated from the answer of the related issue, as I would also like to know whether the ingestion_rate_mb
is tweakable on the Grafana Cloud Free version? If we would bump up a tier, i.e Grafana Cloud Pro, would it be tweakable and if so, what would be the max value that we can set up?