Logfiles disappear if no recent activity in them

Grafana Loki
1

As mentioned in title, log files are not show in dashboards or even explore if there is no constant activity in them.

Is there some configuration that enables or am I missing something?

2

That probably means your querier can’t get to your permanent storage. Share your Loki configuration please?

3

This is my current loki configuration. I think it’s too busy maybe there is way to keep it cleaner. In our monitoring setup we need retention for 1 year and I am saving data on the same server.

auth_enabled: false

server:
  http_listen_port: 3100
  http_server_write_timeout: 3m
  http_server_read_timeout: 3m
  grpc_server_max_recv_msg_size: 104857600  # 100 Mb
  grpc_server_max_send_msg_size: 104857600  # 100 Mb

ingester_client:
  grpc_client_config:
    max_recv_msg_size: 104857600  # 100 Mb
    max_send_msg_size: 104857600  # 100 Mb

ingester:
  chunk_encoding: snappy
  chunk_idle_period: 1m
  chunk_target_size: 1536000
  max_chunk_age: 8760h


query_range:
  split_queries_by_interval: 0
  parallelise_shardable_queries: false

frontend_worker:
  match_max_concurrent: true
  grpc_client_config:
    max_send_msg_size: 268435456

querier:
  max_concurrent: 2048

frontend:
  max_outstanding_per_tenant: 4096
  compress_responses: true

common:
  instance_addr: 0.0.0.0
  path_prefix: /tmp/loki
  storage:
    filesystem:
      chunks_directory: /tmp/loki/chunks
      rules_directory: /etc/loki/rules  # Adjust to your rules directory
  replication_factor: 1
  ring:
    kvstore:
      store: inmemory

schema_config:
  configs:
    - from: 2020-10-24
      store: boltdb-shipper
      object_store: filesystem
      schema: v11
      index:
        prefix: index_
        period: 24h

compactor:
  retention_enabled: true

limits_config:
  split_queries_by_interval: 15m  # Adjust as needed
  reject_old_samples_max_age: 8760h
  max_entries_limit_per_query: 10000  # Increase the limit
  max_query_parallelism: 24  # Adjust based on your system's capacity
  max_query_length: 8760h
  ingestion_rate_mb: 64  # Increase the ingestion rate
  ingestion_burst_size_mb: 128  # Increase the burst size
  per_stream_rate_limit: "5MB"  # Increase the per-stream rate limit
  per_stream_rate_limit_burst: "20MB"  # Increase the burst size
  max_global_streams_per_user: 10000
  deletion_mode: filter-and-delete

chunk_store_config:
  max_look_back_period: 0
4

Had wrong paths. Changed paths for loki config and docker compose file and that fixed it.