I have set up Loki server on Ec2 and aggregating the logs of ECS services running on my AWS. I am storing logs on Loki server and pushing the logs to S3 bucket for back up. Is it possible to read logs from Loki server directly? If yes can you please help me with that. Also I have set the retention period to 0s for storing logs for indefinite period of time but still not able to see it under retention directory on Loki-local-storage. I also shared my Loki config file with you.
Kindly help me in this as I am doing R&D for Loki log aggregation.
You can read logs from loki directly by using the Loki HTTP API. For example here’s an endpoint that will let you run any logql query and get results
I don’t see your loki configuration file in the question though
I want to store my logs on my Loki server too for indefinite period. Following is my configuration. I also set retention period as 0s but still not able to do it. I want to push the logs from Loki server to my s3 bucket at 1 hr interval. Kindly help me correcting my configuration file.
- from: 2020-10-24
Oh my. You have
retention_period: 0s in your config file. That’s not going to work.
Check the Loki storage retention documentation here:
It will give you a sample config that shows you how to set up any retention period. Note it requires an index interval of 24h but it looks like you already have that.
Thanks @davidallen5 Let me check with that.