I have 2 memcached configured in the loki cluster, one for chunks and the other is for results:
chunk_store_config:
chunk_cache_config:
memcached:
batch_size: 256
parallelism: 10
memcached_client:
host: 'loki-memcached-chunks.<namespace>svc.cluster.local'
service: 'loki-memcached-chunks'
addresses: 'loki-memcached-chunks.<namespace>.svc.cluster.local:11211'
query_range:
align_queries_with_step: true
cache_results: true
results_cache:
cache:
default_validity: 12h
memcached_client:
host: 'loki-memcached-results.<namespace>.svc.cluster.local'
service: 'loki-memcached-results'
addresses: 'loki-memcached-results.<namespace>.svc.cluster.local:11211'
timeout: 500ms
From memcached_exporter, I did not find any memcahced was in use during querying or writing:
When I ran the query, here is from loki-read.log:
2024-04-21T18:33:58.183333503+08:00 stderr F level=warn ts=2024-04-21T10:33:58.091176695Z caller=experimental.go:20 msg=“experimental feature in use” feature=“DNS-based memcached service discovery”
2024-04-21T18:33:58.183340434+08:00 stderr F level=debug ts=2024-04-21T10:33:58.103712548Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.219.81:11211 count=1
2024-04-21T18:33:58.183344901+08:00 stderr F level=warn ts=2024-04-21T10:33:58.104945074Z caller=experimental.go:20 msg=“experimental feature in use” feature=“DNS-based memcached service discovery”
2024-04-21T18:33:58.18335424+08:00 stderr F level=debug ts=2024-04-21T10:33:58.1114272Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.22.143:11211 count=1
2024-04-21T18:34:58.182136789+08:00 stderr F level=debug ts=2024-04-21T10:34:58.107151558Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.219.81:11211 count=1
2024-04-21T18:34:58.182174134+08:00 stderr F level=debug ts=2024-04-21T10:34:58.120451469Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.22.143:11211 count=1
2024-04-21T18:35:58.181804079+08:00 stderr F level=debug ts=2024-04-21T10:35:58.106780861Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.219.81:11211 count=1
2024-04-21T18:35:58.181826795+08:00 stderr F level=debug ts=2024-04-21T10:35:58.119872665Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.22.143:11211 count=1
2024-04-21T18:36:58.182384859+08:00 stderr F level=debug ts=2024-04-21T10:36:58.111790906Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.219.81:11211 count=1
2024-04-21T18:36:58.182417735+08:00 stderr F level=debug ts=2024-04-21T10:36:58.119808487Z caller=memcached_client_selector.go:105 msg=“updating memcached servers” servers=10.96.22.143:11211 count=1
I am afraid I mis-configured something, but I cannot confirm, any help for this?
Loki version is 2.9.7.