Grafana Agent Operator not sending logs

Grafana Alloy
1

I have 2 EKS clusters. One running Loki installed via helm and the agent operator installed via that helm chart. One where I am trying to deploy using the Agent Operator Helm chart.

The Loki cluster is sending logs to Loki. The other one is not. Here are my grafanaagent, logsinstance and podlogs CRs…

apiVersion: monitoring.grafana.com/v1alpha1
kind: PodLogs
metadata:
  labels:
    instance: primary
    app.kubernetes.io/instance: gel-prod
    app.kubernetes.io/name: enterprise-logs
  name: kubernetes-pods
  namespace: monitoring
spec:
  namespaceSelector:
    any: true
  pipelineStages:
  - cri: {}
  relabelings:
  - action: replace
    sourceLabels:
    - __meta_kubernetes_pod_node_name
    targetLabel: worker_node
  - action: labelmap
    regex: __meta_kubernetes_pod_label_(.+)
  - action: replace
    replacement: grafana-ent/$1
    sourceLabels:
    - __meta_kubernetes_pod_controller_name
    targetLabel: job
  - action: replace
    sourceLabels:
    - __meta_kubernetes_pod_container_name
    targetLabel: container
  - action: replace
    replacement: eks01-uinfra
    targetLabel: cluster
  - action: replace
    sourceLabels:
    - app_kubernetes_io_managed_by
    targetLabel: managed
  - action: replace
    sourceLabels:
    - app_kubernetes_io_name
    targetLabel: cloudapp
  - action: drop
    sourceLabels:
    - operator_agent_grafana_com_name
    - operator_agent_grafana_com_type
    regex: (.*)
  selector:
    matchLabels: {}

 apiVersion: monitoring.grafana.com/v1alpha1
 kind: LogsInstance
 metadata:
   annotations:
     meta.helm.sh/release-name: gel-prod
     meta.helm.sh/release-namespace: monitoring
   labels:
     agent: grafana-agent
     app.kubernetes.io/instance: gel-prod
     app.kubernetes.io/name: enterprise-logs
   name: gel-prod-enterprise-logs
   namespace: monitoring
 spec:
   clients:
   - url: http://logs.atops.ue1.redacted.com/loki/api/v1/push
     externalLabels:
       cluster: uinfra01
     basicAuth:
       username:
         name: primary-credentials-logs
         key: username
       password:
         name: primary-credentials-logs
         key: password
   podLogsNamespaceSelector: {}
   podLogsSelector:
     matchLabels:
       instance: primary


apiVersion: monitoring.grafana.com/v1alpha1
kind: GrafanaAgent
metadata:
  annotations:
    meta.helm.sh/release-name: gel-prod
    meta.helm.sh/release-namespace: monitoring
  labels:
    app.kubernetes.io/instance: gel-prod
    app.kubernetes.io/name: enterprise-logs
    agent: grafana-agent
  name: gel-prod-enterprise-logs
spec:
  serviceAccountName: grafana-operator-grafana-agent-operator
  logs:
    instanceSelector:
      matchLabels:
        app.kubernetes.io/instance: gel-prod
        app.kubernetes.io/name: enterprise-logs

Anyone have any idea what is going on here?