[Helm Chart Loki - SingleBinary] IPv6 is broken on the latest version 3.4.x

[JihadMotii-REISys]

Describe the bug
I'm deploying the latest Loki Helm Chart version 6.28.0 that comes with Loki image tag: 3.4.2 (SingleBinary mode) through ArgoCD in AWS EKS 1.32 that runs on IPv6 network. Once deployed, Loki POD was throwing the following error message:

no useable address found for interfaces [eth0]
error initialising module: memberlist-kv
github.com/grafana/dskit/modules.(*Manager).initModule
	/src/loki/vendor/github.com/grafana/dskit/modules/modules.go:138
github.com/grafana/dskit/modules.(*Manager).InitModuleServices
	/src/loki/vendor/github.com/grafana/dskit/modules/modules.go:108
github.com/grafana/loki/v3/pkg/loki.(*Loki).Run
	/src/loki/pkg/loki/loki.go:495
main.main
	/src/loki/cmd/loki/main.go:129
runtime.main
	/usr/local/go/src/runtime/proc.go:272
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1700
level=info ts=2025-03-26T15:26:22.988574362Z caller=main.go:126 msg="Starting Loki" version="(version=3.4.2, branch=release-3.4.x, revision=4fa045d3)"
level=info ts=2025-03-26T15:26:22.98865177Z caller=main.go:127 msg="Loading configuration file" filename=/etc/loki/config/config.yaml
level=info ts=2025-03-26T15:26:22.993070353Z caller=server.go:351 msg="server listening on addresses" http=[::]:3100 grpc=[::]:9095
level=error ts=2025-03-26T15:26:22.993793723Z caller=log.go:216 msg="error running loki" err="no useable address found for interfaces [eth0]\nerror initialising module: memberlist-kv\ngithub.com/grafana/dskit/modules.(*Manager).initModule\n\t/src/loki/vendor/github.com/grafana/dskit/modules/modules.go:138\ngithub.com/grafana/dskit/modules.(*Manager).InitModuleServices\n\t/src/loki/vendor/github.com/grafana/dskit/modules/modules.go:108\ngithub.com/grafana/loki/v3/pkg/loki.(*Loki).Run\n\t/src/loki/pkg/loki/loki.go:495\nmain.main\n\t/src/loki/cmd/loki/main.go:129\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:272\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1700"

To Reproduce
Here is the ArgoCD of Loki Helm Chart with values:

• Deploy the Helm Chart Loki v6.28.0 (SingleBinary) on AWS EKS that runs only IPv6:

apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
  name: grafana-loki
  namespace: argocd
spec:
  destination:
    namespace: logging
    server: https://kubernetes.default.svc
  project: default
  source:
    chart: loki
    repoURL: https://grafana.github.io/helm-charts
    targetRevision: 6.28.0
    helm:
      values: |
        loki:
          extraMemberlistConfig:
            bind_addr:
              - "::"
          frontend:
            address: "::"
          common:
            ring:
              instance_enable_ipv6: true
          distributor:
            ring:
              instance_enable_ipv6: true
          memberlist:
            bind_addr:
              - "::"
            bind_port: 7946
            cluster_label: local.namespace
            randomize_node_name: false
            service:
              publishNotReadyAddresses: true
          ruler:
            ring:
              instance_enable_ipv6: true
          index_gateway:
            ring:
              instance_enable_ipv6: true
          commonConfig:
            instance_interface_names:
              - "eth0"
            replication_factor: 1
            ring:
              kvstore:
                store: "memberlist"
              instance_enable_ipv6: true
          ingester:
            lifecycler:
              enable_inet6: true
          compactor:
            compactor_ring:
              instance_enable_ipv6: true
            compaction_interval: 10m
            retention_enabled: true
            retention_delete_delay: 2h
            retention_delete_worker_count: 150
            #delete_request_store: 'filter-and-delete'
            delete_request_store: filesystem
          query_scheduler:
            max_outstanding_requests_per_tenant: 2048
            scheduler_ring:
              instance_enable_ipv6: true
          limits_config:
            retention_period: 744h
          tracing:
            enabled: false
          auth_enabled: false
          storage:
            type: filesystem
          #commonConfig:
          #  replication_factor: 1
          schemaConfig:
            configs:
              - from: "2025-03-25"
                store: tsdb
                index:
                  prefix: index_
                  period: 24h
                object_store: filesystem
                schema: v13
          storage_config:
            tsdb_shipper:
              active_index_directory: /var/loki/tsdb-index
              cache_location: /var/loki/tsdb-cache
        test:
          enabled: false
        lokiCanary:
          enabled: false
        gateway:
          enabled: false
        ingress:
          enabled: false
        deploymentMode: SingleBinary
        chunksCache:
          writebackSizeLimit: 10MB
          allocatedMemory: 256
        singleBinary:
          replicas: 1
          resources:
            limits:
              cpu: 0.5
              memory: 512Mi
            requests:
              cpu: 0.1
              memory: 128Mi
          extraArgs:
            - -config.expand-env=true
          extraEnv:
            - name: GOMEMLIMIT
              value: 412MiB
            - name: POD_IP
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP
          persistence:
            enabled: true
            storageClass: "gp3"
            size: 20Gi
        # Zero out replica counts of other deployment modes
        # https://github.com/grafana/loki/blob/main/production/helm/loki/single-binary-values.yaml
        backend:
          replicas: 0
        read:
          replicas: 0
        write:
          replicas: 0
        ingester:
          replicas: 0
        querier:
          replicas: 0
        queryFrontend:
          replicas: 0
        queryScheduler:
          replicas: 0
        distributor:
          replicas: 0
        compactor:
          replicas: 0
        indexGateway:
          replicas: 0
        bloomCompactor:
          replicas: 0
        bloomGateway:
          replicas: 0
  syncPolicy:
    automated:
      prune: true
      selfHeal: true
    syncOptions:
    - Validate=false

I have followed the examples (#14607, #13416, #4948) to come up with the most recent and best Loki configuration to make it to work on IPv6.

Temporary Fix
With the same configuration above, if you downgrade the loki image tag prior to 3.3.x, the loki Pod will run successfully:

       loki:
         ...
         image:
           tag: 3.3.3 # Latest version 3.4.x doesn't work with IPv6

Expected behavior
Loki IPv6 configuration supposed to be working properly with the latest Loki Image tag 3.4.x

Environment:

• Infrastructure: Kubernetes (AWS EKS) 1.32
• Deployment tool: ArgoCD / Helm

Has anything changed on the latest version that caused this issue? am I missing any configuration to make it to work with the latest version of Loki.

Please Advise!
Thank you in advance!

[yann-soubeyrand]

Hello, we managed to make 3.4 work on EKS IPv6 in simple scalable deployment mode: #14607 (comment). Maybe this configuration also works in single binary mode.

[francisko0]

Hello,

I have my configuration as #14607, I confirm that since 3.4.x if you don't have the configuration below you get the error no usable address found for interfaces [eth0 en0] .

commonConfig :
    instance_addr: ‘ ${INSTANCE_ADDR} 

There's a problem when you define args in the global, Loki read backend and bloomPlanner have a bad configuration and can't start.

It is preferable to add extraArgs: and extraEnv: for each component, my Loki in distributed mode works well with this method.

The bug is in the template charts for 3 components ( read backend and bloomPlanner )

[yann-soubeyrand]

Yes, sorry, I forgot to mention we had to fix the chart to make it work: #17020.