Skip to content

Fluentbit drops logs when huge load of logs incoming #10081

Open
@smiley-ci

Description

@smiley-ci

Bug Report

fluent-bit.conf: |
[SERVICE]
Flush 120
Log_Level Trace
Daemon off
Parsers_File parsers.conf
HTTP_Server ${HTTP_SERVER}
HTTP_Listen 0.0.0.0
HTTP_Port ${HTTP_PORT}
storage.path /var/fluent-bit/state/flb-storage/
storage.sync normal
storage.checksum off
storage.backlog.mem_limit 50M
[INPUT]
Name tail
Tag kubernetes.logs.*
Path /var/log/containers/.log
Docker_Mode On
Docker_Mode_Flush 5
Docker_Mode_Parser container_firstline
Parser docker
DB /var/fluent-bit/state/flb_container.db
Skip_Long_Lines On
Refresh_Interval 5
Rotate_Wait 30
storage.type filesystem
Read_from_Head false
Threaded true
[FILTER]
Name kubernetes
Match kubernetes.logs.

tls.verify Off
Kube_URL https://kubernetes.default.svc.cluster.local:443
Kube_CA_File /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
Kube_Token_File /var/run/secrets/kubernetes.io/serviceaccount/token
Kube_Tag_Prefix kubernetes.logs.var.log.containers
Merge_Log On
Labels Off
Annotations Off
Buffer_Size 0
Use_Kubelet true
We could records are not completely processed by Fluent-bit.
Validated the Input Storage overlimit fluent-bit metrics they looks normal
No Overlimit reached in logs and errors recorded

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions