Skip to content

Fluent Bit crashes on Windows with [storage] [cio_file] error setting new file size on write after running for some time #11379

@PraveenJeffriAndroidDeveloper

Description

I’m running Fluent Bit on Windows and observing a storage-related error after it runs continuously. In some cases, Fluent Bit crashes after ~1 hour of execution.

Environment
OS: Windows (version not pinned yet)
Fluent Bit version: (please fill in, 4.2)
Storage type: filesystem
Input: tail
Output: opentelemetry (gRPC)

`[SERVICE]
Flush 5
Daemon Off
Log_Level debug
Log_File C:\HelloWorld\Logs\FluentBit.log
storage.path C:\HelloWorld\Logs\flb-storage
storage.sync normal
storage.checksum on
storage.backlog.mem_limit 50MB
Parsers_File parsers.conf

[INPUT]
Name tail
Path C:\HelloWorld\Logs\ConsoleLogs.json
Tag Testing
Read_from_Head false
Buffer_Chunk_Size 512KB
Buffer_Max_Size 2MB
storage.type filesystem
Parser json

[OUTPUT]
Name opentelemetry
Match Testing
Port 7003
grpc on
Retry_Limit False
batch_size 200
`

Error Logs

After running for some time (~1 hour), the following errors are logged and Fluent Bit crashes:

[error] [storage] [cio_file] error setting new file size on write
[error] [input chunk] error writing data from tail.0 instance

What does [storage] [cio_file] error setting new file size on write mean in Fluent Bit, what are the common causes on Windows, and what are the recommended ways to resolve it?
I’d really appreciate any guidance on how to debug or resolve this issue on Windows. Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions