Adding a function to calculate the event size in bytes

[omers]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment.

Use Cases

• Calculate the total amount of events in Gb / Tb per day per service
• Add anomaly alerts on High volume ingestion per hour / day etc.
• Generate cost reports based on the total amount of data per team / service / customer etc.

Attempted Solutions

No response

Proposal

No response

References

Today we do it with logstash as:

  ruby {
    code => '
      event.set("log_size_bytes", event.to_hash.to_s.bytesize)
    '
  }