Description
Hi, I'm evaluating Elastic Agent autodiscover mode for Kubernetes based on annotations.
I've got more and more duplicated logs in Kibana and a lot of these errrors in Elastic Agent logs:
{"log.level":"error","@timestamp":"2024-05-31T11:56:27.810Z","message":"filestream input ID without ID might lead to data duplication, please add an ID and restart Filebeat","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-default","type":"filestream"},"log":{"source":"filestream-default"},"[service.name](http://service.name/)":"filebeat","ecs.version":"1.6.0","log.logger":"input","log.origin":{"file.line":176,"[file.name](http://file.name/)":"input-logfile/manager.go","function":"[github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*InputManager).Create](http://github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*InputManager).Create)"},"ecs.version":"1.6.0"}
It seems that the streams defined in the templates here are missing unique "id" field: https://github.com/elastic/elastic-agent/tree/main/deploy/kubernetes/elastic-agent-standalone/templates.d
See how it was fixed here: #2788
Version 8.13.4 on Ubuntu 22.4
No discussion on https://discuss.elastic.co/ because it doesn't accept links.