Recommendations for Starting with a Custom Industrial Log Dataset #62
Tornadosky
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I'm about to start working with a custom real-world dataset. These are text-based machine logs collected from a car production plant. Before receiving the data, I would like to prepare a suitable pipeline for parsing and analyzing it (e.g., anomaly detection, preventive data analysis).
I’ve reviewed many papers and tools, including
Drain,DeepLog,LogLLM,LogSD, and others; but it’s still quite difficult to choose the most appropriate starting point for industrial logs.Could you please advise on the following:
Which existing datasets in Loghub are most suitable for initial testing, especially those that resemble industrial environments?
What models or tools do you recommend for parsing and analyzing logs from a production plant?
Are there any best practices or lessons learned when transitioning from academic datasets to custom industrial ones?
All reactions