Data preporcessing #10
Description
Add preprocessing to parquet files before comparing them
Motivation
We can remove columns that are not necessary or unwanted for comparison.
Tasks
- Create Preprocess class
- add method preprocess
- method will remove columns with specific names (timestamps, run id)