Skip to content

L0 io modules#353

Merged
ladsmund merged 5 commits intomainfrom
feature/mcl_restructure
Sep 12, 2025
Merged

L0 io modules#353
ladsmund merged 5 commits intomainfrom
feature/mcl_restructure

Conversation

@ladsmund
Copy link
Contributor

@ladsmund ladsmund commented Sep 8, 2025

The current pull request is no longer work in progress.

@ladsmund ladsmund force-pushed the feature/mcl_restructure branch from ebc51dc to eaba5b9 Compare September 9, 2025 12:44
@ladsmund ladsmund changed the title wip: L0 io modules L0 io modules Sep 9, 2025
PennyHow
PennyHow previously approved these changes Sep 9, 2025
Copy link
Member

@PennyHow PennyHow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just had a couple of comments but these can be looked into later. I'm happy for you to merge and continue.

PennyHow
PennyHow previously approved these changes Sep 12, 2025
- Introduced `io/ingestion/l0` as the central ingestion module.
- Refactored parsing into version-specific methods with improved metadata handling: CSV default, CSV v1 and TOA5 file parsing
- Implemented `_detect_file_type` for explicit input type detection.
- Standardized naming: `load_l0` → `load_data`, `load_data` → `load_data_files`.
- Enhanced TOA5 support with metadata extraction and per-variable attributes.
- Simplified data flow by removing redundant code and unused functions.
- Added unit tests in `test_ingest.py` to cover ingestion logic.
- Improved logging, type hints, and docstrings for clarity.
Refactor: Standardize method and variable names for data loading operations and update corresponding test cases.
@ladsmund ladsmund merged commit 13d46c6 into main Sep 12, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants