This Elyra tutorial exposes a lot of details about building the underlying infra for supporting data pipelines. Most of the demo notebooks take this infra for granted, leading to challenges when pipelines are ready to be implemented "for real".
For this EPIC we need to:
Ideally, this will lead to regularization of how dependencies are managed and how data exploration with Jupyter Notebooks can lead to reproducible data transformation and management with Elyra pipeline nodes that are efficient in the libraries they load and the code they execute.
This Elyra tutorial exposes a lot of details about building the underlying infra for supporting data pipelines. Most of the demo notebooks take this infra for granted, leading to challenges when pipelines are ready to be implemented "for real".
For this EPIC we need to:
Ideally, this will lead to regularization of how dependencies are managed and how data exploration with Jupyter Notebooks can lead to reproducible data transformation and management with Elyra pipeline nodes that are efficient in the libraries they load and the code they execute.