Skip to content

Environment setup is broken due to pip/conda conflicts (scipy/sklearn/dask-ml) #5

Description

@StRongTomatoes

Hi,

First of all, thank you for the work you put into this project. I was really interested in trying it and exploring its potential.

However, after following the installation instructions from the README and recreating the environment from scratch, I ran into serious dependency issues that make the setup very difficult to use in practice.

The main problem seems to be that the environment mixes conda and pip for core scientific packages (numpy, scipy, scikit-learn, dask-ml). This leads to binary incompatibilities and broken imports.

For example, after installation:
python -c "import dask_ml, sklearn, scipy"

results in errors such as:
ImportError: cannot import name 'get_tags' from sklearn.utils
ImportError: cannot import name '_promote' from scipy.spatial.transform

This happens because pip-installed wheels conflict with conda-installed libraries, especially on Linux/HPC systems.
Unfortunately, after spending a significant amount of time trying to fix this, I decided to step back from using the project for now.

I believe this could be greatly improved by:

  • Installing numpy, scipy, scikit-learn, and dask-ml only via conda-forge
  • Leaving pip only for pure-Python packages
  • Updating the .yml file accordingly

I hope this feedback is useful, because the project itself looks very promising.

Best regards,
StRongTomatoes

Metadata

Metadata

Labels

No labels
No labels

Type

Fields

No fields configured for Bug.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions