Unable to install s2fft in a new conda environment with python = 3.9

[sijil-jose]

HI, I am trying to install s2fft using pip install s2fft in a new python 3.9 environment. But I am failing to install pyssht . The following is the error reports.

thanks,
Sijil

Building wheel for pyssht (pyproject.toml) ... error
  error: subprocess-exited-with-error
  
  × Building wheel for pyssht (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [215 lines of output]
      
      
      --------------------------------------------------------------------------------
      -- Trying 'Ninja' generator
      --------------------------------
      ---------------------------
      ----------------------
      -----------------
      ------------
      -------
      --
      CMake Deprecation Warning at CMakeLists.txt:1 (cmake_minimum_required):
        Compatibility with CMake < 3.10 will be removed from a future version of
        CMake.
      
        Update the VERSION argument <min> value.  Or, use the <min>...<max> syntax
        to tell CMake that the project requires at least <min> but has been updated
        to work with policies introduced by <max> or earlier.
      
      Not searching for unused variables given on the command line.
      
      -- The C compiler identification is GNU 13.2.1
      -- Detecting C compiler ABI info
      -- Detecting C compiler ABI info - done
      -- Check for working C compiler: /usr/bin/gcc - skipped
      -- Detecting C compile features
      -- Detecting C compile features - done
      -- Configuring done (0.3s)
      -- Generating done (0.0s)
      -- Build files have been written to: /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_cmake_test_compile/build
      --
      -------
      ------------
      -----------------
      ----------------------
      ---------------------------
      --------------------------------
      -- Trying 'Ninja' generator - success
      --------------------------------------------------------------------------------
      
      Configuring Project
        Working directory:
          /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-build
        Command:
          /tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/cmake/data/bin/cmake /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19 -G Ninja -DCMAKE_MAKE_PROGRAM:FILEPATH=ninja --no-warn-unused-cli -DCMAKE_INSTALL_PREFIX:PATH=/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-install -DPYTHON_VERSION_STRING:STRING=3.9.21 -DSKBUILD:INTERNAL=TRUE -DCMAKE_MODULE_PATH:PATH=/tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/skbuild/resources/cmake -DPYTHON_EXECUTABLE:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft/bin/python3.9 -DPYTHON_INCLUDE_DIR:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft/include/python3.9 -DPYTHON_LIBRARY:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft/lib/libpython3.9.so -DPython_EXECUTABLE:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft/bin/python3.9 -DPython_ROOT_DIR:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft -DPython_FIND_REGISTRY:STRING=NEVER -DPython_INCLUDE_DIR:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft/include/python3.9 -DPython_NumPy_INCLUDE_DIRS:PATH=/tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/numpy/core/include -DPython3_EXECUTABLE:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft/bin/python3.9 -DPython3_ROOT_DIR:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft -DPython3_FIND_REGISTRY:STRING=NEVER -DPython3_INCLUDE_DIR:PATH=/global/homes/s/sijilj/anaconda3/envs/s2fft/include/python3.9 -DPython3_NumPy_INCLUDE_DIRS:PATH=/tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/numpy/core/include -DCMAKE_MAKE_PROGRAM:FILEPATH=ninja -DBUILD_TESTING:BOOL=OFF -Dconan_deps=ON -DCMAKE_POSITION_INDEPENDENT_CODE=ON -DCMAKE_BUILD_TYPE:STRING=Release
      
      Not searching for unused variables given on the command line.
      -- The C compiler identification is GNU 13.2.1
      -- Detecting C compiler ABI info
      -- Detecting C compiler ABI info - done
      -- Check for working C compiler: /usr/bin/gcc - skipped
      -- Detecting C compile features
      -- Detecting C compile features - done
      -- Downloading conan.cmake from https://github.com/conan-io/cmake-conan
      -- Conan: checking conan executable
      -- Conan: Found program /tmp/pip-build-env-ish1_cts/overlay/bin/conan
      -- Conan: Version found Conan version 1.66.0
      
      -- Conan executing: /tmp/pip-build-env-ish1_cts/overlay/bin/conan install /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/conanfile.txt --remote conancenter --generator cmake_find_package --generator cmake_paths --build missing --settings build_type=Release --settings compiler=gcc --settings compiler.version=13
      
      WARN: **************************************************
      WARN: *** Conan 1 is legacy and on a deprecation path **
      WARN: *********** Please upgrade to Conan 2 ************
      WARN: **************************************************
      Configuration:
      [settings]
      arch=x86_64
      arch_build=x86_64
      build_type=Release
      compiler=gcc
      compiler.libcxx=libstdc++
      compiler.version=13
      os=Linux
      os_build=Linux
      [options]
      [build_requires]
      [env]
      
      fftw/3.3.10: WARN: precision options is deprecated! use dedicated options 'precision_single', 'precision_double', 'precision_longdouble' and 'precision_quad' instead
      Version ranges solved
          Version range '>=3.3' required by 'conanfile.txt' resolved to 'fftw/3.3.10' in local cache
      
      conanfile.txt: Installing package
      Requirements
          fftw/3.3.10 from 'conancenter' - Cache
      Packages
          fftw/3.3.10:76fb618e9f590ad1830f3b3f412b2dc9af0b6433 - Cache
      
      Installing (downloading, building) binaries...
      fftw/3.3.10: Already installed!
      conanfile.txt: WARN:
           ************************************************
           The 'cmake_find_package' generator is deprecated.
           Please update your code and remove it.
           *************************************************
      
      conanfile.txt: Generator cmake_find_package created FindFFTW3.cmake
      conanfile.txt: WARN:
           ************************************************
           The 'cmake' generator is deprecated.
           Please update your code and remove it.
           *************************************************
      
      conanfile.txt: Generator cmake created conanbuildinfo.cmake
      conanfile.txt: Generator txt created conanbuildinfo.txt
      conanfile.txt: WARN:
           ************************************************
           The 'cmake_paths' generator is deprecated.
           Please update your code and remove it.
           *************************************************
      
      conanfile.txt: Generator cmake_paths created conan_paths.cmake
      conanfile.txt: Aggregating env generators
      conanfile.txt: Generated conaninfo.txt
      conanfile.txt: Generated graphinfo
      WARN: Revisions are disabled. Using Conan without revisions enabled is deprecated
      WARN: **************************************************
      WARN: *** Conan 1 is legacy and on a deprecation path **
      WARN: *********** Please upgrade to Conan 2 ************
      WARN: **************************************************
      
      -- Conan: Using autogenerated FindFFTW3.cmake
      -- Found FFTW3: 3.3.10 (found version "3.3.10")
      -- Library fftw3f found /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3f.a
      -- Found: /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3f.a
      -- Library fftw3 found /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3.a
      -- Found: /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3.a
      -- Library fftw3l found /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3l.a
      -- Found: /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3l.a
      -- Library fftw3l found /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3l.a
      -- Found: /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3l.a
      -- Library fftw3 found /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3.a
      -- Found: /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3.a
      -- Library fftw3f found /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3f.a
      -- Found: /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/lib/libfftw3f.a
      CMake Warning (dev) at /tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/skbuild/resources/cmake/FindPythonExtensions.cmake:245 (find_package):
        Policy CMP0148 is not set: The FindPythonInterp and FindPythonLibs modules
        are removed.  Run "cmake --help-policy CMP0148" for policy details.  Use
        the cmake_policy command to set the policy and suppress this warning.
      
      Call Stack (most recent call first):
        CMakeLists.txt:36 (find_package)
      This warning is for project developers.  Use -Wno-dev to suppress it.
      
      -- Found PythonInterp: /global/homes/s/sijilj/anaconda3/envs/s2fft/bin/python3.9 (found version "3.9.21")
      CMake Warning (dev) at /tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/skbuild/resources/cmake/FindPythonExtensions.cmake:252 (find_package):
        Policy CMP0148 is not set: The FindPythonInterp and FindPythonLibs modules
        are removed.  Run "cmake --help-policy CMP0148" for policy details.  Use
        the cmake_policy command to set the policy and suppress this warning.
      
      Call Stack (most recent call first):
        CMakeLists.txt:36 (find_package)
      This warning is for project developers.  Use -Wno-dev to suppress it.
      
      -- Found PythonLibs: /global/homes/s/sijilj/anaconda3/envs/s2fft/lib/libpython3.9.so (found version "3.9.21")
      -- Found Cython: /tmp/pip-build-env-ish1_cts/overlay/bin/cython
      -- Found NumPy: /tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/numpy/core/include (found version "1.19.3")
      -- Performing Test Weak Link MODULE -> SHARED (gnu_ld_ignore) - Success
      _modinit_prefix:PyInit_
      _modinit_prefix:PyInit_
      -- Found Doxygen: /usr/bin/doxygen (found version "1.8.14") found components: doxygen missing components: dot
      -- Configuring done (4.2s)
      -- Generating done (0.0s)
      -- Build files have been written to: /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-build
      [1/12] Building C object src/c/CMakeFiles/ssht.dir/ssht_sampling.c.o
      FAILED: src/c/CMakeFiles/ssht.dir/ssht_sampling.c.o
      /usr/bin/gcc  -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/include -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-build/include -isystem /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/include -std=gnu11 -O3 -DNDEBUG -fPIC -MD -MT src/c/CMakeFiles/ssht.dir/ssht_sampling.c.o -MF src/c/CMakeFiles/ssht.dir/ssht_sampling.c.o.d -o src/c/CMakeFiles/ssht.dir/ssht_sampling.c.o -c /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_sampling.c
      In file included from /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/include/ssht/ssht_types.h:52,
                       from /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_sampling.c:14:
      /usr/include/tgmath.h:54:4: error: #error "Unsupported combination of types for <tgmath.h>."
         54 | #  error "Unsupported combination of types for <tgmath.h>."
            |    ^~~~~
      [2/12] Building C object src/c/CMakeFiles/ssht.dir/ssht_dl.c.o
      FAILED: src/c/CMakeFiles/ssht.dir/ssht_dl.c.o
      /usr/bin/gcc  -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/include -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-build/include -isystem /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/include -std=gnu11 -O3 -DNDEBUG -fPIC -MD -MT src/c/CMakeFiles/ssht.dir/ssht_dl.c.o -MF src/c/CMakeFiles/ssht.dir/ssht_dl.c.o.d -o src/c/CMakeFiles/ssht.dir/ssht_dl.c.o -c /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_dl.c
      In file included from /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/include/ssht/ssht_types.h:52,
                       from /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_dl.c:44:
      /usr/include/tgmath.h:54:4: error: #error "Unsupported combination of types for <tgmath.h>."
         54 | #  error "Unsupported combination of types for <tgmath.h>."
            |    ^~~~~
      [3/12] Building C object src/c/CMakeFiles/ssht.dir/ssht_adjoint.c.o
      FAILED: src/c/CMakeFiles/ssht.dir/ssht_adjoint.c.o
      /usr/bin/gcc  -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/include -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-build/include -isystem /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/include -std=gnu11 -O3 -DNDEBUG -fPIC -MD -MT src/c/CMakeFiles/ssht.dir/ssht_adjoint.c.o -MF src/c/CMakeFiles/ssht.dir/ssht_adjoint.c.o.d -o src/c/CMakeFiles/ssht.dir/ssht_adjoint.c.o -c /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_adjoint.c
      In file included from /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_adjoint.c:18:
      /usr/include/tgmath.h:54:4: error: #error "Unsupported combination of types for <tgmath.h>."
         54 | #  error "Unsupported combination of types for <tgmath.h>."
            |    ^~~~~
      [4/12] Building C object src/c/CMakeFiles/ssht.dir/ssht_core.c.o
      FAILED: src/c/CMakeFiles/ssht.dir/ssht_core.c.o
      /usr/bin/gcc  -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/include -I/tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-build/include -isystem /global/homes/s/sijilj/.conan/data/fftw/3.3.10/_/_/package/76fb618e9f590ad1830f3b3f412b2dc9af0b6433/include -std=gnu11 -O3 -DNDEBUG -fPIC -MD -MT src/c/CMakeFiles/ssht.dir/ssht_core.c.o -MF src/c/CMakeFiles/ssht.dir/ssht_core.c.o.d -o src/c/CMakeFiles/ssht.dir/ssht_core.c.o -c /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_core.c
      In file included from /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/src/c/ssht_core.c:18:
      /usr/include/tgmath.h:54:4: error: #error "Unsupported combination of types for <tgmath.h>."
         54 | #  error "Unsupported combination of types for <tgmath.h>."
            |    ^~~~~
      [5/12] Generating C source src/pyssht/ducc0_sources.c
      ninja: build stopped: subcommand failed.
      Traceback (most recent call last):
        File "/tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/skbuild/setuptools_wrap.py", line 668, in setup
          cmkr.make(make_args, install_target=cmake_install_target, env=env)
        File "/tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/skbuild/cmaker.py", line 696, in make
          self.make_impl(clargs=clargs, config=config, source_dir=source_dir, install_target=install_target, env=env)
        File "/tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/skbuild/cmaker.py", line 741, in make_impl
          raise SKBuildError(msg)
      
      An error occurred while building with CMake.
        Command:
          /tmp/pip-build-env-ish1_cts/overlay/lib/python3.9/site-packages/cmake/data/bin/cmake --build . --target install --config Release --
        Install target:
          install
        Source directory:
          /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19
        Working directory:
          /tmp/pip-install-7j1clh79/pyssht_d91986d9b13244dfb640c3edfc6dff19/_skbuild/linux-x86_64-3.9/cmake-build
      Please check the install target is valid and see CMake's output for more information.
      
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyssht
Failed to build pyssht
ERROR: Failed to build installable wheels for some pyproject.toml based projects (pyssht)

[geggo]

Also encountered this issue. The problem is that currently pyssht fails to build, but a pull request astro-informatics/ssht#78 is pending to fix the problems there. You could try to build and install pyssht from source based on this branch.

A workaround I found is to skip building pyssht when installing s2fft (pip install s2fft --no-deps), manually installing missing dependencies, and patching s2fft/transforms/c_backend_spherical.py, comment out the 'import pyssht' statement at the beginning. pyssht is not essential for s2fft.

hope that helped
geggo

[sijil-jose]

Thanks a lot, This seems to have fixed the installation for the time being. I have tried running some tests and it seems to be working well.

[jasonmcewen]

Thanks for suggesting the workaround @geggo !

Yes, pyssht is only required for regression testing s2fft and so it is fine to skip the install of pyssht.

In any case, @mdavezac is working to fix the pyssht issue, so hopefully we should have a cleaner setup soon. (Will leave this issue open until that is resolved.)

@matt-graham This raises the issue of whether pyssht should be a dependcy for the PyPi install if it's only required for testing?

[matt-graham]

This raises the issue of whether pyssht should be a dependcy for the PyPi install if it's only required for testing?

We removed pyssht as a required dependency in #267 which is merged on main but we haven't made a release since so not yet on latest version on PyPI. Latest development version can be installed directly from GitHub using

pip install git+https://github.com/astro-informatics/s2fft

[jasonmcewen]

Perfect! As usual, you're a step ahead @matt-graham !

[matt-graham]

Just to update that the latest v1.2.2 release of s2fft on PyPI does not have pyssht as a required dependency so should resolve this issue.