You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
creating build/lib.linux-x86_64-cpython-312/ktransformers/util
copying ktransformers/util/cuda_graph_runner.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
copying ktransformers/util/custom_gguf.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
copying ktransformers/util/custom_loader.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
copying ktransformers/util/modeling_rope_utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
copying ktransformers/util/textstream.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
copying ktransformers/util/utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
running build_ext
/home/user/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:426: UserWarning: There are no x86_64-linux-gnu-g++ version bounds defined for CUDA version 12.4
warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/ktransformers-0.2.3post1/build/lib.linux-x86_64-cpython-312/', '-DPYTHON_EXECUTABLE=/home/user/venv/bin/python3', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.3.post1+cu124torch25avx2', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/home/user/venv/bin/ninja']
Traceback (most recent call last):
File "/home/user/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
main()
File "/home/user/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 251, in build_wheel
return _build_backend().build_wheel(wheel_directory, config_settings,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/venv/lib/python3.12/site-packages/setuptools/build_meta.py", line 415, in build_wheel
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/venv/lib/python3.12/site-packages/setuptools/build_meta.py", line 397, in _build_with_temp_dir
self.run_setup()
File "/home/user/venv/lib/python3.12/site-packages/setuptools/build_meta.py", line 313, in run_setup
exec(code, locals())
File "<string>", line 373, in <module>
File "/home/user/venv/lib/python3.12/site-packages/setuptools/__init__.py", line 103, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 184, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 200, in run_commands
dist.run_commands()
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 970, in run_commands
self.run_command(cmd)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/dist.py", line 974, in run_command
super().run_command(command)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 989, in run_command
cmd_obj.run()
File "<string>", line 177, in run
File "/home/user/venv/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 373, in run
self.run_command("build")
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
self.distribution.run_command(command)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/dist.py", line 974, in run_command
super().run_command(command)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 989, in run_command
cmd_obj.run()
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
self.distribution.run_command(command)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/dist.py", line 974, in run_command
super().run_command(command)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 989, in run_command
cmd_obj.run()
File "/home/user/venv/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 93, in run
_build_ext.run(self)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
self.build_extensions()
File "/home/user/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 868, in build_extensions
build_ext.build_extensions(self)
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 479, in build_extensions
self._build_extensions_serial()
File "/home/user/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 505, in _build_extensions_serial
self.build_extension(ext)
File "<string>", line 322, in build_extension
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', '/home/ktransformers-0.2.3post1/ktransformers/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/ktransformers-0.2.3post1/build/lib.linux-x86_64-cpython-312/', '-DPYTHON_EXECUTABLE=/home/user/venv/bin/python3', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.3.post1+cu124torch25avx2', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/home/user/venv/bin/ninja']' returned non-zero exit status 1.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Could not build wheels for ktransformers, which is required to install pyproject.toml-based projects
(venv) root@ds161:/home/ktransformers-0.2.3post1#
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Could not build wheels for ktransformers, which is required to install pyproject.toml-based projects
(venv) root@ds161:/home/ktransformers-0.2.3post1#
Beta Was this translation helpful? Give feedback.
All reactions