You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Standard error: b'CMake Deprecation Warning at /testspace/inference/ktransformers/third_party/pybind11/CMakeLists.txt:13 (cmake_minimum_required):\n Compatibility with CMake < 3.10 will be removed from a future version of\n CMake.\n\n Update the VERSION argument value. Or, use the ... syntax\n to tell CMake that the project requires at least but has been updated\n to work with policies introduced by or earlier.\n\n\nfatal: detected dubious ownership in repository at '/testspace/inference/ktransformers/third_party/llama.cpp'\nTo add an exception for this directory, call:\n\n\tgit config --global --add safe.directory /testspace/inference/ktransformers/third_party/llama.cpp\nfatal: detected dubious ownership in repository at '/testspace/inference/ktransformers/third_party/llama.cpp'\nTo add an exception for this directory, call:\n\n\tgit config --global --add safe.directory /testspace/inference/ktransformers/third_party/llama.cpp\nCMake Warning (dev) at CMakeLists.txt:214 (find_package):\n Policy CMP0146 is not set: The FindCUDA module is removed. Run "cmake\n --help-policy CMP0146" for policy details. Use the cmake_policy command to\n set the policy and suppress this warning.\n\nThis warning is for project developers. Use -Wno-dev to suppress it.\n\nCMake Warning:\n Manually-specified variables were not used by the project:\n\n EXAMPLE_VERSION_INFO\n\n\n'
building 'KTransformersOps' extension
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda/custom_gguf
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda/gptq_marlin
Traceback (most recent call last):
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in
main()
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 251, in build_wheel
return _build_backend().build_wheel(wheel_directory, config_settings,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 438, in build_wheel
return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 426, in _build
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
self.run_setup()
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 320, in run_setup
exec(code, locals())
File "", line 367, in
File "/usr/local/lib/python3.12/dist-packages/setuptools/init.py", line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/core.py", line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/core.py", line 202, in run_commands
dist.run_commands()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 983, in run_commands
self.run_command(cmd)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "", line 177, in run
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/bdist_wheel.py", line 379, in run
self.run_command("build")
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build.py", line 136, in run
self.run_command(cmd_name)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/build_ext.py", line 99, in run
_build_ext.run(self)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 365, in run
self.build_extensions()
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 868, in build_extensions
build_ext.build_extensions(self)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 481, in build_extensions
self._build_extensions_serial()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 507, in _build_extensions_serial
self.build_extension(ext)
File "", line 221, in build_extension
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/build_ext.py", line 264, in build_extension
_build_ext.build_extension(self, ext)
File "/usr/local/lib/python3.12/dist-packages/Cython/Distutils/build_ext.py", line 135, in build_extension
super(build_ext, self).build_extension(ext)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 562, in build_extension
objects = self.compiler.compile(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 672, in unix_wrap_ninja_compile
cuda_post_cflags = unix_cuda_flags(cuda_post_cflags)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 571, in unix_cuda_flags
cflags + _get_cuda_arch_flags(cflags))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 1997, in _get_cuda_arch_flags
raise ValueError(f"Unknown CUDA arch ({arch}) or GPU not supported")
ValueError: Unknown CUDA arch (10.0) or GPU not supported
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
Could not fetch URL https://pypi.ngc.nvidia.com/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.ngc.nvidia.com', port=443): Max retries exceeded with url: /pip/ (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1000)'))) - skipping
The text was updated successfully, but these errors were encountered:
Standard error: b'CMake Deprecation Warning at /testspace/inference/ktransformers/third_party/pybind11/CMakeLists.txt:13 (cmake_minimum_required):\n Compatibility with CMake < 3.10 will be removed from a future version of\n CMake.\n\n Update the VERSION argument value. Or, use the ... syntax\n to tell CMake that the project requires at least but has been updated\n to work with policies introduced by or earlier.\n\n\nfatal: detected dubious ownership in repository at '/testspace/inference/ktransformers/third_party/llama.cpp'\nTo add an exception for this directory, call:\n\n\tgit config --global --add safe.directory /testspace/inference/ktransformers/third_party/llama.cpp\nfatal: detected dubious ownership in repository at '/testspace/inference/ktransformers/third_party/llama.cpp'\nTo add an exception for this directory, call:\n\n\tgit config --global --add safe.directory /testspace/inference/ktransformers/third_party/llama.cpp\nCMake Warning (dev) at CMakeLists.txt:214 (find_package):\n Policy CMP0146 is not set: The FindCUDA module is removed. Run "cmake\n --help-policy CMP0146" for policy details. Use the cmake_policy command to\n set the policy and suppress this warning.\n\nThis warning is for project developers. Use -Wno-dev to suppress it.\n\nCMake Warning:\n Manually-specified variables were not used by the project:\n\n EXAMPLE_VERSION_INFO\n\n\n'
building 'KTransformersOps' extension
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda/custom_gguf
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda/gptq_marlin
Traceback (most recent call last):
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in
main()
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 251, in build_wheel
return _build_backend().build_wheel(wheel_directory, config_settings,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 438, in build_wheel
return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 426, in _build
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
self.run_setup()
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 320, in run_setup
exec(code, locals())
File "", line 367, in
File "/usr/local/lib/python3.12/dist-packages/setuptools/init.py", line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/core.py", line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/core.py", line 202, in run_commands
dist.run_commands()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 983, in run_commands
self.run_command(cmd)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "", line 177, in run
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/bdist_wheel.py", line 379, in run
self.run_command("build")
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build.py", line 136, in run
self.run_command(cmd_name)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/build_ext.py", line 99, in run
_build_ext.run(self)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 365, in run
self.build_extensions()
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 868, in build_extensions
build_ext.build_extensions(self)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 481, in build_extensions
self._build_extensions_serial()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 507, in _build_extensions_serial
self.build_extension(ext)
File "", line 221, in build_extension
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/build_ext.py", line 264, in build_extension
_build_ext.build_extension(self, ext)
File "/usr/local/lib/python3.12/dist-packages/Cython/Distutils/build_ext.py", line 135, in build_extension
super(build_ext, self).build_extension(ext)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 562, in build_extension
objects = self.compiler.compile(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 672, in unix_wrap_ninja_compile
cuda_post_cflags = unix_cuda_flags(cuda_post_cflags)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 571, in unix_cuda_flags
cflags + _get_cuda_arch_flags(cflags))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 1997, in _get_cuda_arch_flags
raise ValueError(f"Unknown CUDA arch ({arch}) or GPU not supported")
ValueError: Unknown CUDA arch (10.0) or GPU not supported
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
Could not fetch URL https://pypi.ngc.nvidia.com/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.ngc.nvidia.com', port=443): Max retries exceeded with url: /pip/ (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1000)'))) - skipping
The text was updated successfully, but these errors were encountered: