Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

在A40服务器上编译失败 #558

Open
cxmt-ai-tc opened this issue Feb 21, 2025 · 1 comment
Open

在A40服务器上编译失败 #558

cxmt-ai-tc opened this issue Feb 21, 2025 · 1 comment

Comments

@cxmt-ai-tc
Copy link

Standard error: b'CMake Deprecation Warning at /testspace/inference/ktransformers/third_party/pybind11/CMakeLists.txt:13 (cmake_minimum_required):\n Compatibility with CMake < 3.10 will be removed from a future version of\n CMake.\n\n Update the VERSION argument value. Or, use the ... syntax\n to tell CMake that the project requires at least but has been updated\n to work with policies introduced by or earlier.\n\n\nfatal: detected dubious ownership in repository at '/testspace/inference/ktransformers/third_party/llama.cpp'\nTo add an exception for this directory, call:\n\n\tgit config --global --add safe.directory /testspace/inference/ktransformers/third_party/llama.cpp\nfatal: detected dubious ownership in repository at '/testspace/inference/ktransformers/third_party/llama.cpp'\nTo add an exception for this directory, call:\n\n\tgit config --global --add safe.directory /testspace/inference/ktransformers/third_party/llama.cpp\nCMake Warning (dev) at CMakeLists.txt:214 (find_package):\n Policy CMP0146 is not set: The FindCUDA module is removed. Run "cmake\n --help-policy CMP0146" for policy details. Use the cmake_policy command to\n set the policy and suppress this warning.\n\nThis warning is for project developers. Use -Wno-dev to suppress it.\n\nCMake Warning:\n Manually-specified variables were not used by the project:\n\n EXAMPLE_VERSION_INFO\n\n\n'
building 'KTransformersOps' extension
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda/custom_gguf
creating /testspace/inference/ktransformers/build/temp.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cuda/gptq_marlin
Traceback (most recent call last):
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in
main()
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 251, in build_wheel
return _build_backend().build_wheel(wheel_directory, config_settings,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 438, in build_wheel
return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 426, in _build
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
self.run_setup()
File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 320, in run_setup
exec(code, locals())
File "", line 367, in
File "/usr/local/lib/python3.12/dist-packages/setuptools/init.py", line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/core.py", line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/core.py", line 202, in run_commands
dist.run_commands()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 983, in run_commands
self.run_command(cmd)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "", line 177, in run
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/bdist_wheel.py", line 379, in run
self.run_command("build")
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build.py", line 136, in run
self.run_command(cmd_name)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/build_ext.py", line 99, in run
_build_ext.run(self)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 365, in run
self.build_extensions()
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 868, in build_extensions
build_ext.build_extensions(self)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 481, in build_extensions
self._build_extensions_serial()
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 507, in _build_extensions_serial
self.build_extension(ext)
File "", line 221, in build_extension
File "/usr/local/lib/python3.12/dist-packages/setuptools/command/build_ext.py", line 264, in build_extension
_build_ext.build_extension(self, ext)
File "/usr/local/lib/python3.12/dist-packages/Cython/Distutils/build_ext.py", line 135, in build_extension
super(build_ext, self).build_extension(ext)
File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/command/build_ext.py", line 562, in build_extension
objects = self.compiler.compile(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 672, in unix_wrap_ninja_compile
cuda_post_cflags = unix_cuda_flags(cuda_post_cflags)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 571, in unix_cuda_flags
cflags + _get_cuda_arch_flags(cflags))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/torch/utils/cpp_extension.py", line 1997, in _get_cuda_arch_flags
raise ValueError(f"Unknown CUDA arch ({arch}) or GPU not supported")
ValueError: Unknown CUDA arch (10.0) or GPU not supported
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
Could not fetch URL https://pypi.ngc.nvidia.com/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.ngc.nvidia.com', port=443): Max retries exceeded with url: /pip/ (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1000)'))) - skipping

@ubergarm
Copy link
Contributor

  1. “系统CA证书配置可能存在异常?建议尝试执行 sudo apt-get install -y ca-certificates 更新证书链。”
  2. “请使用Python 3.11版本,而非3.12版本。”
  3. “如需快速配置,我在此提供包含预编译二进制文件的完整指南(简化依赖编译步骤):” https://github.com/ubergarm/r1-ktransformers-guide/blob/main/README.zh.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants