Skip to content

Issues: kvcache-ai/ktransformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

281 Open 130 Closed
281 Open 130 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

GPU 利用率极低，几乎是纯 CPU 计算
#562 opened Feb 21, 2025 by fungaren
1
修改YAML文件，多GPU部署时的性能异常问题
#561 opened Feb 21, 2025 by VinayaLee
256GB内存，DeepSeek-R1-Q4_K_M可以正常运行，查看设备运行内存占用不正常？还有为什么不会报内存错误？
#560 opened Feb 21, 2025 by codedoves
内存占用低、推理速度慢、回答无显示
#559 opened Feb 21, 2025 by chiyan2022
2
在A40服务器上编译失败
#558 opened Feb 21, 2025 by cxmt-ai-tc
为什么需要两个模型才能运行
#557 opened Feb 21, 2025 by yimisiyang
1
deepseek-r1 671B with 2GPUs
#556 opened Feb 21, 2025 by Yongbozzz
1
Can I have a toy run example for Deepseek-R1?
#555 opened Feb 21, 2025 by MingyuQi1995
如何完整编译
#554 opened Feb 21, 2025 by cnsdzbhm
1
An error occurred when starting the API server in Docker and using the API locally
#553 opened Feb 20, 2025 by lililolo0927
cpu 13th Gen Intel(R) Core(TM) i9-13900K 支持 amx吗
#552 opened Feb 20, 2025 by liangpn
1
v0.3的dockerfile官方同学能上线吗
#551 opened Feb 20, 2025 by txg1550759
如何将gpu显卡性能发挥到最大
#549 opened Feb 20, 2025 by txg1550759
5
DeepSeek-V3-Chat-multi-gpu-8.yaml 错误
#548 opened Feb 20, 2025 by XIONGPEILIN
关于docker run起来后，还需要编译安装（make dev_install or sh ./install.sh）的问题
#547 opened Feb 20, 2025 by sugarfreeLiuYuXuan
1
install.sh run error
#546 opened Feb 20, 2025 by songsh
2
能支持DeepSeek R1 Dynamic 1.58-bit推理吗
#545 opened Feb 20, 2025 by M17764017422
1
ModuleNotFoundError: No module named 'KTransformersOps'
#544 opened Feb 20, 2025 by wjxabai
3
在windos 安裝問題
#542 opened Feb 20, 2025 by c00jsw00
4
when will ktransformer support the feature of Multi-Token Prediction (MTP)？
#541 opened Feb 20, 2025 by Liu-xiandong
无限推理，停不下来
#540 opened Feb 20, 2025 by yeungtuzi
3
并发场景
#539 opened Feb 20, 2025 by baicang1
2
内存占用很少 速度极其慢 500G内存，单卡4090
#538 opened Feb 20, 2025 by seanzhang-zhichen
8
如何使用更多的GPU显存？
#537 opened Feb 20, 2025 by sweihub
9
bash install.sh报错，我是A卡，rocm已经安装好了，不知道pyproject.toml和install.sh应该修改哪
#536 opened Feb 20, 2025 by 12star21
ProTip! Adding no:label will show everything without a label.