Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QWEN2-AUDIO能否替换语言模型 #2428

Open
chaunceyliu30 opened this issue Nov 11, 2024 · 1 comment
Open

QWEN2-AUDIO能否替换语言模型 #2428

chaunceyliu30 opened this issue Nov 11, 2024 · 1 comment

Comments

@chaunceyliu30
Copy link

Describe the feature
Please describe the feature requested here(请在这里描述需求)
QWEN2-AUDIO使用的语言模型好像是最早的预训练版本,但是看config是支持了QWEN2系列的,想问下有没有办法自己替换language model的部分(比如替换成QWEN2-7B-INSTRUCT或者QWEN2.5-7B-INSTRUCT)

Paste any useful information
Paste any useful information, including papers, github links, etc.(请在这里描述其他有用的信息,比如相关的论文地址,github链接等)
开源的QWEN2-AUDIO-INSTRUCT是把所有模型参数都合并在一起了,有没有办法加载模型之后把语言模型的部分替换成自定义模型然后再进行微调或者直接导出模型文件呢?

Additional context
Add any other context or information here(其他信息可以写在这里)

@Jintao-Huang
Copy link
Collaborator

注册一下模型好了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants