You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the feature
Please describe the feature requested here(请在这里描述需求)
QWEN2-AUDIO使用的语言模型好像是最早的预训练版本,但是看config是支持了QWEN2系列的,想问下有没有办法自己替换language model的部分(比如替换成QWEN2-7B-INSTRUCT或者QWEN2.5-7B-INSTRUCT)
Paste any useful information
Paste any useful information, including papers, github links, etc.(请在这里描述其他有用的信息,比如相关的论文地址,github链接等)
开源的QWEN2-AUDIO-INSTRUCT是把所有模型参数都合并在一起了,有没有办法加载模型之后把语言模型的部分替换成自定义模型然后再进行微调或者直接导出模型文件呢?
Additional context
Add any other context or information here(其他信息可以写在这里)
The text was updated successfully, but these errors were encountered:
Describe the feature
Please describe the feature requested here(请在这里描述需求)
QWEN2-AUDIO使用的语言模型好像是最早的预训练版本,但是看config是支持了QWEN2系列的,想问下有没有办法自己替换language model的部分(比如替换成QWEN2-7B-INSTRUCT或者QWEN2.5-7B-INSTRUCT)
Paste any useful information
Paste any useful information, including papers, github links, etc.(请在这里描述其他有用的信息,比如相关的论文地址,github链接等)
开源的QWEN2-AUDIO-INSTRUCT是把所有模型参数都合并在一起了,有没有办法加载模型之后把语言模型的部分替换成自定义模型然后再进行微调或者直接导出模型文件呢?
Additional context
Add any other context or information here(其他信息可以写在这里)
The text was updated successfully, but these errors were encountered: