Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Deepseek R1 Support #3070

Closed
vladrad opened this issue Jan 21, 2025 · 3 comments
Closed

[Feature] Deepseek R1 Support #3070

vladrad opened this issue Jan 21, 2025 · 3 comments
Assignees
@AllentDan

Comments

@vladrad
Copy link

vladrad commented Jan 21, 2025

Motivation

Hello I tried to deploy Deepseek R1 32B and 70B with no success seems like my template is not supported. Am I missing something or does R1 support need to be added.

Thanks!

Related resources

No response

Additional context

No response
@lvhan028
Copy link
Collaborator

It looks we need to add chat template for deepseek R1.

@AllentDan AllentDan mentioned this issue Jan 22, 2025
Merged
@AnyangAngus
Copy link

any Update for deepseek-R1 and deepseek v3?

@lvhan028
Copy link
Collaborator

#3072 updates the chat template
dsv3 is already supported in v0.7.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@AllentDan AllentDan

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@vladrad @lvhan028 @AllentDan @AnyangAngus