Skip to content

Issues: huggingface/text-generation-inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Resolve lora loading bug
#2441 opened Aug 21, 2024 by drbh
Multi-LORA feature question
#2505 opened Sep 9, 2024 by imran3180
Multi-LORA feature question-2
#2506 opened Sep 9, 2024 by imran3180
Inconsistent Behavior with Multi-LoRA Deployment
#2559 opened Sep 24, 2024 by charlatan-101
2 of 4 tasks
Remove max_stop_sequences by default
#2584 opened Sep 29, 2024 by sestinj
3 of 4 tasks
[New Model Request] NVLM
#2636 opened Oct 11, 2024 by nbroad1881
2 tasks done
input tokens exceeded max_input_tokens
#2638 opened Oct 12, 2024 by LanSnowZ
2 of 4 tasks
Add AMD gfx110* support
#2641 opened Oct 13, 2024 by cazlo
TGI Server should be installable via pip
#2696 opened Oct 27, 2024 by cdoern
detokenize
#2705 opened Oct 29, 2024 by oroojlooy
ProTip! What’s not been updated in a month: updated:<2024-12-20.