Skip to content

Issues: sgl-project/sglang

Development Roadmap (2024 Q4)
#1487 opened Sep 21, 2024 by Ying1123
Open 22
[Feature] DeepSeek V3 optimization
#2591 opened Dec 26, 2024 by zhyncs
Open 13
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

181 Open 692 Closed
181 Open 692 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] load llama model with tp > 1 bug Something isn't working
#2829 opened Jan 10, 2025 by Xu-Chen
5 tasks done
1
[Bug] Bug of top_logprobs for the first chunk
#2825 opened Jan 10, 2025 by Snowdar
5 tasks done
[Feature] Compatibility layer to other inference engines
#2818 opened Jan 9, 2025 by fzyzcjy
2 tasks done
[Feature] Multinode docker container
#2817 opened Jan 9, 2025 by EgorovMike219
2 tasks
2
[Bug] Backend crashes with a KeyError while running normally bug Something isn't working
#2812 opened Jan 9, 2025 by seungduk-yanolja
5 tasks
@merrymercy @zhyncs
1
Do not use tools param in stream request!
#2810 opened Jan 9, 2025 by Snowdar
[Bug] enable_dp_attention not worked with DeepSeek-V3 2x8 H20 benchmarking
#2808 opened Jan 9, 2025 by liz-badada
5 tasks
@ispobock
1
[Feature] RFC for adding CPU support for SGLang enhancement New feature or request
#2807 opened Jan 9, 2025 by mingfeima
8 tasks
@mingfeima
1
[Benchmark] sglang successful requests issue (may related to env) await-response
#2805 opened Jan 9, 2025 by Rssevenyu
2
[Bug] NCCL Crash with SIGSEGV
#2803 opened Jan 9, 2025 by looput
5 tasks done
[AMD Feature Performance] Triton kernel performance tuning for DeepSeek V3
#2802 opened Jan 8, 2025 by HaiShaw
2 tasks done
@HaiShaw
[Bug] Huggingface model weight download failures do not cause the process to exit
#2801 opened Jan 8, 2025 by atbe
5 tasks done
1
[Bug] embedding model failed with --enable-metrics
#2800 opened Jan 8, 2025 by CatherineSue
5 tasks done
1
[Feature] Launch sglang-router without worker
#2796 opened Jan 8, 2025 by KYLN24
2 tasks done
[Bug] deepseek v3 inference on multiple nodes is very slow
#2794 opened Jan 8, 2025 by inforly
5 tasks
5
[Feature] Integration of TurboMind AWQ and GPTQ good first issue Good for newcomers help wanted Extra attention is needed
#2788 opened Jan 8, 2025 by zhyncs
2 tasks
1
[Bug] Failed to create router: Timeout 300s waiting for workers to become healthy
#2778 opened Jan 7, 2025 by stas00
2 of 5 tasks
[Bug] Benchmarks with EAGLE-2
#2777 opened Jan 7, 2025 by xavier-h-10
5 tasks done
@yukavio
1
[Bug] Cannot capture kernel trace using nsys
#2776 opened Jan 7, 2025 by yixue-qq
5 tasks done
Output Results are not the same for the same model [lmms-lab/LLaVA-Video-7B-Qwen2]
#2775 opened Jan 7, 2025 by Noctis-SC
[willing to PR] Add Lookahead speculative decoding enhancement New feature or request good first issue Good for newcomers
#2772 opened Jan 7, 2025 by jjjjohnson
2 tasks done
@jjjjohnson
1
[Bug] Error occurs when loading in bitsandbytes format.
#2769 opened Jan 7, 2025 by upskyy
2 of 5 tasks
1
[Feature] add unit test for block wise fp8 good first issue Good for newcomers help wanted Extra attention is needed
#2768 opened Jan 7, 2025 by zhyncs
2 tasks
1
[Bug] Deepseek v3 forward_absorb() of attention bug
#2764 opened Jan 7, 2025 by yixue-qq
5 tasks done
4
[Bug] launch dsv2 service failed
#2763 opened Jan 7, 2025 by lvhan028
2 of 5 tasks
@ispobock
1
ProTip! Exclude everything labeled bug with -label:bug.