Skip to content

Issues: vllm-project/vllm

[Roadmap] vLLM Roadmap Q2 2025
#15735 opened Mar 29, 2025 by simon-mo
Open 9
[Roadmap] vLLM Release/CI/Performance Benchmark Q2 2025
#16284 opened Apr 8, 2025 by khluu
Open 3
[Usage] Qwen3 Usage Guide
#17327 opened Apr 28, 2025 by simon-mo
Open 23
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
150 Open 930 Closed
150 Open 930 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Hardware][Intel GPU] Upgrade to torch 2.7 ci/build documentation Improvements or additions to documentation
#17444 opened Apr 30, 2025 by jikunshang Loading…
1
[Doc]: reasoning-parser qwen3 documentation Improvements or additions to documentation
#17441 opened Apr 30, 2025 by DenceChen
1 task done
4
[Feature][CLI] Unify configuration for structured outputs via --structured-output-config documentation Improvements or additions to documentation needs-rebase structured-output tool-calling v1
#17420 opened Apr 29, 2025 by aarnphm Loading…
14
[Bugfix] Temporarily disable gptq_bitblas on ROCm documentation Improvements or additions to documentation
#17411 opened Apr 29, 2025 by nlzy Loading…
1
3
[Frontend] Fix tool_call handling in llama3.1 and llama3.2 chat template to allow zero tool_calls documentation Improvements or additions to documentation tool-calling
#17409 opened Apr 29, 2025 by CatherineSue Loading…
1
[doc] add install tips documentation Improvements or additions to documentation
#17373 opened Apr 29, 2025 by reidliu41 Loading…
1
[V1][Spec Decode] Share input embedding of target model with EAGLE draft model to free ~1GB for llama 3 model documentation Improvements or additions to documentation needs-rebase v1
#17326 opened Apr 28, 2025 by ekagra-ranjan Loading…
4
[BugFix] Fix authorization of openai_transcription_client.py documentation Improvements or additions to documentation
#17321 opened Apr 28, 2025 by hhy3 Loading…
1
3
[Doc]: multi-image batch inference documentation Improvements or additions to documentation
#17226 opened Apr 26, 2025 by eternal8080
1 task done
1
[Doc] Clarify note for H2O-VL documentation Improvements or additions to documentation
#17219 opened Apr 26, 2025 by DarkLight1337 Loading…
4
[Misc] Add gemma3 chat template with pythonic-style function calling documentation Improvements or additions to documentation tool-calling
#17149 opened Apr 25, 2025 by philipchung Loading…
1
5
Add xLAM tool parser support documentation Improvements or additions to documentation frontend tool-calling
#17148 opened Apr 25, 2025 by zuxin666 Loading…
7
[Frontend][TPU] Enforce user input key args to reduce chance of large performance degradation documentation Improvements or additions to documentation frontend
#17145 opened Apr 24, 2025 by Chenyaaang Loading…
12
[VLM] Support HF format Phi-4-MM model documentation Improvements or additions to documentation
#17121 opened Apr 24, 2025 by Isotr0py • Draft
1
[Bugfix] fix phi4-mini tool call parse in streaming mode documentation Improvements or additions to documentation frontend tool-calling
#17094 opened Apr 24, 2025 by yulin-li Loading…
1
[Core] Prevent side-channel attacks via cache salting documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194) ready ONLY add when PR is ready to merge/full CI is needed security Security related issues and PRs v1
#17045 opened Apr 23, 2025 by dr75 Loading…
25
[Frontend] Add /classify endpoint documentation Improvements or additions to documentation frontend needs-rebase
#17032 opened Apr 23, 2025 by frieda-huang Loading…
1
25
[V1][Metrics] Add API for accessing in-memory Prometheus metrics documentation Improvements or additions to documentation frontend ready ONLY add when PR is ready to merge/full CI is needed speculative-decoding v1
#17010 opened Apr 22, 2025 by markmc Loading…
6
Add squash option to container image build commands ci/build documentation Improvements or additions to documentation
#16991 opened Apr 22, 2025 by radeksm Loading…
1
[Doc]: update contributing guide for macOS Apple silicon documentation Improvements or additions to documentation
#16940 opened Apr 21, 2025 by davidxia
1 task done
1
[Misc] Add DeepSeek deployment example documentation Improvements or additions to documentation
#16938 opened Apr 21, 2025 by ruisearch42 Loading…
1
[Doc]: state requirements for testing or update to work for CPU-only documentation Improvements or additions to documentation
#16920 opened Apr 21, 2025 by davidxia
1 task done
[Lora][Frontend]Add default local directory LoRA resolver plugin. ci/build documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#16855 opened Apr 18, 2025 by jberkhahn Loading…
1
17
[Misc] Add Next Edit Prediction (NEP) datasets support in benchmark_serving.py ci/build documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194) speculative-decoding v1
#16839 opened Apr 18, 2025 by dtransposed Loading…
1 task done
15
[V1][Metrics] add support for kv event publishing documentation Improvements or additions to documentation needs-rebase ready ONLY add when PR is ready to merge/full CI is needed v1
#16750 opened Apr 17, 2025 by alec-flowers Loading…
@markmc
86
ProTip! Adding no:label will show everything without a label.