Skip to content

Issues: ggml-org/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 9
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 14
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
55 Open 410 Closed
55 Open 410 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

sampling: Integrate Top-nσ into main sampling chain (and add it to the server) examples server
#13264 opened May 2, 2025 by oobabooga Loading…
Support start strings, the opposite of stop tokens. examples python python script changes server
#13214 opened Apr 30, 2025 by matteoserva Loading…
14
Support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client examples server
#13196 opened Apr 29, 2025 by matteoserva Loading…
1
3
context : allow cache-less context for embeddings examples server
#13108 opened Apr 25, 2025 by ggerganov • Draft
3
set b = ub when b > ub with embedding examples server
#12940 opened Apr 14, 2025 by ahmedshakill Loading…
1
server : (experimental) vision support via libmtmd examples server
#12898 opened Apr 11, 2025 by ngxson • Draft
2 of 5 tasks
59
server : crash when -b > -ub with embeddings bug Something isn't working embeddings embedding related topics good first issue Good for newcomers server
#12836 opened Apr 8, 2025 by ggerganov
3
common: add partial regex support examples server testing Everything test related tool calling
#12808 opened Apr 7, 2025 by ochafik Loading…
11
server: inject date_string in llama 3.x template + fix date for firefunction v2 examples python python script changes server testing Everything test related tool calling
#12802 opened Apr 7, 2025 by ochafik Loading…
1
2
WIP: Add support for CogAgent examples python python script changes server
#12679 opened Mar 31, 2025 by Tianyue-Zhao • Draft
llama-server : implement universal assisted decoding examples server
#12635 opened Mar 28, 2025 by g2mt Loading…
1
server: streaming of tool calls and thoughts when --jinja is on documentation Improvements or additions to documentation examples python python script changes script Script related server testing Everything test related tool calling
#12379 opened Mar 14, 2025 by ochafik • Draft
4 of 10 tasks
1
25
server : improve infill stop criteria examples server
#12333 opened Mar 11, 2025 by ggerganov • Draft
tool-call: Phi-4 support android Issues specific to Android Apple Metal https://en.wikipedia.org/wiki/Metal_(API) devops improvements to build systems and github actions documentation Improvements or additions to documentation examples ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs python python script changes server SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language testing Everything test related Vulkan Issues specific to the Vulkan backend
#12288 opened Mar 9, 2025 by jpohhhh Loading…
19
Server: openai-style lookup decoding examples python python script changes server
#12127 opened Mar 1, 2025 by eeroel • Draft
Cache based tokenization for the server input prompts demo Demonstrate some concept or idea, not intended to be merged examples server
#12067 opened Feb 25, 2025 by vnicolici Loading…
3
server webui easy config selection demo Demonstrate some concept or idea, not intended to be merged examples server
#12031 opened Feb 22, 2025 by poulphunter Loading…
10
sampling: add Top-nσ sampler to llama-server examples server
#11896 opened Feb 15, 2025 by CasualAutopsy Loading…
13
llama : add llama_batch_ext android Issues specific to Android examples python python script changes server
#11875 opened Feb 14, 2025 by ngxson Loading…
1
89
server (webui): Fix issue with muliple <think> tags in response examples server
#11779 opened Feb 10, 2025 by stduhpf Loading…
8
When llama_chat_apply_template doesn't work examples server
#11687 opened Feb 5, 2025 by ericcurtin Loading…
10
server : (webui) add support for .pdf file upload examples server
#11647 opened Feb 4, 2025 by dannyl1u Loading…
1
3
Update CMakeLists.txt examples server
#11558 opened Jan 31, 2025 by magicse Loading…
1
tool-call: add support for tool-calls using Model Context Protocol build Compilation issues examples server testing Everything test related
#11556 opened Jan 31, 2025 by bandoti Loading…
8 of 12 tasks
34
llama : second attempt to refactor vision API examples python python script changes server
#11292 opened Jan 18, 2025 by ngxson • Draft
1 of 5 tasks
1
55
ProTip! What’s not been updated in a month: updated:<2025-04-02.