Skip to content

Issues: ggerganov/llama.cpp

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
296 Open 3,164 Closed
296 Open 3,164 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Support BitNet b1.58 ternary models enhancement New feature or request Tensor Encoding Scheme https://github.com/ggerganov/llama.cpp/wiki/Tensor-Encoding-Schemes
#5761 opened Feb 28, 2024 by igorbarshteyn
88 👀 17
[Feature request] Any plans for AMD XDNA AI Engine support on Ryzen 7x40 processors?
#1499 opened May 17, 2023 by KarmaMonk
3 of 4 tasks
53 👀 16
Support CoreML like whisper.cpp? help wanted Extra attention is needed macos Issues specific to macOS performance Speed related topics
#1714 opened Jun 6, 2023 by realcarlos
10 👀 7
Phi 3 medium/small support enhancement New feature or request
#7439 opened May 21, 2024 by bartowski1182
33 👀 6
Newest apple model unsupported...
#8514 opened Jul 16, 2024 by 0wwafa
2 👀 6
Support QuaRot quantization scheme enhancement New feature or request stale
#6444 opened Apr 2, 2024 by EwoutH
10 👀 3
Bug: moondream2 inference not correct (severe quality degradation compared to reference) bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8037 opened Jun 20, 2024 by cmp-nct
5 👀 3
Bug: Quantizing Llama 3.1 70B to Q4_K_S with imatrix gives NaN bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8661 opened Jul 23, 2024 by bartowski1182
3 👀 3
llama : create llamax library refactoring Refactoring
#5215 opened Jan 30, 2024 by ggerganov
15 👀 3
Feature Request: Support for Florence-2 Vision Models enhancement New feature or request
#8012 opened Jun 19, 2024 by criminact
2 👀 3
FR: Phi-3-vision-128k-instruct implementation enhancement New feature or request
#7444 opened May 21, 2024 by mirek190
12 👀 3
Server: Add prompt processing progress endpoint? enhancement New feature or request help wanted Extra attention is needed server/webui
#6586 opened Apr 10, 2024 by stduhpf
8 👀 2
Random seed possible problems.
#8593 opened Jul 19, 2024 by 0wwafa
17 👀 2
ci : add Apple silicon (M1) macOS runners good first issue Good for newcomers testing Everything test related
#3469 opened Oct 4, 2023 by ggerganov
5 👀 2
ggml : add GPU support for Mamba models enhancement New feature or request help wanted Extra attention is needed Nvidia GPU Issues specific to Nvidia GPUs
#6758 opened Apr 19, 2024 by ggerganov
21 👀 2
Batched inference with greedy sampling yields different completions bug-unconfirmed stale
#6583 opened Apr 10, 2024 by mbonacci
7 👀 2
server: Bring back multimodal support enhancement New feature or request llava LLaVa and multimodal server
#8010 opened Jun 19, 2024 by ngxson
2 👀 2
Bug: QWEN2 quantization GGML_ASSERT bug-unconfirmed high severity Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow)
#7805 opened Jun 6, 2024 by bartowski1182
73 👀 2
Bug: abort on Android (pixel 8 pro) android Issues specific to Android bug Something isn't working high severity Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow)
#8109 opened Jun 25, 2024 by nivibilla
9 👀 2
Bug: b3383 breaks Llama 3.1 bug-unconfirmed critical severity Used to report critical severity bugs in llama.cpp (e.g. Crashing, Corrupted, Dataloss)
#8671 opened Jul 24, 2024 by Azirine
3 👀 2
[feature] Make space insertion optional in SentencePiece tokenizer enhancement New feature or request
#3664 opened Oct 18, 2023 by shibe2
28 👀 1
Bug: cant finetune bug-unconfirmed critical severity Used to report critical severity bugs in llama.cpp (e.g. Crashing, Corrupted, Dataloss)
#7643 opened May 30, 2024 by cabfile
16 👀 1
Server UI: Code snippets are being mangled by <em> italic emphasize replacement. stale
#7023 opened May 1, 2024 by jboero
3 👀 1
feature request - disabling tokenizer in conversion / inference enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#1765 opened Jun 8, 2023 by genenwoochoi
6 👀 1
ggml : add WebGPU backend help wanted Extra attention is needed research 🔬
#7773 opened Jun 5, 2024 by ggerganov
5 👀 1
ProTip! Adding no:label will show everything without a label.