Skip to content
Navigation Menu
Toggle navigation
Sign in
Product
GitHub Copilot
Write better code with AI
GitHub Advanced Security
Find and fix vulnerabilities
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Discussions
Collaborate outside of code
Code Search
Find more, search less
Explore
Why GitHub
All features
Documentation
GitHub Skills
Blog
Solutions
By company size
Enterprises
Small and medium teams
Startups
Nonprofits
By use case
DevSecOps
DevOps
CI/CD
View all use cases
By industry
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
Topics
AI
DevOps
Security
Software Development
View all
Explore
Learning Pathways
Events & Webinars
Ebooks & Whitepapers
Customer Stories
Partners
Executive Insights
Open Source
GitHub Sponsors
Fund open source developers
The ReadME Project
GitHub community articles
Repositories
Topics
Trending
Collections
Enterprise
Enterprise platform
AI-powered developer platform
Available add-ons
GitHub Advanced Security
Enterprise-grade security features
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search or jump to...
Search code, repositories, users, issues, pull requests...
Search syntax tips
Provide feedback
Saved searches
Use saved searches to filter your results more quickly
Sign in
Sign up
Reseting focus
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
ggml-org
/
llama.cpp
Public
Notifications
You must be signed in to change notification settings
Fork
11.6k
Star
79k
Code
Issues
340
Pull requests
430
Discussions
Actions
Projects
9
Wiki
Security
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Projects
Wiki
Security
Insights
Files
master
Breadcrumbs
llama.cpp
/
examples
/
Copy path
Directory actions
More options
Directory actions
More options
Latest commit
History
History
master
Breadcrumbs
llama.cpp
/
examples
/
Top
Folders and files
Name
Name
Last commit message
Last commit date
parent directory
..
batched-bench
batched-bench
batched.swift
batched.swift
batched
batched
convert-llama2c-to-ggml
convert-llama2c-to-ggml
cvector-generator
cvector-generator
deprecation-warning
deprecation-warning
embedding
embedding
eval-callback
eval-callback
export-lora
export-lora
gen-docs
gen-docs
gguf-hash
gguf-hash
gguf-split
gguf-split
gguf
gguf
gritlm
gritlm
imatrix
imatrix
infill
infill
jeopardy
jeopardy
llama-bench
llama-bench
llama.android
llama.android
llama.swiftui
llama.swiftui
llava
llava
lookahead
lookahead
lookup
lookup
main
main
parallel
parallel
passkey
passkey
perplexity
perplexity
quantize
quantize
retrieval
retrieval
rpc
rpc
run
run
save-load-state
save-load-state
server
server
simple-chat
simple-chat
simple-cmake-pkg
simple-cmake-pkg
simple
simple
speculative-simple
speculative-simple
speculative
speculative
sycl
sycl
tokenize
tokenize
tts
tts
CMakeLists.txt
CMakeLists.txt
Miku.sh
Miku.sh
chat-13B.bat
chat-13B.bat
chat-13B.sh
chat-13B.sh
chat-persistent.sh
chat-persistent.sh
chat-vicuna.sh
chat-vicuna.sh
chat.sh
chat.sh
convert_legacy_llama.py
convert_legacy_llama.py
json_schema_pydantic_example.py
json_schema_pydantic_example.py
json_schema_to_grammar.py
json_schema_to_grammar.py
llama.vim
llama.vim
llm.vim
llm.vim
pydantic_models_to_grammar.py
pydantic_models_to_grammar.py
pydantic_models_to_grammar_examples.py
pydantic_models_to_grammar_examples.py
reason-act.sh
reason-act.sh
regex_to_grammar.py
regex_to_grammar.py
server-llama2-13B.sh
server-llama2-13B.sh
server_embd.py
server_embd.py
ts-type-to-grammar.sh
ts-type-to-grammar.sh
View all files
You can’t perform that action at this time.