llama.cpp

llama.cpp

83313
12413

LLM inference in C/C++

Community

GitHub

Languages

C++
59.5%
C
14.5%
Python
9.3%
Cuda
6.7%
Objective-C
2.5%
Metal
2.3%
Shell
1.8%
CMake
1.1%
TypeScript
1%
JavaScript
0.7%
Makefile
0.4%
Nix
0.2%

Good First Issues

Ideal for first-time contributors

All Issues

Browse every open issue in this repository

README.md