llama.cpp

github.com ↗

Inference of Meta's LLaMA model (and others) in pure C/C++. #opensource