llama.cpp

LLM inference in C/C++

$brew install llama.cpp

Official docs outline

Extra Credit builds an outline of llama.cpp's docs the first time your work uses it. Until then, start at the official documentation.