Searching map area
llama.cpp
Y 100%
Software library for LLM infrence
Join to rate
Join to rate

llama.cpp is an open source software library written in C++, that performs inference on various Large Language Models such as Llama. It is co-developed alongside the ggml library, a general-purpose tensor library.

Instance of
Software
Wikidata