Inference Software
2 applications
Popular inference applications include llama.cpp and BitLlama Desktop. Compare features, track versions, and find alternatives.
llama.cpp
v5.10
Ggml
llama.cpp is an efficient C++ implementation leveraging the GGML library to run large language model (LLM) inference locally, focusing on CPU efficiency with...
BI
BitLlama Desktop
v1.0.0
Imonoonoko
Desktop GUI for BitLlama LLM inference engine with Soul learning and model management. BitLlama Desktop is a Tauri 2.0 + Svelte desktop application for local...
