Overview

The LlamaNexus ecosystem is three products that share one core chat experience over your own local models:

• LlamaNexus - a Go proxy in front of llama.cpp's llama-server, adding model routing, RPC-distributed inference, and an Ollama-compatible API.
• LlamaNexus for VS Code - the same chat experience as a VS Code extension, no browser tab needed.
• LlamaNexus WebUI - a standalone, smooth browser chat client for a LlamaNexus proxy.

Pick a product above to get started.