Private AI, in practice

Guides to running open-source models inside your own infrastructure: deployment, OpenAI-compatible APIs, model choice, security and governance.

Models and RAG

How to Evaluate Open Source LLMs Using Your Own Data

Evaluate open source LLMs on your own data: build a golden set, choose task metrics, use LLM-as-a-judge with care and compare quantized variants for production.

8 min read