Giorgio Sarno
HomeWriting

Writing

Notes on LLM inference, agent memory, and building useful software with AI coding agents.

Serving LLMs is a product decision

How to weigh quality, latency, GPU utilization, and cost when choosing between self-hosted LLM inference and model APIs.