Giorgio Sarno

AI Software Engineer at Replika

At Replika, I work on LLM inference, including models hosted internally on vLLM and SGLang, GPU sizing, and routing to external APIs.

I also build agent infrastructure, covering tool use, background tasks and multi agent orchestration, and I work on a memory layer.

My path to this work runs through data platforms, production machine learning and physics research. At Sparrow Parts, I designed and deployed custom embedding models for industrial part matching. At Stratio, I led a team that deployed time series models to production for fleet monitoring. My PhD research in Marseille focused on numerical approaches to quantum gravity. During that research I developed open source C libraries, including sl2cfoam, with CUDA kernels for GPU parallelization.

Experience

Expand for context

Replika AICurrent
Oct 2025 – present

LLM inference with vLLM and SGLang, GPU sizing and routing to third party APIs, along with agent infrastructure and a memory layer.

October 2025 to present. Work on LLM inference, agent infrastructure covering tool use, background tasks and multi agent orchestration, and a memory layer.

Key initiatives

  • Technical focus: inference, agents, and memory systems.

Sparrow Parts
Feb – Oct 2025

Designed and deployed custom embedding models for industrial part matching, and set direction for the data platform.

February 2025 to October 2025. Work on custom embedding models for industrial part matching and direction for the data platform.

Key initiatives

  • Technical focus: custom embeddings and matching.
  • Leadership: a team of four engineers.

Mate
2024 – 2025 · part-time

Built an event driven recommendation system and the ML stack, including cold start matching and behavioral tracking.

Part time, 2024 to 2025. Work on an event driven recommendation system and the ML stack behind it.

Key initiatives

  • Technical focus: cold-start matching and behavioral signals.

Stratio
2022 – Feb 2025

Led a team deploying time series models to production for fleet monitoring, and worked on automotive diagnostics.

2022 to February 2025. Work on production time series models for fleet monitoring and on automotive diagnostics.

Knots Analytics
2020 – 2023

Built route optimization tools for the marine industry and was responsible for product and technical direction.

2020 to 2023. Work on route optimization tools for the marine industry, with responsibility for product and technical direction.

Centre de Physique Théorique de Marseille
2017 – 2020

Research and a PhD in theoretical physics on numerical quantum gravity, including open source C libraries such as sl2cfoam.

2017 to 2020. Developed open source C libraries, including sl2cfoam, using CUDA kernels for GPU parallelization.

Areas of focus

LLM inference

vLLM, SGLang, GPU sizing and routing to third party APIs.

Agent infrastructure

Tool use, background tasks and multi agent orchestration.

Memory systems and embeddings

Memory layer work and custom embedding models.

Technical context

LLMs and agents

vLLM · SGLang · agent architecture · memory systems

Engineering

Python · PyTorch · C · CUDA

Writing

Technical notes will live here. The first piece is in progress.

Visit writing

Public sources

Connect

For a technical conversation, reach me through LinkedIn. My public work and profile are on GitHub.