Skip to content

Research

Differential privacy budgets in LLM fine-tuning: a practitioner's guide

A reproducible study of ε–δ budgets, gradient clipping, and per-sample noise on three open-weight models, with concrete production trade-offs.

privacyllmdifferential-privacy

14 March 2026 · Reseni Privacy Team · DOI 10.5281/zenodo.0000001

Fine-tuning large language models on sensitive data without leakage is one of the hardest open problems in applied AI privacy.

This report presents a reproducible benchmark across three open-weight models (8B–70B parameters) measuring perplexity loss and downstream task accuracy as a function of the (ε, δ) privacy budget.

We release the training pipeline, evaluation harness, and a decision matrix linking ε ranges to product risk tiers.

Download PDF →

Differential privacy budgets in LLM fine-tuning: a practitioner's guide · Reseni Labs