Evidence-grade sign-off for model swaps and agent deployments.
Model deprecations force migrations on someone else's schedule. "We eyeballed ten outputs" is not evidence a regulated enterprise can take to a risk committee. This site is about migration assurance: the evals, statistics, and governance mapping that let you say "the new model is safe to deploy" — and prove it.
Work
signoff — an open-source LLM migration
assurance harness: N-run, nondeterminism-aware A/B equivalence testing with layered matching
(exact → normalized → numeric → LLM-judge), flip-rate statistics, and an audit-ready report.
Vendor-neutral by design.
Writing
About
I'm Ashish Kumar Singh, a GenAI practitioner building LLM systems for legal and healthcare clients — migration validation, prompt regression testing, and document-extraction evals in privilege- and safety-critical settings. I work at the bridge between the teams that ship AI systems and the teams that must answer for them.
Elsewhere: GitHub.