Senior Software Engineer
Voicedash · AI voice dictation and meeting-notes app
Mar 2026 – Present
- Built the database-driven model-routing engine for the transcription pipeline, selecting STT and LLM-polish providers per request with per-variant timeouts, single-level fallback, and retries, cutting p99 latency by about 33% (9.5s to 6.4s) versus the legacy route.
- Integrated several OpenAI-compatible STT providers along with a Telegram-based shadow-evaluation system that scores alternative models on copied live traffic without changing user-facing responses.
- Made LLM output reliable in production by enforcing a JSON schema through response_format, adding a defensive parser that never shows the user a damaged response, and keeping the system prompt static so it can be cached.
- Instrumented the backend with Sentry tracing, per-request and LLM-cost metrics, and latency distributions tagged by output language (570K+ data points), then tuned span volume to control cost.
- Defined the production infrastructure as code with Terraform, then planned and scripted the move from a US to an EU host with a rehearsal run, preflight checks, and a cutover runbook.