AI Receptionist &
Voice Agent Development

I design, build, and rescue production voice AI agents — the kind that answer real phone calls, book real appointments, and get measured on real dollars. This is what I do full-time at a YC-backed voice AI company. I take on a small number of outside projects.

No agency overhead. You work directly with the engineer.

Where the experience comes from

  • Engineering Manager at Avoca (YC '23) — I lead the Deployed Engineering team shipping AI voice agents for home-services companies. Voice agents in production are my day job, not a side interest.
  • Staff Engineer at Twilio — built on Twilio Verify. Telephony, carrier behaviour, and what actually breaks on a real phone network.
  • PayPal risk platform — infrastructure handling 200M+ payments a day. Systems that cannot go down.
  • Zalando, SingleStore, Wayfair, Nutanix, HP — near real-time ML for fraud detection, control plane and billing, supply chain systems at scale.
  • Founder of QRCodeStack — I ship and operate my own product, so I understand cost per unit and churn, not just architecture diagrams.

What an AI receptionist actually needs to work

Most AI receptionist projects fail for the same four reasons, and none of them are the model. If you are evaluating building one, these are the things to get right first.

How an AI receptionist handles a single call A caller's speech passes through speech-to-text, an LLM that decides what to do, a tool call into your calendar or CRM, and text-to-speech back to the caller. The whole loop is budgeted under 800 milliseconds to first word. 01 Caller speaks on a real phone line 02 Speech → text ASR, streaming 03 Agent decides LLM + your rules 04 Acts on it calendar, CRM, pay 05 Speaks back TTS, interruptible …and the caller replies, and it all happens again Every loop must finish in under ~800 ms to first word
Past roughly 800 ms the caller starts talking over the agent and the conversation breaks down. That budget is an architecture decision, not something you tune in later.
  • It has to answer fast enough to feel human. Past roughly 800ms to first word, callers start talking over the agent and the conversation falls apart. That is an architecture decision, not a tuning one.
  • It has to know when you stopped talking. Bad endpointing cuts people off mid-sentence. This single issue causes more abandoned calls than any wrong answer.
  • It has to actually write to your calendar. An AI phone answering service that says "you are booked" without the booking existing is worse than no agent at all. Verify downstream, in the system of record.
  • It has to know when to hand off. Warm transfer with context, not a cold dump into a queue after the caller has already explained themselves twice.
I measure all four before declaring an agent live — the full scorecard I use is published here, including the target ranges and the ways each number gets gamed.

What I build

The layers of a production voice agent Five stacked layers — telephony, speech recognition, agent orchestration, integrations, and speech synthesis — with an evaluation and observability layer running alongside all of them. Telephony & SIP carriers, numbers, call control Speech recognition streaming ASR, endpointing, barge-in Agent orchestration prompts, state, tool calls, guardrails Your systems calendar, CRM, billing, ticketing Speech synthesis TTS, latency, interruption handling Evals & observability across every layer MOST SKIP THIS
I work across all five layers — but the one on the right is where most stalled projects actually get unstuck.
  • 01
    AI receptionist & phone answering agent — zero to production
    Full build of a working AI receptionist: telephony and SIP, speech-to-text, LLM orchestration, text-to-speech, tool and function calls into your systems, warm handoff to a human, and the dashboard your ops team will actually use. Delivered as code you own, not a locked platform.
  • 02
    Evals, testing & observability for voice agents
    The thing almost everyone skips. A regression suite of real call transcripts, automated scoring for intent coverage, task success and hallucination, plus per-call tracing — so you can change a prompt or swap a model on a Tuesday and know by Wednesday whether it got worse. I have written the field guide on this.
  • 03
    Voice agent audit & rescue
    You already have an agent and it is underperforming. I run a structured diagnostic across latency, endpointing, containment, tool-call reliability, and cost per resolved contact, then hand you a prioritised fix list with the estimated impact of each item.
  • 04
    AI agent architecture & platform selection
    Should you build on Vapi, Retell, LiveKit, Pipecat, or roll your own orchestration? Single agent, or a graph of specialised ones? I have run these architectures side by side and will give you a straight recommendation with the trade-offs written down.
  • 05
    Fractional AI engineering leadership
    Part-time technical leadership for a team already building agents — architecture reviews, hiring and interview loops, delivery process, and mentoring your engineers so the capability stays after I leave.
  • 06
    Backend & data infrastructure behind the agent
    Voice agents are only as good as what they can reach. PostgreSQL, Kafka, event pipelines, queueing and retries, CRM and scheduling integrations — the unglamorous layer that decides whether the agent can actually complete the task.

Voice AI for your industry

The hard parts change a lot by vertical. These are the ones where I have the most context.

Home services Inbound booking, dispatch, after-hours coverage, and quoting for HVAC, plumbing, and electrical. My day-job domain.
Healthcare & clinics Appointment scheduling, reminders, intake, and refill requests — with the consent, audit-trail, and escalation rules the category demands.
Customer support Tier-one deflection that actually resolves rather than deflects, with clean handoff and containment you can measure.
Restaurants & hospitality Reservations, order capture, and wait-time questions in noisy environments with heavy accent and menu-name variance.
Financial services Identity verification, balance and status enquiries, and collections — where a hallucinated answer is a regulatory problem.
Outbound & reminders Confirmation and reminder calls that reduce no-shows. I have built this pipeline end to end.

How much does AI voice agent development cost?

Straight answer: it depends on four things, and any quote you get without them being discussed is a guess.

The four things that drive voice agent cost Four sliding scales: how many intents the agent handles, how many systems it touches, whether it answers or acts, and how strict the compliance bar is. Each runs from a small fixed-scope project to a multi-month build. Intent surface One job Twelve, branching Systems touched None Calendar + CRM + pay Answering vs acting Answers Takes actions Compliance bar Light Audited, regulated
Any quote given before these four are discussed is a guess. I scope against them before putting a number on anything.
  • 1
    Intent surface
    One job — "book an appointment" — is a fixed-scope project. Twelve intents with branching logic is a different animal entirely.
  • 2
    Number of systems it must touch
    An agent that only talks is cheap. An agent that reads your calendar, writes to your CRM, and takes a payment is where the real work lives.
  • 3
    Answering vs. acting
    A wrong answer is embarrassing. A wrong action — a cancelled appointment, a double charge — is expensive. Acting agents need far more eval and guardrail work.
  • 4
    Compliance bar
    Call recording consent, PII handling, retention, and audit trails. In healthcare and finance this is a meaningful share of total build time, not a checkbox at the end.
Engagement shapes I offer: a fixed-price audit (roughly one to two weeks, ends in a written report and fix list); a fixed-scope build sprint; or an ongoing fractional retainer billed by days per month. Tell me which shape fits and I will send a number, not a brochure.

How engagements run

How an engagement runs Four steps: a free scoping call, a written scope and price, weekly build increments, then handover with code, evals and a runbook. 01 Scoping call free, 30 min 02 Written scope fixed price 03 Weekly builds demoable each week 04 Handover code, evals, runbook
No month-long silences. Something you can listen to every week, and a handover that means you do not need me on retainer forever.
  • 01
    Free 30-minute scoping call
    What you are building, where it is stuck, what "working" means in numbers. If I am not the right person you will hear that on this call.
  • 02
    Written scope and price
    A short document: what gets built, what does not, what I need from you, how we know it worked, and the cost. Fixed price wherever the scope allows it.
  • 03
    Build in weekly increments
    Something demoable every week and a written update. No month-long silences ending in a surprise.
  • 04
    Handover you can actually maintain
    Code you own, the eval harness, a runbook, and a walkthrough session with your engineers. The goal is that you do not need me on retainer forever.

Read my work before you hire me

The fastest way to judge whether I know this domain is to read what I have written about it.

Frequently asked questions

How much does AI voice agent development cost?

See the four cost drivers above. A single-intent agent on an existing platform is a small fixed-scope project; a multi-intent agent that writes into your CRM, takes payments, and needs an audit trail is a multi-month build. I scope against those axes before quoting rather than pricing off a template.

Do you build on Vapi, Retell, LiveKit, or from scratch?

All of them, depending on what you need. Platforms like Vapi and Retell get you to a working agent fastest and are the right call for most first builds. A custom orchestration layer on LiveKit or Pipecat earns its keep when you need control over turn-taking, interruption handling, or per-call cost at volume. I will tell you honestly which side of that line you are on — including when the answer is that you do not need me.

What actually makes a voice AI agent fail in production?

Almost never the model. It is latency above roughly 800ms to first token, endpointing that cuts callers off mid-sentence, silent tool-call failures that make the agent confidently wrong, and no eval harness — so nobody notices quality dropped until customers complain. Most rescue work is fixing those four things, not swapping the LLM.

Can you work alongside our existing engineering team?

Yes, and it is usually the better outcome. My day job is leading a Deployed Engineering team, so embedding with your engineers, setting up architecture and eval process, then handing over is a normal engagement shape rather than a special request.

What regions and time zones do you work with?

Teams in the US, UK, Europe, and India, with overlap hours agreed up front. Engagements are remote and mostly asynchronous, with one fixed weekly sync.

How do we start?

Email [email protected] with what you are building and where it is stuck. First call is a free 30-minute scoping conversation. If it is not a fit, I will say so and point you somewhere better.

Have a voice AI project that needs to actually ship?

Email [email protected]

Or find me on LinkedIn. I reply to everything that is not a template.