Skip to content

VAP15-76 docs: define each per-turn latency field and link it from sims, Traffic and logs - #1381

Open
scott-lowe-vapi wants to merge 1 commit into
mainfrom
scottlowe/latency-definitions
Open

scott-lowe-vapi wants to merge 1 commit into
mainfrom
scottlowe/latency-definitions

Conversation

@scott-lowe-vapi

@scott-lowe-vapi scott-lowe-vapi commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Linear: VAP15-76 Assess whether turn latency definitions belong in public docs. The matching API reference change is VapiAI/vapi#25247.

Description

  • Define every per-turn latency field in one place. Understanding latency gets a "Per-turn latency on a call" section. A table says where transcriberLatency, endpointingLatency, modelLatency, voiceLatency and turnLatency start and end, and a short list covers what trips people up: the fields don't add up to turnLatency, voice latency includes the voice.chunkPlan wait, everything is measured on Vapi's servers, turns the assistant didn't answer have no entry, and the first message is recorded only when the assistant waits for the caller, 0 can mean "not measured" (for example, a static tool message), and per-call averages include those zeros while simulation limits skip them.
  • Fix the stage order. The page listed endpointing before transcription. Lasensor measures transcription first (end of speech → words known), then endpointing (words known → turn sent to the model).
  • Say the model-intelligence total isn't turnLatency. It's a sum of component medians across calls, and it leaves out endpointing.
  • Link the new section from the pages that show latency. Simulation latency limits now say each metric is the same field as on a live call, name the field, and note that model and voice sit inside turn and that the synthetic tester can read faster than real callers. The Traffic tab says why its stages don't add up to the total. Performance metrics, call logs and the glossary link to it too.
  • Definitions come from Lasensor in VapiAI/vapi (libs/core/src/util/lasensorUtil/Lasensor.ts) and the simulation evaluator (libs/core/src/functions/simulationFunctions/latencyExpectationsEvaluate.ts).

Testing Steps

  • Pinned Fern 5.151.1 check: 0 errors and the same 15 existing warnings.
  • git diff --check passes.
  • In the preview, open Understanding latency and check the new table, then follow the link from Simulations → Advanced → Metrics and aggregations and from the Traffic tab page to the #per-turn-latency-on-a-call anchor.

🤖 Generated with Claude Code

@scott-lowe-vapi scott-lowe-vapi changed the title Whats new 09-14-2026 (#1234) docs: define each per-turn latency field and link it from sims, Traffic and logs Oct 31, 2026

scott-lowe-vapi commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor Author

@github-actions

Copy link
Copy Markdown
Contributor

@scott-lowe-vapi
scott-lowe-vapi marked this pull request as ready for review October 31, 2026 02:02
@scott-lowe-vapi
scott-lowe-vapi force-pushed the scottlowe/latency-definitions branch from d0f156b to e575ca7 Compare October 31, 2026 02:05
@scott-lowe-vapi scott-lowe-vapi changed the title docs: define each per-turn latency field and link it from sims, Traffic and logs VAP15-76 docs: define each per-turn latency field and link it from sims, Traffic and logs Oct 31, 2026
@github-actions

Copy link
Copy Markdown
Contributor

@scott-lowe-vapi
scott-lowe-vapi marked this pull request as draft October 31, 2026 02:08
@scott-lowe-vapi
scott-lowe-vapi marked this pull request as ready for review October 31, 2026 02:09
@scott-lowe-vapi
scott-lowe-vapi force-pushed the scottlowe/latency-definitions branch from e575ca7 to 267f5e3 Compare October 31, 2026 02:37
@scott-lowe-vapi
scott-lowe-vapi marked this pull request as draft October 31, 2026 02:38
@github-actions

Copy link
Copy Markdown
Contributor

@scott-lowe-vapi
scott-lowe-vapi marked this pull request as ready for review October 31, 2026 02:40
@scott-lowe-vapi
scott-lowe-vapi force-pushed the scottlowe/latency-definitions branch from 267f5e3 to eacdb83 Compare October 31, 2026 02:45
@github-actions

Copy link
Copy Markdown
Contributor

@stephenvapiai stephenvapiai left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Edit pass on the changed passages. Small wording and style suggestions only; technical content not reviewed.

understanding-latency.mdx line 4 is outside the diff, so a note here: the page now covers the per-turn fields too, so the description (which feeds llms.txt) should mention them. Suggested:

description: Understand voice-to-voice latency, the per-turn latency fields each call records, Vapi performance metrics, and how model capability, endpointing, and transport affect it.

Comment thread fern/glossary.mdx Resolved
…ms, Traffic and logs

Add a "Per-turn latency on a call" section to Understanding latency that says
where each turnLatencies field starts and ends, and fix the stage order
(transcription runs before endpointing). Link it from the simulation latency
limits, Traffic tab, performance metrics, call logs and glossary pages, and
note why the stages don't add up to the turn total.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@scott-lowe-vapi
scott-lowe-vapi force-pushed the scottlowe/latency-definitions branch from eacdb83 to f95a238 Compare November 6, 2026 05:33
@scott-lowe-vapi

Copy link
Copy Markdown
Contributor Author

Front-matter description updated in f95a238. I kept 'affect response time' at the end instead of 'affect it', which read oddly after a list: 'Understand voice-to-voice latency, the per-turn latency fields each call records, Vapi performance metrics, and how model capability, endpointing, and transport affect response time.'

@github-actions

github-actions Bot commented Nov 6, 2026

Copy link
Copy Markdown
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants