Vad metrics

[katstankiewicz]

Add vad metrics to track

• early detection rate
  • how often did the vad trigger before the user was done speaking (often the agent is still able to recover from the cancelling ongoing query flow)
• stuck rate
  • how often did the vad not fire at all (relative to all turns)
  • if no fallback/nudge functionality is enabled this "stuck" vad turn will only happen once per conversation since the conversation will die because of this
• forced completion rate
  • with pipecat smartturn there is an automatic turn_end signal after 3s of silence regardless of vad, this measures how often that happened
  • krisp does not have this feature
• vad mean time to complete (ms)
  • average number of ms it took for vad to detect when the user stopped speaking
• forced completion sub-sub-metric:
  • gathers a reason why the vad may not have fired on it's own, same as conversation end correctly reasons: spelled entity, acknowledgement or short utterance