-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Open
Description
Inspired by the conversation in #1999 and my personal experience.
Currently there are certain metrics included in Metric objects, but some useful information can still be added to enrich them for better utility, for example:
parent_speech_id
: for better conversation lineage tracking, from speech_handle's parent ref.- model_name and vendor/provide_name: particularly useful when used with a fallback adapter for better observability over models or third-party services.
With such metadata, Livekit could even publish vendor stats with telemetry like what openrouter is doing with model providers. There are leaderboards like the ones from Artificial Intelligence Analysis, but those numbers can change drastically when used in real-world applications.
What do you think?
Metadata
Metadata
Assignees
Labels
No labels