这是indexloc提供的服务,不要输入任何密码
Skip to content

How is streaming between LLM to TTS working #1697

@kailashsp

Description

@kailashsp

I mostly being using the AWS bedrock LLM, TTS and STT. I have noticed in the terminal that only after you get all the chunks from LLM, TTS starts to work. When the answer are long the latency tend to be really high. Is this the intended way? Or are there any ways to optimise for latency.

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions