这是indexloc提供的服务,不要输入任何密码
Skip to content

[FEAT]: HuggingFace LLM Inference Endpoint support #679

@timothycarambat

Description

@timothycarambat

What would you like to see?

Add support for the 150,000 models found on HuggingFace that are available for inferencing and text/conversation generation.

https://huggingface.co/docs/text-generation-inference/messages_api#streaming

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions