这是indexloc提供的服务,不要输入任何密码
Skip to content

[CHORE]: Embedder embedText length check #1239

@timothycarambat

Description

@timothycarambat

How are you running AnythingLLM?

All versions

What happened?

Continuation of #1238

When embedding a string or array of strings we need to ensure that every item is < the length of the maximum length of the selected embedding model or else the embedder will fail to encode and vectorized a prompt.

This only applies to the prompt given, which tends to be below the embedders length, but we need to ensure this is always the case via a util/helper function.

Are there known steps to reproduce?

No response

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions