[BUG]: User Query embeddings are being chunked per character when using LM Studio embedding models. #1230
Description
How are you running AnythingLLM?
AnythingLLM desktop app
What happened?
Document embeddings are chunked properly, but user query embeddings are chunked per character resulting in useless embeddings - when using LM Studio as embedding provider. Default built-in embeddings work properly.
LM Studio Logs
[2024-04-29 22:21:19.847] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "D"
}
[2024-04-29 22:21:19.855] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.857] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "e"
}
[2024-04-29 22:21:19.865] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.866] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "f"
}
[2024-04-29 22:21:19.874] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.876] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "i"
}
[2024-04-29 22:21:19.884] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.886] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "n"
}
[2024-04-29 22:21:19.893] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.895] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "e"
}
[2024-04-29 22:21:19.903] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.904] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": " "
}
[2024-04-29 22:21:19.912] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.913] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "X"
}
[2024-04-29 22:21:19.921] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.923] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "S"
}
[2024-04-29 22:21:19.931] [INFO] Returning embeddings (not shown in logs)
[2024-04-29 22:21:19.932] [INFO] Received POST request to /v1/embeddings with body: {
"model": "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q8_0.gguf",
"input": "S"
}
[2024-04-29 22:21:19.940] [INFO] Returning embeddings (not shown in logs)Are there known steps to reproduce?
No response