[Bug]: Erroneous error messages with Bedrock : A conversation must start with a user message. #8559
Description
What happened?
When using AWS Bedrock with certain models (Deepseek, Claude) and using RAG API with several attachments I am getting the error message "A conversation must start with a user message. Try again with a conversation that starts with a user message." . I assume this happens because the attachments and plus prompt do not fit the context window but it seems the attachments are added first and then the prompt so that perahps the prompt is ignored ? It should show the typical errro message:
The model returned the following errors: Input is too long for requested model.
Version Information
ochat@peters-chat:~/LibreChat$ docker images | grep librechat
ghcr.io/danny-avila/librechat-dev-api latest cd3432a5c3f6 57 minutes ago 1.18GB
ghcr.io/danny-avila/librechat-dev-api 70065060a0ed 3 days ago 1.19GB
ghcr.io/danny-avila/librechat-dev-api b87bbe4049a3 8 days ago 1.18GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite latest 8858d2bd9ff5 9 days ago 1.48GB
ghcr.io/danny-avila/librechat-dev-api 03a5fd399ee9 2 weeks ago 1.18GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite 13e75a2c0e7a 2 weeks ago 1.48GB
ghcr.io/danny-avila/librechat-dev-api 6e5bce386b73 2 weeks ago 1.19GB
ghcr.io/danny-avila/librechat-dev-api ec732384bd62 6 weeks ago 1.12GB
ghcr.io/danny-avila/librechat-dev-api 506e43540118 8 weeks ago 1.1GB
ghcr.io/danny-avila/librechat-dev-api 44c1aef1f791 2 months ago 1.1GB
ghcr.io/danny-avila/librechat-dev-api 80d5028342c5 2 months ago 1.09GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite e7da8e6aca0f 2 months ago 1.31GB
ghcr.io/danny-avila/librechat-dev-api 65526bf57a1d 2 months ago 1.09GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite 817faebddae9 3 months ago 1.31GB
Steps to Reproduce
- use AWS Bedrock
- select deepseek or claude
- 3-10 attachments
- add a prompt
What browsers are you seeing the problem on?
Chrome
Relevant log output
4-465c-bd8c-758e2be80324/context - 200
rag_api-1 | 2025-07-19 19:46:31,172 - root - INFO - Request GET http://rag_api:8000/documents/51f164c5-e40f-4c49-8aa7-0a348d49cb3c/context - 200
rag_api-1 | 2025-07-19 19:46:31,206 - root - INFO - Request GET http://rag_api:8000/documents/832dd9f1-d0ba-4f63-841c-94719bf4f9a9/context - 200
rag_api-1 | 2025-07-19 19:46:31,206 - root - INFO - Request GET http://rag_api:8000/documents/74d6b6eb-bb2b-4302-870a-369126fb7542/context - 200
rag_api-1 | 2025-07-19 19:46:31,222 - root - INFO - Request GET http://rag_api:8000/documents/9da06e15-4f42-47ed-b41a-14d3eaa7e930/context - 200
LibreChat-NGINX | 97.113.86.216 - - [19/Jul/2025:19:46:31 +0000] "GET /c/297f698a-54d0-4334-8716-c1384fc92373 HTTP/2.0" 200 4821 "https://peters-chat.r.internetchen.de/c/297f698a-54d0-4334-8716-c1384fc92373" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
rag_api-1 | 2025-07-19 19:46:31,263 - root - INFO - Request GET http://rag_api:8000/documents/a3b297a3-e9b6-4ea6-8ab7-4bdb5ac4cc8a/context - 200
rag_api-1 | 2025-07-19 19:46:31,267 - root - INFO - Request GET http://rag_api:8000/documents/ad73bed3-33d2-459b-a8e4-03672739ac42/context - 200
rag_api-1 | 2025-07-19 19:46:31,278 - root - INFO - Request GET http://rag_api:8000/documents/959205e9-6719-4688-9555-8fe6600f456d/context - 200
rag_api-1 | 2025-07-19 19:46:31,287 - root - INFO - Request GET http://rag_api:8000/documents/ba30bd64-553d-41fe-a6f6-80dd439b6b43/context - 200
rag_api-1 | 2025-07-19 19:46:31,295 - root - INFO - Request GET http://rag_api:8000/documents/d4b1fe89-ad66-4b7d-af57-dd7cee85df54/context - 200
rag_api-1 | 2025-07-19 19:46:31,299 - root - INFO - Request GET http://rag_api:8000/documents/d5d12b22-807a-466c-a1a7-0ba3ff1a647c/context - 200
rag_api-1 | 2025-07-19 19:46:31,315 - root - INFO - Request GET http://rag_api:8000/documents/e717a123-9847-41c5-b7d5-90c98500f71e/context - 200
rag_api-1 | 2025-07-19 19:46:31,317 - root - INFO - Request GET http://rag_api:8000/documents/fe6a5f70-e50c-4797-8c12-21f0af083996/context - 200
chat-meilisearch | 2025-07-19T19:46:31.698166Z INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=4.51ms time.idle=6.97ms
chat-meilisearch | 2025-07-19T19:46:31.708254Z INFO HTTP request{method=GET host="meilisearch:7700" route=/indexes/convos/documents/297f698a-54d0-4334-8716-c1384fc92373 query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=1.26ms time.idle=96.6µs
LibreChat-API | 2025-07-19 19:46:31 error: [api/server/controllers/agents/client.js #sendCompletion] Operation aborted A conversation must start with a user message. Try again with a conversation that starts with a user message.
LibreChat-API | 2025-07-19 19:46:31 error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type A conversation must start with a user message. Try again with a conversation that starts with a user message.
chat-meilisearch | 2025-07-19T19:46:31.854791Z INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=401µs time.idle=2.80ms
chat-meilisearch | 2025-07-19T19:46:31.864171Z INFO HTTP request{method=GET host="meilisearch:7700" route=/indexes/convos/documents/297f698a-54d0-4334-8716-c1384fc92373 query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=180µs time.idle=149µs
LibreChat-NGINX | 97.113.86.216 - - [19/Jul/2025:19:46:31 +0000] "POST /api/agents/chat/bedrock HTTP/2.0" 200 2623 "https://peters-chat.r.internetchen.de/c/297f698a-54d0-4334-8716-c1384fc92373" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
chat-meilisearch | 2025-07-19T19:46:31.876223Z INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=329µs time.idle=1.97ms
LibreChat-NGINX | 97.113.86.216 - - [19/Jul/2025:19:46:31 +0000] "GET /c/297f698a-54d0-4334-8716-c1384fc92373 HTTP/2.0" 200 4821 "https://peters-chat.r.internetchen.de/c/297f698a-54d0-4334-8716-c1384fc92373" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
chat-meilisearch | 2025-07-19T19:46:32.441574Z INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 4014 }Screenshots
Code of Conduct
- I agree to follow this project's Code of Conduct