这是indexloc提供的服务,不要输入任何密码
Skip to content

[BUG]: (fetch failed on embed) HuggingFace/Xenova blocking download from user IP #821

@gabrie

Description

@gabrie

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I'm using latest AnythingLLM Version 1.1.1 (1.1.1) on a M2 Mac Studio.

I tried to embed some PDF or TXT files with default LanceDB, fetch failed.
Then I get Chroma from github installed and ran locally with below command, NOT using Docker. Which is suggested by Chroma github.

pip install chromadb
chroma run --path /Volumes/Thunder_1T/chromaDB/

Then I tested heartbeat, working.
Then I tried to embed same docs again, still failed. Since I tried with LanceDB getting same error from AnythingLLM, I guess I should report the bug here instead of Chroma. If it's a bug on Chroma, please excuse me. Not a tech guy.
Below finds running logs when error pops.

            (((((((((    (((((####
         ((((((((((((((((((((((#########
       ((((((((((((((((((((((((###########
     ((((((((((((((((((((((((((############
    (((((((((((((((((((((((((((#############
    (((((((((((((((((((((((((((#############
     (((((((((((((((((((((((((##############
     ((((((((((((((((((((((((##############
       (((((((((((((((((((((#############
         ((((((((((((((((##############
            (((((((((    #########

Running Chroma

Saving data to: /Volumes/Thunder_1T/chromaDB/
Connect to chroma at: http://localhost:8000
Getting started guide: https://docs.trychroma.com/getting-started

INFO: [27-02-2024 21:37:24] Set chroma_server_nofile to 65535
INFO: [27-02-2024 21:37:24] Anonymized telemetry enabled. See https://docs.trychroma.com/telemetry for more information.
DEBUG: [27-02-2024 21:37:24] Starting component System
DEBUG: [27-02-2024 21:37:24] Starting component OpenTelemetryClient
DEBUG: [27-02-2024 21:37:24] Starting component SimpleAssignmentPolicy
DEBUG: [27-02-2024 21:37:24] Starting component SqliteDB
DEBUG: [27-02-2024 21:37:24] Starting component QuotaEnforcer
DEBUG: [27-02-2024 21:37:24] Starting component Posthog
DEBUG: [27-02-2024 21:37:24] Starting component LocalSegmentManager
DEBUG: [27-02-2024 21:37:24] Starting component SegmentAPI
INFO: [27-02-2024 21:37:24] Started server process [3055]
INFO: [27-02-2024 21:37:24] Waiting for application startup.
INFO: [27-02-2024 21:37:24] Application startup complete.
INFO: [27-02-2024 21:37:24] Uvicorn running on http://localhost:8000 (Press CTRL+C to quit)
INFO: [27-02-2024 21:37:48] ::1:54252 - "GET /api/v1/heartbeat HTTP/1.1" 200
ERROR: [27-02-2024 21:37:48] Collection test does not exist.
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py", line 97, in receive
return self.receive_nowait()
^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py", line 92, in receive_nowait
raise WouldBlock
anyio.WouldBlock

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 159, in call_next
message = await recv_stream.receive()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py", line 112, in receive
raise EndOfStream
anyio.EndOfStream

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/init.py", line 82, in catch_exceptions_middleware
return await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 165, in call_next
raise app_exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/contextlib.py", line 155, in exit
self.gen.throw(value)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 191, in call
response = await self.dispatch_func(request, call_next)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/init.py", line 96, in check_http_version_middleware
return await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 165, in call_next
raise app_exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 758, in call
await self.middleware_stack(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 778, in app
await route.handle(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 299, in handle
await self.app(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 79, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py", line 74, in app
response = await func(request)
^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/fastapi/routing.py", line 278, in app
raw_response = await run_endpoint_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/fastapi/routing.py", line 193, in run_endpoint_function
return await run_in_threadpool(dependant.call, **values)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool
return await anyio.to_thread.run_sync(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 2144, in run_sync_in_worker_thread
return await future
^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 851, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/telemetry/opentelemetry/init.py", line 127, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/auth/fastapi.py", line 242, in wrapped
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/init.py", line 440, in get_collection
return self._api.get_collection(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/telemetry/opentelemetry/init.py", line 127, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/api/segment.py", line 261, in get_collection
raise ValueError(f"Collection {name} does not exist.")
ValueError: Collection test does not exist.
INFO: [27-02-2024 21:37:48] ::1:54254 - "GET /api/v1/collections/test?tenant=default_tenant&database=default_database HTTP/1.1" 500

Are there known steps to reproduce?

Launch Chroma locally
Launch AnythingLLM
Set Vector DB to Chroma
Try to embed any docs in a workspace in AnythingLLM

Metadata

Metadata

Assignees

No one assigned

    Labels

    possible bugBug was reported but is not confirmed or is unable to be replicated.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions