Bug Report

Description

Failure to download the reranker model from the UI, UI hangs and healthcheck fails. Need to rebuild the container every time.

"GET /ws/socket.io/?EIO=4&transport=polling&t=P3UgWz5&sid=bsurF5q0lo1p8SNnAAEd HTTP/1.0" 200 OK
INFO  [apps.rag.main] Updating reranking model:  to BAAI/bge-reranker-v2-m3
INFO  [config] Saving 'RAG_RERANKING_MODEL' to config.json
ERROR [apps.rag.utils] Cannot determine model snapshot path: Cannot find an appropriate cached snapshot folder for the specified revision on the local disk and outgoing traffic has been disabled. To enable repo look-ups and downloads online, pass 'local_files_only=False' as input.
Traceback (most recent call last):
  File "/app/backend/apps/rag/utils.py", line 353, in get_model_path
    model_repo_path = snapshot_download(**snapshot_kwargs)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 220, in snapshot_download

Bug Summary: [Provide a brief but clear summary of the bug]

Steps to Reproduce: From the webui/admin panel/documents click hybrid search and add BAAI/bge-reranker-v2-m3 in the field, and click download icon. It keeps downloading and the server fails.

Expected Behavior: Should download model and ready for queries.

Actual Behavior: Server crashes

Environment

• Open WebUI Version: [e.g., 0.1.120]

• Ollama (if applicable): [e.g., 0.1.30, 0.1.32-rc1]

• Operating System: Ubuntu 22.04

• Browser (if applicable): [e.g., Chrome 100.0, Firefox 98.0]

Reproduction Details

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I am on the latest version of both Open WebUI and Ollama.
• [] I have included the browser console logs.
• I have included the Docker container logs.

Logs and Screenshots

Browser Console Logs: [Include relevant browser console logs, if applicable]

Docker Container Logs:

"GET /ws/socket.io/?EIO=4&transport=polling&t=P3UgWz5&sid=bsurF5q0lo1p8SNnAAEd HTTP/1.0" 200 OK
INFO  [apps.rag.main] Updating reranking model:  to BAAI/bge-reranker-v2-m3
INFO  [config] Saving 'RAG_RERANKING_MODEL' to config.json
ERROR [apps.rag.utils] Cannot determine model snapshot path: Cannot find an appropriate cached snapshot folder for the specified revision on the local disk and outgoing traffic has been disabled. To enable repo look-ups and downloads online, pass 'local_files_only=False' as input.
Traceback (most recent call last):
  File "/app/backend/apps/rag/utils.py", line 353, in get_model_path
    model_repo_path = snapshot_download(**snapshot_kwargs)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/huggingface_hub/_snapshot_download.py", line 220, in snapshot_download

Screenshots (if applicable): [Attach any relevant screenshots to help illustrate the issue]

Installation Method

Docker installation

Additional Information

Added the following suggestions but still crashes: RAG_EMBEDDING_MODEL_AUTO_UPDATE=False

and

RAG_EMBEDDING_MODEL_TRUST_REMOTE_CODE = True

Note

If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!