Models Don't Auto-download on embedderd --start #2

Open
opened 2026-01-27 14:54:00 +00:00 by rawan · 1 comment
Member

Current behaviour:

  • embedderd checks if the models directory exists, if not it fails with this error
✗ Service 'embedderd' failed

Recent logs:
  Run ./download_models.sh first
  Error: Models directory not found: /home/rawan/hero/var/embedder/models
  
  ========================================
    HeroEmbedder - Loading all models...
  ========================================

Expected behavior:

  • Models are auto-downloaded if they don't exist
  • Models download shouldn't timeout to download the models
  • Models should download in background, we should be able to test this with openrpc endpoint
## Current behaviour: - embedderd checks if the models directory exists, if not it fails with this error ``` ✗ Service 'embedderd' failed Recent logs: Run ./download_models.sh first Error: Models directory not found: /home/rawan/hero/var/embedder/models ======================================== HeroEmbedder - Loading all models... ======================================== ``` ## Expected behavior: - Models are auto-downloaded if they don't exist - Models download shouldn't timeout to download the models - Models should download in background, we should be able to test this with openrpc endpoint
Member
  • Models are auto downloaded if they doesn't exist
  • Models download doesn't timeout
  • Models are downloaded in the foreground process for now, when it was added as a background process two issues appeared:
    * Race condition: between the thread downloading the model (writing in the directory) and zinit service trying to read from this directory
    * Partial download problem: when download happens in the background it partially downloads the models while the server expects that all models are downloaded in the directory, so in that case the server have the possibility to use a non-existent model while it should not
    @rawan
- [x] Models are auto downloaded if they doesn't exist - [x] Models download doesn't timeout - Models are downloaded in the foreground process for now, when it was added as a background process two issues appeared: * **Race condition:** between the thread downloading the model (writing in the directory) and zinit service trying to read from this directory * **Partial download problem:** when download happens in the background it partially downloads the models while the server expects that all models are downloaded in the directory, so in that case the server have the possibility to use a non-existent model while it should not @rawan
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
lhumina_code/hero_embedder#2
No description provided.