OmniVoice TTS: boot/long-reply OOM fixes + precomputed clone prompts - fix: pre-computed VoiceClonePrompt workflow (scripts/prepare_omnivoice_prompt.py) avoids the ~3.2 GiB DAC-encode transient at boot; handler --omnivoice_voice_clone_prompt loads the … #17

Merged

troed merged 6 commits from devel into main 2026-09-08 11:34:55 +02:00

Conversation 0 Commits 6 Files changed 20 +533 -135

troed commented 2026-09-08 11:29:45 +02:00

Owner

Copy link

No description provided.

troed added 6 commits 2026-09-08 11:29:45 +02:00

style: ruff format c324dd4f41

fix: pass omnivoice kwargs in prepare_all_args/build_pipeline call sites 76fbc3161e

fix: skip Qwen3 TTS singleton preload when pipeline uses another TTS backend e267977d5b

feat: include bitsandbytes in the omnivoice extra for quantized loads cbf1da53be

fix: avoid OmniVoice boot OOM on small GPUs via pre-computed clone prompts ... 6723284c2b

Encoding --omnivoice_ref_audio at startup needs a ~3.2 GiB transient
audio-tokenizer activation (independent of quantization) that OOMs a
12 GB GPU alongside other resident models. Add a script to pre-compute
the VoiceClonePrompt offline (~18 KB) for --omnivoice_voice_clone_prompt,
and warn when the boot-time encode path is used.

fix: offload idle OmniVoice encoder modules to reclaim VRAM for long replies 3793f8a637

troed merged commit 5b2353d8a4 into main 2026-09-08 11:34:55 +02:00

troed referenced this pull request from a commit 2026-09-08 11:34:57 +02:00

Merge pull request 'OmniVoice TTS: boot/long-reply OOM fixes + precomputed clone prompts

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

starfleet/computer!17

No description provided.