Skip to content

No GPU→CPU fallback when separation fails #276

Closed

Description

@thcp

Location: separate.py
Severity: CRIT

One MPS/CUDA failure (OOM, unsupported op, driver hiccup) kills the whole job with the generic “Audio processing failed.” This is the Mac Mini report verbatim — the user needed a LaunchAgent env-var hack to force CPU. separate() raises on any non-zero demucs exit; runner._run_async marks error and deletes the job dir.
On failure with device != cpu, log the real stderr tail, retry once on CPU, and surface a “ran on CPU (slower)” note. Mirrors the #247 lesson on the runtime path.

From the health report. Part of #273 (Phase 2 — Resilience).

Activity

  1. added
    bugSomething isn't working
    reliabilityStability, resource management, race conditions
    on Jul 16, 2026
  2. added a commit that references this issue on Jul 17, 2026
    5355a93
  3. self-assigned this
    on Oct 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingreliabilityStability, resource management, race conditions

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions