Search results

启动图像模型报错: cannot import name 'HybridCache' from 'transformers'

gpu

Status: Open.

#5221 In xorbitsai/inference;

· zhenyu-24 opened on Jul 21, 2026

·  

v3.x

bug: xinference:v3.0.0，用VLLM启动qwen3.5模型报错

bugSomething isn't workingSomething isn't working

gpu

Status: Open.

#5219 In xorbitsai/inference;

· hediyuan opened on Jul 21, 2026

·  

v3.x

bug: Cannot multi select worker ip address

bugSomething isn't workingSomething isn't working

Status: Open.

#5206 In xorbitsai/inference;

· leslie2046 opened on Jul 19, 2026

·  

v3.x

[Bug] IndexTTS2 /v1/audio/speech returns 500 at WAV save: libtorchcodec cannot load in v2.12.0 Docker

bugSomething isn't workingSomething isn't working

gpu

Status: Open.

#5201 In xorbitsai/inference;

· kvenLin opened on Jul 18, 2026

·  

v3.x

parse_replica_model_uid silently corrupts bare model_uid values ending in '-<digits>' (e.g. llama-2, phi-2, gpt-2)

gpu

Status: Open.

#5198 In xorbitsai/inference;

· ErenAta16 opened on Jul 18, 2026

·  

v3.x

arm架构启动bge-reranker-large,只创建1个实例不能访问。需要创建2个独立实例，第1个实例才能访问(第二个不能访问)。

gpu

Status: Open.

#5190 In xorbitsai/inference;

· 316719744 opened on Jul 17, 2026

·  

v3.x

First launch after a virtualenv (re)build always fails: model subprocess is spawned BEFORE venv packages are installed, caching host-version base libraries in sys.modules

bugSomething isn't workingSomething isn't working

Status: Open.

#5189 In xorbitsai/inference;

· kejhz653-stack opened on Jul 17, 2026

·  

v3.x

Audio models with #system_torchaudio# fail to launch when host env lacks torchaudio — error is unactionable and prerequisite is undocumented

bugSomething isn't workingSomething isn't working

Status: Open.

#5187 In xorbitsai/inference;

· kejhz653-stack opened on Jul 17, 2026

·  

v3.x

Unauthenticated arbitrary-path file read (partial) via /v1/models/llm/auto-register, plus unauthenticated arbitrary module import via flexible launcher

Status: Open.

#5176 In xorbitsai/inference;

· geo-chen opened on Jul 13, 2026

·  

v3.x

第二次启动 Qwen3-Reranker-0.6B 稳定失败

gpu

Status: Open.

#5156 In xorbitsai/inference;

· fantastlcok opened on Jul 11, 2026

·  

v3.x

双卡4090环境vllm引擎加载模型报错

gpu

stale

Status: Open.

#5106 In xorbitsai/inference;

· goodmaney opened on Jun 30, 2026

·  

v2.x

[Docker CD] Failure on main

gpu

Status: Open.

#5104 In xorbitsai/inference;

· github-actions opened on Jun 29, 2026

·  

v3.x