Issues

• 0.4.4: the image ubatch bound reads the whole KV pool, so one conversation's output depends on another slot

  rulith-dev/rulith-inference#10 · Filter by author obsidience opened on Oct 6, 2026
  1

• Feature Request: Model alias support (--alias) for external OpenAI-compatible clients

  rulith-dev/rulith-inference#9 · Filter by author sincrack opened on Oct 5, 2026
  1

• Feature Request: tuned-kernel coverage for a GSQ-RCO (IQ3_S-mixed) Qwen3.8-Flash-Next quantization

  rulith-dev/rulith-inference#8 · Filter by author Thegongyx opened on Oct 5, 2026
  1

• Feature Request: Configurable host and port for llama-server (e.g., 0.0.0.0 and custom port)

  rulith-dev/rulith-inference#6 · Filter by author sincrack opened on Oct 3, 2026
  1