Feature Description
support loading W4A16 with diffusers
Motivation and Use Case
Currently, we don't have a platform to verify the quantized diffusion model.
Supporting in vLLM-Omni is WIP, and supporting in diffusers could be a reference implementation.
Alternatives Considered
No response
Definition of Done
No response
Additional Context
No response
Feature Description
support loading W4A16 with diffusers
Motivation and Use Case
Currently, we don't have a platform to verify the quantized diffusion model.
Supporting in vLLM-Omni is WIP, and supporting in diffusers could be a reference implementation.
Alternatives Considered
No response
Definition of Done
No response
Additional Context
No response