Repository navigation
Integrate Lumina-T2X #8641
Description
Activity
We are currently preparing our code to integrate diffusers.
Reacted by YiYi Xu and gaopengpjlabThis model is SO cool
Reacted by Aryan V S@PommesPeter look forward to the PR!
PR here: #8652
Reacted by YiYi Xu, Sayak Paul, Indra's Mirror and Aryan V SThis issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
I think we can close this since Lumina has been integrated. Thanks @PommesPeter!
Model/Pipeline/Scheduler description
Lumina-T2X is a text-to-any generation model. Our model is capable of generating multiple modalities, most notably image generation. Currently, our image generation supports any resolution, achieving stunning results. We will unify various modalities and integrate them into diffusers, including controlnet, Lora fine-tune, compositional generation, etc.
Paper: Lumina-Next
Paper: Lumina-T2X
Open source status
Provide useful links for the implementation
Weight v1: https://huggingface.co/Alpha-VLLM/Lumina-Next-T2I
Weight v2: https://huggingface.co/Alpha-VLLM/Lumina-Next-SFT
Code: https://github.com/Alpha-VLLM/Lumina-T2X/
HF Space: https://huggingface.co/spaces/Alpha-VLLM/Lumina-Next-T2I