Repository navigation
Support for hpcaitech OpenSora's STDiT for text2video and text2image generation #7370
Description
Model/Pipeline/Scheduler description
STDiT builds on Latte and DiT and yields a trade-off between generation quality and speed
sample_0_flower.mp4
Open source status
- The model implementation is available.
- The model weights are available (Only relevant if addition is not a scheduler).
Activity
[-]Support for hpcaitech OpenSora's STDiT for text2video generation[/-][+]Support for hpcaitech OpenSora's STDiT for text2video and text2image generation[/+]kabachuha commentedon Mar 18, 2024
If nobody mind, I'd like to proceed with its implementation this week
sayakpaul commentedon Mar 18, 2024
Cc: @DN6 @patil-suraj
@kabachuha sure, feel free to proceed and we will definitely help you out :)
patil-suraj commentedon Mar 18, 2024
awesome, feel free to start @kabachuha we'll def help! Maybe for now we could keep it as researc_project since it's still experimental and the arch might change in future.
github-actions commentedon Apr 17, 2024
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
ElliotQi commentedon May 12, 2024
@kabachuha Hi, what's current status of diffusers version?
narrowsnap commentedon Jul 16, 2024
@kabachuha @patil-suraj Is there any update?
github-actions commentedon Sep 14, 2024
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
a-r-r-o-w commentedon Nov 20, 2024
I don't think there are any plans to support this at the moment, or that we have the bandwidth, so I've opened to community contributions. cc @DN6