Add Consistency Models Pipeline - #3492

Merged

patrickvonplaten merged 79 commits into

huggingface:mainfrom

dg845:consistency-models-pipeline

Jul 5, 2023

Commits on May 15, 2023

initial commit
dg845
committed
799ab23

Commits on May 17, 2023

Improve consistency models sampling implementation.
dg845
committed
63b7f01

Commits on May 18, 2023

Add CMStochasticIterativeScheduler, which implements the multi-step sampler (stochastic_iterative_sampler) in the original code, and make further improvements to sampling.
dg845
committed
f2e53da

Commits on May 22, 2023

Merge branch 'main2' into consistency_unet
ayushmangal
committed
37e1895
Add Unet blocks for consistency models
ayushmangal
committed
7c1e81f
Add conversion script for Unet
ayushmangal
committed
3a151bd
Fix bug in new unet blocks
ayushmangal
committed
b6c5e15

Commits on May 23, 2023

Fix attention weight loading
ayushmangal
committed
4e93f09

Commits on May 25, 2023

Merge pull request #1 from ayushtues/consistency_unet
dg845
authored
d137d11

Commits on May 26, 2023

Commits on May 30, 2023

Make small random test UNet class conditional and set resnet_time_scale_shift to 'scale_shift' to better match consistency model checkpoints.
dg845
committed
5a27c2f
Add support for converting a test UNet and non-class-conditional UNets to the consistency models conversion script.
dg845
committed
f2783a8
make style
dg845
committed
ed53b85
Change num_class_embeds to 1000 to better match the original consistency models implementation.
dg845
committed
a505c6c
Add support for distillation in pipeline_consistency_models.py.
dg845
committed
a927a4a
Improve consistency model tests:
dg845
committed
b2e6424
make style
dg845
committed
c37e302
Improve ConsistencyModelPipeline:
dg845
committed
a0a164c
make style
dg845
committed
0d1de08
Improve ConsistencyModelPipeline:
dg845
committed
5f4f406
make style
dg845
committed
213b25d
Fix bug when randomly generating class labels for class-conditional generation.
dg845
committed
fbe34c3

Commits on Jun 1, 2023

Commits on Jun 2, 2023

Add expected slices for multistep sampling tests and make them pass.
dg845
committed
94c99ca
Work on consistency model fast tests:
dg845
committed
0773b27
make style
dg845
committed
6867a3a

Commits on Jun 4, 2023

Refactor conversion script to make it easier to add more model architectures to convert in the future.
dg845
committed
f0c85d3
Work on ConsistencyModelPipeline tests:
dg845
committed
6adb589
make style
dg845
committed
c213bf7
Remove the add_noise and add_noise_to_input methods from CMStochasticIterativeScheduler for now.
dg845
committed
3be6e08
Run python utils/check_copies.py --fix_and_overwrite
dg845
committed
660909f
Make fast tests from PipelineTesterMixin pass.
dg845
committed
ad5abdc
make style
dg845
committed
a1c11d3

Commits on Jun 7, 2023

Refactor consistency models pipeline and scheduler:
dg845
committed
2dc2fa3
make style
dg845
committed
7d3dbe3
Add docstrings and further refactor pipeline and scheduler.
dg845
committed
55f80ed
make style
dg845
committed
3234543

Commits on Jun 9, 2023

Add initial version of the consistency models documentation.
dg845
committed
dc4349c

Commits on Jun 10, 2023

Commits on Jun 13, 2023

Convert current slow tests to use fp16 and flash attention.
dg845
committed
fd0a253
make style
dg845
committed
7c03ff6
Add slow tests for normal attention on cuda device.
dg845
committed
80d7745
make style
dg845
committed
0662f63
Fix attention weights loading
ayushtues
committed
cce04c0
Merge pull request #3 from ayushtues/fix-attention-loading
dg845
authored
c1ba8b9
Update consistency model fast tests for new test checkpoints with attention fix.
dg845
committed
62a49a2
make style
dg845
committed
58f12ca

Commits on Jun 16, 2023

apply suggestions
dg845
committed
071f850

Commits on Jun 18, 2023

Add add_noise method to CMStochasticIterativeScheduler (copied from EulerDiscreteScheduler).
dg845
committed
6968615

Commits on Jun 29, 2023

apply suggestions from review
dg845
committed
2606d82
make style
dg845
committed
075351a

Commits on Jun 30, 2023

Merge branch 'main' into consistency-models-pipeline
dg845
committed
8976471
fix attention naming
dg845
committed
6486049

Commits on Jul 3, 2023

Add tests for CMStochasticIterativeScheduler.
dg845
committed
cf514b3
make style
dg845
committed
b5c2b23

Commits on Jul 4, 2023

Commits on Jul 5, 2023

rename some models
patrickvonplaten
committed
2fc7f2c
Improve API
patrickvonplaten
committed
e14189c
rename some models
patrickvonplaten
committed
9f627ed
Remove duplicated block
patrickvonplaten
committed
3febb18
Add docstring and make torch compile work
patrickvonplaten
committed
d430fab
Merge branch 'main' into consistency-models-pipeline
patrickvonplaten
authored
44d2c22
More fixes
patrickvonplaten
committed
f7675d3
Fixes
patrickvonplaten
committed
c66b702
Apply suggestions from code review
patrickvonplaten
authored
66f1603
Apply suggestions from code review
patrickvonplaten
authored
033fbe6
add more docstring
patrickvonplaten
committed
fd67410
update consistency conversion script
patrickvonplaten
committed
541dd84