Repository navigation

Add a ControlNet model & pipeline - #2407

Merged

patrickvonplaten merged 135 commits into

huggingface:mainfrom

takuma104:controlnet

Mar 2, 2023

Commits on Feb 13, 2023
- add scaffold
  takuma104
  committed
  6123837
- Add support to load ControlNet (WIP)
  takuma104
  committed
  d382f93
- Update to convert ControlNet without error msg
  takuma104
  committed
  04a514a
- cleanup of commented out
  takuma104
  committed
  1f4b706
Commits on Feb 14, 2023
- split create_controlnet_diffusers_config()
  takuma104
  committed
  25eb4e7
- Add input_hint_block, input_zero_conv and
  takuma104
  committed
  a7cb5a2
- add unet_2d_blocks_controlnet.py
  takuma104
  committed
  148b46d
Commits on Feb 15, 2023
- Add loading for input_hint_block, zero_convs
  takuma104
  committed
  584edfd
- Copy from UNet2DConditionalModel except __init__
  takuma104
  committed
  0f9781c
- Add ultra primitive test for ControlNetModel
  takuma104
  committed
  0327e73
- Support ControlNetModel inference
  takuma104
  committed
  e5cabdf
- copy forward() from UNet2DConditionModel
  takuma104
  committed
  1fc01a3
- Impl ControlledUNet2DConditionModel inference
  takuma104
  committed
  cb7bb9a
- Frozen weight & biases for training
  takuma104
  committed
  87ed105
Commits on Feb 16, 2023
- Minimized version of ControlNet/ControlledUnet
  takuma104
  committed
  efccecc
- make style
  takuma104
  committed
  a838366
- Add support model loading for minimized ver
  takuma104
  committed
  a296de9
- Remove all previous version files
  takuma104
  committed
  bd51c6d
- from_pretrained and inference test passed
  takuma104
  committed
  7656925
- copied from pipeline_stable_diffusion.py
  takuma104
  committed
  839e009
Commits on Feb 17, 2023
- Impl pipeline, pixel match test (almost) passed.
  takuma104
  committed
  cf16a43
- Merge branch 'main' into controlnet
  takuma104
  authored
  ce0e571
- make style
  takuma104
  committed
  9cc8b99
- make fix-copies
  takuma104
  committed
  7dbbe22
- Fix to add import ControlNet blocks
  takuma104
  committed
  a316d86
Commits on Feb 18, 2023
- Remove einops dependency
  takuma104
  committed
  b17fd20
- Support np.ndarray, PIL.Image for controlnet_hint
  takuma104
  committed
  894bd84
- set default config file as lllyasviel's
  takuma104
  committed
  3d3a02f
- Add support grayscale (hw) numpy array
  takuma104
  committed
  38bf48d
- Add and update docstrings
  takuma104
  committed
  cc597a1
- add control_net.mdx
  takuma104
  committed
  4bcc159
- add control_net.mdx to toctree
  takuma104
  committed
  33841b6
Commits on Feb 19, 2023
- Update copyright year
  takuma104
  committed
  9a37409
- Fix to add PIL.Image RGB->BGR conversion
  takuma104
  committed
  0a1bb45
- make fix-copies
  takuma104
  committed
  90d05e9
Commits on Feb 20, 2023
- Merge branch 'huggingface:main' into controlnet
  takuma104
  authored
  189f46f
- add basic fast test for controlnet
  takuma104
  committed
  3ade8c0
- add slow test for controlnet/unet
  takuma104
  committed
  d5965c7
- Ignore down/up_block len check on ControlNet
  takuma104
  committed
  79c0ecb
Commits on Feb 21, 2023
- add a copy from test_stable_diffusion.py
  takuma104
  committed
  04f9b8a
- Accept controlnet_hint is None
  takuma104
  committed
  fe82f10
- merge pipeline_stable_diffusion.py diff
  takuma104
  committed
  1c7d311
- Update class name to SDControlNetPipeline
  takuma104
  committed
  e492e9d
- make style
  takuma104
  committed
  2eab486
- Baseline fast test almost passed (w long desc)
  takuma104
  committed
  faf1cfb
Commits on Feb 22, 2023
- Add note comment related vae_scale_factor
  takuma104
  committed
  f656952
Commits on Feb 23, 2023
- add test_stable_diffusion_controlnet_ddim
  takuma104
  committed
  6300a52
- add assertion for vae_scale_factor != 8
  takuma104
  committed
  bac69f1
- slow test of pipeline almost passed
  takuma104
  committed
  4f394a8
- test_stable_diffusion_long_prompt passed
  takuma104
  committed
  2b0f04b
- test_stable_diffusion_no_safety_checker passed
  takuma104
  committed
  c6c7312
- remove PoC test files
  takuma104
  committed
  bd5d7b7
- Merge branch 'main' into will/controlnet
  williamberman
  committed
  2c0d4d4
Commits on Feb 24, 2023
- fix num_of_image, prompt length issue add add test
  takuma104
  committed
  808376c
- add support List[PIL.Image] for controlnet_hint
  takuma104
  committed
  cd85086
- wip
  williamberman
  committed
  e376edb
- Merge remote-tracking branch 'will_diffusers/will/controlnet' into controlnet
  takuma104
  committed
  19be7e6
- all slow test passed
  takuma104
  committed
  b74ef10
- make style
  takuma104
  committed
  b8e689e
- update for slow test
  takuma104
  committed
  2d8cca1
- RGB(PIL)->BGR(ctrlnet) conversion
  takuma104
  committed
  0f70cf5
- fixes
  williamberman
  committed
  91623a9
Commits on Feb 25, 2023
- remove manual num_images_per_prompt test
  williamberman
  committed
  855580d
- Merge branch 'main' into controlnet
  williamberman
  authored
  e758682
- add document
  takuma104
  committed
  788e03d
- add `image` argument docstring
  takuma104
  committed
  42ebc45
- make style
  takuma104
  committed
  8bb964d
- Add line to correct conversion
  takuma104
  committed
  49024f6
- add controlnet_conditioning_scale (aka control_scales
  williamberman
  committed
  30f7570
- rgb channel ordering by default
  williamberman
  committed
  e169f32
Commits on Feb 26, 2023
- image batching logic
  williamberman
  committed
  e1b8b49
- Merge branch 'main' into controlnet
  williamberman
  authored
  2953f9f
Commits on Feb 27, 2023
- Add control image descriptions for each checkpoint
  takuma104
  committed
  f5cd24a
Commits on Feb 28, 2023
- Merge branch 'main' into controlnet
  williamberman
  authored
  1a02798
- Only save controlnet model in conversion script
  williamberman
  committed
  8f01ca1
- Update src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_controlnet.py
  
  takuma104
  and
  pcuenca
  authored
  ca4378e
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  1799d83
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  d7b95cf
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  2e86e1f
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  bb03069
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  9a14567
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  71d0a96
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  16efb00
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  1b0af7d
- Update docs/source/en/api/pipelines/stable_diffusion/control_net.mdx
  
  takuma104
  and
  pcuenca
  authored
  53f4523
- add gerated image example
  takuma104
  committed
  161aac2
- a depth mask -> a depth map
  takuma104
  committed
  349f3bf
- rename control_net.mdx to controlnet.mdx
  takuma104
  committed
  3f6e8f7
- fix toc title
  takuma104
  committed
  ebabcbe
- add ControlNet abstruct and link
  takuma104
  committed
  30e2bde
- Merge branch 'main' into controlnet
  takuma104
  authored
  a00c9ca
Commits on Mar 1, 2023
- Update src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_controlnet.py
  
  takuma104
  and
  dqueue
  authored
  f099be5
- remove controlnet constructor arguments re: @patrickvonplaten
  williamberman
  committed
  2b553d9
- Merge branch 'main' into controlnet
  williamberman
  authored
  238e26f
- [integration tests] test canny
  williamberman
  committed
  d49296c
- test_canny fixes
  williamberman
  committed
  d1cd65a
- [integration tests] test_depth
  williamberman
  committed
  7eb43f1
- [integration tests] test_hed
  williamberman
  committed
  032d5e0
- [integration tests] test_mlsd
  williamberman
  committed
  5c7dbb3
- add channel order config to controlnet
  williamberman
  committed
  cdbc7c4
- [integration tests] test normal
  williamberman
  committed
  86c1684
- [integration tests] test_openpose test_scribble
  williamberman
  committed
  a18fc70
- change height and width to default to conditioning image
  williamberman
  committed
  9ec6ad4
- [integration tests] test seg
  williamberman
  committed
  8fd8e42
- style
  williamberman
  committed
  7c35fc7
- test_depth fix
  williamberman
  committed
  e200797
- [integration tests] size fixes
  williamberman
  committed
  e6973eb
- [integration tests] cpu offloading
  williamberman
  committed
  0ba19da
- style
  williamberman
  committed
  1a803d1
- generalize controlnet embedding
  williamberman
  committed
  8dea9c7
- fix conversion script
  williamberman
  committed
  60e3635
- Update docs/source/en/api/pipelines/stable_diffusion/controlnet.mdx
  
  takuma104
  and
  sayakpaul
  authored
  b15fca9
- Update docs/source/en/api/pipelines/stable_diffusion/controlnet.mdx
  
  takuma104
  and
  sayakpaul
  authored
  d7ed0b1
- Update docs/source/en/api/pipelines/stable_diffusion/controlnet.mdx
  
  takuma104
  and
  sayakpaul
  authored
  0ed0581
- Update docs/source/en/api/pipelines/stable_diffusion/controlnet.mdx
  
  takuma104
  and
  sayakpaul
  authored
  5e16d13
- Style adapted to the documentation of pix2pix
  takuma104
  committed
  06bb1db
- Merge branch 'huggingface:main' into controlnet
  takuma104
  authored
  acf8d26
- merge main by hand
  takuma104
  committed
  3981459
Commits on Mar 2, 2023
- Merge branch 'main' into controlnet
  williamberman
  committed
  b799512
- style
  williamberman
  committed
  0810e4c
- [docs] controlling generation doc nits
  williamberman
  committed
  10dedd9
- correct some things
  patrickvonplaten
  committed
  042c75e
- add: controlnetmodel to autodoc.
  sayakpaul
  committed
  ff2e691
- finish docs
  patrickvonplaten
  committed
  9cb8816
- Merge branch 'controlnet' of https://github.com/takuma104/diffusers into controlnet
  patrickvonplaten
  committed
  8f62631
- finish
  patrickvonplaten
  committed
  3bbc356
- finish 2
  patrickvonplaten
  committed
  b8d1908
- correct images
  patrickvonplaten
  committed
  1f36d9e
- Merge branch 'controlnet' of https://github.com/takuma104/diffusers into controlnet
  patrickvonplaten
  committed
  8052dde
- finish controlnet
  patrickvonplaten
  committed
  a610e47
- Apply suggestions from code review
  
  patrickvonplaten
  and
  pcuenca
  authored
  9947fcb
- uP
  patrickvonplaten
  committed
  592f389
- upload model
  patrickvonplaten
  committed
  ec4fc3a
- up
  patrickvonplaten
  committed
  b010e3c
- up
  patrickvonplaten
  committed
  547ba02

Commits

Commits on Feb 13, 2023

Commits on Feb 14, 2023

Commits on Feb 15, 2023

Commits on Feb 16, 2023

Commits on Feb 17, 2023

Commits on Feb 18, 2023

Commits on Feb 19, 2023

Commits on Feb 20, 2023

Commits on Feb 21, 2023

Commits on Feb 22, 2023

Commits on Feb 23, 2023

Commits on Feb 24, 2023

Commits on Feb 25, 2023

Commits on Feb 26, 2023

Commits on Feb 27, 2023

Commits on Feb 28, 2023

Commits on Mar 1, 2023

Commits on Mar 2, 2023