Textual Inversion got error of cannot find config.json file #579

Activity

1. XavierXiao

   added

   bugSomething isn't workingSomething isn't working

   on Sep 19, 2022
2. XavierXiao

   changed the title [-]Textual Inversion got 404 Client Error[/-] [+]Textual Inversion got error of cannot find config.json file[/+] on Sep 19, 2022
3. Oragi commented on Sep 20, 2022

   

   Oragi

   on Sep 20, 2022

   Last edited by Oragi

   More actions

   I had to git clone the CompVis/stable-diffusion-v1-4 repo and make this change to get mine to work (using a local path as --pretrained_model_name_or_path) :

       # Load models and create wrapper for stable diffusion
       text_encoder = CLIPTextModel.from_pretrained(
           args.pretrained_model_name_or_path, subfolder="text_encoder", use_auth_token=args.use_auth_token
       )
       vae = AutoencoderKL.from_pretrained(
           args.pretrained_model_name_or_path, subfolder="vae", use_auth_token=args.use_auth_token
       )
       unet = UNet2DConditionModel.from_pretrained(
           args.pretrained_model_name_or_path, subfolder="unet", use_auth_token=args.use_auth_token
       )

   to

       # Load models and create wrapper for stable diffusion
       text_encoder = CLIPTextModel.from_pretrained(
           args.pretrained_model_name_or_path + "/text_encoder", use_auth_token=args.use_auth_token
       )
       vae = AutoencoderKL.from_pretrained(
           args.pretrained_model_name_or_path + "/vae", use_auth_token=args.use_auth_token
       )
       unet = UNet2DConditionModel.from_pretrained(
           args.pretrained_model_name_or_path + "/unet", use_auth_token=args.use_auth_token
       )

   Seems like the subfolder="" parameter isn't working?
   It loads fine on the Colab when using a hosted runtime, but if you try to run the exact same steps with a local windows jupyter runtime it gives the same issue
4. patrickvonplaten commented on Sep 22, 2022

   

   patrickvonplaten

   on Sep 22, 2022

   Contributor

   More actions

   Gently pinging @patil-suraj
5. patrickvonplaten

   assigned

   patil-suraj

   on Sep 22, 2022
6. crackedbeefcake commented on Sep 24, 2022

   

   crackedbeefcake

   on Sep 24, 2022

   More actions

   might be related, I get something similar.

   cwd = path.join(os.getcwd())
   modelpath = 'models/ldm/stable-diffusion-v1/model.ckpt'
   loadpath = path.normpath(path.join(cwd, '..', modelpath))
   vae = AutoencoderKL.from_pretrained(loadpath)
   

   leads to:

   nfigMixin._dict_from_json_file(cls, json_file)
       298 with open(json_file, "r", encoding="utf-8") as reader:
   --> 299     text = reader.read()
       300 return json.loads(text)
   
   File ~/miniconda3/envs/ldm/lib/python3.8/codecs.py:322, in BufferedIncrementalDecoder.decode(self, input, final)
       321 data = self.buffer + input
   --> 322 (result, consumed) = self._buffer_decode(data, self.errors, final)
       323 # keep undecoded input until the next call
   
   UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 64: invalid start byte
   
   During handling of the above exception, another exception occurred:
   
   OSError                                   Traceback (most recent call last)
   /home/finn/code/lstein-diffusion/notebooks/sd_custom.ipynb Cell 4 in <cell line: 1>()
   ----> 1 vae = AutoencoderKL.from_pretrained(loadpath)
   ...
       262 except (json.JSONDecodeError, UnicodeDecodeError):
   --> 263     raise EnvironmentError(f"It looks like the config file at '{config_file}' is not a valid JSON file.")
       265 return config_dict
   
   OSError: It looks like the config file at '/home/finn/code/lstein-diffusion/models/ldm/stable-diffusion-v1/model.ckpt' is not a valid JSON file.
   
7. 2132660698 commented on Sep 27, 2022

   

   2132660698

   on Sep 27, 2022

   More actions

   try this:
   pip install transformers==4.22.1
8. patil-suraj commented on Sep 28, 2022

   

   patil-suraj

   on Sep 28, 2022

   Last edited by patil-suraj

   Contributor

   More actions

   Hey @XavierXiao , @Oragi ! IAs pointed out by @2132660698 if you upgrade transformers version. to >=4.22.0 this should work. Because the subfolder argument isn't available in previous versions. I will update the minimum version in example requirements.

   @FinnFrotscher It looks like you are using the compvis checkpoint, you should clone the diffusers checkpoint to use it with this library. https://huggingface.co/CompVis/stable-diffusion-v1-4

   👍React with 👍2Reacted by Oragi and Alex
9. patil-suraj

   closed this as completedin #665on Sep 29, 2022
10. s3rgeym commented on Mar 26, 2023

    

    s3rgeym

    on Mar 26, 2023

    More actions

    Блять, че я должен сделать чтобы эта хуета работала?

    pip install transformers==4.22.0

    Traceback (most recent call last):
      File "/home/sergey/workspace/test-diffusers/./image_gen.py", line 5, in <module>
        from diffusers import DiffusionPipeline
      File "/home/sergey/workspace/test-diffusers/.venv/lib/python3.10/site-packages/diffusers/__init__.py", line 55, in <module>
        from .pipelines import (
      File "/home/sergey/workspace/test-diffusers/.venv/lib/python3.10/site-packages/diffusers/pipelines/__init__.py", line 18, in <module>
        from .dance_diffusion import DanceDiffusionPipeline
      File "/home/sergey/workspace/test-diffusers/.venv/lib/python3.10/site-packages/diffusers/pipelines/dance_diffusion/__init__.py", line 1, in <module>
        from .pipeline_dance_diffusion import DanceDiffusionPipeline
      File "/home/sergey/workspace/test-diffusers/.venv/lib/python3.10/site-packages/diffusers/pipelines/dance_diffusion/pipeline_dance_diffusion.py", line 21, in <module>
        from ..pipeline_utils import AudioPipelineOutput, DiffusionPipeline
      File "/home/sergey/workspace/test-diffusers/.venv/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.py", line 64, in <module>
        from transformers.utils import SAFE_WEIGHTS_NAME as TRANSFORMERS_SAFE_WEIGHTS_NAME
    ImportError: cannot import name 'SAFE_WEIGHTS_NAME' from 'transformers.utils' (/home/sergey/workspace/test-diffusers/.venv/lib/python3.10/site-packages/transformers/utils/__init__.py)

    pip install -U transformers

    OSError: It looks like the config file at '/home/sergey/workspace/test-diffusers/CounterfeitV25_25.safetensors' is not a valid JSON file.
    

    Мудацкое говно

    😄React with 😄1Reacted by Krasikov Kirill
11. s3rgeym commented on Mar 26, 2023

    

    s3rgeym

    on Mar 26, 2023

    More actions

    #!/usr/bin/env python
    import argparse
    from pathlib import Path
    
    from diffusers import DiffusionPipeline
    
    if __name__ == "__main__":
        parser = argparse.ArgumentParser()
        parser.add_argument("prompt", nargs="+")
        parser.add_argument(
            "-o", "--output", default="output.png", type=argparse.FileType("wb+")
        )
        args = parser.parse_args()
        print(args)
        safetensors_path = Path(__file__).parent / "CounterfeitV25_25.safetensors"
        pipe = DiffusionPipeline.from_pretrained(safetensors_path)
        pipe.to("cuda")
        img, = pipe(" ".join(args.prompt)).images
        img.save(args.output)