Metal support? #79

Activity

1. monatis commented on Oct 1, 2023

   

   monatis

   on Oct 1, 2023

   Owner

   More actions

   Hi @kchro3, thanks for reaching out! It needs Conv2D implementation on Metal. I'm currently implementing LLaVA with llama.cpp and clip.cpp combined (initial release in a few days). The CLIP part will run on CPU in the first place, but then I'll implement Conv2D on Metal to support end-to-end Metal inference for multimodal models.

   👍React with 👍1Reacted by lin72h
2. kchro3 commented on Oct 1, 2023

   

   kchro3

   on Oct 1, 2023

   Author

   More actions

   wow, that's awesome. i'm looking forward to the release!
3. kchro3 commented on Oct 1, 2023

   

   kchro3

   on Oct 1, 2023

   Author

   More actions

   where can i follow your progress btw? will it be in this repo or are you going to make a new one
4. monatis commented on Oct 1, 2023

   

   monatis

   on Oct 1, 2023

   Owner

   More actions

   WIP PR for the initial release of large multimodal model inference is in another repo. Metal implementation of Conv2D will require another pr to the main GGML repo after this PR is merged and released.

   👍React with 👍1Reacted by lin72h
5. kchro3 commented on Oct 10, 2023

   

   kchro3

   on Oct 10, 2023

   Author

   More actions

   awesome work, @monatis ! cheering you on

   👍React with 👍1Reacted by lin72h
6. yysu-888 commented on Sep 25, 2024

   

   yysu-888

   on Sep 25, 2024

   More actions

   Hi, awesome work on this project!

   I'm building some Swift apps using llama.cpp, and I'd love to try getting clip.cpp running on my app too.

   I'm curious if you're going to support running clip.cpp on Metal like llama.cpp?
   welcome to my project, support all openai clip and ofa-sys chinese clip model,at the same time support metal gpu
   and f16,q8_0 quantization
   https://github.com/yysu-888/clip.cpp