I do research on edge/mobile LLM inferencing systems.
🔭 I'm currently working on the following fun projects:
- umm.cpp: Building the edge-friendly inference system for Unified Multimodal Models (UMMs)
Some of my recent works
- llama.cpp support for SenseNova U1.5: ggml-org/llama.cpp#28919
- sd.cpp support for SenseNova U1.5: leejet/stable-diffusion.cpp#1935
- ai-pdf-reader: Answer your questions while reading papers using Google Scholar PDF Reader