I am an M.S. student at the University of Electronic Science and Technology of China (UESTC), with a background in communication systems, systems programming, and applied AI. I work with C/C++, Python, Linux, CUDA, and C++ inference runtimes. I am currently an LLM Inference Engine Intern at Enflame Technology 
.
LLM inference engine development, including runtime execution, scheduling, KV-cache management, and performance optimization.
I work with C/C++, Python, CUDA, and inference runtimes.
| Project | Description |
|---|---|
| LLM-Serve | A single-node LLM inference runtime exploring Paged KV Cache, continuous batching, chunked prefill, admission control, CUDA Graph, speculative decoding, AWQ quantization, and experimental dual-GPU Prefill/Decode separation with shared-KV transport. |
| HunyuanOCR-ncnn | A pure C++17 runtime for HunyuanOCR 1.5 using pnnx and ncnn, with dynamic vision input, KV-cache decoding, JSONL batching, CPU/Vulkan backends, and dimension-aware GEMM/GEMV routing. See the public technical report. |
| SeedVR2-ncnn | Completed C++/ncnn/Vulkan implementation of SeedVR2 for image and video enhancement, including custom operators, staged graph execution, and fixed-shape GPU validation. See the public technical report. |
| LLM-Kernels | CUDA and Triton implementations of LLM inference operators with correctness tests, benchmarks, profiling, and optimization notes. |
| riscv-memcpy-memset-opt | RV64GC memcpy and memset optimizations using scalar unrolling, RVV 1.0, and Zicboz. |
| Community | Contributions |
|---|---|
 Mooncake |
Contributed Mooncake Store allocator benchmarking work, including a merged fragmentation benchmark. |
 ncnn |
Developed HunyuanOCR-ncnn and SeedVR2-ncnn, community implementations for deploying Tencent models through the pnnx/ncnn toolchain. See the HunyuanOCR report and SeedVR2 report. |