Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
-
Updated
Oct 25, 2026 - Python
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration
Agent-friendly GPU coordination for shared Linux labs: rootless reservations, resource budgets, Bash visibility and installable skills.
GPUs unite using secure and private crypto transactions to distribute compute to decentralized nodes.
Share a GPU, borrow a GPU. Contribute spare capacity so anyone can run their local AI on it — free, no account, no weights to download.
Distributed peer-to-peer LLM inference network. Volunteer your GPU, earn AI credits, run any open-source model for free. Anonymous, encrypted, unstoppable.
To associate your repository with the gpu-sharing topic, visit your repo's landing page and select "manage topics."