Network-faithful simulation of LLM serving and training deployments
-
Updated
Oct 8, 2026 - Python
Network-faithful simulation of LLM serving and training deployments
Early-warning bottleneck profiler for GPU training nodes: GPU + RDMA fabric telemetry with job-level classification
RDMA fork version of Strix Halo inference engine. Qwen Flash Next Q4_K_XL: >2100pp …
KAI Data Center Builder
NCCL over a switchless 4-node DGX Spark / GB10 ring using both PCIe halves of every QSFP cable: ~193 Gb/s per cable instead of ~112, up to +34% vLLM prefill. One patch on top of switchless-nccl.
Performance metrics for AI / ML cluster
A distributed hardware-software co-design fabric for MoE models (DeepSeek-V3, Mixtral) that eradicates NCCL All-to-All communication stalls via distributed RoCEv2 RDMA virtual address MUX and JAX/XLA SPMD sharding.
Line-rate out-of-band network packet classification & RoCEv2 isolation engine offloaded to SmartNIC/DPU cores.
Packet-level simulator (ns-3 + RoCEv2/DCQCN/PFC/ECN) comparing fat-tree vs rail-optimized topologies for AI training fabrics. Validated against NCCL on real GPUs.
Visual, exam-focused study guide for Cisco 300-640 DCAI v1.0
Production-grade High-Frequency Streaming Telemetry Ingestion (TIG Stack: Telegraf, InfluxDB v2, Grafana) & Sub-Second Buffer Incast Inspection for AI Data Center Fabrics (Cisco Nexus Streaming Telemetry aligned).
Ultra-Ethernet compliance test architecture eliminating expensive HBM memory buffers. Design utilizes FPGAs, PRBS payloads, state hash tables, and virtual RDMA.
A simple experiment applying compressible flow principles to soften distributed gradient communication stalls.
Emulated 2-Tier Spine-Leaf AI Lossless Fabric with FRR BGP EVPN, Linux tc multi-queue PRIO/RED/ECN scheduling, Scapy synthetic RoCEv2 (UDP 4791), and ASIC hardware buffer boundary analysis.
Software examples for RDMA senders and receivers using RDMA WRITE and RDMA READ
Lossless-Ethernet benchmark harness for RoCEv2 fabrics: sweeps queue thresholds, ECN marking, and oversubscription to locate throughput collapse and PFC pressure.
Hands-on code, configurations, and visual labs for Cisco 300-640 DCAI v1.0
To associate your repository with the rocev2 topic, visit your repo's landing page and select "manage topics."