Skip to content

Rengz correl - #56

Draft
rengzhengcodes wants to merge 25 commits into
mainfrom
rengz-correl
Draft

rengzhengcodes wants to merge 25 commits into
mainfrom
rengz-correl

Conversation

@rengzhengcodes

Copy link
Copy Markdown
Collaborator

No description provided.

rengzhengcodes and others added 5 commits July 16, 2026 12:15
The EC2 profiling scripts under notebooks/astrasim2_correlation/correlation/
now live in their own repo (rengzhengcodes/aws-gpu-profiler), generalized
from an nccl-tests-only orchestrator into a manifest-driven GPU profiler.
Wire it in as a submodule at the same path, tracking the
profiling-data-20260904 branch, which carries the 2026-09-04 8x H100
all-to-all sweep (run correl-20260904-154601) that the notebook reads.

Notebook: read empirical CSVs from correlation/data (inside the submodule)
with the repo-root fallback, cite the aws-gpu-profiler run command instead
of orchestrate.py, and re-execute in place. Fit unchanged: alpha 74.23 us,
BW_eff 339.5 GB/s, R^2 0.9996.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…n git LFS

notebooks/astrasim2_correlation/nvlink_probe.ipynb answers the five fabric questions (minimum NVLink packet, NVSwitch capacity, in-network reduction incl. Nsight HBM counters, SM role, launch overhead) from run nvlink-20260917-d of the aws-gpu-profiler nvlink_probe workload, executed inline. The correlation submodule moves to profiling-data-20260904 @ 62170dc, where data/ is stored through git LFS (install git-lfs before 'git submodule update'). correlation.ipynb now selects empirical CSVs by their unified header, so other workloads' results.csv files in the same data tree are ignored.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

This branch was previously deployed

1 inactive (outdated) deployment
pypi — 5b1f632d Deployed Jul 9, 2026 by rengzhengcodes via Publish package to PyPI #301
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant