Skip to content

feat: prototype ROS2-free mobile dual-arm shoe mission - #40

Merged
Alpenj merged 15 commits into
mainfrom
pro/mujoco-shoe-mission-01
Sep 7, 2026
Merged

Alpenj merged 15 commits into
mainfrom
pro/mujoco-shoe-mission-01

Conversation

@Alpenj

@Alpenj Alpenj commented Sep 2, 2026 •

Copy link
Copy Markdown
Owner

Summary

  • Add ROS2-free mission contracts for mobility, visual SLAM, multi-camera input, object pose, dual-arm manipulation, FSR tactile sensing, transport safety, health, world state, and workstation-side LLM supervision.
  • Add MuJoCo mobile dual-SO101 adapters and scripted IK shoe mission.
  • Add a measured cardboard box scene (28.2 x 21 x 10.5 cm, 1.5 mm wall), right-arm lid opening, and left-arm cuboid shoe extraction prototype.

Verification

  • Box mission tests: 5 passed.
  • Grasp planner tests: 4 passed.
  • Full suite with the local SO101 asset: 149/151 passed.
  • Hardware execution: false.

Known failures / do not merge yet

  1. Camera contract test expects 3 cameras while the current composed model exposes 5.
  2. Home-pose bare-camera clearance is 0.1075 m, below the 0.13 m test gate.
  3. The physical MuJoCo sequence opens the lid, but left gripper-to-shoe dynamic contact remains 0; an unintended lid/left-wrist collision was also observed.

Review focus

  • Identify unnecessary code growth and duplicate helpers across the 1,862-line box prototype.
  • Review whether the boolean-heavy event state machine should be replaced with typed events/state transitions.
  • Review collision-pair classification and scene configuration truthfulness.
  • Recommend the smallest safe path to fix the two suite failures and the dynamic grasp-contact failure.

This PR is intentionally Draft and must not be merged until the known failures are resolved.

Define the ordered A-to-B pick, return-to-A, and place state machine with freshness, base-arm interlock, transport hold, bounded retry, and fail-closed contracts. Verified by 84 MuJoCo headless tests.
Expose named navigation goals, pose, velocity, settled-state, freshness, and watchdog contracts while keeping left/right wheel commands private to adapters. Verified by five mobility contract tests.
Model front RGB-D and left/right gripper RGB streams with explicit modality, calibration, payload, timestamp, disabled-role, synchronization, and per-stream health contracts. Verified by ten combined capability tests.
Complete collision, world-state, and safe-stop validation for the mobile dual-SO101 shoe mission. Preserve truthful MuJoCo evidence and add regression coverage for the reviewed failure modes.
Alpenj added a commit that referenced this pull request Sep 4, 2026
Preserve the reviewed PR #40 integration while making unsafe rollout failures serializable and fail-closed, disabling remaining unverified physical motion entrypoints, and aligning simulation tests and evidence with the guarded behavior.
@Alpenj
Alpenj merged commit 842fbb2 into main Sep 7, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant