Skip to content

fix(self-driving): keep the session replay scout eligible for capture cliffs - #413

Draft
posthog[bot] wants to merge 1 commit into
mainfrom
posthog-self-driving/fixself-driving-retain-capture-cliff-bf2802
Draft

posthog[bot] wants to merge 1 commit into
mainfrom
posthog-self-driving/fixself-driving-retain-capture-cliff-bf2802

Conversation

@posthog

@posthog posthog Bot commented Sep 26, 2026 •

Copy link
Copy Markdown
Contributor

Problem

  • Setup always disables signals-scout-session-replay, so a project that uses Session Replay loses its only capture-integrity watcher.
  • Step 6 says the Replay Vision scanners of step 6c cover session replay. They do not cover capture: a scanner reads only recordings that exist.
  • An SDK or configuration failure that stops new recordings leaves nothing for a scanner to read, and recordings are not retroactive. The gap is silent.
  • The canonical session-replay scout names capture cliffs as its first job, so the two layers are complementary, not duplicates.

Origin

  • Scout: a custom scout
  • First signal: 2026-09-26
  • Inbox report: open
  • Task started by: auto-start, after the report was rated P2 and ready to fix

Changes

  • The route map splits session replay into two seams:

    Seam Owner Step
    On-screen defects inside a recording Replay Vision scanners 6c
    Recording capture (capture cliffs) signals-scout-session-replay 6
  • Step 6: only the error-tracking scout stays routed elsewhere. The session-replay scout is a normal specialist candidate when step 2 found recordings. If step 6 disables it, the follow-up says what it watches.

  • Step 6b: recording capture is never a custom-scout surface. If the built-in scout is off, setup records a note to enable it, not a custom copy. A rerun keeps this division.

  • Step 6c: says the scanners cannot see a capture cliff, and that step 6 owns the scout.

Note

The session-replay scout now competes for one of the at most five specialist slots. It does not add a slot or raise the ten-scout ceiling.

Test plan

  • npm test passes.
  • npm run build passes. The new text is in dist/skills/self-driving-setup.zip.

Agent context

  • I read the current canonical signals-scout-session-replay body to confirm that capture integrity is its first job.
  • I left the report step (7) as is. Its scout-troop row already lists enabled and disabled scouts with a reason.

Created with PostHog Desktop from this inbox report.

🤖 Generated with Claude Code

… cliffs

Replay Vision scanners read only recordings that exist, so they cannot detect a capture cliff. Split session replay in the route map: scanners own on-screen defects, signals-scout-session-replay owns recording capture. Step 6 now treats the scout as a specialist candidate, and step 6b never proposes a custom scout for recording capture.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Generated-By: PostHog Desktop
Task-Id: 4d0e1f04-2c64-45ab-a7f2-3f702fc0b78c
@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci ai-observability
  • /wizard-ci basic-integration
  • /wizard-ci feature-flags
  • /wizard-ci mcp-analytics
  • /wizard-ci replay-vision
  • /wizard-ci revenue
  • /wizard-ci self-driving
  • /wizard-ci warehouse
  • /wizard-ci warehouse-seeded

Test an individual app:

  • /wizard-ci ai-observability/anthropic
  • /wizard-ci ai-observability/google-adk
  • /wizard-ci ai-observability/groq
Show more apps
  • /wizard-ci ai-observability/manual-capture
  • /wizard-ci ai-observability/openai
  • /wizard-ci ai-observability/openai-agents
  • /wizard-ci ai-observability/opentelemetry
  • /wizard-ci ai-observability/vercel-ai
  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/flutter
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci feature-flags/django
  • /wizard-ci feature-flags/next-js
  • /wizard-ci mcp-analytics/custom-dispatcher
  • /wizard-ci mcp-analytics/typescript-sdk
  • /wizard-ci replay-vision/javascript-node
  • /wizard-ci replay-vision/next-js
  • /wizard-ci replay-vision/react-vite
  • /wizard-ci revenue/stripe
  • /wizard-ci self-driving/astro
  • /wizard-ci self-driving/fastapi
  • /wizard-ci self-driving/nuxt
  • /wizard-ci self-driving/react-router
  • /wizard-ci self-driving/sveltekit
  • /wizard-ci warehouse/monorepo-env
  • /wizard-ci warehouse/multi-source-next
  • /wizard-ci warehouse/stripe-node
  • /wizard-ci warehouse/zero-source
  • /wizard-ci warehouse-seeded/next-stripe
  • /wizard-ci warehouse-seeded/next-stripe-declined

Test against a wizard branch:

  • /wizard-ci all wizard:my-branch

Add wizard:<branch> to any command above to pin the wizard branch. It defaults to main.

Results will be posted here when complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant