Skip to content

fix(self-driving): create custom scouts with scout-create, not skill-create - #411

Merged
andrewm4894 merged 1 commit into
mainfrom
posthog-self-driving/fixself-driving-create-custom-scouts-on-77a73b
Sep 25, 2026
Merged

andrewm4894 merged 1 commit into
mainfrom
posthog-self-driving/fixself-driving-create-custom-scouts-on-77a73b

Conversation

@posthog

@posthog posthog Bot commented Sep 25, 2026 •

Copy link
Copy Markdown
Contributor

Problem

  • The wizard's custom-scout step created every approved scout on the deprecated signal channel, so a user who accepts a scout gets weak findings for later clustering instead of the full inbox reports the setup promises them.
  • Step 6b told the wizard to call skill-create. That call does not grant the report-channel tools, and the scout prompt turns the report channel on only when emit_report / edit_report are stored.
  • The same step called the signals-scout- prefix mandatory. The prefix only drives config auto-registration, so a valid name without it is still runnable when the config is created alongside the skill.

Origin

  • Scout: a custom scout
  • First signal: 2026-09-25
  • Inbox report: open
  • Task started by: auto-start, after the report was rated P2 and ready to fix

Changes

  • Use scout-create. It grants the report-channel tools and writes the skill and its config in one atomic call, which is what makes the first run land on the report channel.
skill-create (before) scout-create (after)
Report tools ungranted until a user approves always granted
Config auto-registered later by the signals-scout-* glob created in the same call
First-run channel deprecated signal channel report channel
Name prefix must be signals-scout- optional
  • Pass config: {"enabled": true} and nothing else, so the posture the wizard intends is explicit while emit and run_interval_minutes stay the server's defaults.
  • Reword the prefix rule: keep signals-scout-<scope> as a deliberate naming choice for a readable troop, not a run requirement.
  • Update the write-surface line in description.md to match.

Agent context

  • Verified against the live scout-create schema and the current authoring-scouts guide, not from the report alone.
  • npm test (215 tests) and npm run build both pass.

Created with PostHog Desktop from this inbox report.

🤖 Generated with Claude Code

…create

Step 6b told the wizard to create each approved scout with `skill-create`.
That call does not grant the report-channel tools, so the new scout ran on
the deprecated signal channel and sent weak findings for later clustering
instead of writing full inbox reports.

Switch the recipe to `scout-create`, which grants the report tools and
writes the config in one atomic call. Also correct the name rule: the
`signals-scout-` prefix only drives config auto-registration, which
`scout-create` does itself, so the prefix is a readability choice and not
a run requirement.

Generated-By: PostHog Desktop
Task-Id: b0c568e1-a021-4e49-8085-c9c1fcafd73e
@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci ai-observability
  • /wizard-ci basic-integration
  • /wizard-ci feature-flags
  • /wizard-ci mcp-analytics
  • /wizard-ci replay-vision
  • /wizard-ci revenue
  • /wizard-ci self-driving
  • /wizard-ci warehouse
  • /wizard-ci warehouse-seeded

Test an individual app:

  • /wizard-ci ai-observability/anthropic
  • /wizard-ci ai-observability/google-adk
  • /wizard-ci ai-observability/groq
Show more apps
  • /wizard-ci ai-observability/manual-capture
  • /wizard-ci ai-observability/openai
  • /wizard-ci ai-observability/openai-agents
  • /wizard-ci ai-observability/opentelemetry
  • /wizard-ci ai-observability/vercel-ai
  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/flutter
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci feature-flags/django
  • /wizard-ci feature-flags/next-js
  • /wizard-ci mcp-analytics/custom-dispatcher
  • /wizard-ci mcp-analytics/typescript-sdk
  • /wizard-ci replay-vision/javascript-node
  • /wizard-ci replay-vision/next-js
  • /wizard-ci replay-vision/react-vite
  • /wizard-ci revenue/stripe
  • /wizard-ci self-driving/astro
  • /wizard-ci self-driving/fastapi
  • /wizard-ci self-driving/nuxt
  • /wizard-ci self-driving/react-router
  • /wizard-ci self-driving/sveltekit
  • /wizard-ci warehouse/monorepo-env
  • /wizard-ci warehouse/multi-source-next
  • /wizard-ci warehouse/stripe-node
  • /wizard-ci warehouse/zero-source
  • /wizard-ci warehouse-seeded/next-stripe
  • /wizard-ci warehouse-seeded/next-stripe-declined

Test against a wizard branch:

  • /wizard-ci all wizard:my-branch

Add wizard:<branch> to any command above to pin the wizard branch. It defaults to main.

Results will be posted here when complete.

@andrewm4894
andrewm4894 marked this pull request as ready for review September 25, 2026 15:38
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 25, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-09-25T15:40:51.183889Z 3cdd8c4 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@andrewm4894
andrewm4894 merged commit 88504eb into main Sep 25, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants