Repository navigation
Open
Description
Original author: Todd Anglin (@toddanglin)
Summary
Add a new coding-agent benchmark worker for OpenAI Codex CLI, mirroring the existing coder-acp-copilot (GitHub Copilot) and coder-acp-claude-code (Claude Code) ACP workers. Codex is driven via the @zed-industries/codex-acp ACP adapter, reusing the ACP stdio client + queue-processor pattern.
Motivation
MS Scope benchmarks multiple AI coding agents. OpenAI Codex CLI is a major harness that should be represented alongside Copilot, Claude Code, and Gemini so we can compare agent performance on standardized tasks.
Scope
- Worker
apps/workers/coder-acp-codex/— queue processor + ACP stdio client drivingcodex-acp. - Auth plumbing — support all Codex auth methods (ChatGPT OAuth, device auth, API key, access token over stdin); token type
openai-api-key→ capabilitycodex-cli. - Version checker
apps/version-checkers/acp-codex/— track@zed-industries/codex-acplatest and auto-bumpCODEX_ACP_VERSION(same updating pattern as other harnesses). - Docker Compose —
codexprofile worker + devproxy/mcp-gateway sidecars, volumes, agent registration, scheduler wiring. - Deploy — base manifest + KEDA ScaledObject + register-version Job + devproxy ConfigMap, overlays, FluxCD image automation.
- CI/CD —
ci.yml,promote.yml,check-worker-versions.yml. - Docs — overview, deployment, ENV_VARIABLES, README, AGENTS.
Key architectural differences
- Native Rust binary -> proxy CA injected via
SSL_CERT_FILEcombined bundle (notNODE_EXTRA_CA_CERTS). - Auth = OpenAI key / ChatGPT OAuth / device / access token.
- Single bundled version
CODEX_ACP_VERSION(no separate SDK version). - Full access via ACP session mode
full-access. - Model/effort via ACP config options (
modelfirst, thenreasoning_effort). - DevProxy watches
api.openai.com/chatgpt.com. - MCP via ACP
newSession.mcpServers(like Claude).
Acceptance criteria
- Worker builds and processes
queue-coder-acp-codextasks end-to-end. - All Codex auth methods supported.
- Version auto-update wired.
- Deploy manifests + CI green.
- Docs updated.
Metadata
Metadata
Assignees
Labels
No labels
Activity