Skip to content

Add support for Codex CLI worker #1101

Open

Description

Original author: Todd Anglin (@toddanglin)

Summary

Add a new coding-agent benchmark worker for OpenAI Codex CLI, mirroring the existing coder-acp-copilot (GitHub Copilot) and coder-acp-claude-code (Claude Code) ACP workers. Codex is driven via the @zed-industries/codex-acp ACP adapter, reusing the ACP stdio client + queue-processor pattern.

Motivation

MS Scope benchmarks multiple AI coding agents. OpenAI Codex CLI is a major harness that should be represented alongside Copilot, Claude Code, and Gemini so we can compare agent performance on standardized tasks.

Scope

  • Worker apps/workers/coder-acp-codex/ — queue processor + ACP stdio client driving codex-acp.
  • Auth plumbing — support all Codex auth methods (ChatGPT OAuth, device auth, API key, access token over stdin); token type openai-api-key → capability codex-cli.
  • Version checker apps/version-checkers/acp-codex/ — track @zed-industries/codex-acp latest and auto-bump CODEX_ACP_VERSION (same updating pattern as other harnesses).
  • Docker Compose — codex profile worker + devproxy/mcp-gateway sidecars, volumes, agent registration, scheduler wiring.
  • Deploy — base manifest + KEDA ScaledObject + register-version Job + devproxy ConfigMap, overlays, FluxCD image automation.
  • CI/CD — ci.yml, promote.yml, check-worker-versions.yml.
  • Docs — overview, deployment, ENV_VARIABLES, README, AGENTS.

Key architectural differences

  1. Native Rust binary -> proxy CA injected via SSL_CERT_FILE combined bundle (not NODE_EXTRA_CA_CERTS).
  2. Auth = OpenAI key / ChatGPT OAuth / device / access token.
  3. Single bundled version CODEX_ACP_VERSION (no separate SDK version).
  4. Full access via ACP session mode full-access.
  5. Model/effort via ACP config options (model first, then reasoning_effort).
  6. DevProxy watches api.openai.com / chatgpt.com.
  7. MCP via ACP newSession.mcpServers (like Claude).

Acceptance criteria

  • Worker builds and processes queue-coder-acp-codex tasks end-to-end.
  • All Codex auth methods supported.
  • Version auto-update wired.
  • Deploy manifests + CI green.
  • Docs updated.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions