claudegoodies
Skill

qa-test

From steipete

CodexBar live QA/e2e testing: run provider usage matrix checks, validate real app config, use Peekaboo for menu proof, use Browser Use/official docs for API spec or logged-in dashboard checks, and handle 1Password credentials safely.

Runs live QA on the CodexBar macOS app: provider usage matrix checks, config validation, menu verification via Peekaboo.

Use it when

  • Verifying a provider works/fails report against live APIs
  • Running release smoke tests before shipping CodexBar
  • Checking menu bar UI matches enabled provider config
  • Debugging usage-API auth failures for OpenAI, Deepgram, Groq, MiniMax

Skip it if

  • Specific to the CodexBar macOS app repo, not general-purpose
  • Requires macOS tools: Peekaboo, tmux, 1Password CLI, sips, screencapture
  • Needs provider API keys/sessions and possibly a browser profile for logged-in dashboards

Facts

Repository
steipete/CodexBar
Status
Actively maintained
Last commit
Source file
.agents/skills/qa-test/SKILL.md

Source preview

The instructions Claude Code reads when this skill runs.

# CodexBar Live QA

Use for live provider testing, release smoke tests, menu verification, or debugging “provider works/fails” reports.

## Rules

- Work from the CodexBar repo checkout.
- Use the packaged CLI first: `CodexBar.app/Contents/Helpers/CodexBarCLI`.
- Do not use `CodexBar.app/Contents/MacOS/codexbar`; that is the app binary and may appear to hang as a CLI.
- Never run broad `env`, `set`, or secret regex dumps.
- Use `$one-password` for secrets: all `op` commands inside one persistent tmux session, service account first, no raw secret output.
- Treat browser-cookie/keychain flows as prompt-risky. Prefer CLI/API-token checks and `KeychainNoUIQuery`-safe tests unless the user explicitly requested live UI.
- For current API behavior, browse official provider docs only.

## CLI Matrix

Run the bundled script:

```bash
.agents/skills/qa-test/scripts/live_provider_matrix.sh --enabled
```

Useful modes:

```bash
.agents/skills/qa-test/scripts/live_provider_matrix.sh --provider all
.agents/skills/qa-test/scripts/live_provider_matrix.sh --providers openai,zai,deepseek
.agents/skills/qa-test/scripts/live_provider_matrix.sh --default
```

Interpretation:

- `--enabled` asks `CodexBarCLI config providers` for enabled providers, honoring `CODEXBAR_CONFIG` and default toggles.
- `--default` runs the app-facing default command with no provider override.
- `--provider all` forces ev
View full source on GitHub →

Other skills