Audits all cli-web-* CLIs for convention drift against HARNESS.md. Reports PASS/FAIL matrix per check per CLI. Read-only.
From cli-anything-webnpx claudepluginhub itamarzand88/cli-anything-web --plugin cli-anything-webReviews completed project steps against plans for alignment, code quality, architecture, SOLID principles, error handling, tests, security, documentation, and standards. Categorizes issues as critical/important/suggestions.
Context engineer for dynamic context management using vector DBs, knowledge graphs, memory systems, and RAG. Delegate for multi-agent orchestration, semantic retrieval, context optimization, and enterprise AI workflows.
Elite code reviewer specializing in AI-powered analysis, security vulnerabilities, performance optimization, production reliability, static tools, and config reviews using 2024/2025 best practices. Delegate for PR analysis and proactive code quality assurance.
Audit all generated cli-web-* CLIs against current HARNESS.md conventions. This is a read-only audit — it reports findings but does not auto-fix.
Read registry.json at the repository root to get the list of all CLIs.
For each entry, note the directory, namespace, and auth fields.
Fallback: If registry.json doesn't exist, glob for
*/agent-harness/cli_web/*/__init__.py to find CLI packages.
Find the plugin's canonical repl_skin.py for version comparison using Glob:
Glob pattern: **/cli-anything-web-plugin/scripts/repl_skin.py
For each discovered CLI, run all applicable checks. Mark checks as N/A when they don't apply (e.g., auth checks for no-auth CLIs).
Read core/exceptions.py and verify:
to_dict() methodRateLimitError has retry_after field AND to_dict() includes itServerError stores status_code as instance attributeraise_for_status() maps: 401/403→AuthError, 404→NotFoundError, 429→RateLimitError, 5xx→ServerErrorHow to check:
Grep for "def to_dict" in exceptions.py
Grep for "retry_after" in exceptions.py — must appear in both __init__ and to_dict
Grep for "status_code" in ServerError class
Read *_cli.py and verify BOTH stdout AND stderr are reconfigured:
Grep for "stdout.reconfigure" and "stderr.reconfigure" in *_cli.py
Both must be present. Only stdout = FAIL.
Read *_cli.py and verify shlex.split is used in the REPL loop:
Grep for "shlex.split" in *_cli.py — must be present
Grep for "line.split()" in *_cli.py — must NOT be present (or only in non-REPL context)
Read *_cli.py and verify REPL dispatch uses standalone_mode=False:
Grep for "standalone_mode=False" in *_cli.py
Grep for "**ctx.params" in *_cli.py — must NOT be present
Verify cli_web/__init__.py does NOT exist at the agent-harness level:
Check: {dir}/cli_web/__init__.py should NOT exist
Check: {dir}/cli_web/{app}/__init__.py SHOULD exist
Read all commands/*.py files and verify they use handle_errors():
Grep for "with handle_errors" in commands/*.py — should appear in every command function
Grep for "except.*Exception" in commands/*.py — should NOT appear (manual try/except)
Grep for "click.ClickException" in commands/*.py and *_cli.py
Any match = FAIL (bypasses handle_errors JSON output)
Read core/exceptions.py and verify to_dict() returns structured format:
Grep for '"error".*True' in exceptions.py
Grep for '"code"' in exceptions.py
Grep for "CLI_WEB_.*_AUTH_JSON" in config.py or auth.py
N/A for no-auth CLIs.
Grep for "chmod" or "0o600" in auth.py
N/A for no-auth CLIs.
Compare utils/repl_skin.py against the plugin's canonical version:
diff {cli_dir}/utils/repl_skin.py {plugin_dir}/scripts/repl_skin.py
Any differences = FAIL (stale copy).
For CLIs with Google SSO auth, verify that .google.com cookies take
priority over regional ccTLD duplicates (.google.co.il, .google.de, etc.):
Read core/auth.py
Look for cookie domain priority logic — sorting or filtering that prefers
.google.com over regional domains
If auth uses Google SSO but no domain priority logic exists → FAIL
N/A for non-Google-SSO CLIs.
Grep for 'find_namespace_packages' in setup.py
Grep for 'include=\["cli_web\.\*"\]' in setup.py
Format as a matrix table:
Cross-CLI Consistency Report
━━━━━━━━━━━━━━━━━━━━━━━━━━━
ExcH UTF8 REPL Disp NS HErr NoClk JSON Auth Chmd Cook Skin Setup
futbin PASS FAIL PASS PASS PASS PASS PASS PASS N/A N/A N/A FAIL PASS
reddit PASS PASS PASS PASS PASS FAIL FAIL PASS PASS PASS N/A PASS PASS
...
Legend: ExcH=Exception Hierarchy, UTF8=UTF-8 Fix, REPL=shlex.split, Disp=REPL Dispatch,
NS=Namespace Package, HErr=handle_errors, NoClk=No click.ClickException,
JSON=JSON Error Format, Auth=Auth Env Var, Chmd=Auth chmod, Cook=Cookie Domain Priority,
Skin=repl_skin version, Setup=setup.py namespaces
Summary: X Critical, Y Important, Z Minor findings across N CLIs
Critical Issues:
[CLI]: [check name] — [description] ([file:line])
...
Important Issues:
[CLI]: [check name] — [description] ([file:line])
...
Minor Issues:
[CLI]: [check name] — [description] ([file:line])
...