Query and debug Arize ML observability data via GraphQL using curl-based tools for schema fetching, query execution on spaces/models/monitors/datasets, and mutation handling. Extend the Arize Toolkit by following a guided workflow to add new GraphQL queries: explore schemas, generate models/types, write tests, implement client methods, and update docs.
npx claudepluginhub duncankmckinnon/arize_toolkit --plugin arize-toolkit-devQuery and analyze data from the Arize platform using GraphQL, or help build/validate GraphQL queries and mutations. Use when users want to explore spaces, models, monitors, datasets, any Arize platform data, OR when they need help writing, formatting, or debugging GraphQL queries/mutations for the Arize API.
Complete workflow for adding new GraphQL queries or mutations to the Arize Toolkit, including models, types, tests, client methods, and documentation. Use when (1) adding a new GraphQL query or mutation to arize_toolkit, (2) implementing new API functionality that requires queries, (3) user requests to add Arize API capabilities, or (4) user invokes /new-query-workflow. Triggers on phrases like "add a query", "create a mutation", "implement API for", "add support for [feature]", or explicit workflow invocation.
Share bugs, ideas, or general feedback.
Manage resources with the CLI, and debug traces
Add Arize AX observability to LLM applications — auto-instrumentation, trace export, dataset management, experiment workflows, prompt optimization, and deep linking via the ax CLI.
Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI.
ML experiment tracking with metrics logging and run comparison
Track and analyze AI experiments with a web dashboard and MCP tools
Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
| Tool Category | Description |
|---|---|
| Project/Model Tools | Access and manage projects/models, retrieve performance metrics and traces/inference volumes |
| Monitor Tools | Create, copy, and manage monitors and alerting |
| Custom Metrics Tools | Create and manage custom metrics |
| Language Model Tools | Work with prompts, annotations, evaluations, and LLM features |
| Space & Organization Tools | Navigate and manage spaces, organizations, and projects |
| Data Import Tools | Import data from cloud storage and databases |
| Trace Tools | Query traces and spans, discover columns, and export trace data |
| Dashboard Tools | Create and manage dashboards |
| Utility Tools | Client configuration and utility functions |
| Extension | Description |
|---|---|
| Prompt Optimization | Automated prompt improvement based on historical performance |
This repository is a Claude Code plugin marketplace with AI-assisted tools for the Arize platform.
# Add the marketplace
claude plugin marketplace add duncankmckinnon/arize_toolkit
# Install plugins
claude plugin install arize-toolkit@arize-toolkit
claude plugin install arize-toolkit-dev@arize-toolkit
| Plugin | Skills | Description |
|---|---|---|
| arize-toolkit | arize-toolkit-cli, arize-traces | Manage Arize resources via CLI, debug traces |
| arize-toolkit-dev | arize-graphql-analytics, new-query-workflow | Developer workflows for adding new functionality |
See the Plugin Marketplace docs for full details.
For automatic tracing of Claude Code sessions to Arize AX or Phoenix, install the tracing plugin from the Arize Claude Code Plugin marketplace:
# Add the Arize plugin marketplace
claude plugin marketplace add Arize-ai/arize-claude-code-plugin
# Install the tracing plugin
claude plugin install claude-code-tracing@arize-claude-plugin
| Plugin | Skills | Description |
|---|---|---|
| claude-code-tracing | setup-claude-code-tracing | Automatic tracing of Claude Code sessions with OpenInference spans (9 lifecycle hooks) |