Arize AI skill for production ML monitoring, embedding drift, and performance analysis.
Monitors production ML models for performance issues, drift, and generates analysis dashboards.
npx claudepluginhub a5c-ai/babysitterThis skill is limited to using the following tools:
README.mdArize AI skill for production ML monitoring, embedding drift detection, and comprehensive performance analysis.
{
"type": "object",
"required": ["action"],
"properties": {
"action": {
"type": "string",
"enum": ["log", "monitor", "analyze", "alert-config", "compare"],
"description": "Arize action to perform"
},
"logConfig": {
"type": "object",
"properties": {
"modelId": { "type": "string" },
"modelVersion": { "type": "string" },
"modelType": { "type": "string", "enum": ["score_categorical", "regression", "ranking"] },
"environment": { "type": "string", "enum": ["training", "validation", "production"] },
"dataPath": { "type": "string" },
"predictionIdColumn": { "type": "string" },
"timestampColumn": { "type": "string" },
"featureColumns": { "type": "array", "items": { "type": "string" } },
"embeddingColumns": { "type": "array", "items": { "type": "string" } },
"predictionColumn": { "type": "string" },
"actualColumn": { "type": "string" }
}
},
"monitorConfig": {
"type": "object",
"properties": {
"metrics": { "type": "array", "items": { "type": "string" } },
"thresholds": { "type": "object" },
"schedule": { "type": "string" }
}
},
"analysisConfig": {
"type": "object",
"properties": {
"analysisType": { "type": "string", "enum": ["drift", "performance", "fairness", "data_quality"] },
"timeRange": { "type": "object" },
"segments": { "type": "array", "items": { "type": "string" } }
}
}
}
}
{
"type": "object",
"required": ["status", "action"],
"properties": {
"status": {
"type": "string",
"enum": ["success", "error"]
},
"action": {
"type": "string"
},
"logId": {
"type": "string"
},
"dashboardUrl": {
"type": "string"
},
"analysis": {
"type": "object",
"properties": {
"overallScore": { "type": "number" },
"driftMetrics": { "type": "object" },
"performanceMetrics": { "type": "object" },
"topIssues": { "type": "array" },
"recommendations": { "type": "array", "items": { "type": "string" } }
}
},
"alerts": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": { "type": "string" },
"severity": { "type": "string" },
"triggered": { "type": "boolean" }
}
}
}
}
}
{
kind: 'skill',
title: 'Log production predictions to Arize',
skill: {
name: 'arize-observability',
context: {
action: 'log',
logConfig: {
modelId: 'fraud-detector',
modelVersion: '2.0.0',
modelType: 'score_categorical',
environment: 'production',
dataPath: 'data/production_predictions.parquet',
predictionIdColumn: 'request_id',
timestampColumn: 'timestamp',
featureColumns: ['amount', 'merchant_category', 'hour'],
predictionColumn: 'fraud_probability',
actualColumn: 'is_fraud'
}
}
}
}
Activates when the user asks about AI prompts, needs prompt templates, wants to search for prompts, or mentions prompts.chat. Use for discovering, retrieving, and improving prompts.
Search, retrieve, and install Agent Skills from the prompts.chat registry using MCP tools. Use when the user asks to find skills, browse skill catalogs, install a skill for Claude, or extend Claude's capabilities with reusable AI agent components.
This skill should be used when the user asks to "create an agent", "add an agent", "write a subagent", "agent frontmatter", "when to use description", "agent examples", "agent tools", "agent colors", "autonomous agent", or needs guidance on agent structure, system prompts, triggering conditions, or agent development best practices for Claude Code plugins.