Set up comprehensive observability for CodeRabbit integrations with metrics, traces, and alerts. Use when implementing monitoring for CodeRabbit operations, setting up dashboards, or configuring alerting for CodeRabbit integration health. Trigger with phrases like "coderabbit monitoring", "coderabbit metrics", "coderabbit observability", "monitor coderabbit", "coderabbit alerts", "coderabbit tracing".
From coderabbit-packnpx claudepluginhub nickloveinvesting/nick-love-plugins --plugin coderabbit-packThis skill is limited to using the following tools:
Guides Next.js Cache Components and Partial Prerendering (PPR) with cacheComponents enabled. Implements 'use cache', cacheLife(), cacheTag(), revalidateTag(), static/dynamic optimization, and cache debugging.
Migrates code, prompts, and API calls from Claude Sonnet 4.0/4.5 or Opus 4.1 to Opus 4.5, updating model strings on Anthropic, AWS, GCP, Azure platforms.
Details PluginEval's skill quality evaluation: 3 layers (static, LLM judge), 10 dimensions, rubrics, formulas, anti-patterns, badges. Use to interpret scores, improve triggering, calibrate thresholds.
Monitor CodeRabbit AI code review effectiveness, review latency, and team adoption. Key metrics include time-to-first-review (how fast CodeRabbit posts its review after PR creation), comment acceptance rate (comments resolved vs dismissed), review coverage (percentage of PRs reviewed), and per-repository review volume.
// coderabbit-metrics.ts - Process GitHub webhook events
function handlePullRequestReview(event: any) {
if (event.review.user.login === 'coderabbitai') {
const prCreatedAt = new Date(event.pull_request.created_at);
const reviewPostedAt = new Date(event.review.submitted_at);
const timeToReview = (reviewPostedAt.getTime() - prCreatedAt.getTime()) / 1000; # 1000: 1 second in ms
emitHistogram('coderabbit_time_to_review_sec', timeToReview, { repo: event.repository.name });
emitCounter('coderabbit_reviews_total', 1, { repo: event.repository.name, state: event.review.state });
}
}
# Query GitHub API for CodeRabbit review comments and their resolution status
gh api repos/ORG/REPO/pulls/comments \
--jq '[.[] | select(.user.login=="coderabbitai")] | {
total: length,
resolved: [.[] | select(.resolved == true)] | length
} | {total, resolved, acceptance_rate: (.resolved / .total * 100)}'
// Check what percentage of PRs get CodeRabbit reviews
async function reviewCoverage(org: string, repo: string, days: number) {
const prs = await github.pulls.list({ owner: org, repo, state: 'closed', per_page: 100 });
let reviewed = 0;
for (const pr of prs) {
const reviews = await github.pulls.listReviews({ owner: org, repo, pull_number: pr.number });
if (reviews.data.some(r => r.user?.login === 'coderabbitai')) reviewed++;
}
return { total: prs.length, reviewed, coverage: (reviewed / prs.length * 100).toFixed(1) };
}
groups:
- name: coderabbit
rules:
- alert: CodeRabbitReviewSlow
expr: histogram_quantile(0.95, rate(coderabbit_time_to_review_sec_bucket[1h])) > 600 # 600: timeout: 10 minutes
annotations: { summary: "CodeRabbit P95 review time exceeds 10 minutes" }
- alert: CodeRabbitNotReviewing
expr: rate(coderabbit_reviews_total[6h]) == 0 and rate(github_prs_opened_total[6h]) > 0
annotations: { summary: "PRs opening but CodeRabbit not reviewing -- check installation" }
- alert: LowCommentAcceptance
expr: coderabbit_comment_acceptance_rate < 30
for: 7d
annotations: { summary: "CodeRabbit comment acceptance rate below 30% -- review config" }
Key panels: review latency distribution, comment acceptance rate over time, PRs reviewed vs total PRs (coverage), reviews per repository (bar chart), and most common comment categories (helps tune .coderabbit.yaml instructions).
| Issue | Cause | Solution |
|---|---|---|
| No reviews posting | GitHub App lost permissions | Reinstall CodeRabbit App on the org |
| Review delayed >15 min | Large PR or service backlog | Expected for 1000+ line PRs; split PRs |
| Low acceptance rate | Reviews too nitpicky | Change profile from nitpicky to assertive |
| Missing repos in metrics | Repos not added to App | Add repos in GitHub App installation settings |
Basic usage: Apply coderabbit observability to a standard project setup with default configuration options.
Advanced scenario: Customize coderabbit observability for production environments with multiple constraints and team-specific requirements.