quality-tooling

Red Hat Quality Tiger Team

Quality tooling and automation for RHOAI component development.

Overview

This repository contains tools and documentation created by the Quality Tiger Team to improve quality practices across Red Hat OpenShift AI (RHOAI) components.

Tools

1. Quality Repo Analysis (/.claude/skills/quality-repo-analysis/)

Automated analysis tool that evaluates CI/CD, testing, security, and best practices against gold standards.

Usage:

/quality-repo-analysis https://github.com/org/repo

Outputs:

• Quality scorecard (0-10 scoring)
• Critical gaps report
• Quick wins recommendations
• Benchmarking against gold standards

2. Konflux Build Simulator (/.claude/skills/konflux-build-simulator/)

Generates GitHub Actions workflows and local scripts that simulate Konflux builds before merge.

Usage:

/konflux-build-simulator https://github.com/org/repo

Outputs:

• .github/workflows/konflux-build-simulator.yml
• scripts/validate-konflux-build.sh
• Documentation and reports

Validates:

• Docker builds with production BUILD_MODE
• Module Federation (for monorepos)
• Kubernetes manifests (kustomize)
• Operator integration

3. Test Rules Generator (/.claude/skills/test-rules-generator/)

Extracts test patterns from existing tests and generates .claude/rules/ documentation.

Usage:

/test-rules-generator https://github.com/org/repo

Outputs:

• testing-standards.md - Cross-cutting guidance
• unit-tests.md - Unit test patterns
• e2e-tests.md - E2E test patterns (if found)
• contract-tests.md - Contract test patterns (if found)
• mock-tests.md - Mock/component test patterns (if found)

4. Workflow Diagram Generator (/.claude/skills/workflow-diagram-generator/)

Generates Mermaid diagrams visualizing software development workflows and processes.

Usage:

/workflow-diagram-generator

Outputs:

• Mermaid diagram definitions (.mmd files)
• PNG renderings of diagrams
• Documentation of workflow processes

5. Quality Report Aggregator (/aggregate_quality_reports.py)

Aggregates quality analysis reports across multiple repositories and generates combined reports with statistics.

Usage:

# Generate analysis commands for all configured repos
python aggregate_quality_reports.py --generate-commands

# Process existing reports and create combined report
python aggregate_quality_reports.py --reports-dir ./quality_reports \
  --output-md combined_report.md \
  --output-json summary.json

Outputs:

• Combined markdown report with cross-repo statistics
• JSON export for programmatic analysis
• Analysis command lists for batch processing

Features:

• Analyzes 20+ RHOAI component repositories
• Supports Upstream (opendatahub-io), Downstream (RHODS), and External repos
• Identifies common gaps and quick wins
• Tracks quality trends across repository groups

See AGGREGATOR_README.md for detailed documentation.

Repository Structure

.
├── .claude/
│   └── skills/
│       ├── quality-repo-analysis/
│       │   ├── SKILL.md
│       │   └── instructions.md
│       ├── konflux-build-simulator/
│       │   ├── SKILL.md
│       │   └── instructions.md
│       ├── test-rules-generator/
│       │   ├── SKILL.md
│       │   └── instructions.md
│       ├── workflow-diagram-generator/
│       │   └── SKILL.md
│       └── shared/
│           ├── fingerprint_utils.py
│           └── jira_utils.py
├── docs/
│   └── diagrams/
├── aggregate_quality_reports.py   # Report aggregation tool
├── repos_config.yaml               # Repository configuration
├── run_batch_analysis.sh          # Batch analysis helper
├── AGGREGATOR_README.md           # Aggregator documentation
├── WORKFLOW.md                    # Analysis workflow guide
└── README.md

Getting Started

These tools are designed to be used with Claude Code (Anthropic's CLI tool for Claude).

Prerequisites

• Claude Code installed
• Access to target repositories
• Docker (for build simulator)
• Git

Usage

Skills can be invoked using the /skill-name syntax in Claude Code:

# Analyze repository quality
/quality-repo-analysis https://github.com/opendatahub-io/odh-dashboard

# Generate build validation
/konflux-build-simulator https://github.com/opendatahub-io/odh-model-controller

# Extract test patterns
/test-rules-generator https://github.com/opendatahub-io/notebooks

# Generate workflow diagrams
/workflow-diagram-generator

Documentation

Each skill includes:

• SKILL.md - High-level overview and usage
• instructions.md - Detailed implementation instructions
• Example outputs and reports

Proven Results

Repositories Tested:

• odh-dashboard (Quality: 8.5/10, Build validation: ✅)
• notebooks (Test rules: 77 KB, 30+ examples)
• odh-model-controller (Build validation: ✅)
• kserve (external benchmarking)