Zero Script QA

Verify features through real-time Docker log monitoring without writing test scripts.

What is Zero Script QA?

Traditional: Write test code → Execute → Check results → Maintain
Zero Script: Build log infrastructure → Manual UX test → AI log analysis → Auto issue detection

Key Points:
- Structured JSON logs
- Track entire flow with Request ID
- Claude Code monitors logs in real-time
- Auto issue detection and documentation

---

Execution Modes

1. Setup Mode (/zero-script-qa setup)

Build logging infrastructure:
1. Verify JSON log format configuration
2. Verify Request ID propagation
3. Verify Docker Compose logging configuration
4. Verify environment variables (LOG_LEVEL=DEBUG)

2. Monitor Mode (/zero-script-qa monitor)

Real-time monitoring:
1. Guide docker compose logs -f execution
2. Request user manual UX testing
3. Real-time log analysis
4. Immediate report on issue detection

3. Analyze Mode (/zero-script-qa analyze)

Log analysis:
1. Analyze collected logs
2. Identify issue patterns
3. Performance statistics
4. Write comprehensive report

---

Workflow

Step 1: Start Environment

# Start Docker environment
docker compose up -d

# Check status
docker compose ps

Step 2: Start Log Monitoring

# Stream all logs (Claude Code monitors)
docker compose logs -f

# Filter errors only
docker compose logs -f | grep '"level":"ERROR"'

Step 3: Manual UX Testing

User tests actual features in browser:
- Sign up
- Log in
- Use core features
- Test edge cases

Step 4: Issue Detection and Documentation

Claude Code automatically:
1. Detect error patterns
2. Detect slow responses (> 1000ms)
3. Track entire flow with Request ID
4. Document issues
5. Suggest fixes

---

JSON Log Standard

{
  "timestamp": "2026-01-08T10:30:00.000Z",
  "level": "INFO",
  "service": "api",
  "request_id": "req_abc123",
  "message": "API Request completed",
  "data": {
    "method": "POST",
    "path": "/api/users",
    "status": 200,
    "duration_ms": 45
  }
}

---

Issue Detection Patterns

Pattern	Severity	Condition
Error	🔴 Critical	"level":"ERROR"
Server Error	🔴 Critical	"status":5xx
Very Slow	🔴 Critical	duration_ms > 3000
Auth Failure	🟡 Warning	"status":401 or 403
Slow Response	🟡 Warning	duration_ms > 1000
Consecutive Failures	🟡 Warning	Same endpoint fails 3 times

---

Monitoring Commands

# All logs
docker compose logs -f

# Specific service
docker compose logs -f api
docker compose logs -f web

# Errors only
docker compose logs -f | grep '"level":"ERROR"'

# Track specific Request ID
docker compose logs -f | grep 'req_xxx'

# Slow responses (1000ms+)
docker compose logs -f | grep -E '"duration_ms":[0-9]{4,}'

# Last 5 minutes
docker compose logs --since "5m"

---

Result Document

Report generated at docs/03-analysis/zero-script-qa-{date}.md after verification

---

Reference

• .claude/skills/zero-script-qa/SKILL.md: Expert knowledge
• .claude/agents/qa-monitor.md: QA monitoring agent
• .claude/templates/pipeline/zero-script-qa.template.md: Report template
• .claude/instructions/zero-script-qa-rules.md: Auto-applied rules