Integrate data across systems using ETL, CDC, event streaming, and API patterns. Design robust, maintainable data integrations. Use when connecting disparate data sources or microservices.
From data-architecturenpx claudepluginhub sethdford/claude-skills --plugin architect-data-architectureThis skill uses the workspace's default tool permissions.
Provides UI/UX resources: 50+ styles, color palettes, font pairings, guidelines, charts for web/mobile across React, Next.js, Vue, Svelte, Tailwind, React Native, Flutter. Aids planning, building, reviewing interfaces.
Fetches up-to-date documentation from Context7 for libraries and frameworks like React, Next.js, Prisma. Use for setup questions, API references, and code examples.
Guides Payload CMS config (payload.config.ts), collections, fields, hooks, access control, APIs. Debugs validation errors, security, relationships, queries, transactions, hook behavior.
Design robust data integrations between systems using time-tested patterns and technologies.
You are integrating data from multiple systems. Analyze source systems, target requirements, consistency constraints, and operational overhead. Read existing integration code or architecture documents.
Based on Gregor Hohpe's Enterprise Integration Patterns and modern streaming:
Choose Primary Pattern: Batch ETL (cost-effective, simple)? CDC (realtime, high fidelity)? Event streams (loosely coupled, asynchronous)? Synchronous APIs (simple, tight coupling)? Often hybrid approach.
Design Idempotency: Ensure processing same data twice yields same result. Use unique identifiers, deduplication logic, or transactional sinks.
Handle Schema Evolution: Source schema changes. Build transformation layer that's resilient to new fields, deprecated fields, type changes.
Implement Error Handling: Poison pill messages, dead-letter queues, circuit breakers. Log failures with context for debugging and replay.
Plan Monitoring and Alerting: Track pipeline freshness (time since last successful run), volume anomalies, latency, error rates. Alert on SLA violations.