Databricks AI Dev Kit
Overview
AI-Driven Development (vibe coding) on Databricks just got a whole lot better. The AI Dev Kit gives your AI coding assistant (Claude Code, Cursor, Windsurf, etc.) the trusted sources it needs to build faster and smarter on Databricks.
What Can I Build?
- Spark Declarative Pipelines (streaming tables, CDC, SCD Type 2, Auto Loader)
- Databricks Jobs (scheduled workflows, multi-task DAGs)
- AI/BI Dashboards (visualizations, KPIs, analytics)
- Unity Catalog (tables, volumes, governance)
- Genie Spaces (natural language data exploration)
- Knowledge Assistants (RAG-based document Q&A)
- MLflow Experiments (evaluation, scoring, traces)
- Model Serving (deploy ML models and AI agents to endpoints)
- Databricks Apps (full-stack web applications)
- ...and more
Choose Your Own Adventure
| Adventure | Best For | Start Here |
|---|---|---|
| :star: Install AI Dev Kit | Start here! Follow quick install instructions to add to your existing project folder | Quick Start (install) |
| Visual Builder App | Web-based UI for Databricks development | databricks-builder-app/ |
| Core Library | Building custom integrations (LangChain, OpenAI, etc.) | pip install |
| Skills Only | Provide Databricks patterns and best practices (without MCP functions) | Install skills |
| MCP Tools Only | Just executable actions (no guidance) | Register MCP server |
Quick Start
Prerequisites
- uv - Python package manager
- Databricks CLI - Command line interface for Databricks
- AI coding environment (one or more):
Install in existing project
By default this will install at a project level rather than a user level. This is often a good fit, but requires you to run your client from the exact directory that was used for the install. Note: Project configuration files can be re-used in other projects. You find these configs under .claude, .cursor, or .gemini
Mac / Linux
Basic installation (uses DEFAULT profile, project scope)
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh)
Advanced Options (click to expand)
Global installation with force reinstall
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --global --force
Specify profile and force reinstall
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --profile DEFAULT --force
Install for specific tools only
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --tools cursor,gemini
Next steps: Respond to interactive prompts and follow the on-screen instructions.
- Note: Cursor and Copilot require updating settings manually after install.
Windows (PowerShell)
Basic installation (uses DEFAULT profile, project scope)
irm https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.ps1 | iex
Advanced Options (click to expand)
Download script first
irm https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.ps1 -OutFile install.ps1
Global installation with force reinstall
.\install.ps1 -Global -Force
Specify profile and force reinstall
.\install.ps1 -Profile DEFAULT -Force
Install for specific tools only
.\install.ps1 -Tools cursor,gemini
Next steps: Respond to interactive prompts and follow the on-screen instructions.
- Note: Cursor and Copilot require updating settings manually after install.
Visual Builder App
Full-stack web application with chat UI for Databricks development:
cd ai-dev-kit/databricks-builder-app
./scripts/setup.sh
# Follow instructions to start the app
Core Library
Use databricks-tools-core directly in your Python projects:
from databricks_tools_core.sql import execute_sql