databricks-ai-dev-kit

Databricks AI Dev Kit

Overview

AI-Driven Development (vibe coding) on Databricks just got a whole lot better. The AI Dev Kit gives your AI coding assistant (Claude Code, Cursor, Windsurf, etc.) the trusted sources it needs to build faster and smarter on Databricks.

What Can I Build?

• Spark Declarative Pipelines (streaming tables, CDC, SCD Type 2, Auto Loader)
• Databricks Jobs (scheduled workflows, multi-task DAGs)
• AI/BI Dashboards (visualizations, KPIs, analytics)
• Unity Catalog (tables, volumes, governance)
• Genie Spaces (natural language data exploration)
• Knowledge Assistants (RAG-based document Q&A)
• MLflow Experiments (evaluation, scoring, traces)
• Model Serving (deploy ML models and AI agents to endpoints)
• Databricks Apps (full-stack web applications)
• ...and more

Choose Your Own Adventure

Quick Start

Prerequisites

• uv - Python package manager
• Databricks CLI - Command line interface for Databricks
• AI coding environment
  • Claude Code
  • Cursor

Install in existing project

By default this will install at a project level rather than a user level. This is often a good fit, but requires you to run your client from the exact directory that was used for the install.
Note: Project configuration files can be re-used in other projects. You find these configs under .claude or .cursor

Mac / Linux

Basic installation (uses DEFAULT profile, project scope)

bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh)

bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --global --force

bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --profile DEFAULT --force

bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --tools cursor

Next steps: Respond to interactive prompts and follow the on-screen instructions.

• Note: Cursor and Copilot require updating settings manually after install.

Windows (PowerShell)

Basic installation (uses DEFAULT profile, project scope)

irm https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.ps1 | iex

irm https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.ps1 -OutFile install.ps1

.\install.ps1 -Global -Force

.\install.ps1 -Profile DEFAULT -Force

.\install.ps1 -Tools cursor

Next steps: Respond to interactive prompts and follow the on-screen instructions.

• Note: Cursor and Copilot require updating settings manually after install.

Visual Builder App

Full-stack web application with chat UI for Databricks development:

cd ai-dev-kit/databricks-builder-app
./scripts/setup.sh
# Follow instructions to start the app

Core Library

Use databricks-tools-core directly in your Python projects:

from databricks_tools_core.sql import execute_sql

results = execute_sql("SELECT * FROM my_catalog.schema.table LIMIT 10")