twelvelabs

TwelveLabs Claude Code Plugin

Index, search, and analyze videos directly from Claude Code using TwelveLabs multimodal AI.

Install

1. Set your TwelveLabs API key as an environment variable (get one at twelvelabs.io):

export TWELVELABS_API_KEY=your_api_key_here

Add this to your ~/.zshrc or ~/.bashrc to persist it.

2. In Claude Code, add the plugin marketplace:

/plugin marketplace add twelvelabs-io/twelve-labs-claude-code-plugin

3. Then install the plugin:

/plugin install twelvelabs@twelvelabs-plugins

You may need to restart Claude Code after installing for the plugin and MCP to take effect.

The plugin configures the MCP server, slash commands, skills, and hooks automatically.

What You Can Do

Index videos from local files, remote URLs, or Google Drive links. Once a video is indexed, it becomes searchable and analyzable. Indexing is asynchronous — you can check on progress at any time.

Search across your videos using natural language descriptions of what you're looking for — visual elements, actions, sounds, or on-screen text. You can also search using a reference image to find visually similar content, combine an image with text for refined results, or search for specific people and objects using entity recognition.

Analyze video content to generate summaries, extract key topics, answer questions, list action items, or perform any open-ended analysis guided by a custom prompt.

Create video embeddings for use in downstream applications like similarity search, clustering, or recommendation systems.

Manage indexes to organize your videos into separate collections. Each index can be configured with different model capabilities — Marengo for search or Pegasus for text generation.

Set up entity search by creating collections of people or objects with reference images. Once configured, you can find exactly when and where a specific person appears across all your indexed videos.

Usage

Commands

Command	Description
/twelvelabs:index-video <path-or-url> [index-id]	Index a local video, URL, or Google Drive link
/twelvelabs:index-video status [task-id]	Check indexing task status
/twelvelabs:indexes	List all indexes
/twelvelabs:indexes create <name> [model]	Create a new index (models: marengo, pegasus, or both)
/twelvelabs:indexes delete <index-id>	Delete an index
/twelvelabs:videos [index-id]	List indexed videos
/twelvelabs:search <query> [index-id]	Text search across videos
/twelvelabs:search <image> [text] [index-id]	Image or composed (image + text) search
/twelvelabs:search <@entity_id> [action] [index-id]	Entity search for specific people/objects
/twelvelabs:analyze [video-id] [index-id] [prompt]	Analyze video content (summary, Q&A, etc.)
/twelvelabs:embed <path-or-url>	Create video embeddings
/twelvelabs:embed status [task-id]	Check embedding task status
/twelvelabs:entities create-collection <name>	Create an entity collection
/twelvelabs:entities list-collections	List all entity collections
/twelvelabs:entities upload <path-or-url>	Upload a reference image as an asset
/twelvelabs:entities create-entity <collection-id> <name> <asset-ids...>	Create an entity from reference images
/twelvelabs:entities list-entities <collection-id>	List entities in a collection
/twelvelabs:entities delete-entity <collection-id> <entity-id>	Delete an entity
/twelvelabs:entities delete-collection <collection-id>	Delete a collection and all its entities
/twelvelabs:help	Show help and available commands

Natural Language

You can also skip slash commands and just describe what you want:

Indexing

• "Index this video: /path/to/video.mp4"
• "Index this URL: https://example.com/video.mp4"
• "Add this video for analysis"
• "Process this video file"
• "Add this Google Drive folder for analysis: https://drive.google.com/drive/folders/ABC123"

Checking Status

• "Is my video ready?"
• "How long until indexing is done?"
• "Is it still processing?"
• "Can I search my video yet?"
• "Check status of task abc123"

Text Search

• "Find the part where someone is cooking"
• "Search for a red car driving fast"
• "When does the presenter mention AI?"
• "Look for the sunset scene"
• "Find text showing 'hello world'"

Image Search

• "Find scenes matching this image: https://example.com/photo.jpg"
• "Search with this picture: /path/to/screenshot.png"
• "Find videos that look like this image"

Composed Search (Image + Text)

• "Find this car but in blue: https://example.com/car.jpg"
• "Find this building at night: https://example.com/building.jpg"
• "Search for this product in premium packaging: /path/to/product.jpg"

Entity Search