langsmith-cli

🛠️ LangSmith CLI

---

[!TIP] Install as Claude Code Plugin

Step 1: Install the CLI tool

# Quick install (Linux/macOS)
curl -sSL https://raw.githubusercontent.com/langchain-ai/langsmith-cli/main/scripts/install.sh | sh

# Or use uv
uv tool install langsmith-cli

Step 2: Add the plugin to Claude Code

Option A: Terminal Command

claude plugin marketplace add gigaverse-app/langsmith-cli
claude plugin install langsmith-cli@langsmith-cli

Option B: Interactive UI Inside Claude Code, run /plugin (without arguments) and use the UI to add the marketplace

This gives Claude Code instant access to all LangSmith commands via skills.

---

🎯 Why LangSmith CLI?

Traditional tools are slow, verbose, and waste tokens. LangSmith CLI is different:

Feature	LangSmith CLI	Official MCP Server
Startup Time	< 100ms (lazy loading)	~2s (heavy imports)
Context Usage	96% reduction with --fields	Full objects always
Human UX	Rich tables with colors	JSON only
Agent UX	Strict --json mode	Mixed output
Live Dashboard	runs watch real-time monitoring	❌
Advanced Filters	Regex, wildcards, time presets	Basic only
Stratified Sampling	runs sample by tag/metadata	❌
Aggregate Analytics	runs analyze group & metrics	❌
Tag Discovery	runs tags auto-discover patterns	❌
File Operations	View/analyze offline with globs	❌
Export Formats	JSON, CSV, YAML	JSON only

100% Feature Parity + 10x Better QoL 🚀

---

✨ Features

🏎️ Performance First

• <100ms startup via lazy-loaded imports
• Streams large datasets without memory bloat
• Async-ready architecture

🧠 Agent Optimized

# Traditional: Returns 20KB trace object (1000+ tokens)
langsmith-cli runs get abc123

# Agent Mode: Returns only what you need (40 tokens)
langsmith-cli --json runs get abc123 --fields inputs,outputs,error

96% context savings on large traces!

🎨 Human Friendly

• Beautiful Rich tables with syntax highlighting
• Color-coded statuses (🟢 success, 🔴 error, 🟡 pending)
• Smart column truncation for readability
• Export to CSV/YAML for spreadsheets

🔍 Power User Features

# Regex filtering
langsmith-cli runs list --name-regex "^prod-.*-v[0-9]+"

# Wildcard patterns
langsmith-cli runs list --name-pattern "*auth*"

# Smart filters
langsmith-cli runs list --slow --failed --today

# Live dashboard
langsmith-cli runs watch

📦 Complete Coverage

Every LangSmith resource at your fingertips:

• ✅ Projects - List, create, inspect
• ✅ Runs - Search, stats, watch, sample, analyze, field discovery
• ✅ Datasets - CRUD + bulk JSONL uploads
• ✅ Examples - Full lifecycle management
• ✅ Prompts - Version control your prompts
• ✅ Self - Installation detection + auto-update

---

🚀 Installation

Quick Install (Recommended)

Linux/macOS:

curl -sSL https://raw.githubusercontent.com/langchain-ai/langsmith-cli/main/scripts/install.sh | sh

Windows:

iwr -useb https://raw.githubusercontent.com/langchain-ai/langsmith-cli/main/scripts/install.ps1 | iex

This standalone installer:

• Creates an isolated environment (no conflicts)
• Automatically adds langsmith-cli to your PATH
• Works without manually installing Python packages
• Requires Python 3.12+

Using uv

uv tool install langsmith-cli

Using pip

pip install langsmith-cli

For Claude Code Users

After installing the CLI above, add the skill:

/plugin marketplace add gigaverse-app/langsmith-cli

From Source

git clone https://github.com/gigaverse-app/langsmith-cli.git
cd langsmith-cli
uv sync
uv run langsmith-cli --help

---

🔑 Quick Start