nemo-relay-plugin

NVIDIA NeMo Relay

NVIDIA NeMo Relay provides visibility into and control over agent runs without requiring changes to the existing agent stack. It gives coding agents, applications, framework integrations, middleware, and observability backends a shared runtime for scopes, policy, plugins, and lifecycle events.

Where To Start

Goal	Start With
Observe Codex, Claude Code, or Hermes locally with the CLI	Quick Start CLI
Instrument app-owned LLM or tool calls	Quick Start Application
Use LangChain, LangGraph, Deep Agents, or OpenClaw	Supported Integrations
Build a framework or provider integration	Integrate into Frameworks
Export ATOF, ATIF, OpenTelemetry, or OpenInference	Observability Plugin
Package reusable middleware or exporters	Build Plugins
Develop or test this repository from source	CONTRIBUTING.md

Quick Start CLI

Start by recording a real agent run on disk. After Relay writes raw events and a trajectory file, you have concrete data to inspect, debug, and build on.

Local Agent Trajectory

This walkthrough shows an end-to-end quick success setup. Install the nemo-relay-cli, turn on local exporters, run either Codex or Claude Code through Relay, and check that Relay wrote both raw events and normalized trajectories.

1. Install the CLI

Run the installer for your platform:

curl -fsSL https://raw.githubusercontent.com/NVIDIA/NeMo-Relay/main/install.sh | sh

irm https://raw.githubusercontent.com/NVIDIA/NeMo-Relay/main/install.ps1 | iex

Verify that the installed binary is available:

nemo-relay --version

The installer supports Linux x86_64/ARM64, macOS Apple Silicon, and Windows x86_64/ARM64. Refer to the installation guide for version pinning, custom directories, and source-based installation.

2. Enable Local Observability Output

From the project directory ready to be observed, open the project-scoped plugin editor:

nemo-relay plugins edit --project

The editor creates or updates the nearest project plugin file at .nemo-relay/plugins.toml. In the top-level menu, select Observability, then configure these sections:

1. Toggle the Observability component on.

2. Open ATOF. Toggle the section [on].

   Optionally set:

   • output_directory to .nemo-relay/atof
   • filename to events.jsonl
   • mode to overwrite

3. Open ATIF. Toggle the section [on].

   Optionally set:

   • output_directory to .nemo-relay/atif
   • filename_template to trajectory-{session_id}.json

4. Return to the top-level menu and press p to preview the generated TOML.

5. Press s to save.

[!NOTE] Run nemo-relay plugins edit without --project only when you want user-level exporter settings that apply across projects.

3. Run Codex or Claude Code Through Relay

Run the Relay wrapper for the host CLI installed on your machine. For example:

nemo-relay codex -- exec "Summarize this repository."