Skill

uipath-interact

UiPath UI interaction (`uip rpa uia`) — drive live desktop/browser apps: click, type, read values, screenshot, inspect UI state, verify behavior, fill forms, navigate menus, extract table data from running applications.

npx claudepluginhub uipath/skills --plugin uipath

Configuration

When to use: User wants to drive or inspect a live running app (Windows desktop or browser) — 'click the button', 'fill this form', 'read the value from the screen', 'screenshot the dialog', 'extract this table', 'verify the UI shows X', 'walk through this app'. Live execution only — NOT for authoring XAML/coded selectors at design time (use uipath-rpa).

Tool Access

This skill is limited to using the following tools:

Bash(uip:*)ReadGrep

Preview

> **Preview** — skill is under active development; surface and behavior may change.

SKILL.md

Similar Skills

uipath-core

Generates UiPath Studio projects, REFramework scaffolds, XAML workflows, and VB/C# expressions via 104 deterministic Python generators.

20 files

uipath-core

uipath-planner

UiPath task planner — elicits preferences, plans multi-skill execution, detects project type (.cs, .xaml, .flow, .py). Triggers for non-trivial or ambiguous UiPath requests. Simple single-skill tasks→specialist directly.

7 tools

uipath

handson

Automates GUI interactions via screen capture, mouse clicks, typing, scrolling for UI testing, visual verification, and non-browser apps. Bridges Playwright to user browsers using extensions or CDP endpoints.

handson

Stats

Stars59

Forks16

Last CommitApr 29, 2026

Actions

View Source View Plugin View on GitHub View README

Help us improve

Share bugs, ideas, or general feedback.

UI Interaction via "uip rpa uia"

Preview — skill is under active development; surface and behavior may change.

Drive live desktop applications and browser tabs via the uip rpa uia CLI: discover applications and interact with elements using stable refs.

When to use

Probing a running application -- read values, inspect state, explore a UI tree.

Driving a UI end-to-end (click, type, fill form, extract table).

Verifying behavior after a change.

When NOT to use

For anything else (building workflows, configuring Object Repository targets, fixing selectors, etc.) -- use the uipath-rpa skill. It is the entry point for all non-interactive UIA work and routes to the appropriate sub-skills.

Prerequisites

Entry procedure

Read and follow $PROJECT_DIR/.local/docs/packages/UiPath.UIAutomation.Activities/skills/uia-interact/SKILL.md inline in the main conversation. Do NOT delegate to a subagent -- the skill drives the live CLI and needs the main conversation's feedback loop (screenshots, captured output, user replies).

Trouble? If something didn't work as expected, use /uipath-feedback to send a report.