作者 bytedance · bytedance/UI-TARS-desktop
ByteDance's open multimodal agent stack — vision-grounded computer-use, callable from Claude via MCP.
UI-TARS Desktop is ByteDance's open multimodal agent platform. It uses screen understanding for desktop control and exposes itself as MCP. Claude can delegate vision-grounded GUI tasks where text-only tools fall short.
%APPDATA%\Claude\claude_desktop_config.json{
"mcpServers": {
"ui-tars-desktop-mcp": {
"command": "docker",
"args": [
"run",
"-p",
"8080:8080",
"ghcr.io/bytedance/ui-tars-desktop:latest"
]
}
}
}Claude Desktop → Settings → Developer → Edit Config を開く。保存後、アプリを再起動。
{
"mcpServers": {
"ui-tars-desktop-mcp": {
"command": "docker",
"args": [
"run",
"-p",
"8080:8080",
"ghcr.io/bytedance/ui-tars-desktop:latest"
]
}
}
}Cursor は Claude Desktop と同じ mcpServers スキーマを使用。プロジェクト設定はグローバルより優先。
{
"mcpServers": {
"ui-tars-desktop-mcp": {
"command": "docker",
"args": [
"run",
"-p",
"8080:8080",
"ghcr.io/bytedance/ui-tars-desktop:latest"
]
}
}
}Cline サイドバーの MCP Servers アイコンをクリックし、"Edit Configuration" を選択。
{
"mcpServers": {
"ui-tars-desktop-mcp": {
"command": "docker",
"args": [
"run",
"-p",
"8080:8080",
"ghcr.io/bytedance/ui-tars-desktop:latest"
]
}
}
}Claude Desktop と同じ形式。Windsurf を再起動して反映。
{
"mcpServers": [
{
"name": "ui-tars-desktop-mcp",
"command": "docker",
"args": [
"run",
"-p",
"8080:8080",
"ghcr.io/bytedance/ui-tars-desktop:latest"
]
}
]
}Continue はマップではなくサーバーオブジェクトの配列を使用。
{
"context_servers": {
"ui-tars-desktop-mcp": {
"command": {
"path": "docker",
"args": [
"run",
"-p",
"8080:8080",
"ghcr.io/bytedance/ui-tars-desktop:latest"
]
}
}
}
}context_servers に追加。保存時に Zed がホットリロード。
claude mcp add ui-tars-desktop-mcp -- docker run -p 8080:8080 ghcr.io/bytedance/ui-tars-desktop:latestワンライナー。claude mcp list で確認、claude mcp remove で削除。
使うタイミング： You're automating a desktop or canvas app that has no scripting surface.
結果： GUI automation in apps with no API.
UI-TARS for vision tasks; OpenAgent for code-text tasks
| ツール | 入力 | 呼び出すタイミング | コスト |
|---|---|---|---|
| ui_act | (see docs) | Run a vision-grounded GUI action | 1 call |
| ui_observe | (see docs) | Capture screen state | 1 call |
screen-capture input-injectionRun with banking app visibleAction misses target on Retina displaySet the DPI scale; UI-TARS defaults to 1x
| 代替案 | 代わりに使う場面 | トレードオフ |
|---|---|---|
| OpenAgent | Lower resource cost | Less vision grounding |