Pilot Browse MCP

中文

Show your agent how to use websites, or let it explore autonomously. Pilot Browse MCP turns website interactions into reusable manuals, making future tasks faster and cheaper.

Showcase (Pi Demo)

Agent Autonomy

Install a skill, let the agent explore a website. When done, it generates an operation manual. You can share manuals with others.

After exploration, the manual is saved in website-manuals/:

website-manuals/<site>/
├── README.md              # Manual overview (read this first!)
├── meta.json              # Site info + page map + API map
├── pages/                 # Page interaction models (JSON)
├── navigation/            # Navigation paths
├── workflows/             # Operation workflows (with fallback)
├── apis/                  # API definitions (mapped to workflows)
└── capabilities.json      # Browser capability model

Guided Teaching

Stuck on exploration? Record or mark elements manually to help the agent through.

Mark Element

Record Workflow

Manual Reuse

Given a task, the agent checks for existing manuals. If found, it operates based on the manual -- fewer tokens, faster execution.

Demos

Build various workflows, simple demo showcase.

YouTube Like & Comment

Search a keyword, find a video, like and comment.

Qidian Novel Saver

Search a novel, save the first 5 chapters.

Install

# Build
cd server && npm install && npm run build
cd extension && npm install && npm run build

# Load extension
# chrome://extensions/ -> Developer mode -> Load unpacked -> extension/dist/

# Start server
cd server && node dist/index.js

MCP Configuration

Example - fill args with the actual path to server/dist/index.js:

{
  "mcpServers": {
    "browser-mcp": {
      "command": "node",
      "args": ["/path/to/server/dist/index.js"]
    }
  }
}

Skills

Check scripts/Skill for available skills.

Quick Start with Examples

Refer to agent-examples/ for ready-to-use agent workspace examples. Run your agent in one of those directories and it will automatically load the MCP config, skills, and project prompts. (Remember to update the MCP path to your actual setup.)

Architecture

AI Agent (Claude Code / Pi / Codex)
    |
    | 1) MCP stdio protocol (JSON-RPC)
    | stdin / stdout
    v
MCP Server (Node.js)          protocol translator
    |
    | 2) WebSocket :9456
    v
Chrome Extension
    |
    | 3) Chrome API
    |
    v
Browser

Features

• 40+ MCP tools -- tab management, content extraction, DOM operations, network interception, file saving, workflow recording
• Element picker -- click any element on the page and tell the agent what it is
• Workflow recording -- demonstrate operations to the agent, it learns and reuses
• Network API discovery -- intercept XHR/Fetch to find JSON APIs behind SPAs
• Token-efficient saving -- save page content directly to disk, bypassing the LLM
• Shadow DOM + contenteditable

Tools

License

MIT