CLI-Anything-WEB

agent
SUMMARY

Generate agent-native Python CLIs for any web app by capturing HTTP traffic. A Claude Code plugin with 13 reference CLIs.

README.md

CLI Anything Web

Turn any website into a production-grade CLI — automatically.

Quick Start  •  Examples  •  How It Works  •  Protocols  •  Registry  •  Roadmap  •  Contributing

License: MIT GitHub Stars Issues Python 3.10+ 13 CLIs Claude Code Plugin CLI Registry

Quick Start Examples Protocols Contributing


CLI-Anything-Web is a Claude Code plugin that generates production-grade Python CLIs for any web application by capturing its live HTTP traffic. Point it at a URL, and get a fully working CLI on your PATH — with auth, REPL mode, --json output, and tests.

[!WARNING]
Experimental Project — Use Responsibly

This project uses undocumented web APIs reverse-engineered from live HTTP traffic. These APIs can change without notice.

  • Not affiliated with any website — This is an independent open-source project
  • APIs may break — Websites can change their internal endpoints, HTML structure, or add protections at any time
  • Respect rate limits — Generated CLIs include exponential backoff, but heavy usage may be throttled
  • For personal use — Best suited for prototyping, automation, research, and personal productivity

Generated CLIs interact with real production services. Use them responsibly and in accordance with each website's terms of service.

💡 The Idea

Most web apps don't have public APIs. CLI-Anything-Web changes that:

CLI-Anything-Web Demo

No API docs needed. No reverse-engineering by hand. Just point and generate.


🚀 Quick Start

Prerequisites

Requirement Version Why
Claude Code With plugin support Runs the generation pipeline
Node.js 18+ For playwright traffic capture
Python 3.10+ Generated CLIs are Python

Install the Plugin

# Inside Claude Code
/plugin marketplace add ItamarZand88/CLI-Anything-WEB
/plugin install cli-anything-web
/reload-plugins

Generate Your First CLI

/cli-anything-web https://your-favorite-website.com

The agent opens a browser, asks you to log in if needed, captures traffic, and generates a complete CLI. That's it.


📦 Examples

12 real CLIs generated by the plugin — shipped as reference implementations:

CLI Website Protocol Auth Skill Description
cli-web-stitch Google Stitch batchexecute RPC Google SSO 📖 Skill AI UI design — generate mobile/web app mockups from text prompts
cli-web-reddit Reddit REST JSON API (curl_cffi) Optional (OAuth) 📖 Skill Feeds, subreddits, search, vote, comment, submit, save, inbox
cli-web-booking Booking.com GraphQL + HTML (curl_cffi) WAF cookies 📖 Skill Hotel search, property details, destination resolution
cli-web-gai Google AI Mode Browser-rendered (Playwright) None 📖 Skill AI-powered search with source references
cli-web-notebooklm Google NotebookLM batchexecute RPC Google SSO 📖 Skill Notebooks, sources, chat, 9 artifact types (audio, video, slides, quiz, mindmap)
cli-web-pexels Pexels SSR + NEXT_DATA (curl_cffi) None 📖 Skill Free stock photos & videos — search, download, collections, profiles
cli-web-unsplash Unsplash REST API (curl_cffi) None 📖 Skill Photo search, download, topics, collections, profiles
cli-web-producthunt Product Hunt HTML scraping (curl_cffi) None 📖 Skill Today's launches, leaderboards, product details
cli-web-futbin FUTBIN HTML + JSON API None 📖 Skill EA FC player database — search, compare, prices
cli-web-gh-trending GitHub Trending HTML scraping None 📖 Skill Trending repos & developers with language/time filters
cli-web-youtube YouTube InnerTube REST API None 📖 Skill Search videos, video details, trending, channel info
cli-web-hackernews Hacker News REST API (Firebase + Algolia) Cookie (optional) 📖 Skill Stories, search, comments, users, upvote, submit, comment, favorite
cli-web-codewiki Google Code Wiki batchexecute RPC None 📖 Skill AI-generated repo docs, wiki sections, Gemini chat, download as .md
Try them yourself
# Pick any CLI below — each is independent

# GitHub Trending — no auth, great first test
pip install -e gh-trending/agent-harness
cli-web-gh-trending repos list --language python --since weekly --json

# FUTBIN — search EA FC players
pip install -e futbin/agent-harness
cli-web-futbin players search --name "Messi" --json

# NotebookLM — requires Google login
pip install -e notebooklm/agent-harness
cli-web-notebooklm auth login
cli-web-notebooklm notebooks list --json

# Product Hunt — no auth, bypasses Cloudflare
pip install -e producthunt/agent-harness
cli-web-producthunt posts list --json

# Unsplash — photo search
pip install -e unsplash/agent-harness
cli-web-unsplash photos search "mountains" --json

# Booking.com — hotel search
pip install -e booking/agent-harness
cli-web-booking search find "Paris" --json

# Google Stitch — requires Google SSO login
pip install -e stitch/agent-harness
cli-web-stitch auth login
cli-web-stitch projects list --json

# Pexels — free stock photos & videos
pip install -e pexels/agent-harness
cli-web-pexels photos search "mountains" --json

# Reddit — feeds, search, vote, comment, submit
pip install -e reddit/agent-harness
cli-web-reddit feed hot --limit 5 --json

# Hacker News — stories, search, upvote, submit
pip install -e hackernews/agent-harness
cli-web-hackernews stories top -n 5 --json

# Google Code Wiki — AI-generated repo docs + Gemini chat
pip install -e codewiki/agent-harness
cli-web-codewiki wiki sections excalidraw/excalidraw --json
cli-web-codewiki chat ask "How does rendering work?" --repo excalidraw/excalidraw --json

# Google AI Mode — AI-powered search
cd gai/agent-harness && pip install -e . && playwright install chromium
cli-web-gai search ask "What is quantum computing" --json

Agent-Native: Claude uses the CLIs automatically

Every generated CLI comes with a skill file (.claude/skills/<app>-cli/SKILL.md) that Claude Code loads automatically. The skill tells Claude exactly how to use the CLI — every command, every option, every output format. When you ask Claude a question like "find me a hotel in Paris", it reads the booking skill and runs cli-web-booking search find "Paris" on its own.

Each skill includes:

  • All available commands with arguments and options
  • Output format for each command
  • Auth requirements and setup instructions
  • Common agent patterns (piping, filtering, chaining commands)

Agentic Pattern Demo


⚙️ How It Works

The plugin runs a 4-phase pipeline, fully automated by Claude:

CLI-Anything-Web Pipeline

Phase What Happens
1. Capture Opens browser via Playwright, records all HTTP traffic while you use the site
2. Analyze & Generate Identifies protocol (REST/GraphQL/RPC/HTML), maps endpoints, generates full Python CLI
3. Test Writes unit tests (mocked) + E2E tests (live API) + subprocess tests
4. Publish pip install -e . → on your PATH → smoke tested → Claude skill generated

🔧 What Every Generated CLI Includes

Feature Details
Click commands cli-web-<app> <group> <command> [options]
Interactive REPL Run with no args — history, autocomplete, branded prompt
--json output Machine-readable on every command — pipe into jq, scripts, or agents
Auth management Python Playwright browser login → cookie extraction → auth.json
Error handling Typed exceptions → structured JSON errors: {"error": true, "code": "AUTH_EXPIRED"}
Tests Unit (mocked HTTP) + E2E (live API) + subprocess (_resolve_cli)
Installable pip install -e . puts it on your PATH immediately

📋 Commands

Command Description
/cli-anything-web <url> Full pipeline — capture, analyze, generate, publish
/cli-anything-web:record <url> Capture traffic only (for exploration)
/cli-anything-web:refine <path> Add more commands to an existing CLI
/cli-anything-web:test <path> Run tests and update TEST.md
/cli-anything-web:validate <path> Validate against 75-check quality standards
/cli-anything-web:list List all generated CLIs

🌐 Supported Protocols

The plugin auto-detects and handles multiple web architectures:

Protocol Example Sites How It's Handled
REST / JSON API Monday.com, Dev.to httpx client, JSON response parsing
Server-rendered HTML GitHub, FUTBIN, Hacker News BeautifulSoup4 + CSS selectors
Cloudflare-protected Product Hunt, Unsplash curl_cffi with Chrome TLS impersonation
GraphQL Shopify, GitHub API v4 Query abstraction into CLI commands
GraphQL + AWS WAF Booking.com curl_cffi + WAF cookie bypass
Google batchexecute NotebookLM, Google Docs, Keep Custom RPC encoder/decoder
Browser-rendered (Playwright) Google AI Mode Headless browser rendering + content extraction

🏗️ Repository Structure

CLI-Anything-WEB/
├── cli-anything-web-plugin/     # 🔌 The installable Claude Code plugin
│   ├── commands/                #    Slash command definitions
│   ├── skills/                  #    4-phase pipeline skills
│   │   ├── capture/             #      Phase 1: browser + traffic capture
│   │   ├── methodology/         #      Phase 2: analysis + code generation
│   │   ├── testing/             #      Phase 3: test generation
│   │   └── standards/           #      Phase 4: validation + publishing
│   ├── scripts/                 #    Shared utilities
│   └── HARNESS.md               #    Complete methodology SOP
│
├── stitch/                      # 🎨 Google Stitch (batchexecute RPC)
├── reddit/                      # 💬 Reddit (REST JSON API)
├── booking/                     # 🏨 Booking.com (GraphQL + AWS WAF)
├── gai/                         # 🤖 Google AI Mode (Browser-rendered)
├── notebooklm/                  # 📓 NotebookLM (Google batchexecute)
├── pexels/                      # 📸 Pexels (SSR + __NEXT_DATA__)
├── unsplash/                    # 📷 Unsplash (REST API + curl_cffi)
├── producthunt/                 # 🚀 Product Hunt (curl_cffi)
├── futbin/                      # 🎮 FUTBIN (HTML + JSON)
├── gh-trending/                 # 📈 GitHub Trending (HTML scraping)
├── youtube/                     # 🎬 YouTube (InnerTube REST API)
├── hackernews/                  # 📰 Hacker News (Firebase + Algolia API)
└── codewiki/                    # 📚 Google Code Wiki (batchexecute RPC)

🔗 Inspiration

This project is directly inspired by CLI-Anything by HKUDS — a Claude Code plugin that makes desktop software (GIMP, Blender, LibreOffice, OBS Studio) agent-native by analyzing source code and generating CLI wrappers.

CLI-Anything-Web extends the same vision to the web — where there's no source code to analyze, only live HTTP traffic to capture.

CLI-Anything CLI-Anything-Web
Target Desktop apps (GIMP, Blender, OBS) Web apps (NotebookLM, Booking.com, any website)
Input Source code, GUI APIs, plugin systems Live HTTP traffic from browser
Analysis Static code analysis + API mapping Network traffic capture + protocol detection
Auth N/A (local software) Browser login, cookies, WAF bypass, API keys
Output Click CLI + REPL + --json + tests Click CLI + REPL + --json + tests

Together they cover the full spectrum: CLI-Anything for desktop, CLI-Anything-Web for the web.


🗺️ What's Next

We're actively building more CLIs and improving the plugin:

  • 🎯 More CLIs — Jira, Notion, Monday.com, Spotify, LinkedIn
  • 🎵 Content generation — Suno, ElevenLabs, Midjourney
  • 🧠 Smarter analysis — Auto-detect auth flows, pagination, WebSocket streams
  • 🔄 CI/CD integration — Run CLIs in GitHub Actions with env-var auth
  • 📦 Community registry — Share and install CLIs built by other users

Want a specific website? Open an issue with the URL — we'll prioritize the most requested ones.


🤝 Contributing

We'd love your help! See CONTRIBUTING.md for the full guide.

The quickest ways to contribute:

What How
Build a new CLI Run /cli-anything-web <url> on any website, submit a PR
Improve the plugin Add patterns to cli-anything-web-plugin/skills/
Report bugs Open an issue with --json output
Fix a broken CLI Website changed? Update the scraper/client


📄 License

This project is licensed under the MIT License.


Built with Claude Code  ·  Inspired by CLI-Anything  ·  Request a CLI

Yorumlar (0)

Sonuc bulunamadi