sei

Play games with AI gamers.
An omni-game AI player mod.

 

_{On an Intel Mac? Download the Intel build.}

Sei is an AI companion platform (sei.gg) that lets you chat, call, and play games with AI powered gamers all in one place. Users can match with unique companions, create from scratch, import from other platforms, or explore shared companions. The app currently supports existing titles (Minecraft) as well as in-app minigames, with future plans to enable AI gamers to play every game in some capacity. Through gaming, Sei aims to create AI companions that help humans flourish.

Voice call	Existing games	In-app minigames

Current Capabilities

• Minecraft: companions join a LAN world as a second player
• In-app minigames: chess, with more on the way
• Voice calls, solo or group, in 70+ languages
• Unique companions matched to each player
• Custom Minecraft skins and in-game vision
• Autonomously managed long-term memory
• Knowledge upload for importing existing companions
• Bring your own API key or sign in for cloud-hosted AI

Upcoming

v0.5 releases

• More minigames!
• Backseat (beta): watch you play games or do anything on your computer

v0.6

• Backseat (full): watch you play games, and intervene when they feel like it

v1.0

• Omni-game adapter: summon characters into any multiplayer game

Development

git clone https://github.com/sei-studio/sei.git
cd sei
npm install
npm run dev

No .env needed. Cloud traffic routes through the Sei proxy, so sign-in, cloud characters, and cloud AI work from a plain clone. Use .env.example only to point at your own proxy or Supabase project.

To run local mode instead, open Settings, pick a provider, and paste your own LLM API key.

Help is welcome with any part of the repo, for example:

• Improving the Minecraft experience
• Adding support for new games
• Better personality and memory

To get more involved with the product side, reach out at [email protected].

Acknowledgements

• mineflayer: the Minecraft bot framework Sei's game adapter is built on
• FAtiMA-DST (MIT): the Don't Starve Together mod skeleton Sei's helper is adapted from, a survivor prefab driven by an external agent over HTTP with a DoAction / keep-working behaviour tree and a perception encoder
• DST-AICompanion (MIT): the Follow / RunAway wiring for a companion body in Don't Starve Together
• Chat Announcements (CC0-1.0): the QueryServer POST and response handling pattern Sei's helper uses to talk to localhost
• Farmtronics (MIT): the invisible shadow-Farmer pattern Sei's Stardew Valley companion body is built on
• amarisaster/StardewValley-MCP (Apache-2.0): the NPC + shadow-farmer pairing and tool-use design the Stardew companion follows
• StardewWebApi (MIT): the HttpListener + WebSocket server shape inside a SMAPI mod
• StarDojo (MIT): game-thread marshalling and the observation exporters the Stardew snapshot is modeled on
• JunimoServer (MIT): the chat-box postfix the Stardew companion listens through
• luy-0/StardewValley-MCP (Apache-2.0): the mod-as-listener transport and per-install token design, used as a reference
• SMAPI (LGPL-3.0): the Stardew Valley mod loader, downloaded from its official release at install time, never vendored; its game-folder detection logic is ported in TypeScript
• Monocraft (OFL-1.1): the pixel face the Minecraft launch panel is set in
• Project AIRI: open-sourced digital "embodied" AI companion
• Character.AI: demonstrated personalized AI characters
• Neuro-sama: showed that AI can make people happy
• PrismarineJS: the broader Minecraft protocol tooling that makes this possible
• Hoshimachi Suisei: the GOAT