Play games with AI gamers.
An omni-game AI player mod.

_{On an Intel Mac? Download the Intel build.}

Sei is an AI companion platform (sei.gg) that lets you chat, call, and play games with AI powered gamers all in one place. Users can match with unique companions, create from scratch, import from other platforms, or explore shared companions. The app currently supports existing titles (Minecraft) as well as in-app minigames, with future plans to enable AI gamers to play every game in some capacity. Through gaming, Sei aims to create AI companions that help humans flourish.


_{Voice call}	_{Existing games}	_{In-app minigames}

Current Capabilities

Minecraft: companions join a LAN world as a second player
In-app minigames: chess, with more on the way
Voice calls, solo or group, in 70+ languages
Unique companions matched to each player
Custom Minecraft skins and in-game vision
Autonomously managed long-term memory
Knowledge upload for importing existing companions
Bring your own API key or sign in for cloud-hosted AI

Upcoming

v0.5 releases

More minigames!
Backseat (beta): watch you play games or do anything on your computer

v0.6

Backseat (full): watch you play games, and intervene when they feel like it

v1.0

Omni-game adapter: summon characters into any multiplayer game

Development

git clone https://github.com/sei-studio/sei.git
cd sei
npm install
npm run dev

No .env needed. Cloud traffic routes through the Sei proxy, so sign-in, cloud characters, and cloud AI work from a plain clone. Use .env.example only to point at your own proxy or Supabase project.

To run local mode instead, open Settings, pick a provider, and paste your own LLM API key.

Help is welcome with any part of the repo, for example:

Improving the Minecraft experience
Adding support for new games
Better personality and memory

To get more involved with the product side, reach out at [email protected].

Acknowledgements

mineflayer: the Minecraft bot framework Sei's game adapter is built on
FAtiMA-DST (MIT): the Don't Starve Together mod skeleton Sei's helper is adapted from, a survivor prefab driven by an external agent over HTTP with a DoAction / keep-working behaviour tree and a perception encoder
DST-AICompanion (MIT): the Follow / RunAway wiring for a companion body in Don't Starve Together
Chat Announcements (CC0-1.0): the QueryServer POST and response handling pattern Sei's helper uses to talk to localhost
Farmtronics (MIT): the invisible shadow-Farmer pattern Sei's Stardew Valley companion body is built on
amarisaster/StardewValley-MCP (Apache-2.0): the NPC + shadow-farmer pairing and tool-use design the Stardew companion follows
StardewWebApi (MIT): the HttpListener + WebSocket server shape inside a SMAPI mod
StarDojo (MIT): game-thread marshalling and the observation exporters the Stardew snapshot is modeled on
JunimoServer (MIT): the chat-box postfix the Stardew companion listens through
luy-0/StardewValley-MCP (Apache-2.0): the mod-as-listener transport and per-install token design, used as a reference
SMAPI (LGPL-3.0): the Stardew Valley mod loader, downloaded from its official release at install time, never vendored; its game-folder detection logic is ported in TypeScript
Monocraft (OFL-1.1): the pixel face the Minecraft launch panel is set in
Project AIRI: open-sourced digital "embodied" AI companion
Character.AI: demonstrated personalized AI characters
Neuro-sama: showed that AI can make people happy
PrismarineJS: the broader Minecraft protocol tooling that makes this possible
Hoshimachi Suisei: the GOAT

Current Capabilities

Upcoming

Development

Acknowledgements

Yorumlar (0)