CipherDolls — AI companion platform
-
An AI companion platform spanning cloud, web, and physical IoT devices.
-
github.com/cipherdolls ↗
+
What if an AI companion wasn't just an app, but something physical in your room? CipherDolls is my biggest project: an AI companion platform where characters can talk, listen — and live inside real devices.
+
github.com/cipherdolls ↗
core
- Backend API for the CipherDolls platform: wallet-signature auth, AI chat completions, TTS/STT, embeddings (pgvector), USDC payments on Base, and IoT device management over MQTT.
+ The brain of the platform: one backend that handles chat, voice, memory, payments and the connection to the physical dolls.
- View on GitHub ↗
+ View on GitHub ↗
server
- Minimal chat backend derived from core, stripped to the essentials: chat with a Character, optional TTS/STT — same architecture, no payments or IoT.
+ A slimmed-down core for anyone who just wants to chat with a character — the same architecture, none of the complexity.
- View on GitHub ↗
+ View on GitHub ↗
webapp
- Web frontend for the platform.
+ The web face of CipherDolls — where you meet the characters.
- View on GitHub ↗
+ View on GitHub ↗
stream-player
- TTS audio streaming proxy — subscribes to Redis Pub/Sub and forwards audio chunks to WebSocket clients with a compact binary protocol.
+ Voices need to arrive instantly. This streams the AI's speech to your browser the moment it is generated.
- View on GitHub ↗
+ View on GitHub ↗
stream-recorder
- WebSocket audio ingestion microservice — accepts raw WAV streams, converts to MP3 in-memory via ffmpeg, forwards to the backend.
+ The listening half: your voice streams in, gets converted on the fly, and lands with the AI.
- View on GitHub ↗
+ View on GitHub ↗
firmware-watcher
- ESP-IDF firmware for the SenseCAP Watcher companion device: BLE WiFi provisioning, MQTT events, MP3 playback through the onboard codec, LVGL UI on a 412×412 display, deep sleep.
+ The magic moment: a real device on your desk wakes up, connects, and speaks with the character's voice.
- View on GitHub ↗
+ View on GitHub ↗
firmware-m5sticks3
- ESP-IDF firmware for the M5StickS3 (ESP32-S3) pocket companion device with display, audio codec, and IMU.
+ The pocket version: the same companion on a tiny stick with a display and a microphone.
- View on GitHub ↗
+ View on GitHub ↗
@@ -96,62 +96,62 @@