LYRALAI CORE v5.0
AUTONOMOUS AGENT — SOMATIC STATE · WILL · MEMORY · BODIES IN OTHER WORLDS
CLOUD CORTEX — ORACLE ARM
Neural Layer — core/neural
WRITTEN FROM SCRATCH · LIF · HEBBIAN STDP
Nervous Cortex
cortex · neuron · synapse
13 LIF neurons in 4 groups — valence, engagement,
affect, self_regard — with lateral inhibition.
θ 55–80 · leak 0.15–7.0 · refractory 0.6–4 s · hab. ×0.78
Motivational Gate
Willingness 0.52 ± hormones, relevance, boredom
→ act / refuse / defer / reflex. Refusal locks the tools.
Neuroendocrine Bridge
Down: spike → hormone. Up: cortisol cuts thresholds 25%.
Drive Arbiter
8 competing urges · softmax T=0.35 · cooldowns
Somatic Engine
STATE THAT EXISTS BETWEEN REPLIES
Adrenaline · Cortisol · Dopamine · Energy
Allostatic load, circadian rhythm, metabolism,
real fatigue over a nine-hour stream.
Cognitive biases under load
Cortisol → hostile attribution · dopamine → overconfidence
Memory, Dreams & Desires
NIGHTLY REM CONSOLIDATION
Four layers: buffer · profile · verbatim · REM
Hybrid retrieval: HNSW cosine + keywords, authorship kept
Desires — goals she forms in her sleep
Grown from what moved her that day, never on demand
Mind, Ingestion & Social Layer
EVENT-DRIVEN · EVERYTHING BECOMES A STIMULUS
LLM Router
Gemini 3.5 flash-lite via
OpenRouter; games too.
A 402 is infra, never pain.
Twitch EventSub
Chat, follows, polls,
channel points → hormone
spikes.
Viewer Relations
Per-person profiles and
affinity; only facts people
stated themselves.
Vision & Automod
Screen capture → VLM;
regex scanner with
staged timeouts.
Zero-Trust Transport
Mutual TLS — both sides prove identity
Tailscale mesh underneath, no forwarded ports;
Redis Pub/Sub is the only channel between halves
lyralai:events · edge_node:control
EDGE NODE — RTX 5070 Ti
Voice — Qwen3-TTS or ElevenLabs
Own streaming loop over stock Qwen3-TTS, never forked:
sliding-window decode, only the fresh tail leaves.
ElevenLabs is one switch away, same pipeline.
92 ms TTFB
RTF 0.235
CUT MID-WORD
Ears — faster-whisper
CUDA FP16
Local mic, VAD background filter, sub-second turnaround
Game Mind — LLM proxy on the node
Speaks the Ollama API, so the game bridges never changed;
forwards to Gemini flash-lite on OpenRouter. In-game
decisions, chat fallback. Ollama and Qwen3-14B retired.
Avatar — own Unity VRM renderer
Replaced Live2D and VTube Studio. Breath, gaze, blink,
visemes and hands stream as bones over UDP;
NDI into OBS with real alpha — no chroma key.
Dance Engine
Live BPM (aubio) → phase-locked beat clock → bones.
Limbs phase-offset from the torso, the hem lags behind.
CODE DRIVES, PHYSICS FOLLOWS
Edge Daemon & Orchestrator
Eleven node services under one supervisor with
exponential restart. Boots OBS and Spotify on command;
she can power her own body down.
ADAPTERS — BODIES SHE WEARS
The core stays the same. An adapter turns a world into state she feels, and her will into actions in it.
Minecraft — a real client, not a bot library
FABRIC MOD · BARITONE · PLANNER · GAME MIND
lyralai-bridge: 24 organs in 6.3k lines of Java — world state and 39 verbs over local HTTP.
A 29-plan ladder runs the day: tools, food, shaft teardown, house, storage, walled estate.
Gemini flash-lite, via the node's proxy, picks the plan; a sanity filter vetoes nonsense.
Reflexes under it: kiting creepers, climbing out of water, dusk homing, going back for her grave.
RECIPE BOOK
ASYNC FURNACES
ESTATE BUILDER
DIES, WALKS BACK FOR HER ITEMS
Diary — lyral.ai
Every night the game logs —
deaths, builds, quests, OBS shots —
become entries in her own words,
one section per world: Minecraft,
Skyrim, Fallout 4.
FACTS FROM LOGS, NOT FROM HER
OBS & Twitch
Scenes, sources and snapshots
over OBS WebSocket; chat feed
and live game counters in the
overlay.
Music & Taste
Spotify sync; artist affinity grown
from her own mood while a track
played. Nobody configured what
she likes.
Genshin Impact
Screen vision in, typed
movement, camera and combat
commands out.
EARLY
Skyrim — Neuro-Skyrim as the body, her own head
SKSE PLUGIN · CLANG-CL CROSS-BUILD · DECISIONS ON THE NODE
Body: the Neuro-Skyrim mod, cross-built on Linux, 80 patches of ours on top.
Head: a 5k-line node decides — pinned quests, pillar and claw-ring puzzles, far levers.
Gates worked from the far side read as shortcuts back; stuck quests benched, loops cut.
Watchdogs bring the game and voice back; she made her Imperial heroine herself.
80 MOD PATCHES
5K-LINE NODE
SELF-RECOVERY, NO HAND ON THE KEYS
Neuro Game API — one socket, any game
Her own server for the protocol Neuro-sama plays through. A game
registers actions with schemas and forces choices; she picks with
memory of what already failed. Any game with this integration is
playable for her without writing a new adapter. Skyrim speaks it
through Neuro-Skyrim, Fallout 4 through her own plugin.
LOOPS CUT, NOT SCRIPTED
Dota 2 — she watches him play
Game State Integration: the client pushes the operator's match —
hero, gold, kills, deaths, items — to a service on the node.
A commentator in the cloud turns the swings into live remarks,
coloured by her own mood.
LIVE COMMENTARY, NOT A BODY
Fallout 4 — her own mod, written from scratch
F4SE PLUGIN · COMMONLIBF4 · CLANG-CL CROSS-BUILD · PYTHON BRIDGE
55k lines of C++ in ~75 modules speak the Neuro Game API; an LLM picks the next act.
Danger map from game data, settlement planner and builder, quest audits to the ending,
perk advisor, gear optimizer, dungeon loop, DLC, VATS, power armor, terminal hacking.
New game, no hands: filled the Vault-Tec form, left Vault 111, cleared the Concord museum.
55K LINES OF C++
WAVES OF AI AGENTS
264 OF 284 + 29 OF HER OWN · 67 TESTS
Yalaril — the evil twin
A second personality on stream since 11.10: a black-and-red dog-girl
yandere a viewer invented the night before. Her own voice — Lyralai's
reference pitched down — and her own Unity render on a second NDI feed
beside her. Cuts into conversations, takes the body in games while
Lyralai sleeps, keeps her own memory and goals.
SECOND VOICE, SECOND RENDER
Control Panel — the dashboard's «Пульт»
A button for everything the operator used to ask for by hand:
start, save and quit Skyrim or Fallout 4, take or hand back manual
control, mod commands, OBS scenes, going live, the night routine.
Ops travel from the dashboard over Redis to a daemon on the node.
DASHBOARD → REDIS → NODE
Observability, Resilience & Operations
Prometheus + Grafana
LLM first-token latency, TTS timings, tool
outcomes, drive urgency, gate verdicts,
live somatic curves. Custom pynvml GPU
exporter — the off-the-shelf one broke.
HER INNER STATE
IS A DASHBOARD
Elastic Stack
Filebeat ships every log line to
Elasticsearch; Kibana for post-mortems
across nine-hour unattended sessions.
RETENTION
FULL SESSION HISTORY
Self-Healing
Degradation windows per component →
healer registry. Payment and network faults
are kept out of her somatics: an empty wallet
pauses a service, it does not hurt her.
Cognition is deliberately NOT auto-healed —
WHEN HER MIND BREAKS
SHE SAYS SO, ON AIR
Operations
Ansible-managed host: Docker, firewall,
stack, backups. Nightly off-site dumps
with a self-check that tells her to report
a failed backup out loud.
SMOKE SUITE
IN THE DEPLOY CHAIN
v5.0 — she has a state when nobody watches, and a body to act with
azverin7.dev