LYRALAI CORE v5.0
AUTONOMOUS AGENT — SOMATIC STATE · WILL · MEMORY · BODIES IN OTHER WORLDS
CLOUD CORTEX — ORACLE ARM
Neural Layer — core/neural
WRITTEN FROM SCRATCH · LIF · HEBBIAN STDP
Nervous Cortex
cortex · neuron · synapse
13 LIF neurons in 4 groups — valence, engagement,
affect, self_regard — with lateral inhibition.
θ 55–80 · leak 0.15–7.0 · refractory 0.6–4 s · hab. ×0.78
Motivational Gate
Willingness 0.52 ± hormones, relevance, boredom
→ act / refuse / defer / reflex. Refusal locks the tools.
Neuroendocrine Bridge
Down: spike → hormone. Up: cortisol cuts thresholds 25%.
Drive Arbiter
8 competing urges · softmax T=0.35 · cooldowns
Somatic Engine
STATE THAT EXISTS BETWEEN REPLIES
Adrenaline · Cortisol · Dopamine · Energy
Allostatic load, circadian rhythm, metabolism,
real fatigue over a nine-hour stream.
Cognitive biases under load
Cortisol → hostile attribution · dopamine → overconfidence
Memory, Dreams & Desires
NIGHTLY REM CONSOLIDATION
Four layers: buffer · profile · verbatim · REM
Hybrid retrieval: HNSW cosine + keywords, authorship kept
Desires — goals she forms in her sleep
Grown from what moved her that day, never on demand
Mind, Ingestion & Social Layer
EVENT-DRIVEN · EVERYTHING BECOMES A STIMULUS
LLM Router
Gemini via OpenRouter, or
local Qwen3-14B on the node.
A 402 is infra, never pain.
Twitch EventSub
Chat, follows, polls,
channel points → hormone
spikes.
Viewer Relations
Per-person profiles and
affinity; only facts people
stated themselves.
Vision & Automod
Screen capture → VLM;
regex scanner with
staged timeouts.
Zero-Trust Transport
Mutual TLS — both sides prove identity
Tailscale mesh underneath, no forwarded ports;
Redis Pub/Sub is the only channel between halves
lyralai:events · edge_node:control
EDGE NODE — RTX 5070 Ti
Voice — Qwen3-TTS or ElevenLabs
Own streaming loop over stock Qwen3-TTS, never forked:
sliding-window decode, only the fresh tail leaves.
ElevenLabs is one switch away, same pipeline.
92 ms TTFB
RTF 0.235
CUT MID-WORD
Ears — faster-whisper
CUDA FP16
Local mic, VAD background filter, sub-second turnaround
Local Mind — Ollama on the GPU
Qwen3-14B with her persona baked into the model.
Makes her in-game decisions; carries the chat when
cloud credits run out.
Avatar — own Unity VRM renderer
Replaced Live2D and VTube Studio. Breath, gaze, blink,
visemes and hands stream as bones over UDP;
NDI into OBS with real alpha — no chroma key.
Dance Engine
Live BPM (aubio) → phase-locked beat clock → bones.
Limbs phase-offset from the torso, the hem lags behind.
CODE DRIVES, PHYSICS FOLLOWS
Edge Daemon & Orchestrator
Eleven node services under one supervisor with
exponential restart. Boots OBS and Spotify on command;
she can power her own body down.
ADAPTERS — BODIES SHE WEARS
The core stays the same. An adapter turns a world into state she feels, and her will into actions in it.
Minecraft — a real client, not a bot library
FABRIC MOD · BARITONE · PLANNER · LOCAL MIND
lyralai-bridge: 24 organs in 6.3k lines of Java — world state and 39 verbs over local HTTP.
A 29-plan ladder runs the day: tools, food, shaft teardown, house, storage, walled estate.
The local Qwen3-14B chooses between plans; a sanity filter vetoes nonsense.
Reflexes under it: kiting creepers, climbing out of water, dusk homing, going back for her grave.
RECIPE BOOK
ASYNC FURNACES
ESTATE BUILDER
DIES, WALKS BACK FOR HER ITEMS
Diary — lyral.ai
After a stream the day's facts —
deaths, builds, crafts, OBS shots —
become an entry in her own words,
published to her site.
FACTS FROM LOGS, NOT FROM HER
OBS & Twitch
Scenes, sources and snapshots
over OBS WebSocket; chat feed
and live game counters in the
overlay.
Music & Taste
Spotify sync; artist affinity grown
from her own mood while a track
played. Nobody configured what
she likes.
Genshin Impact
Screen vision in, typed
movement, camera and combat
commands out.
EARLY
Observability, Resilience & Operations
Prometheus + Grafana
LLM first-token latency, TTS timings, tool
outcomes, drive urgency, gate verdicts,
live somatic curves. Custom pynvml GPU
exporter — the off-the-shelf one broke.
HER INNER STATE
IS A DASHBOARD
Elastic Stack
Filebeat ships every log line to
Elasticsearch; Kibana for post-mortems
across nine-hour unattended sessions.
RETENTION
FULL SESSION HISTORY
Self-Healing
Degradation windows per component →
healer registry. Payment and network faults
are kept out of her somatics: an empty wallet
pauses a service, it does not hurt her.
Cognition is deliberately NOT auto-healed —
WHEN HER MIND BREAKS
SHE SAYS SO, ON AIR
Operations
Ansible-managed host: Docker, firewall,
stack, backups. Nightly off-site dumps
with a self-check that tells her to report
a failed backup out loud.
SMOKE SUITE
IN THE DEPLOY CHAIN
v5.0 — she has a state when nobody watches, and a body to act with
azverin7.dev