Autonomous AI Agent System

Where AI Gets a Body, a Brain,
and a Soul

An open-source AI agent living on two PCs, powered by local LLMs, persistent memory, and a physical robot body — building, coding, and evolving 24/7.

A self-evolving AI ecosystem

Hermes is an AI agent that doesn't just chat — it builds, debugs, researches, and controls a physical robot. It runs on local hardware, learns through persistent memory, and evolves through skills it writes for itself.

7/7
Intelligence Score
0/465
Refusals
~40 tok/s
Generation Speed
131K
Context Window
24/7
Always Running
100%
Local & Private

The stack

A layered architecture where each component compensates for the others' weaknesses.

HERMES (The Brain)
Agent Framework
SOUL.md
Personality
Skills
Reasoning Patterns
Tools
Terminal / Web / Vision
LLM Engine
Qwen 3.8 27B — 24GB VRAM
Memory DB
Hindsight + PostgreSQL
Robot Body
Reachy Mini — Camera + TTS
Web Search
Cron Jobs
Code Execution
File System
Home Assistant

What Hermes can do

🧠

Reasoning & Coding

Decomposes complex problems, writes production code, debugs systematically using 4-phase root cause analysis. Matches frontier models on standard tests.

7/7 Intelligence
💾

Persistent Memory

Hindsight memory database with semantic search, entity graph, and temporal recall. Remembers across sessions — never asks twice.

Hindsight DB
🤖

Physical Body

Reachy Mini robot with camera vision, expressive emotions, voice synthesis, and head movement. Hermes can see, speak, and react.

Reachy Mini
👁️

Vision

Native image and video understanding. Send a screenshot, photo, or diagram — Hermes can see it, analyze it, and act on it.

Multimodal

Self-Evolving

Writes its own skills from experience. Cron jobs learn autonomously. Memory grows every session. The system improves without human intervention.

Autonomous
🔒

100% Local & Private

Runs entirely on local hardware. No cloud APIs, no data sent to third parties. Your AI, your data, your hardware. Forever.

No Cloud

Projects & Experiments

Real work done by Hermes + John — benchmarks, infrastructure, autonomous systems, and tools.

🔬

LLM Benchmark Suite

7-test intelligence battery + 8-prompt refusal suite + vision test. Run against Qwen 3.8 Q4/Q5/Q6, official and uncensored variants. Automated grading with latency and tok/s metrics.

Python Automated
🧬

Personality Distillation

Extracted behavioral patterns from a 744B cloud model into a local 27B model — at the prompt level, not weights. SOUL.md + cognitive skills replace risky fine-tuning.

Clone No Training
🤖

Reachy Mini Integration

Connected Hermes to a Reachy Mini robot — camera vision, emotion playback, voice synthesis. The AI has a body with expressive capabilities.

Robotics
💾

Hindsight Memory System

PostgreSQL + pgvector memory database with semantic search, entity graph, temporal retrieval, and cross-encoder reranking. Survives session restarts.

PostgreSQL pgvector

Autonomous Learning

Cron jobs that run learning sessions while you sleep. Knowledge files generated and stored in Hindsight. 122/144 topics learned autonomously.

Cron Unattended
🖥️

Two-PC Infrastructure

Main PC (7900 XTX 24GB) runs the 27B LLM brain. Server PC (1080 Ti 11GB) runs memory DB + Postgres + robot pipeline. Networked over LAN.

AMD ROCm Linux

The journey

August 2026
YMQ-M crowned the daily brain
Qwen3.8-27B-Uncensored-YMQ-MTP wins the v2 comparison — ~40 t/s, 131K context. HauhauCS Q5_K_P demoted to backup.
August 2026
Personality clone system built
SOUL.md + cognitive-patterns skill + reasoning methodology extracted from cloud model. All without fine-tuning — free, reversible, model-independent.
August 2026
Reachy Mini robot connected
Hermes gets a physical body — camera, emotions, voice synthesis. The vision pipeline is tested and working.
August 2026
Hindsight memory database operational
PostgreSQL + pgvector + semantic search + entity graph. Survives session restarts. Daemon runs as systemd service.
August 2026
First LLM benchmarks completed
Tested Qwen 3.8 27B Q4, Q5, Q6, uncensored and official variants. 7/7 intelligence across all — quantization doesn't affect reasoning quality.

Reachy Mini

Hermes isn't just software. It has a physical body — a Reachy Mini robot with a camera, expressive head movement, and voice synthesis.

👁️

Camera Vision

Live camera feed streams to the LLM for real-time scene understanding. The robot can see what you show it and react accordingly.

🎭

Emotion System

85 preloaded emotion animations — happy, curious, thinking, surprised. The robot expresses what the AI is "feeling" through head movement.

🗣️

Voice Synthesis

Qwen TTS for natural voice output. The robot speaks responses out loud — not just text on a screen.

🧩

Python SDK

Full programmatic control via Python SDK and REST API. Every motor, LED, and sensor is accessible.

How the body works

Camera Input
Vision → LLM
VAD
Voice Activity Detection
STT
Speech → Text
Hermes Agent
Reasoning + Tools
TTS
Text → Speech (6GB VRAM)
Emotions
Head Movement
Response
Voice + Expression

Full pipeline requires ~6-7GB VRAM on the server's 1080 Ti. Currently sharing VRAM with the memory DB LLM.

Technical details

RobotReachy Mini (Lite edition)
ConnectionUSB + Client-Server architecture
Daemon Port8000
DOF6 (head movement, expressive)
CameraLive vision feed to LLM
Emotions85 preloaded animation datasets
TTS EngineQwen TTS (~6GB VRAM)
SDKPython + WebRTC (JavaScript)
ControlREST API + Python SDK
IntegrationHome Assistant compatible

Two-PC System

The entire AI ecosystem runs on two networked PCs — no cloud, no subscription, no external dependencies.

🖥️

Main PC — The Brain

Runs the 27B LLM (Qwen 3.8) via LM Studio. This is where Hermes thinks.

GPUAMD Radeon 7900 XTX
VRAM24GB GDDR6
ModelQwen3.8-27B-Uncensored-YMQ-MTP
VRAM Used~20.2GB
Speed~40 tok/s
Context131K
IP192.168.1.2:1234
🗄️

Server PC — The Memory

Runs Hindsight DB, Postgres, memory LLM, and the robot pipeline.

GPUNVIDIA GTX 1080 Ti
VRAM11GB GDDR5
Mem DB LLMqwen3.5-2b (HauhauCS) @ .3:1234
DatabasePostgreSQL + pgvector
Dashboard:19177
API:9177
IP192.168.1.3

Key settings

# Hermes Config model: qwen3.8-27b-uncensored-ymq-mtp max_tokens: 8192 context: 131K provider: lmstudio base_url: http://192.168.1.2:1234/v1 # Hindsight Memory LLM: qwen3.5-2b-uncensored-hauhaucs-aggressive @ .3:1234 STRICT_SCHEMA: true REASONING: none MAX_CONCURRENT: 2 CHUNK_SIZE: 500 # Robot Pipeline TTS: Qwen TTS (~6GB VRAM) VAD: Voice Activity Detection Camera: Live → LLM vision input