Article II
Seven chambers of the kernel
A hybrid Python and Rust codebase. Rust carries the hot paths; Python orchestrates everything else.
Inference
Two backends behind one contract: Candle, written in Rust and shipped as a single Python wheel, and llama.cpp for quantised GGUF models. Both generate text today.
The agent
An in-house agent loop of a few hundred lines, with no LangGraph, CrewAI or AutoGen underneath. It calls tools, reads their results and stops at a final answer.
Memory
A SOUL.md identity file read at the start of every session, a local-only conversational memory built on mem0, and a SQLite knowledge graph with trust tiers.
Retrieval
Hybrid search over your own documents: BM25 keyword matching plus optional dense vectors, fused with reciprocal rank fusion.
Grounding
A verifier that needs no model checks each sentence of an answer against its sources, flags unsupported claims and cites the best supporting passage.
The sandbox
A hardened Docker container for untrusted code: no network, Linux capabilities dropped, and quotas on CPU, memory and time. It is built and tested, but not yet wired into the command line.
The model
A from-scratch trainer for a Llama-style decoder, with streamed data, checkpoint and resume, and a size ladder from about 20 million to 1.5 billion parameters.