Karpathy's Genius Strikes Again, Challenging RAG, Turning Your Notes into a Second Brain
Andrej Karpathy has proposed a revolutionary concept for managing personal knowledge: treating notes as immutable "source code" and using LLMs as "compilers" to build a structured, interlinked wiki. This approach fundamentally shifts the cognitive workflow away from the limitations of RAG (Retrieval-Augmented Generation), which merely retrieves and pieces together fragments, leading to contradictions and "digital mummies"—unused, decaying notes.
The LLM-Wiki framework introduces a three-layer architecture: the **Raw Layer** for original, immutable notes; the **Schema Layer** defining rules for structuring knowledge; and the **Wiki Layer**, where the LLM continuously compiles and maintains a coherent, cross-referenced knowledge base. Key operations are **Ingest** (adding new material, which triggers updates across related pages), **Query** (asking the compiled wiki, with answers that can become new pages), and **Lint** (periodic AI audits to find contradictions, outdated claims, or gaps).
This system automates the tedious maintenance—updating links, resolving conflicts, keeping summaries fresh—that has historically made large-scale personal knowledge management unsustainable. It realizes Vannevar Bush's 1945 "Memex" vision by finally solving the maintenance problem. Karpathy's proposal represents a third piece in human-AI collaboration, following "Vibe Coding" and "Agentic Engineering." It liberates human attention from organizational drudgery, refocusing it on what matters: deciding what to read and deriving meaning.
marsbit07/01 09:53
