Session 3 — Knowledge Landscape & .nci Format
What We Built
The top-level brain object that owns everything — KnowledgeLandscape. Added consolidation (nodes mature over time), inter-cluster connections (pathways across the brain), and the .nci binary file format for saving and loading a complete brain.
Key Concepts
Knowledge Landscape
The skull that holds the brain. Owns all nodes, clusters, inter-cluster connections, and metadata. Built in one call via landscape.build(). Handles querying with auto-reinforcement, consolidation cycles, and save/load.
Analogy
The skull that holds the brain. Neurons (nodes) and brain regions (clusters) live inside it. It manages the whole system as one unit.
Consolidation
A score from 0.0 (fresh) to 1.0 (crystallized) on every node. Reinforced nodes consolidate — their threshold drops and they resist decay. Unused nodes decay back toward fresh.
Analogy
Learning to drive. Day 1: every action is conscious (fresh, high threshold). Year 10: it's automatic (crystallized, low threshold). Stop driving for a year and you're rusty — but it comes back fast.
.nci File Format
Custom binary format for saving and loading a complete Knowledge Landscape. Header with magic bytes "NCI!" and version, then packed numpy arrays for all node data, JSON for cluster metadata, and the LSH projection matrix.
Analogy
Freezing a brain and thawing it later with all memories intact. The .nci file IS the brain on disk.
Inter-Cluster Connections
Clusters connect to their most similar neighbors automatically. Creates pathways across the landscape — networking → security → linux. Built by comparing cluster centroids.
Analogy
Hallways between sections of a library. The networking section has a door to the security section, which has a door to the Linux section.
Design Principle — Nodes Never Disappear
Core Design Decision
Nodes are never removed through decay. Decay is priority sorting only — unused knowledge becomes harder to activate but never disappears. Nodes are only removed by explicit deprecation with a logged reason.
Benchmarks Achieved
| Metric | Target | Result |
|---|---|---|
| .nci save (100k nodes) | < 5 sec | 0.4s ✅ |
| .nci load (100k nodes) | < 5 sec | 1.6s ✅ |
| File size (100k nodes) | — | ~34 MB |
| Consolidation | reinforced > fresh | 0.50→0.70 ✅ |
| Inter-cluster connections | > 0 per cluster | 3.0 avg ✅ |
Key Files
index.py— KnowledgeLandscape, consolidation, save/load
Key Methods
landscape.build(num_nodes, num_clusters) # build complete brain
landscape.query(signature, top_k) # query with reinforcement
landscape.consolidation_cycle() # decay unused nodes
landscape.save("brain.nci") # save to binary file
KnowledgeLandscape.load("brain.nci") # load from binary file