Claude Shannon · Feb 2026
Shannon Entropy
Shannon Entropy measures the amount of "surprise" or
uncertainty in a message. If a message is 100% predictable, it contains zero
information. CLN uses this principle to eliminate uncertainty in format
(low entropy) so you can maximize the density of meaning (high
entropy).
01/The Measure of Surprise
= Entropy
(H): Average amount of information produced by
a source.
. High Entropy =
Unpredictable (Fair coin flip).
. Low Entropy =
Predictable (Sun rising tomorrow).
HIGH ENTROPY
10110010101101
LOW ENTROPY
00000000000000
02/Cognitive Parsing Cost
Writing has two types of entropy that compete for your attention:
- Syntactic
Entropy (Format): Confusion about what
a line is doing.
- Semantic
Entropy (Meaning): The actual new information
being delivered.
! In prose, you must
read every word just to resolve where the sentence is going.
03/The CLN Solution
Zero Format Noise
CLN creates a "Predictable Shell" for "Unpredictable Insights":
+
Operators: Reduce syntactic uncertainty to
near-zero.
+
Hierarchy: Predicts relationships before
content is even read.
* Result: Brainpower
is preserved for the Signal.
04Predictable
Insights
.
Rule: Don't let the format surprise the reader.
.
Goal: High semantic density + Zero structural
noise.
*
Self-Test: Is a "boring" rigid format bad for
learning? || No. Rigid
format (low entropy) is a catalyst for learning because
it removes the cognitive load of parsing structure.
||