Tag: attention
All the articles with the tag "attention".
-
ai8 min readContext Windows: Why Your AI Has a Working Memory Limit
Context windows are not memory. They are working memory. Here is what the model can see right now, why extending that limit is hard, and what it costs to try.
-
ai9 min readPositional Encoding and Sampling: How the Transformer Finds Position and Picks Its Next Word
Attention cannot tell 'the dog bit the man' from 'the man bit the dog.' Positional encoding fixes that. Then sampling decides what word the model actually says.
-
ai6 min readThe Transformer: How Attention Solved the Problem Everything Else Could Not
In 2017, eight researchers replaced the entire approach to language modeling with a single idea: let every word attend to every other word directly.
-
brain7 min readRecovery: Nature, Silence, and Taking Your Brain Offline
Science of brain recovery: the default mode network, how nature resets attention, why silence grows neurons, and what sleep does that nothing else can.
-
brain8 min readYour Brain on Screens: How Social Media and AI Hijack Attention
How infinite scroll, variable rewards, and AI recommendation engines exploit your dopamine pathways and weaken your prefrontal cortex.
-
brain7 min readDopamine: The Molecule That Drives Everything
What dopamine actually does in your brain, why it controls motivation more than pleasure, and how your phone is quietly draining it.
-
brain7 min readMemory: How We Learn, Store, and Forget
How your brain turns experiences into memories, why you forget most of what you learn within hours, and how constant distraction is making it worse.
-
brain6 min readThe Brain Roadmap: Understanding Your Own Operating System
Why understanding how your brain works is practical self-defense in the age of AI algorithms designed to manipulate your attention.