My Latent Space

Mind

All

Categories

  • Attention is all you need (in life too)
  • Notes on attention
  • The stub problem
  • Latent spaces as maps
  • The loss landscape of understanding
  • Models are maps
  • On clarity
  • The cloud and the basin
  • The shape of a thought
  • Why I write
  • Writing is a search procedure
Latent Space/Mind

mind ·11 entries

  • The loss landscape of understandingLearning is gradient descent over a landscape nobody drew. The minima we find shape the thoughts we can have.[note]May 1
  • Writing is a search procedureYou don't write what you know. You write to find out what you know.[idea]Apr 30
  • The shape of a thoughtIf a thought has a shape, the shape changes every time you say it out loud.[idea]Apr 29
  • Why I writeSome reasons evolve. This is a snapshot, not a final answer.[idea]Apr 28
  • Latent spaces as mapsA model is not a brain. It is a map of relationships, and you only see the territory by walking it.[note]Apr 28
  • On clarityClarity is not the goal. Faithfulness is.[idea]Apr 27
  • Models are mapsYou don't see the territory by studying the map. You see it by walking.[note]Apr 26
  • Attention is all you need (in life too)The architecture of the mind follows the architecture of neural nets.[idea]Apr 25
  • The cloud and the basinBefore writing there is fog. After writing there is stone.[note]Apr 24
  • Notes on attentionWhat you attend to shapes what you become.[note]Apr 22
  • The stub problemEvery idea starts as a stub. Most stubs never become trees.[idea]Apr 21
view all notes →