Guy Reams (00:01.164)
This is day 150. What counts as a word? I'm living the dream job of a linguist right now. I spend my days deep in the manipulation and understanding of the context behind words. This morning I started to ask myself a question that should be simple, but it's not. What actually counts as a word? The word word is strange because it is self-referential.
It can refer to itself and to the entire category it belongs to at the same time. That creates a small philosophical loop. The concept of a word takes on various meanings depending on how you use it. You can spread the word, which means tell people. You can make a promise, as in you have my word. You can give the word a signal on when to begin. Philosophically, a word is a symbol that represents an idea or reality.
A word is essentially an idea encoded into sound or text so another mind can understand it. This is the business that I am in right now, and it's a fascinating place. What is really throwing me for a loop is that a word is a chunk of language that carries meaning and behaves as a unit of speech or grammar. But across all languages, the edges of what counts as a word are pretty fuzzy. There's no clean boundary.
Even more perplexing is how we as humans process words. For example, read the following statement. If you want to check out my blog, you can read the way I spelled all these words, but I basically took the words according to research at Cambridge University. It doesn't matter in what order the letters in a word are. The only important thing is that the first and last letters be in the right place. If you take a sentence and you take the first and last letter and scramble everything in between,
Your brain will process it and get the right word right. Why could you process this? Your brain recognizes the pattern and fills in the correct words automatically. Reading is actually a rapid prediction and correction system. Your brain predicts upcoming words. Your eyes scan the text. Your brain checks if the prediction is correct. When you read or when you scan a room full of people or you watch a movie, whatever you are doing,
Guy Reams (02:22.54)
You are actually just taking a quick snapshot and predicting what will come next. These are called saccades. Saccades are the quick tiny jumps your eyes make when they move from one point to another. They happen constantly when you read, look around a room, scan a scene. Your brain is constantly building reality from fragments of visual snapshots. So your brain is constantly building reality from these visual snapshots. Even though
Computer scientists are doing some amazing things right now. They have a long way to go to even get close to the marvelous capability of the human mind. I work with language models every day. I see what they can do. But they do not predict and correct the way the human brain automatically does. They do not build meaning from fragments the way a human brain does in real time. This morning I asked what counts as a word. I still do not have a clean answer, but I know this.
Words are not fixed objects. They are living tools we use to encode ideas and pass them to another mind. The edges are fuzzy because language itself is fuzzy. It bends, it adapts, it predicts, then corrects. The next time you read something, pay attention to how your eyes move. Notice the jumps. Notice how your brain fills in the gaps before you even finish the sentence. That is not a bug. That is the system working exactly as it should.