General · LESSON 9 OF 33 · 1 min
What if every word could look at every other word?
About this lesson
What if every word could look at every other word? — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.
Continue in the reels feed ↓Video transcript
Here is a sentence: the animal was tired. Think about how the old way read it.
One word at a time, passing a note along the line. Each word only hears from its neighbor.
So the last word barely knows about the first one. What if we skip the line?
Exactly. Let every word look at every other word, directly. Draw a line between every pair.
So tired can look straight at animal, no matter how far apart they are. Is it helpful that distance stops mattering?
Yes. Every word sees the whole sentence at once. That is the big idea, and it is called attention.