General · LESSON 6 OF 33 · 1 min
Why the old way forgets your first sentence.
About this lesson
Why the old way forgets your first sentence. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.
Continue in the reels feed ↓Video transcript
The old notebook is small. What happens when the sentence gets really long?
Watch. The first word, Maria, gets written into the one memory box.
But every new word must be squeezed into that same box. So the old notes get overwritten and fainter.
So by the end, the memory is mostly the recent words. By the last word, would Maria still be clear?
Right, the recent words. The first sentence fades, and that hurts translation, because the ending may depend on the beginning.