The decoder: writing one word at a time.

Video transcript

The encoder gave us rich meaning for the input sentence. Now the decoder writes the translation, but only one word at a time.

So it starts with a start signal and writes the first word, like Le?

Yes. That word is fed back in. Now the decoder must pick the next word. What should it use to choose?

It uses the words already written. Le helps decide chat, because the sentence must make sense so far.

It also checks the encoder output, to stay faithful to the original. Each new word uses the ones before it, and then the loop repeats.