https://skylab.website/ https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea2026-10-23T13:12:24.703Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/d0746c39-cea5-4313-af71-dd7a4a63c2bb2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/d0746c39-cea5-4313-af71-dd7a4a63c2bb/thumbnailComputers can’t read. So how do they translate?Computers can’t read. So how do they translate? — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/d0746c39-cea5-4313-af71-dd7a4a63c2bb/media352026-10-23T11:50:30.746Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9aa925c2-4631-4bb8-82cd-3af8ea4495f82026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9aa925c2-4631-4bb8-82cd-3af8ea4495f8/thumbnailComputers don’t read words. They read pieces.Computers don’t read words. They read pieces. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9aa925c2-4631-4bb8-82cd-3af8ea4495f8/media452026-10-23T11:51:57.431Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/ba3515f5-7f19-420e-96b3-11d730b801432026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/ba3515f5-7f19-420e-96b3-11d730b80143/thumbnailEvery word becomes a point in space.Every word becomes a point in space. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/ba3515f5-7f19-420e-96b3-11d730b80143/media442026-10-23T11:54:12.240Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/f940b52f-393d-4ed2-9a39-767d57282e2e2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/f940b52f-393d-4ed2-9a39-767d57282e2e/thumbnail“Bank” means two things. How does a machine pick one?“Bank” means two things. How does a machine pick one? — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/f940b52f-393d-4ed2-9a39-767d57282e2e/media452026-10-23T12:12:22.170Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/679e9aaa-914b-41f0-8287-4e10ed4626802026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/679e9aaa-914b-41f0-8287-4e10ed462680/thumbnailThe old way: read one word at a time.The old way: read one word at a time. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/679e9aaa-914b-41f0-8287-4e10ed462680/media362026-10-23T12:26:06.343Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/369b8dd5-e3d6-4566-83cb-d580efaf1ebe2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/369b8dd5-e3d6-4566-83cb-d580efaf1ebe/thumbnailWhy the old way forgets your first sentence.Why the old way forgets your first sentence. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/369b8dd5-e3d6-4566-83cb-d580efaf1ebe/media322026-10-23T12:26:51.558Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c49735b2-e452-41ef-9d27-e6754305963e2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c49735b2-e452-41ef-9d27-e6754305963e/thumbnailWhy the old way is painfully slow.Why the old way is painfully slow. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c49735b2-e452-41ef-9d27-e6754305963e/media442026-10-23T12:27:42.774Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/f2b01723-2ab5-4ef1-b57f-d2acdd6353ff2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/f2b01723-2ab5-4ef1-b57f-d2acdd6353ff/thumbnailWhat is a GPU? 60 seconds, no jargon.What is a GPU? 60 seconds, no jargon. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/f2b01723-2ab5-4ef1-b57f-d2acdd6353ff/media402026-10-23T12:28:46.034Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/3c988015-c49f-4d89-a00c-97f64b6487a52026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/3c988015-c49f-4d89-a00c-97f64b6487a5/thumbnailWhat if every word could look at every other word?What if every word could look at every other word? — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/3c988015-c49f-4d89-a00c-97f64b6487a5/media382026-10-23T12:29:41.251Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/8054f99b-4418-4898-89db-c6cafd8a27b32026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/8054f99b-4418-4898-89db-c6cafd8a27b3/thumbnailAttention is a search engine inside the sentence.Attention is a search engine inside the sentence. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/8054f99b-4418-4898-89db-c6cafd8a27b3/media432026-10-23T12:30:34.447Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9176cb16-e408-41fd-86f6-56d6544bd2992026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9176cb16-e408-41fd-86f6-56d6544bd299/thumbnailHow a word finds its match.How a word finds its match. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9176cb16-e408-41fd-86f6-56d6544bd299/media372026-10-23T12:31:28.658Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9c54a90b-17fa-4416-ba1c-a5e8d9205c7c2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9c54a90b-17fa-4416-ba1c-a5e8d9205c7c/thumbnailTurning scores into percentages.Turning scores into percentages. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9c54a90b-17fa-4416-ba1c-a5e8d9205c7c/media482026-10-23T12:32:40.972Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/a2ac3d59-6e51-47ec-a83f-b694209b7ec82026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/a2ac3d59-6e51-47ec-a83f-b694209b7ec8/thumbnailHow “it” finds “animal.”How “it” finds “animal.” — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/a2ac3d59-6e51-47ec-a83f-b694209b7ec8/media482026-10-23T12:33:51.237Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/cd099530-93f7-4fb9-ad4f-f5ec35c412292026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/cd099530-93f7-4fb9-ad4f-f5ec35c41229/thumbnailWhere do Q, K, V come from?Where do Q, K, V come from? — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/cd099530-93f7-4fb9-ad4f-f5ec35c41229/media482026-10-23T12:34:52.461Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/df40982e-55b1-4915-a315-0ebb55c75c442026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/df40982e-55b1-4915-a315-0ebb55c75c44/thumbnailThe tiny √d fix that saves everything.The tiny √d fix that saves everything. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/df40982e-55b1-4915-a315-0ebb55c75c44/media542026-10-23T12:36:01.763Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/bcb1b99d-7766-4235-bde6-4fb4c0d0b7372026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/bcb1b99d-7766-4235-bde6-4fb4c0d0b737/thumbnailAll of attention in one line of math.All of attention in one line of math. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/bcb1b99d-7766-4235-bde6-4fb4c0d0b737/media542026-10-23T12:38:24.621Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/cf67e6ac-035b-4ba6-b317-304c137f48632026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/cf67e6ac-035b-4ba6-b317-304c137f4863/thumbnailOne look isn’t enough. Use 8.One look isn’t enough. Use 8. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/cf67e6ac-035b-4ba6-b317-304c137f4863/media472026-10-23T12:39:31.889Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/8e5c617c-f368-4b38-ba23-6d808452a2ce2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/8e5c617c-f368-4b38-ba23-6d808452a2ce/thumbnailThe flaw: it can’t tell “dog bites man” from “man bites dog.”The flaw: it can’t tell “dog bites man” from “man bites dog.” — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/8e5c617c-f368-4b38-ba23-6d808452a2ce/media452026-10-23T12:40:32.324Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/07b0120f-5509-49fa-9438-c179627a772d2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/07b0120f-5509-49fa-9438-c179627a772d/thumbnailTeaching order with sine waves.Teaching order with sine waves. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/07b0120f-5509-49fa-9438-c179627a772d/media552026-10-23T12:41:30.549Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/432a3d7b-175e-4e9c-b6a1-5a14ef2aa6292026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/432a3d7b-175e-4e9c-b6a1-5a14ef2aa629/thumbnailThe trick that lets you stack many layers.The trick that lets you stack many layers. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/432a3d7b-175e-4e9c-b6a1-5a14ef2aa629/media512026-10-23T12:42:35.789Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/78189ad0-df87-40ae-85ae-f0a26536da3a2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/78189ad0-df87-40ae-85ae-f0a26536da3a/thumbnailAttention mixes. This part thinks.Attention mixes. This part thinks. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/78189ad0-df87-40ae-85ae-f0a26536da3a/media502026-10-23T12:43:41.095Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9f8334df-95b8-4209-add3-775c4cfab2082026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9f8334df-95b8-4209-add3-775c4cfab208/thumbnailThe encoder: how it reads a sentence.The encoder: how it reads a sentence. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/9f8334df-95b8-4209-add3-775c4cfab208/media482026-10-23T12:44:44.333Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c02ac277-2c34-4c0c-9417-2cd46e8fb9102026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c02ac277-2c34-4c0c-9417-2cd46e8fb910/thumbnailThe decoder: writing one word at a time.The decoder: writing one word at a time. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c02ac277-2c34-4c0c-9417-2cd46e8fb910/media372026-10-23T12:45:57.966Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/ce6f3df2-1f9f-42d0-94e9-cda8055d59332026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/ce6f3df2-1f9f-42d0-94e9-cda8055d5933/thumbnailNo peeking: the mask.No peeking: the mask. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/ce6f3df2-1f9f-42d0-94e9-cda8055d5933/media432026-10-23T12:46:50.222Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c5f0564a-6648-45ba-9b2f-a679b94d93002026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c5f0564a-6648-45ba-9b2f-a679b94d9300/thumbnailHow the writer looks back at the reader.How the writer looks back at the reader. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/c5f0564a-6648-45ba-9b2f-a679b94d9300/media522026-10-23T12:47:50.461Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/7ba83da5-a67a-4d20-bbc8-2eaec1c9eb382026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/7ba83da5-a67a-4d20-bbc8-2eaec1c9eb38/thumbnailFrom numbers back to a word.From numbers back to a word. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/7ba83da5-a67a-4d20-bbc8-2eaec1c9eb38/media392026-10-23T12:48:59.737Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/2e8a093e-686d-42ea-9593-93f8b2f697892026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/2e8a093e-686d-42ea-9593-93f8b2f69789/thumbnailHow does it learn? Guess, check, fix.How does it learn? Guess, check, fix. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/2e8a093e-686d-42ea-9593-93f8b2f69789/media532026-10-23T12:50:00.985Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/213cade2-5789-4d8b-86d2-2bb48f8a75602026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/213cade2-5789-4d8b-86d2-2bb48f8a7560/thumbnailStart slow, speed up, slow down.Start slow, speed up, slow down. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/213cade2-5789-4d8b-86d2-2bb48f8a7560/media492026-10-23T12:50:58.222Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/e006408e-ad96-4d5c-b4af-3b7383d519882026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/e006408e-ad96-4d5c-b4af-3b7383d51988/thumbnailWhy this trains so much faster.Why this trains so much faster. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/e006408e-ad96-4d5c-b4af-3b7383d51988/media382026-10-23T12:52:01.517Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/a91c2818-ae6c-4e89-a0bf-024335718c8c2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/a91c2818-ae6c-4e89-a0bf-024335718c8c/thumbnailThe scoreboard: did it actually work?The scoreboard: did it actually work? — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/a91c2818-ae6c-4e89-a0bf-024335718c8c/media452026-10-23T12:52:48.726Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/da98bcfb-c1d6-4965-99ba-b986254db5192026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/da98bcfb-c1d6-4965-99ba-b986254db519/thumbnailWhat do the heads actually look at?What do the heads actually look at? — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/da98bcfb-c1d6-4965-99ba-b986254db519/media352026-10-23T12:53:55.068Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/08b308f8-da1b-4905-a849-ca2a9b9e0a3f2026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/08b308f8-da1b-4905-a849-ca2a9b9e0a3f/thumbnailOne paper. Then ChatGPT.One paper. Then ChatGPT. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/08b308f8-da1b-4905-a849-ca2a9b9e0a3f/media412026-10-23T12:55:01.507Z https://skylab.website/learn/1f757238-290a-4504-918a-a22d98aa3bea/lessons/e7347149-c4a8-471d-9543-b32ebd2269732026-10-23T13:12:24.703Zhttps://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/e7347149-c4a8-471d-9543-b32ebd226973/thumbnailExplain the whole paper in 60 seconds.Explain the whole paper in 60 seconds. — a video lesson in attention is all you need. Learn attention is all you need through short video lessons.https://skylab.website/api/learn/playlists/1f757238-290a-4504-918a-a22d98aa3bea/lessons/e7347149-c4a8-471d-9543-b32ebd226973/media592026-10-23T12:55:51.704Z