Scientific Computing in Python / 2027 · Lecture 6 · Proposed 2027; calendar dates pending
Embeddings and scaled dot-product attention
Reading guide
- Embedding and projection matricesp. 1
- Rowwise softmaxp. 1
- Weighted valuesp. 2
- A two-key calculationp. 3
- Causal maskingp. 3
- Scaling and learned representationsp. 4
Computation and practice