Topic · attention
attention
2 entries on AIKnowHub tagged "attention", spanning 1 content type.
- 2entries
- 1content types
- Interviewmost coverage in
Interviews2
Interview
Explain self-attention. Why is it better than RNNs for sequence modeling?
Foundational LLM knowledge. If you can't explain attention, you can't reason about modern AI architectures.
Interview
Implement scaled dot-product attention in NumPy (or PyTorch).
Tests whether you understand the math behind transformers, not just the API.