Ramsha
Khan
Toggle navigation
About
Blog
(current)
Projects
CV
Ramsha's Writings
Sharing my thoughts and idea through the art of writing
The Math behind Rotating Attention
A deep dive into how RoPE works in transformers
August 05, 2025 · 1 min read