500AI
Back to researchers

Ahmed Murtadha

Rotary position embeddings (RoPE)

Co-authored RoFormer (RoPE): a positional-embedding design now widely used in modern LLMs.

Highlights

RoPERoFormerPosition embeddingsArchitectures
Focus: Rotary position embeddings (RoPE)
Why it matters: Co-authored RoFormer (RoPE): a positional-embedding design now widely used in modern LLMs.
Start here
RoFormer: Enhanced Transformer with Rotary Position Embeddingpaper →

Research Areas

RoPERoFormerPosition embeddingsArchitectures
Ahmed Murtadha - AI Researcher Profile | 500AI