Back to researchers
Yunfeng Liu
Rotary position embeddings (RoPE)
Co-authored RoFormer (RoPE): a positional-embedding design now widely used in modern LLMs.
Highlights
RoPERoFormerPosition embeddingsArchitectures
Focus: Rotary position embeddings (RoPE)
Why it matters: Co-authored RoFormer (RoPE): a positional-embedding design now widely used in modern LLMs.
Research Areas
RoPERoFormerPosition embeddingsArchitectures