500AI
Back to researchers

Atri Rudra

Fast, memory-efficient attention

Co-authored FlashAttention: one of the most impactful attention-kernel optimizations.

Highlights

FlashAttentionEfficient attentionSystems
Focus: Fast, memory-efficient attention
Why it matters: Co-authored FlashAttention: one of the most impactful attention-kernel optimizations.
Start here
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesspaper →FlashAttention (GitHub)project →

Research Areas

FlashAttentionEfficient attentionSystems
Atri Rudra - AI Researcher Profile | 500AI