500AI
Back to researchers

Mike Lewis

Streaming + long-context stability (attention sinks)

Co-authored Attention Sinks: a practical trick for stable streaming and long-context attention.

Highlights

Long contextInferenceEfficiency
Focus: Streaming + long-context stability (attention sinks)
Why it matters: Co-authored Attention Sinks: a practical trick for stable streaming and long-context attention.
Start here
Efficient Streaming Language Models with Attention Sinkspaper →

Research Areas

Long contextInferenceEfficiency
Mike Lewis - AI Researcher Profile | 500AI