500AI
Back to researchers

Uriya Pumerantz

Hybrid Transformer–Mamba language models (Jamba)

Co-authored Jamba: a hybrid Transformer–Mamba architecture for efficient long-context modeling.

Highlights

JambaAI21Hybrid modelsState space models
Focus: Hybrid Transformer–Mamba language models (Jamba)
Why it matters: Co-authored Jamba: a hybrid Transformer–Mamba architecture for efficient long-context modeling.
Start here
Jamba: A Hybrid Transformer-Mamba Language Modelpaper →Jamba-1.5: Hybrid Transformer-Mamba Models at Scalepaper →

Research Areas

JambaAI21Hybrid modelsState space models
Uriya Pumerantz - AI Researcher Profile | 500AI