500AI
Back to researchers

Bo Peng

RWKV and efficient sequence modeling

Connected to a fast-moving open-source alternative line of work aimed at transformer-like capability with different tradeoffs.

Highlights

RWKVOpen-sourceSequence models
Focus: RWKV and efficient sequence modeling
Why it matters: Connected to a fast-moving open-source alternative line of work aimed at transformer-like capability with different tradeoffs.
Start here
RWKV: Reinventing RNNs for the Transformer Erapaper →RWKV (project)project →

Research Areas

RWKVOpen-sourceSequence models
Bo Peng - AI Researcher Profile | 500AI