Back to researchers
Songlin Yang
Linear transformers via the delta rule
Co-authored “Parallelizing Linear Transformers with the Delta Rule over Sequence Length”.
Highlights
DeltaNetLinear transformersEfficient attention
Focus: Linear transformers via the delta rule
Why it matters: Co-authored “Parallelizing Linear Transformers with the Delta Rule over Sequence Length”.
Research Areas
DeltaNetLinear transformersEfficient attention