Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Paper
•
2501.13629
•
Published
•
44
Yuting Jiang
Stautinger
·
AI & ML interests
None yet
Recent Activity
authored
a paper
about 1 month ago
Sigma: Differential Rescaling of Query, Key and Value for Efficient
Language Models
Organizations
None yet
Stautinger's activity
authored
a
paper
about 1 month ago