Oliver Wei
Oliver2021
AI & ML interests
None yet
Recent Activity
updated
a collection
about 17 hours ago
Long context
updated
a collection
about 17 hours ago
Long context
updated
a collection
about 17 hours ago
Long context
Organizations
None yet
Collections
7
-
InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU
Paper • 2502.08910 • Published • 139 -
Cramming 1568 Tokens into a Single Vector and Back Again: Exploring the Limits of Embedding Space Capacity
Paper • 2502.13063 • Published • 60 -
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
Paper • 2502.11089 • Published • 133 -
LLM Pretraining with Continuous Concepts
Paper • 2502.08524 • Published • 26
models
None public yet
datasets
None public yet