tencent/HiLS-Attention-7B
Text Generation • 7B • Updated • 5
Xiang Hu
imhuim982
AI & ML interests
None yet
Recent Activity
published a model about 10 hours ago
tencent/HiLS-Attention-7B updated a model about 13 hours ago
tencent/HiLS-Attention-7B authored a paper 1 day ago
Random Long-Context Access for Mamba via Hardware-aligned Hierarchical
Sparse AttentionOrganizations
published a
model about 10 hours ago
updated a
model about 13 hours ago
authored 7
papers 1 day ago
Random Long-Context Access for Mamba via Hardware-aligned Hierarchical Sparse Attention
Paper • 2504.16795 • Published • 1
Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Models
Paper • 2511.23319 • Published • 25
FlashMemory-DeepSeek-V4: Lightning Index Ultra-Long Context via Lookahead Sparse Attention
Paper • 2606.09079 • Published • 66
Efficient Length-Generalizable Attention via Causal Retrieval for Long-Context Language Modeling
Paper • 2410.01651 • Published
Understanding and Improving Length Generalization in Hierarchical Sparse Attention Models
Paper • 2510.17196 • Published
Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling
Paper • 2607.02980 • Published • 57
Augmenting Transformers with Recursively Composed Multi-grained Representations
Paper • 2309.16319 • Published
upvoted a paper 3 days ago