TensorLLM: Tensorising Multi-Head Attention for Enhanced Reasoning and Compression in LLMs
Paper
•
2501.15674
•
Published
•
2
Yuxuan Gu
yuxuan-gu
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 17 hours ago
KromHC: Manifold-Constrained Hyper-Connections with Kronecker-Product Residual Matrices
authored
a paper
about 20 hours ago
TensorLLM: Tensorising Multi-Head Attention for Enhanced Reasoning and
Compression in LLMs
authored
a paper
about 20 hours ago
TeRA: Vector-based Random Tensor Network for High-Rank Adaptation of Large Language Models
Organizations
None yet
authored
2
papers
about 20 hours ago