Distillation Scaling Laws
Paper
• 2502.08606 • Published
• 47
Nandan Kumar Jha
nandan523
·
AI & ML interests
Privacy and security of LLMs, and Cryptographically-secure machine learning
Recent Activity
submitted
a paper
36 minutes ago
NerVE: Nonlinear Eigenspectrum Dynamics in LLM Feed-Forward Networks authored
a paper
5 months ago
A Random Matrix Theory Perspective on the Learning Dynamics of
Multi-head Latent Attention authored
a paper
5 months ago
Spectral Scaling Laws in Language Models: How Effectively Do
Feed-Forward Networks Use Their Latent Space? Organizations
