Nandan Kumar Jha

nandan523's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

submitted a paper to Daily Papers about 2 hours ago

NerVE: Nonlinear Eigenspectrum Dynamics in LLM Feed-Forward Networks

Paper • 2603.06922 • Published 6 days ago

authored 2 papers 5 months ago

A Random Matrix Theory Perspective on the Learning Dynamics of Multi-head Latent Attention

Paper • 2507.09394 • Published Jul 12, 2025

Spectral Scaling Laws in Language Models: How Effectively Do Feed-Forward Networks Use Their Latent Space?

Paper • 2510.00537 • Published Oct 1, 2025 • 3

commented a paper 5 months ago

Spectral Scaling Laws in Language Models: How Effectively Do Feed-Forward Networks Use Their Latent Space?

Paper • 2510.00537 • Published Oct 1, 2025 • 3 •

2

upvoted a paper about 1 year ago

Distillation Scaling Laws

Paper • 2502.08606 • Published Feb 12, 2025 • 47

upvoted a collection about 1 year ago

Attention

Collection

24 items • Updated Feb 2 • 3

commented 3 papers about 1 year ago

Entropy-Guided Attention for Private LLMs

Paper • 2501.03489 • Published Jan 7, 2025 • 14 •

8

Entropy-Guided Attention for Private LLMs

Paper • 2501.03489 • Published Jan 7, 2025 • 14 •

8

Entropy-Guided Attention for Private LLMs

Paper • 2501.03489 • Published Jan 7, 2025 • 14 •

8

authored a paper about 1 year ago

Entropy-Guided Attention for Private LLMs

Paper • 2501.03489 • Published Jan 7, 2025 • 14

commented a paper about 1 year ago

Entropy-Guided Attention for Private LLMs

Paper • 2501.03489 • Published Jan 7, 2025 • 14 •

8

authored a paper over 1 year ago

AERO: Softmax-Only LLMs for Efficient Private Inference

Paper • 2410.13060 • Published Oct 16, 2024 • 4

commented 2 papers over 1 year ago

AERO: Softmax-Only LLMs for Efficient Private Inference

Paper • 2410.13060 • Published Oct 16, 2024 • 4 •

2

ReLU's Revival: On the Entropic Overload in Normalization-Free Large Language Models

Paper • 2410.09637 • Published Oct 12, 2024 • 3 •

2

authored 6 papers over 1 year ago

DeepReShape: Redesigning Neural Networks for Efficient Private Inference

Paper • 2304.10593 • Published Apr 20, 2023

ReLU's Revival: On the Entropic Overload in Normalization-Free Large Language Models

Paper • 2410.09637 • Published Oct 12, 2024 • 3

Circa: Stochastic ReLUs for Private Deep Learning

Paper • 2106.08475 • Published Jun 15, 2021

Sisyphus: A Cautionary Tale of Using Low-Degree Polynomial Activations in Privacy-Preserving Deep Learning

Paper • 2107.12342 • Published Jul 26, 2021

CryptoNite: Revealing the Pitfalls of End-to-End Private Inference at Scale

Paper • 2111.02583 • Published Nov 4, 2021

Modeling Data Reuse in Deep Neural Networks by Taking Data-Types into Cognizance

Paper • 2008.02565 • Published Aug 6, 2020