Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss
Paper • 2608.03796 • Published • 3
AI & ML interests
Data Contamination in LLMs and other modalities
Recent Activity
View all activity
Iker
authored 5
papers about 9 hours ago
Refusal Steering: Fine-grained Control over LLM Refusal Behaviour for Sensitive Topics
Paper • 2512.16602 • Published
Instructing Large Language Models for Low-Resource Languages: A Systematic Study for Basque
Paper • 2506.07597 • Published
GuideX: Guided Synthetic Data Generation for Zero-Shot Information Extraction
Paper • 2506.00649 • Published • 4
Cross-Lingual Transfer for Low-Resource Natural Language Processing
Paper • 2502.02722 • Published
OSainz
authored 2
papers about 1 month ago
OSainz
authored 2
papers about 1 year ago
yanaiela
authored a
paper over 1 year ago
yanaiela
authored 6
papers almost 2 years ago
Hybrid Preferences: Learning to Route Instances for Human vs. AI Feedback
Paper • 2410.19133 • Published • 11
Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection
Paper • 2004.07667 • Published
Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation
Paper • 2305.16938 • Published
Text-based NP Enrichment
Paper • 2109.12085 • Published
A Survey on Data Selection for Language Models
Paper • 2402.16827 • Published • 4
Lexical Generalization Improves with Larger Models and Longer Training
Paper • 2210.12673 • Published
eagirre
authored a
paper about 2 years ago
yanaiela
authored a
paper about 2 years ago
Iker
authored a
paper about 2 years ago
OSainz
authored a
paper about 2 years ago