AetherMind-KD-Student: A Robust and Efficient Knowledge-Distilled NLI Model
Community Article
Published
November 15, 2025
AetherMind-KD-Student is a 184M-parameter Natural Language Inference (NLI) model distilled from a DeBERTa-v3 teacher using a multi-stage, adversarial-aware knowledge distillation pipeline.
The model is designed to provide:
- High accuracy on standard NLI benchmarks
- Strong robustness on adversarial datasets
- Excellent zero-shot generalization to unseen datasets
- High inference efficiency on consumer GPUs
This makes it suitable for both research and real-world applications that require fast and reliable sentence-level reasoning.
๐ Model Page:
https://huggingface.co/samerzaher80/AetherMind-KD-Student