AetherMind-KD-Student: A Robust and Efficient Knowledge-Distilled NLI Model

Community Article Published November 15, 2025

AetherMind-KD-Student is a 184M-parameter Natural Language Inference (NLI) model distilled from a DeBERTa-v3 teacher using a multi-stage, adversarial-aware knowledge distillation pipeline.

The model is designed to provide:

  • High accuracy on standard NLI benchmarks
  • Strong robustness on adversarial datasets
  • Excellent zero-shot generalization to unseen datasets
  • High inference efficiency on consumer GPUs

This makes it suitable for both research and real-world applications that require fast and reliable sentence-level reasoning.

๐Ÿ”— Model Page:
https://huggingface.co/samerzaher80/AetherMind-KD-Student

Community

Sign up or log in to comment