EXAONE-4.0-1.2B-trivia-medium

This model is a medium pruned version of LGAI-EXAONE/EXAONE-4.0-1.2B, specialized for TRIVIA tasks.

Pruning Details

  • Base Model: LGAI-EXAONE/EXAONE-4.0-1.2B
  • Specialization: Trivia
  • Prune Mode: Medium
  • Method: Activation-based weight pruning

Performance Comparison

Category Original Pruned
Python 20.0% 20.0%
HTML 6.7% 6.7%
Trivia 86.7% 86.7%
Math 60.0% 60.0%
Reasoning N/A N/A
Medical 93.3% 93.3%
Linux 93.3% 93.3%
Writing 46.7% 40.0%

Comparison Graph

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("CompactAI/EXAONE-4.0-1.2B-trivia-medium")
tokenizer = AutoTokenizer.from_pretrained("CompactAI/EXAONE-4.0-1.2B-trivia-medium")

License

This model inherits the license from the base model.

Downloads last month
-
Safetensors
Model size
1B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for CompactAI/EXAONE-4.0-1.2B-trivia-medium

Finetuned
(62)
this model

Collection including CompactAI/EXAONE-4.0-1.2B-trivia-medium