EXAONE-4.0-1.2B-html-medium-heavy

This model is a medium-heavy pruned version of LGAI-EXAONE/EXAONE-4.0-1.2B, specialized for HTML tasks.

Pruning Details

• Base Model: LGAI-EXAONE/EXAONE-4.0-1.2B
• Specialization: Html
• Prune Mode: Medium-heavy
• Method: Activation-based weight pruning

Performance Comparison

Category	Original	Pruned
Python	20.0%	0.0%
HTML	6.7%	N/A
Trivia	86.7%	N/A
Math	60.0%	N/A
Reasoning	N/A	N/A
Medical	93.3%	N/A
Linux	93.3%	N/A
Writing	46.7%	N/A

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("CompactAI/EXAONE-4.0-1.2B-html-medium-heavy")
tokenizer = AutoTokenizer.from_pretrained("CompactAI/EXAONE-4.0-1.2B-html-medium-heavy")

License

This model inherits the license from the base model.