TinyLlama-1.1B-Chat-v1.0-reasoning-safe

🎯 REASONING-optimized | πŸ“¦ Safe pruning | ⚑ 1% weights pruned

This model is a conservatively pruned version of TinyLlama/TinyLlama-1.1B-Chat-v1.0.

Performance Comparison

Category Original Pruned Change
Python 0.0% 0.0% β†’
Html 0.0% 0.0% β†’
Trivia 83.3% 83.3% β†’
Math 0.0% 0.0% β†’
Reasoning 0.0% 0.0% ⭐ β†’
Medical 33.3% 33.3% β†’
Linux 33.3% 33.3% β†’
Writing 33.3% 33.3% β†’

Average: 22.9% β†’ 22.9% (+0.0%)

Comparison Graph

Quick Start

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("CompactAI/TinyLlama-1.1B-Chat-v1.0-reasoning-safe")
tokenizer = AutoTokenizer.from_pretrained("CompactAI/TinyLlama-1.1B-Chat-v1.0-reasoning-safe")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Technical Details

Property Value
Base Model TinyLlama/TinyLlama-1.1B-Chat-v1.0
Specialization Reasoning
Prune Mode Safe
Weight Reduction 1% weights pruned

License

This model inherits the license from the base model.

Downloads last month
19
Safetensors
Model size
1B params
Tensor type
F16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for CompactAI/TinyLlama-1.1B-Chat-v1.0-reasoning-safe

Finetuned
(512)
this model

Collection including CompactAI/TinyLlama-1.1B-Chat-v1.0-reasoning-safe