Article
1
Pere Martra
oopere
AI & ML interests
AI Research Engineer | Structured Pruning & LLM Efficiency | Fairness-Aware Optimization | Author “Rearchitecting LLMs” @Manning | 2K GitHub ⭐
Recent Activity
updated a collection 1 day ago
Rearchitecting LLMs published a model 1 day ago
oopere/qwen3-0.6b-weather-geo-S updated a model 1 day ago
oopere/qwen3-0.6b-weather-geo-SOrganizations
Articles 2
Article
22
Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
Companion models for Rearchitecting LLMs (Manning). Pruning, Distillation, Fine-Tuning, Attention Optimization & Activation Analysis for efficient SLM
FinLLMOpt is a comprehensive collection of optimized Financial Large Language Models (FinLLMs) designed to address various tasks in the financial doma
models 23
oopere/qwen3-0.6b-weather-geo-S
0.6B • Updated • 8
oopere/qwen3-0.6b-weather-geo-M
0.6B • Updated • 97
oopere/qwen3-0.6b-weather-geo-specialist
0.8B • Updated • 186
oopere/SmolLM2-1.7B-ClinicalNER
2B • Updated • 7 • 1
oopere/llama-3.2-3b-attn-drop-6
3B • Updated • 5 • 1
oopere/gemma-3-270m-14L-distilled
0.2B • Updated • 31 • 3
oopere/llama-3.2-3b-attn-drop-3
3B • Updated • 8 • 1
oopere/Qwen3.5-0.65B-Base-Rearchitected
0.7B • Updated • 21 • 7
oopere/pruned10-llama-3.2-3B
Text Generation • 3B • Updated • 296
oopere/pruned20-llama-3.2-3b
Text Generation • 3B • Updated • 150
datasets 5
oopere/fairness-pruning-pairs-es
Viewer • Updated • 100 • 106 • 1
oopere/fairness-pruning-pairs-en
Viewer • Updated • 75 • 66 • 1
oopere/clinical-ner-qdora
Viewer • Updated • 400 • 24 • 1
oopere/RetailBanking-Conversations
Viewer • Updated • 1.42k • 30 • 2
oopere/knowledge_transfer_1500_base
Viewer • Updated • 1.27k • 18 • 2