mgoin/llama-2-7b-chat-quant-nodown-ds
Text Generation • Updated • 17
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
updated a model 5 days ago
nm-testing/Qwen3.8-27B-MXFP6A8 published a model 5 days ago
nm-testing/Qwen3.8-27B-MXFP6A8 updated a model 5 days ago
nm-testing/Qwen3-0.6B-MXFP6A8Organizations
mgoin/Sheared-LLaMA-1.3B-ds
Text Generation • Updated • 10
mgoin/llama2.c-stories15M-ds
Text Generation • Updated • 39
mgoin/zephyr-7b-alpha-pruned50-ds
Text Generation • Updated • 12
mgoin/Mistral-7B-v0.1-pruned70
Text Generation • Updated • 18
mgoin/Mistral-7B-v0.1-pruned60
Text Generation • Updated • 19
mgoin/Mistral-7B-v0.1-pruned50
Text Generation • Updated • 26
mgoin/zephyr-7b-alpha-pruned40
Text Generation • Updated • 21
mgoin/zephyr-7b-alpha-pruned50
Text Generation • Updated • 19
mgoin/Mistral-7B-v0.1-pruned40
Text Generation • Updated • 21
mgoin/zephyr-7b-alpha-ds
Text Generation • Updated • 11 • 1
mgoin/TinyLlama-1.1B-step-50K-105b-ONNX
Text Generation • Updated • 36 • 1
mgoin/open_llama_3b_v2-ds
Text Generation • Updated • 16
mgoin/mpt-7b-gsm8k-pruned40-quant
Text Generation • Updated • 25
mgoin/mpt-7b-gsm8k-quant
Text Generation • Updated • 24
mgoin/mpt-7b-gsm8k
Text Generation • Updated • 20
mgoin/all-MiniLM-L6-v2-ds
Feature Extraction • Updated • 63
mgoin/mpt-7b-chat-quant
Text Generation • Updated • 18 • 1
mgoin/TinyStories-33M-pruned50-ds
Text Generation • Updated • 240
mgoin/TinyStories-33M-quant-ds
Text Generation • Updated • 254
mgoin/TinyStories-33M-ds
Text Generation • Updated • 250
mgoin/vit-base-beans-one-shot
Image Classification • Updated • 8