fp16 llm - a roshniramesh Collection

roshniramesh 's Collections

nf4 llm

fp8 llm

fp16 llm

updated Jan 16, 2025

nvidia/Hymba-1.5B-Instruct

Text Generation • 2B • Updated Jan 2, 2025 • 295 • 242
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov

Text Generation • Updated Nov 11, 2024 • 2
microsoft/phi-4

Text Generation • 15B • Updated Nov 24, 2025 • 572k • 2.22k
unsloth/phi-4-GGUF

Text Generation • 15B • Updated Jan 13, 2025 • 1.98k • 181
microsoft/phi-4-gguf

Text Generation • 15B • Updated Nov 24, 2025 • 9.98k • 174
microsoft/Phi-3-mini-4k-instruct

Text Generation • 4B • Updated Dec 10, 2025 • 906k • 1.38k
microsoft/Phi-3.5-mini-instruct

Text Generation • 4B • Updated Dec 10, 2025 • 380k • 962
microsoft/phi-1_5

Text Generation • 1B • Updated Nov 24, 2025 • 83.9k • 1.35k
microsoft/phi-1

Text Generation • 1B • Updated Nov 24, 2025 • 5.42k • 218
microsoft/Phi-3-small-8k-instruct

Text Generation • 7B • Updated Dec 10, 2025 • 12.6k • 175
mistralai/Mistral-Nemo-Instruct-2407

12B • Updated Jul 28, 2025 • 80.6k • 1.65k
Qwen/Qwen-14B-Chat

Text Generation • 14B • Updated Dec 13, 2023 • 1.9k • 373
Qwen/Qwen-14B

Text Generation • 14B • Updated Dec 13, 2023 • 2.41k • 212
Qwen/Qwen-14B-Chat-Int4

Text Generation • 14B • Updated Dec 13, 2023 • 108 • 100
Qwen/Qwen-7B

Text Generation • 8B • Updated Jan 4, 2024 • 296k • 395
Qwen/Qwen-7B-Chat

Text Generation • 8B • Updated Mar 19, 2024 • 184k • 787
Qwen/Qwen-1_8B

Text Generation • 2B • Updated Dec 13, 2023 • 2.12k • 73
Qwen/Qwen-1_8B-Chat

Text Generation • 2B • Updated Dec 13, 2023 • 4.71k • 124
Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • 111B • Updated Apr 30, 2024 • 84.9k • 9
Qwen/CodeQwen1.5-7B-Chat-GGUF

Text Generation • 7B • Updated Apr 23, 2024 • 813 • 109
Qwen/CodeQwen1.5-7B-Chat

Text Generation • 7B • Updated Apr 30, 2024 • 819 • 351
Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • 0.6B • Updated Apr 30, 2024 • 36 • 7
Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • 2B • Updated Apr 30, 2024 • 36 • 4
Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • 14B • Updated Apr 30, 2024 • 340 • 23
Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • 4B • Updated Apr 30, 2024 • 541 • 3
Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • 72B • Updated Apr 30, 2024 • 1.34k • 25
Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • 7B • Updated Apr 30, 2024 • 38 • 14
Qwen/Qwen2.5-7B

Text Generation • 8B • Updated Sep 25, 2024 • 1.08M • • 263
Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Oct 9, 2024 • 483k • 6
Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 20, 2024 • 78.9k • 82
Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • 0.6B • Updated Oct 9, 2024 • 994 • 10
Qwen/Qwen2.5-1.5B

Text Generation • 2B • Updated Oct 8, 2024 • 420k • • 163
Qwen/Qwen2.5-0.5B

Text Generation • 0.5B • Updated Sep 25, 2024 • 1.08M • 371
Qwen/Qwen2.5-3B

Text Generation • 3B • Updated Sep 20, 2024 • 231k • 168
Qwen/Qwen1.5-4B

Text Generation • 4B • Updated Apr 5, 2024 • 11.7k • 35
Qwen/Qwen2-0.5B-Instruct-AWQ

Text Generation • 0.6B • Updated Aug 21, 2024 • 152 • 5
Qwen/Qwen2-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Aug 21, 2024 • 17.1k • 9
Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • 8B • Updated Aug 21, 2024 • 12.7k • 22
Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • 73B • Updated Aug 21, 2024 • 178 • 41
Qwen/Qwen2-0.5B

Text Generation • 0.5B • Updated Oct 22, 2024 • 314k • 163
Qwen/Qwen2-1.5B

Text Generation • 2B • Updated Jun 6, 2024 • 102k • • 99
Qwen/Qwen2-7B

Text Generation • 8B • Updated Jun 6, 2024 • 54.9k • • 170
mistralai/Mistral-7B-Instruct-v0.2

Text Generation • 7B • Updated Jul 24, 2025 • 2.43M • • 3.07k