pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF
Text Generation ā¢ 0.6B ā¢ Updated ā¢ 249 ā¢ 1
Pankaj Pandey
pankajpandey-dev
Ā·
AI & ML interests
Natural Language Processing, Text Generation, Large Language Models, Quantization, Fine-Tuning, RLHF, Model Merging
Recent Activity
liked a model about 2 hours ago
pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF liked a model about 2 hours ago
pankajpandey-dev/Carbon-3B-GGUF posted an update about 23 hours ago
š§¬ Just uploaded K-quants of Carbon-3B for llama.cpp users!
@HuggingFaceBio released the original GGUF in bf16 only ā so I added the full quant ladder for CPU/edge inference:
ā¢ Q2_K ā 1.4 GB
ā¢ Q3_K_M ā 1.8 GB
ā¢ Q4_K_M ā 2.1 GB ā
ā¢ Q5_K_M ā 2.4 GB
ā¢ Q6_K ā 2.7 GB
ā¢ Q8_0 ā 3.5 GB
š https://huggingface.co/pankajpandey-dev/Carbon-3B-GGUF
Now you can generate DNA sequences on your laptop. Needs a llama.cpp build with PR #23410 (HybridDNATokenizer support).
Huge thanks to the HuggingFaceBio team for the original model š
#GGUF #llamacpp #genomics #DNA
Organizations
liked 2
models about 2 hours ago
posted an update about 23 hours ago
Post
80
š§¬ Just uploaded K-quants of Carbon-3B for llama.cpp users!
@HuggingFaceBio released the original GGUF in bf16 only ā so I added the full quant ladder for CPU/edge inference:
ā¢ Q2_K ā 1.4 GB
ā¢ Q3_K_M ā 1.8 GB
ā¢ Q4_K_M ā 2.1 GB ā
ā¢ Q5_K_M ā 2.4 GB
ā¢ Q6_K ā 2.7 GB
ā¢ Q8_0 ā 3.5 GB
š pankajpandey-dev/Carbon-3B-GGUF
Now you can generate DNA sequences on your laptop. Needs a llama.cpp build with PR #23410 (HybridDNATokenizer support).
Huge thanks to the HuggingFaceBio team for the original model š
#GGUF #llamacpp #genomics #DNA
@HuggingFaceBio released the original GGUF in bf16 only ā so I added the full quant ladder for CPU/edge inference:
ā¢ Q2_K ā 1.4 GB
ā¢ Q3_K_M ā 1.8 GB
ā¢ Q4_K_M ā 2.1 GB ā
ā¢ Q5_K_M ā 2.4 GB
ā¢ Q6_K ā 2.7 GB
ā¢ Q8_0 ā 3.5 GB
š pankajpandey-dev/Carbon-3B-GGUF
Now you can generate DNA sequences on your laptop. Needs a llama.cpp build with PR #23410 (HybridDNATokenizer support).
Huge thanks to the HuggingFaceBio team for the original model š
#GGUF #llamacpp #genomics #DNA
updated a
collection about 23 hours ago
updated a
model about 23 hours ago
published a
model about 23 hours ago
posted an update 3 days ago
Post
184
Just released Qwen3-0.6B fine-tuned on Hindi instruction data š®š³
ā Full model: pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1
ā GGUF versions (Q2/Q4/Q5/Q8): pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF
Smallest Hindi-capable GGUF ā runs on any laptop at 0.37GB.
Next: v2 with more data, better responses.
#Hindi #LLM #GGUF #OpenSource
ā Full model: pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1
ā GGUF versions (Q2/Q4/Q5/Q8): pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF
Smallest Hindi-capable GGUF ā runs on any laptop at 0.37GB.
Next: v2 with more data, better responses.
#Hindi #LLM #GGUF #OpenSource
updated a
collection 3 days ago
updated a
model 3 days ago
published a
model 3 days ago
updated a
model 3 days ago
published a
model 3 days ago
liked a
Space 3 months ago
published a
Space 3 months ago
liked a
Space 3 months ago
published a
Space 3 months ago