Naphula

/

Ancient-Awakening-12B-MPOA

like 4

Yeah I can try to add these later unless @mradermacher is able to

Ohh, shish, I forgot that you just recently released this model and mradermacher hasn't done his masterwork yet. Sorry!

This one and Riemannian Redshift too. Though I suppose nobody filed a request to mradermacher, so that's why. But quants would be appreciated, if possible.

imatrix will take longer but I can get some regular quants up soon

added these to the upload queue

    echo hf upload Naphula/Ancient-Awakening-12B-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B\Ancient-Awakening-12B-Q2_K.gguf
    echo hf upload Naphula/Ancient-Awakening-12B-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B\Ancient-Awakening-12B-Q3_K_M.gguf
    echo hf upload Naphula/Ancient-Awakening-12B-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B\Ancient-Awakening-12B-Q4_K_M.gguf
    echo hf upload Naphula/Ancient-Awakening-12B-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B\Ancient-Awakening-12B-Q5_K_M.gguf
    
    echo hf upload Naphula/Ancient-Awakening-12B-MPOA-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B-MPOA\Ancient-Awakening-12B-MPOA-Q2_K.gguf
    echo hf upload Naphula/Ancient-Awakening-12B-MPOA-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B-MPOA\Ancient-Awakening-12B-MPOA-Q3_K_M.gguf
    echo hf upload Naphula/Ancient-Awakening-12B-MPOA-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B-MPOA\Ancient-Awakening-12B-MPOA-Q4_K_M.gguf
    echo hf upload Naphula/Ancient-Awakening-12B-MPOA-GGUF B:\12B\models--Naphula--Ancient-Awakening-12B-MPOA\Ancient-Awakening-12B-MPOA-Q5_K_M.gguf
    
    echo hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q2_K.gguf
    echo hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q3_K_M.gguf
    echo hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q4_K_M.gguf
    echo hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q5_K_M.gguf

Updated conversion sequence for Redshift

python convert_hf_to_gguf.py B:\12B\models--Naphula--Riemannian-Redshift-12B-v1 --outfile B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\RR_input.gguf --outtype bf16
llama-quantize B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\RR_input.gguf B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q5_K_M.gguf Q5_K_M
llama-quantize B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\RR_input.gguf B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q4_K_M.gguf Q4_K_M
llama-quantize B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\RR_input.gguf B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q3_K_M.gguf Q3_K_M
llama-quantize B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\RR_input.gguf B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q2_K.gguf Q2_K
llama-quantize B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\RR_input.gguf B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q8_0.gguf Q8_0
hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q5_K_M.gguf
hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q4_K_M.gguf
hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q3_K_M.gguf
hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q2_K.gguf
hf upload Naphula/Riemannian-Redshift-12B-v1-GGUF B:\12B\models--Naphula--Riemannian-Redshift-12B-v1\Riemannian-Redshift-12B-v1-Q8_0.gguf