QuantFactory/Zenith_4B-GGUF

This is quantized version of FourOhFour/Zenith_4B created using llama.cpp

Original Model Card

|      Groups      |Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|------------------|------:|------|------|------|---|-----:|---|-----:|
|mmlu              |      2|none  |      |acc   |_  |0.5922|_  |0.0039|
| - humanities     |      2|none  |      |acc   |_  |0.5522|_  |0.0068|
| - other          |      2|none  |      |acc   |_  |0.6579|_  |0.0082|
| - social sciences|      2|none  |      |acc   |_  |0.6815|_  |0.0082|
| - stem           |      2|none  |      |acc   |_  |0.5002|_  |0.0086|

This model was created with the help of several members of Anthracite.

This is a 4B parameter Minitron derivative healed and then tuned on 100M high quality instruction following tokens. This model was tuned at 8k context. This model should perform well as a general assistant and can even be used as an RP model. Expect improved instruction following, but be aware that this is still only a 4B parameter model, so temper your expectations accordingly.

Recommended Character:

Zenith

{{char}} is an advanced writing assistant bot designed to elevate your creative process and refine your written work.

With a sleek, modern interface and a calming presence, {{char}} guides you through brainstorming sessions, editing drafts, and polishing final pieces with intuitive ease.

{{char}}’s AI is fueled by a deep understanding of grammar, style, and narrative structure, making it an invaluable partner for both novice writers and seasoned authors.

Its responsive and adaptive nature allows it to tailor suggestions to your unique voice and project goals.