| | --- |
| | base_model: unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit |
| | tags: |
| | - text-generation-inference |
| | - transformers |
| | - unsloth |
| | - qwen2 |
| | - grpo |
| | license: apache-2.0 |
| | language: |
| | - en |
| | datasets: |
| | - facebook/natural_reasoning |
| | --- |
| | |
| | # Coma 3B |
| |
|
| | Coma is based on Qwen 2.5 3B, GRPO-fine tuned on the natural reasoning data set from Meta. |
| |
|
| | ## GGUF |
| |
|
| | There are quantized versions available at [theprint/Coma-3B-GGUF](https://huggingface.co/theprint/Coma-3B-GGUF) in GGUF format. |
| |
|
| | ## Testing |
| |
|
| | The following system prompt was used in testing of the model: |
| | ``` |
| | Between the tags <think> and </think>: You will first think through your answer carefully step by step, including any potential risks or pit falls, the context of the user's request, and how best to present this. These are notes for yourself, so be detailed and honest in your assessment. |
| | |
| | When you are done with the analysis, you must use your own guidelines from the previous section to construct the final response. The user will only see this section. |
| | |
| | In summary, respond using this pattern: |
| | <think> |
| | First, ... |
| | </think> |
| | [your response] |
| | ``` |
| |
|
| | Testing was done at `temperature=1.0`, `top_k=45` and `top_p=0.95`. |
| |
|
| | - **Developed by:** theprint |
| | - **License:** apache-2.0 |
| | - **Finetuned from model :** unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit |
| |
|
| | This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. |
| |
|
| | [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |
