File size: 2,724 Bytes
8b23705 b877b3a 8b23705 9a11635 8b23705 ca7a890 8b23705 ca7a890 8b23705 ca7a890 8b23705 ca7a890 8b23705 ca7a890 be9cdf8 8b23705 be9cdf8 8b23705 ca7a890 8b23705 ca7a890 8b23705 ca7a890 8b23705 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 | ---
base_model:
- meta-llama/Llama-3.1-8B-Instruct
language:
- en
tags:
- problem-solving
- chain-of-thought
- reasoning
datasets:
- agentlans/train-of-thought
license: llama3.1
pipeline_tag: text-generation
---
# Llama3.1-deep-o1
- A robust merge of DeepSeek R1 distilled and O1-style long chain-of-thought (CoT) large language models (LLMs).
- It can generate long, coherent solutions and excels at problem-solving tasks among models with 8 billion parameters.
## Model Overview
- Supports long reasoning and non-reasoning modes.
- In reasoning mode, generates the thought process for problem solving.
- Suitable for creating solution outlines and analyzing problems
- Or as a foundation model for finetuning and merging.
> [!NOTE]
> To use the long CoT reasoning mode, use a system prompt like
>
> `Explain your reasoning step-by-step using <think>...</think>, then give the final answer inside <response>...</response>.`
### Examples to Try:
- Write the equations for glycolysis and pyruvate oxidation.
- Calculate net ATP formation from glucose metabolism (excluding electron transport chain).
- Integrate x^2 e^x dx.
- Prove that the complete bipartite graph K_{3,3} isn't planar.
- Derive a formula for the critical angle between two media with refractive indices n_1 and n_2.
- Compare steam vs. diesel engines including their capabilities and historical significance.
## Limitations
> [!WARNING]
> This model is experimental.
> While the model provides coherent and expert-like responses, users should verify its outputs for accuracy - especially in calculations or logical reasoning tasks.
- It is not optimized for conversational tasks but performs well in single-turn question answering.
- Inconsistent formatting for mathematical equations and LaTeX code.
- May have inaccurate data, make calculation errors or reasoning mistakes.
- Struggles with multiturn conversations and user alignment.
## Model Details
The model was created using the following Mergekit YAML configuration:
```yaml
models:
- model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
- model: Skywork/Skywork-o1-Open-Llama-3.1-8B
- model: SimpleBerry/LLaMA-O1-Supervised-1129
- model: NousResearch/DeepHermes-3-Llama-3-8B-Preview
- model: O1-OPEN/OpenO1-LLama-8B-v0.1
- model: nvidia/Llama-3.1-Nemotron-Nano-8B-v1
merge_method: karcher
tokenizer:
source: meta-llama/Llama-3.1-8B-Instruct
dtype: bfloat16
```
Then the merged model was trained on [agentlans/train-of-thought](https://huggingface.co/datasets/agentlans/train-of-thought) `10K` subset for 1 epoch using LLaMA Factory.
- LoRA rank 8, alpha 16, dropout 0.5, use rsLoRA
- Pack sequences, NEFTune 5
- Liger kernel accelerator
## Licence
Llama 3.1 license |