SimplyRuba's picture
Update README.md
229d879 verified
|
Raw
History Blame Contribute Delete
2.85 kB
---
license: apache-2.0
base_model: meta-llama/Llama-3.1-8B-Instruct
model_creator: SimplyRuba
tags:
- unsloth
- llama
- agentic-reasoning
---
# Model Card: Llama-3.1-8B-Agentic-Reasoning
**Developed by SimplyRuba**
## 1. Overview
This model is a fine-tuned version of Llama-3.1-8B-Instruct, optimized for sequential reasoning in agentic environments. The fine-tuning specifically addresses "Premature Commitment," a failure mode where small language models execute terminal actions prior to integrating external tool observations.
## 2. Technical Methodology
The model was optimized using Supervised Fine-Tuning (SFT) on multi-turn reasoning traces.
- Backbone: Llama-3.1-8B-Instruct.
- Optimization: Parameter-Efficient Fine-Tuning (PEFT) via LoRA (r=16, alpha=16).
- Framework: Unsloth (4-bit quantized training).
## 3. Logic Protocol
The model follows a structured reasoning sequence to ensure logical consistency:
1. Thought Process: Identification of dependencies and required external data.
2. Action Generation: Issuance of tool calls in structured JSON format.
3. Execution Pause: Generation of an End-of-Turn (EOS) signal to wait for system input.
4. Observation Integration: Resumption of reasoning from the <observation> block to finalize the task.
## 4. Benchmark Comparison
| Metric | Llama-3.1-8B (Base) | Agentic-Reasoning (Fine-tuned) |
| :--- | :--- | :--- |
| Logic Adherence | Parallel/Impulsive | Sequential/Deterministic |
| Formatting | Unstructured | Strict JSON Schema |
| Reasoning Mode | Implicit | Explicit via Thought Process |
| Conditional Logic Accuracy | Low | 100.0% (Verified across 5 domains) |
## 5. Transparent Reasoning (Audit Trail)
Unlike base SLMs that generate black-box JSON outputs, this model exposes its reasoning trajectory. Below is a raw execution trace demonstrating the strict wait-and-act protocol. The model suspends execution in Turn 1, and mathematically validates the external observation in Turn 2 before committing to a tool call.
**Test Case: Supply Chain Logistics**
```text
[TURN 1: Initial Action]
<thought_process>
I need the GPU count first. I will call 'get_inventory' to retrieve it.
</thought_process>
<tool_calls>
[{"tool_name": "get_inventory", "arguments": {"item_name": "GPU"}}]
</tool_calls>
[OBSERVATION INJECTED]
[{"tool": "check_stock", "output": {"item": "GPU", "count": 2}}]
[TURN 2: Final Decision]
<thought_process>
The GPU count is 2, which is less than 5. I must now order more.
</thought_process>
<tool_calls>
[{"tool_name": "order_stock", "arguments": {"item_name": "GPU", "quantity": 3}}]
</tool_calls>
```
## 6. Usage
Integration requires an orchestrator to provide tool outputs within <observation> tags.
```python
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained("SimplyRuba/Llama-3.1-8B-Agentic-Reasoning")
```