Update README.md
Browse files
README.md
CHANGED
|
@@ -8,3 +8,7 @@ tags:
|
|
| 8 |
---
|
| 9 |
|
| 10 |

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |

|
| 11 |
+
|
| 12 |
+
# **LwQ-30B-Instruct**
|
| 13 |
+
|
| 14 |
+
LwQ-30B-Instruct (Llama with Questions), based on the Llama 3.1 collection of multilingual large language models (LLMs), is a set of pre-trained and instruction-tuned generative models optimized for multilingual dialogue use cases. These models outperform many available open-source alternatives. **Model Architecture:** Llama 3.1 is an auto-regressive language model utilizing an optimized transformer architecture. The tuned versions undergo supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to better align with human preferences for helpfulness and safety. LwQ-30B is trained on synthetic reasoning datasets for mathematical reasoning and context-based problem-solving, with a focus on following instructions or keywords embedded in the input.
|