Update README.md
Browse files
README.md
CHANGED
|
@@ -14,11 +14,11 @@ pipeline_tag: text-generation
|
|
| 14 |
- **Output:** Text
|
| 15 |
- **Model Optimizations:**
|
| 16 |
- **Pruned:** 50% 2:4
|
| 17 |
-
- **Release Date:**
|
| 18 |
- **Version:** 1.0
|
| 19 |
- **Model Developers:** Neural Magic
|
| 20 |
|
| 21 |
-
Compressed version of [Llama-2-7b](https://huggingface.co/meta-llama/Llama-2-7b-hf) specialized for
|
| 22 |
This model was obtained by fine-tuning the Sparse Foundational model [Sparse-Llama-2-7b-pruned_50.2of4](https://huggingface.co/nm-testing/SparseLlama-2-7b-pruned_50.2of4) on the [ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k) dataset.
|
| 23 |
It achieves a win rate of 62.1% on the [AlpacaEval](https://github.com/tatsu-lab/alpaca_eval) benchmark (version 1.0) when using [Llama-2-70b-chat](https://huggingface.co/meta-llama/Llama-2-70b-chat-hf) as evaluator, whereas the dense [Llama-2-7b-ultrachat200k](https://huggingface.co/neuralmagic/Llama-2-7b-ultrachat200k) model achieves 57.6% win rate.
|
| 24 |
|
|
|
|
| 14 |
- **Output:** Text
|
| 15 |
- **Model Optimizations:**
|
| 16 |
- **Pruned:** 50% 2:4
|
| 17 |
+
- **Release Date:** 7/2/2024
|
| 18 |
- **Version:** 1.0
|
| 19 |
- **Model Developers:** Neural Magic
|
| 20 |
|
| 21 |
+
Compressed version of [Llama-2-7b](https://huggingface.co/meta-llama/Llama-2-7b-hf) specialized for code-generation.
|
| 22 |
This model was obtained by fine-tuning the Sparse Foundational model [Sparse-Llama-2-7b-pruned_50.2of4](https://huggingface.co/nm-testing/SparseLlama-2-7b-pruned_50.2of4) on the [ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k) dataset.
|
| 23 |
It achieves a win rate of 62.1% on the [AlpacaEval](https://github.com/tatsu-lab/alpaca_eval) benchmark (version 1.0) when using [Llama-2-70b-chat](https://huggingface.co/meta-llama/Llama-2-70b-chat-hf) as evaluator, whereas the dense [Llama-2-7b-ultrachat200k](https://huggingface.co/neuralmagic/Llama-2-7b-ultrachat200k) model achieves 57.6% win rate.
|
| 24 |
|