Update README.md
Browse files
README.md
CHANGED
|
@@ -55,7 +55,23 @@ This model is not uncensored, yet it may produce erotic outputs. You are solely
|
|
| 55 |
Like any other LLM, users and hosters alike should be aware that AI language models may hallucinate and produce inaccurate, dangerous, or even completly nonsensical outputs, all the information the model provides may seem accurate, but please, for important tasks always double check responses with credible sources.
|
| 56 |
|
| 57 |
# Notices
|
| 58 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 59 |
# Uploaded model
|
| 60 |
|
| 61 |
- **Developed by:** Pinkstack
|
|
|
|
| 55 |
Like any other LLM, users and hosters alike should be aware that AI language models may hallucinate and produce inaccurate, dangerous, or even completly nonsensical outputs, all the information the model provides may seem accurate, but please, for important tasks always double check responses with credible sources.
|
| 56 |
|
| 57 |
# Notices
|
| 58 |
+
This was the mergekit YAML config we used:
|
| 59 |
+
```yaml
|
| 60 |
+
base_model: meta-llama/Llama-3.2-3B-Instruct
|
| 61 |
+
merge_method: passthrough
|
| 62 |
+
slices:
|
| 63 |
+
- sources:
|
| 64 |
+
- model: meta-llama/Llama-3.2-3B-Instruct
|
| 65 |
+
layer_range: [0, 22] # Lower layers
|
| 66 |
+
- sources:
|
| 67 |
+
- model: huihui-ai/Llama-3.2-3B-Instruct-abliterated
|
| 68 |
+
layer_range: [6, 24] # Mid layers
|
| 69 |
+
- sources:
|
| 70 |
+
- model: Unsloth/Llama-3.2-3B-Instruct
|
| 71 |
+
layer_range: [12, 28] # Higher layers
|
| 72 |
+
tokenizer_source: unsloth/Llama-3.2-3B-Instruct
|
| 73 |
+
dtype: bfloat16
|
| 74 |
+
```
|
| 75 |
# Uploaded model
|
| 76 |
|
| 77 |
- **Developed by:** Pinkstack
|