Pinkstack commited on
Commit
9002233
·
verified ·
1 Parent(s): 2e876b2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -55,7 +55,23 @@ This model is not uncensored, yet it may produce erotic outputs. You are solely
55
  Like any other LLM, users and hosters alike should be aware that AI language models may hallucinate and produce inaccurate, dangerous, or even completly nonsensical outputs, all the information the model provides may seem accurate, but please, for important tasks always double check responses with credible sources.
56
 
57
  # Notices
58
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
59
  # Uploaded model
60
 
61
  - **Developed by:** Pinkstack
 
55
  Like any other LLM, users and hosters alike should be aware that AI language models may hallucinate and produce inaccurate, dangerous, or even completly nonsensical outputs, all the information the model provides may seem accurate, but please, for important tasks always double check responses with credible sources.
56
 
57
  # Notices
58
+ This was the mergekit YAML config we used:
59
+ ```yaml
60
+ base_model: meta-llama/Llama-3.2-3B-Instruct
61
+ merge_method: passthrough
62
+ slices:
63
+ - sources:
64
+ - model: meta-llama/Llama-3.2-3B-Instruct
65
+ layer_range: [0, 22] # Lower layers
66
+ - sources:
67
+ - model: huihui-ai/Llama-3.2-3B-Instruct-abliterated
68
+ layer_range: [6, 24] # Mid layers
69
+ - sources:
70
+ - model: Unsloth/Llama-3.2-3B-Instruct
71
+ layer_range: [12, 28] # Higher layers
72
+ tokenizer_source: unsloth/Llama-3.2-3B-Instruct
73
+ dtype: bfloat16
74
+ ```
75
  # Uploaded model
76
 
77
  - **Developed by:** Pinkstack