Naphula commited on
Commit
6e7eb09
·
verified ·
1 Parent(s): 9bff1b9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -1
README.md CHANGED
@@ -51,4 +51,34 @@ widget:
51
 
52
  # Soulblighter 24B v1
53
 
54
- ![Soulblighter](https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/ld5W0rJIPnW792SafO6zA.png)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
51
 
52
  # Soulblighter 24B v1
53
 
54
+ ![Soulblighter](https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/ld5W0rJIPnW792SafO6zA.png)
55
+
56
+ This is a creative merge made using the `karcher` method. It has some refusals but should be easy to ablate or jailbreak if needed.
57
+
58
+ Similar to the StormSeeker merge, except this also blends Magistral finetunes. You can probably enable "reasoning mode" (untested).
59
+
60
+ Impish Magic had to be excluded due to various issues (tokenizers, vocab_size, etc.) so Allura's Angel was added in place.
61
+
62
+ ```
63
+ architecture: MistralForCausalLM
64
+ merge_method: karcher
65
+ models:
66
+ - model: B:\hub\!BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly # Q0F Pass
67
+ - model: B:\hub\!models--aixonlab--Eurydice-24b-v3.5 # Q0F Pass
68
+ - model: B:\hub\!models--allura-forge--ms32-final-TEXTONLY # Q0F Pass
69
+ - model: B:\hub\!models--CrucibleLab--M3.2-24B-Loki-V2 # Q0F Pass
70
+ - model: B:\hub\!models--LatitudeGames--Hearthfire-24B # Q0F Pass
71
+ - model: B:\hub\!models--PocketDoc--Dans-PersonalityEngine-V1.3.0-24b # Q0F Fail
72
+ - model: B:\hub\!models--ReadyArt--Dark-Nexus-24B-v2.0 # Q0F Pass
73
+ # - model: B:\hub\!models--SicariusSicariiStuff--Impish_Magic_24B\fixed # Q0F Pass
74
+ - model: B:\hub\!models--TheDrummer--Precog-24B-v1 # Q0F Pass
75
+ - model: B:\hub\!models--trashpanda-org--MS3.2-24B-Mullein-v2 # Q0F Fail (but still impressive)
76
+ - model: B:\hub\!models--zerofata--MS3.2-PaintedFantasy-v3-24B # Q0F Fail # v2 pass # v1 fail
77
+ dtype: float32
78
+ out_dtype: bfloat16
79
+ parameters:
80
+ tokenizer:
81
+ source: union
82
+ chat_template: auto
83
+ name: Soulblighter-24B-v1
84
+ ```