ParasiticRogue commited on
Commit
5f42e95
·
verified ·
1 Parent(s): c788ee2

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +65 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/QwQ-32B
4
+ - EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
5
+ - arcee-ai/Virtuoso-Medium-v2
6
+ - ArliAI/QwQ-32B-ArliAI-RpR-v4
7
+ - trashpanda-org/QwQ-32B-Snowdrop-v0
8
+ license: apache-2.0
9
+ license_name: qwen
10
+ license_link: https://huggingface.co/Qwen/Qwen2.5-32B-Instruct/blob/main/LICENSE
11
+ language:
12
+ - en
13
+ pipeline_tag: text-generation
14
+ tags:
15
+ - chat
16
+ - merge
17
+ - roleplay
18
+ library_name: transformers
19
+ ---
20
+
21
+ # RareBit-v2-32B
22
+
23
+ Another big merge, similar in idea to RP-Stew. V2 here hasn't dropped a random Chinese character like V1 did, which might be because I regulated QwQ to only being used as the base model, instead of mixing it wholesale. Only other change was using v4 of ArliAI's model in the mix. I still need to do some more testing with it to see if it's fully ready to be shared in a broader sense, but so far it's been pretty good. I'll make a proper model page later this weakened, but this is what I've gathered from it so far:
24
+
25
+ **Pros:**
26
+ - Prose seem natural and creative.
27
+ - Hasn't made any big logical mistakes.
28
+ - Stays in-character and hasn't responded as user.
29
+ - Decent thinking capabilities.
30
+ - No refusals, even during the thinking stage.
31
+
32
+ **Cons:**
33
+ - None so far from testing, but I doubt it's perfect. I'm sure there's something I missed, so consider this pending full critique.
34
+
35
+ Big thanks to the original model creators for providing the ingredients!
36
+ - Qwen
37
+ - EVA-UNIT-01
38
+ - arcee-ai
39
+ - ArliAI
40
+ - trashpanda
41
+
42
+ ### Prompt Format: ChatML
43
+
44
+ ```
45
+ <|im_start|>system
46
+ System prompt<|im_end|>
47
+ <|im_start|>user
48
+ User prompt<|im_end|>
49
+ <|im_start|>assistant
50
+ Bot response<|im_end|>
51
+ ```
52
+
53
+ ### Models Merged
54
+
55
+ The following models were included in the merge:
56
+
57
+ https://huggingface.co/Qwen/QwQ-32B
58
+
59
+ https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
60
+
61
+ https://huggingface.co/arcee-ai/Virtuoso-Medium-v2
62
+
63
+ https://huggingface.co/ArliAI/QwQ-32B-ArliAI-RpR-v4
64
+
65
+ https://huggingface.co/trashpanda-org/QwQ-32B-Snowdrop-v0