aimeri commited on
Commit
d2869cd
·
verified ·
1 Parent(s): 00971d8

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +111 -0
README.md ADDED
@@ -0,0 +1,111 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ thumbnail: https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.3.0-24b/resolve/main/resources/pe.png
3
+ license: apache-2.0
4
+ tags:
5
+ - general-purpose
6
+ - roleplay
7
+ - storywriting
8
+ - chemistry
9
+ - biology
10
+ - code
11
+ - climate
12
+ - axolotl
13
+ - text-generation-inference
14
+ - finetune
15
+ - legal
16
+ - medical
17
+ - finance
18
+ - mlx
19
+ - mlx-my-repo
20
+ datasets:
21
+ - PocketDoc/Dans-Prosemaxx-RP
22
+ - PocketDoc/Dans-Personamaxx-Logs-2
23
+ - PocketDoc/Dans-Personamaxx-VN
24
+ - PocketDoc/Dans-Kinomaxx-VanillaBackrooms
25
+ - PocketDoc/Dans-Prosemaxx-Gutenberg
26
+ - PocketDoc/Dans-Prosemaxx-Cowriter-3-XL
27
+ - PocketDoc/Dans-Prosemaxx-Adventure
28
+ - PocketDoc/Dans-Failuremaxx-Adventure-3
29
+ - PocketDoc/Dans-Prosemaxx-InstructWriter-ZeroShot-2
30
+ - PocketDoc/Dans-Prosemaxx-InstructWriter-ZeroShot-3
31
+ - PocketDoc/Dans-Prosemaxx-InstructWriter-Continue-2
32
+ - PocketDoc/Dans-Prosemaxx-Instructwriter-Long
33
+ - PocketDoc/Dans-Prosemaxx-RepRemover-1
34
+ - PocketDoc/Dans-MemoryCore-CoreCurriculum-Small
35
+ - AquaV/US-Army-Survival-Sharegpt
36
+ - AquaV/Multi-Environment-Operations-Sharegpt
37
+ - AquaV/Resistance-Sharegpt
38
+ - AquaV/Interrogation-Sharegpt
39
+ - AquaV/Chemical-Biological-Safety-Applications-Sharegpt
40
+ - AquaV/Energetic-Materials-Sharegpt
41
+ - PocketDoc/Dans-Mathmaxx
42
+ - PJMixers/Math-Multiturn-1K-ShareGPT
43
+ - PocketDoc/Dans-Taskmaxx
44
+ - PocketDoc/Dans-Taskmaxx-DataPrepper
45
+ - PocketDoc/Dans-Taskmaxx-ConcurrentQA-Reworked
46
+ - PocketDoc/Dans-Taskmaxx-TableGPT
47
+ - PocketDoc/Dans-Taskmaxx-SciRIFF
48
+ - PocketDoc/Dans-Taskmaxx-Edit
49
+ - PocketDoc/Dans-Toolmaxx-Agent
50
+ - PocketDoc/Dans-Toolmaxx-ShellCommands
51
+ - PocketDoc/Dans-Toolmaxx-Functions-Toolbench
52
+ - PocketDoc/Dans-Toolmaxx-Functions-ToolACE
53
+ - PocketDoc/Dans-Toolmaxx-Functions-apigen-subset
54
+ - PocketDoc/Dans-Assistantmaxx-OpenAssistant2
55
+ - PocketDoc/Dans-Assistantmaxx-Opus-Merge-2
56
+ - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset
57
+ - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset-2
58
+ - PocketDoc/Dans-Assistantmaxx-Synthia
59
+ - PocketDoc/Dans-Assistantmaxx-ASL
60
+ - PocketDoc/Dans-Assistantmaxx-PersonaLLM-Opus
61
+ - PocketDoc/Dans-Assistantmaxx-LongAlign
62
+ - PocketDoc/Dans-Assistantmaxx-OpenLeecher-Instruct
63
+ - PocketDoc/Dans-Assistantmaxx-Tulu3-IF
64
+ - PocketDoc/Dans-Systemmaxx
65
+ - PocketDoc/Dans-Logicmaxx-SAT-AP
66
+ - PJMixers/grimulkan_theory-of-mind-ShareGPT
67
+ - PJMixers/grimulkan_physical-reasoning-ShareGPT
68
+ - PocketDoc/Dans-Reasoningmaxx-NaturalReasoning
69
+ - PocketDoc/Dans-Reasoningmaxx-WebInstruct
70
+ - PocketDoc/Dans-Reasoningmaxx-GeneralReasoning
71
+ - PocketDoc/Dans-Assistantmaxx-ClosedInstruct
72
+ language:
73
+ - en
74
+ - ar
75
+ - de
76
+ - fr
77
+ - es
78
+ - hi
79
+ - pt
80
+ - ja
81
+ - ko
82
+ base_model: PocketDoc/Dans-PersonalityEngine-V1.3.0-24b
83
+ pipeline_tag: text-generation
84
+ library_name: transformers
85
+ ---
86
+
87
+ # aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-6Bit
88
+
89
+ The Model [aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-6Bit](https://huggingface.co/aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-6Bit) was converted to MLX format from [PocketDoc/Dans-PersonalityEngine-V1.3.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.3.0-24b) using mlx-lm version **0.26.4**.
90
+
91
+ ## Use with mlx
92
+
93
+ ```bash
94
+ pip install mlx-lm
95
+ ```
96
+
97
+ ```python
98
+ from mlx_lm import load, generate
99
+
100
+ model, tokenizer = load("aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-6Bit")
101
+
102
+ prompt="hello"
103
+
104
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
105
+ messages = [{"role": "user", "content": prompt}]
106
+ prompt = tokenizer.apply_chat_template(
107
+ messages, tokenize=False, add_generation_prompt=True
108
+ )
109
+
110
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
111
+ ```