| | --- |
| | thumbnail: https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.3.0-24b/resolve/main/resources/pe.png |
| | license: apache-2.0 |
| | tags: |
| | - general-purpose |
| | - roleplay |
| | - storywriting |
| | - chemistry |
| | - biology |
| | - code |
| | - climate |
| | - axolotl |
| | - text-generation-inference |
| | - finetune |
| | - legal |
| | - medical |
| | - finance |
| | - mlx |
| | - mlx-my-repo |
| | datasets: |
| | - PocketDoc/Dans-Prosemaxx-RP |
| | - PocketDoc/Dans-Personamaxx-Logs-2 |
| | - PocketDoc/Dans-Personamaxx-VN |
| | - PocketDoc/Dans-Kinomaxx-VanillaBackrooms |
| | - PocketDoc/Dans-Prosemaxx-Gutenberg |
| | - PocketDoc/Dans-Prosemaxx-Cowriter-3-XL |
| | - PocketDoc/Dans-Prosemaxx-Adventure |
| | - PocketDoc/Dans-Failuremaxx-Adventure-3 |
| | - PocketDoc/Dans-Prosemaxx-InstructWriter-ZeroShot-2 |
| | - PocketDoc/Dans-Prosemaxx-InstructWriter-ZeroShot-3 |
| | - PocketDoc/Dans-Prosemaxx-InstructWriter-Continue-2 |
| | - PocketDoc/Dans-Prosemaxx-Instructwriter-Long |
| | - PocketDoc/Dans-Prosemaxx-RepRemover-1 |
| | - PocketDoc/Dans-MemoryCore-CoreCurriculum-Small |
| | - AquaV/US-Army-Survival-Sharegpt |
| | - AquaV/Multi-Environment-Operations-Sharegpt |
| | - AquaV/Resistance-Sharegpt |
| | - AquaV/Interrogation-Sharegpt |
| | - AquaV/Chemical-Biological-Safety-Applications-Sharegpt |
| | - AquaV/Energetic-Materials-Sharegpt |
| | - PocketDoc/Dans-Mathmaxx |
| | - PJMixers/Math-Multiturn-1K-ShareGPT |
| | - PocketDoc/Dans-Taskmaxx |
| | - PocketDoc/Dans-Taskmaxx-DataPrepper |
| | - PocketDoc/Dans-Taskmaxx-ConcurrentQA-Reworked |
| | - PocketDoc/Dans-Taskmaxx-TableGPT |
| | - PocketDoc/Dans-Taskmaxx-SciRIFF |
| | - PocketDoc/Dans-Taskmaxx-Edit |
| | - PocketDoc/Dans-Toolmaxx-Agent |
| | - PocketDoc/Dans-Toolmaxx-ShellCommands |
| | - PocketDoc/Dans-Toolmaxx-Functions-Toolbench |
| | - PocketDoc/Dans-Toolmaxx-Functions-ToolACE |
| | - PocketDoc/Dans-Toolmaxx-Functions-apigen-subset |
| | - PocketDoc/Dans-Assistantmaxx-OpenAssistant2 |
| | - PocketDoc/Dans-Assistantmaxx-Opus-Merge-2 |
| | - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset |
| | - PocketDoc/Dans-Assistantmaxx-sonnetorca-subset-2 |
| | - PocketDoc/Dans-Assistantmaxx-Synthia |
| | - PocketDoc/Dans-Assistantmaxx-ASL |
| | - PocketDoc/Dans-Assistantmaxx-PersonaLLM-Opus |
| | - PocketDoc/Dans-Assistantmaxx-LongAlign |
| | - PocketDoc/Dans-Assistantmaxx-OpenLeecher-Instruct |
| | - PocketDoc/Dans-Assistantmaxx-Tulu3-IF |
| | - PocketDoc/Dans-Systemmaxx |
| | - PocketDoc/Dans-Logicmaxx-SAT-AP |
| | - PJMixers/grimulkan_theory-of-mind-ShareGPT |
| | - PJMixers/grimulkan_physical-reasoning-ShareGPT |
| | - PocketDoc/Dans-Reasoningmaxx-NaturalReasoning |
| | - PocketDoc/Dans-Reasoningmaxx-WebInstruct |
| | - PocketDoc/Dans-Reasoningmaxx-GeneralReasoning |
| | - PocketDoc/Dans-Assistantmaxx-ClosedInstruct |
| | language: |
| | - en |
| | - ar |
| | - de |
| | - fr |
| | - es |
| | - hi |
| | - pt |
| | - ja |
| | - ko |
| | base_model: PocketDoc/Dans-PersonalityEngine-V1.3.0-24b |
| | pipeline_tag: text-generation |
| | library_name: transformers |
| | --- |
| | |
| | # aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-4Bit |
| |
|
| | The Model [aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-4Bit](https://huggingface.co/aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-4Bit) was converted to MLX format from [PocketDoc/Dans-PersonalityEngine-V1.3.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.3.0-24b) using mlx-lm version **0.22.3**. |
| |
|
| | ## Use with mlx |
| |
|
| | ```bash |
| | pip install mlx-lm |
| | ``` |
| |
|
| | ```python |
| | from mlx_lm import load, generate |
| | |
| | model, tokenizer = load("aimeri/Dans-PersonalityEngine-V1.3.0-24b-mlx-4Bit") |
| | |
| | prompt="hello" |
| | |
| | if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None: |
| | messages = [{"role": "user", "content": prompt}] |
| | prompt = tokenizer.apply_chat_template( |
| | messages, tokenize=False, add_generation_prompt=True |
| | ) |
| | |
| | response = generate(model, tokenizer, prompt=prompt, verbose=True) |
| | ``` |
| |
|
