File size: 2,603 Bytes
f9aa21b 1283d8a f9aa21b 1283d8a f9aa21b 23dd5f8 f9aa21b 179a749 f9aa21b 1283d8a f9aa21b 1283d8a f9aa21b 1283d8a f9aa21b 1283d8a f9aa21b 1283d8a f9aa21b f9998b5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 |
---
license: apache-2.0
tags:
- unsloth
- Uncensored
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- roleplay
- conversational
datasets:
- openerotica/mixed-rp
- kingbri/PIPPA-shareGPT
language:
- en
base_model:
- N-Bot-Int/OpenRP3B-Llama3.2
new_version: N-Bot-Int/OpenElla3-Llama3.2B
pipeline_tag: text-generation
library_name: peft
---
<a href="https://ibb.co/FbZyWMB7"><img src="https://raw.githubusercontent.com/ItsMeDevRoland/NexusBotWorkInteractives/refs/heads/main/image.webp" alt="image-1" border="0"></a>
# Llama3.2 - OpenElla3A
- OpenElla, is a Llama3.2 **3B** Parameter Model,
That is fine-tuned for Roleplaying purposes, even if it only have a limited Parameters.
This is achieved through Series of Dataset Finetuning, using 2 Dataset with different
Weight, Aiming to Counter Llama3.2's Generalist Approach and focusing On Specializing with
Roleplaying and Acting.
- OpenElla3A Excells in Outputting **RAW** and **UNCENSORED** Output
However **LACKS THE PROPER TRAINING FOR OBIDIENCE**, Due to this, OpenElla3 Model **A**
Are Only Used for Training purposes, if you seek to train or Distill A Llama Model to
Force it to generate Uncensored Content then please do so with care and ethical considerations
- OpenElla3B is
- **Developed by:** N-Bot-Int
- **License:** apache-2.0
- **Parent Model from model:** unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit
- **Sequential Trained from Model:** N-Bot-Int/OpenElla3-Llama3.2A
- **Dataset Combined Using:** Mosher-R1(Propietary Software)
- OpenElla3B Is **NOT YET RANKED WITH ANY METRICS**
- Feel free to support by Emailing me: <link src="mailto:nexus.networkinteractives@gmail.com">nexus.networkinteractives@gmail.com</link>
- # Notice
- **For a Good Experience, Please use**
- Low temperature 1.5, min_p = 0.1 and max_new_tokens = 128
- # Detail card:
- Parameter
- 3 Billion Parameters
- (Please visit your GPU Vendor if you can Run 3B models)
- Training
- 500 steps
- Mixed-RP Startup Dataset
- 200 steps
- PIPPA-ShareGPT for Increased Roleplaying capabilities
- 150 steps(Re-fining)
- PIPPA-ShareGPT to further increase weight of PIPPA and to override the noises
- Finetuning tool:
- Unsloth AI
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
- Fine-tuned Using:
- Google Colab |