Mistral 7b Self-Alignment SFT Model
The Mistral 7b Self-Alignment SFT Model is an adapter fine-tuned specifically for self-alignment and harmlessness. It has been trained using the Mistral Self-Alignment Preference Dataset, which can be accessed here.
The fine-tuning process is detailed on the corresponding GitHub page, providing insights into the methodology and purpose behind the model's adaptation.
Model Details:
- Base Model: Mistral 7b
- Fine-Tuning Purpose: Self-Alignment and Harmlessness
- Fine-Tuning Dataset: Mistral Self-Alignment Preference Dataset
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("August4293/mistral_self_alignment_SFT", dtype="auto")