File size: 3,150 Bytes
77ade84 509da2c 77ade84 509da2c 77ade84 3f7acbb 77ade84 509da2c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 | ---
tags:
- gguf
- llama.cpp
- vision-language-model
base_model:
- google/gemma-4-E2B-it
- prithivMLmods/gemma-4-E2B-it-Uncensored-MAX
pipeline_tag: any-to-any
---
# mythos : GGUF
This model was finetuned on the **Opus 4.7 dataset** (using ~40,000 high-quality samples) and converted to GGUF format.
**Credit**: Finetuned efficiently using [Unsloth](https://github.com/unslothai/unsloth).
**Example usage**:
- For text only LLMs: `llama-cli -hf Shadow0482/mythos --jinja`
- For multimodal models: `llama-mtmd-cli -hf Shadow0482/mythos --jinja`
## Available Model files:
- `gemma-4-E2B-it-Uncensored-MAX.Q5_K_M.gguf`
- `gemma-4-E2B-it-Uncensored-MAX.BF16-mmproj.gguf`
## Training Details
The model was fine-tuned on the **Opus 4.7 dataset** using approximately 40,000 samples. This dataset consists of high-quality instruction-response pairs (including advanced Chain-of-Thought reasoning traces, typically generated by Claude Opus 4.7 for superior reasoning and instruction-following capabilities).
### Detailed Training Steps:
1. **Dataset Preparation**:
- Acquired/gathered the Opus 4.7 dataset containing ~40,000 high-quality samples.
- Performed data cleaning, deduplication, and quality filtering to remove low-quality or redundant entries.
- Formatted all samples into the appropriate instruction-tuning/chat template (compatible with Gemma models, using system/user/assistant roles and multimodal support where applicable).
- Split the dataset into training and validation sets (typically 95/5 ratio).
2. **Environment Setup**:
- Set up a training environment with Hugging Face Transformers, TRL, PEFT, and the necessary GPU resources (multi-GPU setup with high VRAM).
- Loaded the base model in 4-bit quantization for memory efficiency during training.
3. **Model Configuration**:
- Applied LoRA (Low-Rank Adaptation) adapters for parameter-efficient fine-tuning on the base Gemma-4-E2B-it model.
- Configured the training pipeline for supervised fine-tuning (SFT), including proper handling of vision-language components (text + image projector).
4. **Training**:
- Ran supervised fine-tuning on the 40,000 prepared samples.
- Monitored training loss, validation metrics, and adjusted hyperparameters as needed (learning rate, batch size, number of epochs, warmup steps, LoRA rank/alpha, etc.).
- Completed the full training run to produce the fine-tuned "mythos" model while preserving the uncensored behavior of the base.
5. **Post-Training Processing**:
- Merged the LoRA adapters back into the base model weights.
- Saved the resulting fine-tuned model in Hugging Face format.
6. **GGUF Conversion & Quantization**:
- Converted the fine-tuned model to GGUF format using the official llama.cpp tools.
- Generated the main model file in Q5_K_M quantization (balanced quality/size).
- Converted the multimodal projector (mmproj) to `BF16-mmproj.gguf` format.
- Verified model integrity and basic functionality post-conversion.
This process produced a high-performance, uncensored vision-language model optimized for both text-only and multimodal inference with llama.cpp. |