README.md

metadata

title: Mistral Nemo Alpaca Finetune Demo
emoji: 🚀
colorFrom: purple
colorTo: purple
sdk: gradio
sdk_version: 6.26.0
app_file: app.py
pinned: false
hardware: t4-medium
license: apache-2.0

Mistral Nemo Alpaca Finetune Demo

This Space provides an interactive chat demo for the TensorVizion/mistral-nemo-alpaca-finetune model.

Model Details

• Base Model: Mistral Nemo (12B)
• Finetuned by: TensorVizion
• Training: Fine-tuned 2x faster with Unsloth and Hugging Face's TRL library on Alpaca-style instructions.
• Precision: Loaded in 4-bit quantization (NF4) for efficient inference on consumer-grade GPUs.

Hardware Requirements

This Space is configured to run on a t4-medium GPU (16GB VRAM). The 4-bit quantization ensures the 12B parameter model fits comfortably within this memory limit (~8GB VRAM usage). If you experience out-of-memory errors or want faster generation, consider upgrading to an a10g-small hardware tier in the Space settings.