Erudite-1.1b / README.md
Stormtrooperaim's picture
Update README.md
95a6ba9 verified
metadata
base_model:
  - unsloth/tinyllama
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - llama
license: apache-2.0
language:
  - en
datasets:
  - Stormtrooperaim/Erudite-200K-Cleaned

Unsuccesful finetuned model. Model outputs are very low quality

  • Erudite-1.1b is a 1.1 billion parameter language model fine-tuned from TinyLlama, optimized for enhanced response quality and superior instruction-following capabilities. Through careful dataset curation and fine-tuning, this compact model delivers improved coherence and accuracy while maintaining efficient performance suitable for resource-constrained environments.

image

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.