Test-Model / README.md
juuwel's picture
Upload README.md with huggingface_hub
9ce91f2 verified
|
raw
history blame
559 Bytes

Test-Model

This model is a fine-tuned version of llama, and is specialized for document classification. It achieves the following results on the evaluation set:

  • Accuracy: ACCURACY
  • Hit rate: HIT RATE

Training Parameters

  • Epochs: 5
  • Batch Size: 20
  • Threshold: 0.975
  • Token Length: 512
  • Data Set Size: 10000
  • Evenly Distributed: True
  • Municipalities: Heroey, Kongsberg, Boemlo, Luster, Maalselv
  • Learning Rate: 0.0001
  • Weight Decay: 0.01
  • Eval Accumulation Steps: 4