Training detail

  • Training hardware: 2 AMD MI200
  • Batch size: 64
  • Samples per query: 512 (32 * 2 * 8)
  • Data: msmarco-passage 491K
  • Learning steps: 25K with 2.5K warm-up
  • Learning rate: 1e-5
Downloads last month
-
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support