aitetic
/

gpt-r-0.3b-base

Model card Files Files and versions

Model.size = 302M

Pre-trained model.

SEQUENCE_LENGTH = 1024
LEARNING_RATE = 8e-5
total_batch_size = 524288
B = 16 # micro batch size
Epoch = 1
Steps = 9050

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for aitetic/gpt-r-0.3b-base

Base model

aitetic/gpt-r-0.3b-warmup

Finetuned

(1)

this model

Finetunes

Dataset used to train aitetic/gpt-r-0.3b-base