metadata
library_name: transformers
tags:
- generated_from_trainer
datasets:
- roneneldan/TinyStories
metrics:
- accuracy
model-index:
- name: 01_moedl_dense-0119
results:
- task:
name: Causal Language Modeling
type: text-generation
dataset:
name: roneneldan/TinyStories
type: roneneldan/TinyStories
metrics:
- name: Accuracy
type: accuracy
value: 0.6932485809263506
01_moedl_dense-0119
This model is a dense (Moedl) pretrained with roneneldan/TinyStories dataset.
- Eval Loss: 1.1112
- Accuracy: 0.6932
- Num Input Tokens Seen: 1027671040
- wandb log