chronollm-2015 / README.md
fitleech's picture
Update weights (step 21711)
75f008c verified
|
Raw
History Blame Contribute Delete
416 Bytes
metadata
license: apache-2.0
tags:
  - text-generation
  - pytorch
  - chronological
  - year-2015

chronollm-2015

A 2B-parameter causal language model (PyTorch / safetensors), ChronoGPT-style GPT architecture.

Source checkpoint: jjjlimaus/chrono2014-finance2015-ft3.

{
  "model_type": "gpt",
  "vocab_size": 50304,
  "num_layers": 52,
  "num_heads": 12,
  "model_dim": 1536,
  "torch_dtype": "bfloat16"
}