DatedGPT-2024-Instruct

DatedGPT is a family of point-in-time language models: each vintage is trained only on data available up to its cutoff date, making it suitable for lookahead-bias-free prediction and point-in-time analysis.

This is the instruction-tuned chat model with data up to 2024. For the base (pretrained) model, see datedgpt/datedgpt-2024-base.

Property	Value
Architecture	LlamaForCausalLM
Parameters	~1.3 B
Context length	2048
Vocab	32,000 (SentencePiece)
Precision	bfloat16
Data vintage	2024

Chat template

The Llama-2-style chat template ships in chat_template.jinja. Apply it with the tokenizer. The template includes BOS/EOS tokens, so use add_special_tokens=False when tokenizing the rendered prompt.

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM

repo_id = "datedgpt/datedgpt-2024-instruct"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(repo_id, torch_dtype=torch.bfloat16, device_map="auto")

prompt = tokenizer.apply_chat_template(
    [{"role": "user", "content": "What is the capital of France?"}],
    tokenize=False,
)
inputs = tokenizer(prompt, return_tensors="pt", add_special_tokens=False).to(model.device)
output = model.generate(**inputs, max_new_tokens=128, do_sample=True,
                        temperature=0.7, top_p=0.95, use_cache=True,
                        eos_token_id=tokenizer.eos_token_id,
                        pad_token_id=tokenizer.eos_token_id)
print(tokenizer.decode(output[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True))

Limitations

• Knowledge limited to the 2024 data vintage.
• No RLHF or safety tuning; outputs can be confidently wrong.

Checkpoint update (2026-10-14)

This checkpoint uses the updated SFT hyperparameters with the same training data. The FP32 checkpoint was converted to BF16; saved tensors were verified against the expected BF16 casts. Loading and a short generation test passed with vLLM 0.27.1. This is a functional smoke test, not a quality benchmark. See training_recipe.json for the training configuration.