---
library_name: pytorch
pipeline_tag: text-generation
tags:
  - pytorch
  - text-generation
  - homework
  - fineweb-edu
  - gsm8k
datasets:
  - HuggingFaceFW/fineweb-edu
  - openai/gsm8k
---

# RL-Homework

This is a homework model repo containing a base pretrained checkpoint and an additional supervised fine-tuned checkpoint.

## Files

- `model_base.pth`: base model checkpoint exported in the homework's LLaMA-like single-file format
- `model_sft.pth`: supervised fine-tuned checkpoint trained further on the GSM8K training set
- `params.json`: model architecture parameters for the homework loader

## Model Info

Architecture from `params.json`:

- dimension: 1024
- feed-forward dimension: 4096
- heads: 16
- layers: 8
- max sequence length: 1024
- vocabulary size: 50432

## Training Summary

### Base model

`model_base.pth` is the final FineWebEDU-pretrained checkpoint, exported in the homework loader format.

### SFT model

`model_sft.pth` starts from the same base model family and is additionally trained on the GSM8K training set for the homework's supervised fine-tuning stage.

## Intended Use

- homework reproduction
- educational experiments
- small-scale reasoning and RL homework pipelines

## Limitations

- these are homework checkpoints, not production models
- outputs may still be repetitive or incorrect
- GSM8K fine-tuning improves math-style behavior but does not guarantee reliable reasoning