ANLP Assignment 3 Models: ALL

Model checkpoints and assets for ANLP Assignment 3 (ALL).

Checkpoint Architecture

  • Formulation: Decoder-Only Prefix-LM mapping cipher inputs to plain characters.
  • Architecture: Decoder-Only Transformer (RMSNorm, RoPE, GQA) & Mamba SSM.
  • Tokenization: Character-level tokenizer with fixed 86-token alphabet.

Uploaded Assets

Synchronization & Usage

Download these checkpoints locally using the provided script:

python3 scripts/sync_models.py download --part all

Or using the shell script:

bash scripts/sync_models.sh download --part all

Python Loading Example

import torch
from src.models.transformer import DecoderOnlyTransformer

ckpt = torch.load('models/all/transformer/best_model.pt', map_location='cpu')
config = ckpt['config']
model = DecoderOnlyTransformer(**{k: v for k, v in config.items() if k not in ('model_type', 'gradient_checkpointing')})
model.load_state_dict(ckpt['model_state_dict'])
model.eval()
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support