File size: 2,435 Bytes
6524139
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
---
library_name: pytorch
license: mit
tags:
  - pytorch
  - mamba
  - deltanet
  - transformer
  - graph-neural-network
  - cipher
---

# ANLP Assignment 3 checkpoints

Checkpoints for both parts of ANLP Assignment 3 (IIIT Hyderabad, 2026). All models are implemented from scratch in PyTorch. Each file holds the model weights and the full training config, and is loaded by the assignment's code.

## Part 1: cipher decryption

Character-level models that decrypt a position- and context-dependent substitution cipher. The input at step `i` is `embed(p_{i-1}) + embed(c_i)` plus a sinusoidal encoding of the position in the line, and decoding is greedy. Each checkpoint is the best validation-loss checkpoint (step 50,000) of a 50k-step run with a mixed length curriculum.

| File | Model | Parameters | Char acc | Word acc | Norm. Levenshtein | Exact lines |
|---|---|---|---|---|---|---|
| `hybrid/best.pt` (default) | Interleaved `MMDMMDMMDMMD` Mamba / DeltaNet | 6.98M | 9.60% | 3.44% | 0.3783 | 535 / 1318 |
| `transformer/best.pt` | Decoder-only transformer, 8 layers, d 256 | 8.44M | 9.87% | 3.19% | 0.3757 | 529 / 1318 |
| `mamba/best.pt` | Mamba, 16 layers, d 256, d_state 16 | 7.06M | 9.71% | 3.52% | 0.3755 | 524 / 1318 |
| `deltanet/best.pt` | DeltaNet, 8 layers, 4 heads, β ∈ (0, 1) | 6.90M | 9.76% | 3.43% | 0.3755 | 525 / 1318 |

Test-set results (1,318 lines).

```bash
bash scripts/part1/test_assn.sh --heldout
bash scripts/part1/test_assn.sh --heldout --model transformer
```

## Part 2: fake news detection on UPFD GossipCop

Graph classifiers on news propagation trees. Files are `part2/{model}_{feature}_s{seed}.pt` for seeds 0–4, each the best validation-F1 epoch of a 100-epoch run.

| Model | Features | Parameters | Test F1 (mean ± std, 5 seeds) |
|---|---|---|---|
| Root-only MLP | bert | 115,202 | 0.7286 ± 0.0031 |
| GCN | bert | 246,530 | 0.9693 ± 0.0022 |
| GraphSAGE | bert | 361,218 | 0.9637 ± 0.0023 |
| GAT | bert | 247,042 | 0.9670 ± 0.0024 |
| Bi-GCN | bert | 492,418 | 0.9570 ± 0.0012 |
| GraphSAGE | profile | 70,146 | 0.9628 ± 0.0014 |
| GraphSAGE | spacy | 181,506 | 0.9621 ± 0.0019 |
| GraphSAGE | content | 185,346 | 0.9737 ± 0.0026 |

```bash
bash scripts/part2/test_gnn.sh --ta
```

## Training logs

WandB: [Part 1](https://forge.coreweave.com/wandb/winterdew-iiit-hyderabad/anlp-a3-part1), [Part 2](https://forge.coreweave.com/wandb/winterdew-iiit-hyderabad/anlp-a3-part2)