PaulQ1 commited on
Commit
9cc39bf
·
verified ·
1 Parent(s): 0af98fe

Add root config.json to enable Hub download tracking; document it in README

Browse files
Files changed (2) hide show
  1. README.md +1 -0
  2. config.json +15 -0
README.md CHANGED
@@ -41,6 +41,7 @@ time-series encoder onto a pretrained LLM.
41
  | `stage-2/` | **Stage 2** | Stage 1 + a short alignment stage that interleaves the two modalities (best multimodal results); context extended to 4096. `model.safetensors` + `config.json` |
42
  | `tokenizer/` | — | 131k-vocabulary BPE tokenizer (trained from scratch) |
43
  | `model.py` · `tokenizer.py` | — | Minimal inference implementation (`Chronicle`, `ChronicleConfig`, `ChronicleTokenizer`) |
 
44
 
45
  ## Architecture
46
 
 
41
  | `stage-2/` | **Stage 2** | Stage 1 + a short alignment stage that interleaves the two modalities (best multimodal results); context extended to 4096. `model.safetensors` + `config.json` |
42
  | `tokenizer/` | — | 131k-vocabulary BPE tokenizer (trained from scratch) |
43
  | `model.py` · `tokenizer.py` | — | Minimal inference implementation (`Chronicle`, `ChronicleConfig`, `ChronicleTokenizer`) |
44
+ | `config.json` | — | Repo-level model metadata (mirrors the stage-2 architecture); the per-stage `config.json` files remain authoritative for loading |
45
 
46
  ## Architecture
47
 
config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "chronicle",
3
+ "architectures": ["Chronicle"],
4
+ "checkpoints": ["stage-1", "stage-2"],
5
+ "default_checkpoint": "stage-2",
6
+ "sequence_len": 4096,
7
+ "vocab_size": 131072,
8
+ "n_layer": 16,
9
+ "n_head": 8,
10
+ "n_kv_head": 4,
11
+ "n_embd": 1024,
12
+ "patch_len": 32,
13
+ "num_quantiles": 21,
14
+ "torch_dtype": "bfloat16"
15
+ }