221 MB

Ctrl+K

1 contributor

History: 2 commits

sergeymanevitch

tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG)

7e56b25 verified 1 day ago

.gitattributes

1.52 kB
initial commit 1 day ago
README.md

3.53 kB
tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
bpe.py

4.39 kB
tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
dpo-m4c.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
108 MB
xet

tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
draft-m5.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
5.13 MB
xet

tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
model.py

8.19 kB
tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
rag-corpus.txt

1.12 kB
tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
rag-m6.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
108 MB
xet

tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
rag.py

3.33 kB
tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
speculative.py

4 kB
tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago
tokenizer.json

69 kB
tiny-llm: 27M from-scratch pipeline (BPE, pretrain, SFT, DPO, draft, RAG) 1 day ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)