---
license: apache-2.0
tags:
- text-generation
- transformers
- russian
- llm
- from-scratch
- pytorch
---

# Blind - LLMs, trained from scratch

**A series of models from 1 to 3B parameters**, created entirely from scratch and trained on Russian-language data.

A project for enthusiasts, students, and developers who want to experiment with LLMs without a huge investment.

---

## Models

| File | Size | Parameters |
|------|----------|----------|
| `blind_one_param_model.pt` | 3 KB | 1 |
| `blind-0-ultrasmall.pt` | 173 MB | ~50M |
| `blind-0-small.pt` | 356 MB | ~85M |
| `blind-0-medium.pt` | 407 MB | ~100M |
| `blind-0-large.pt` | 445 MB | ~110M |
| `blind-1.pt` | 1 GB | ~740M |
| `blind-1.1.pt` | 1 GB | ~750M |
| `blind-1.5.pt` | 6 GB | ~3B |