deepcode-ai-5m commited on
Commit
a225e9c
·
verified ·
1 Parent(s): c9f415d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -14
README.md CHANGED
@@ -11,22 +11,21 @@ tags:
11
 
12
  # DeepCode-Rust-2M
13
 
14
- This is a lightweight, custom language model built entirely from scratch in **Rust**. It does not rely on Python, PyTorch, or standard Hugging Face `transformers` libraries. The entire forward pass, backpropagation, and Adam optimizer are implemented in pure Rust.
15
 
16
  ## Model Details
17
- * **Parameters:** ~2 Million (2,000,000)
18
  * **Architecture:** Decoder-only Transformer (6 layers, 256 embedding dim)
19
- * **Language:** Rust (trained on a multilingual dataset)
20
- * **Format:** Serialized via `bincode` (requires the custom Rust inference engine to run)
21
- * **Capabilities:** Generates basic Python functions and simple HTML structures.
22
 
23
- ## Limitations
24
- Due to its extremely small size (2M parameters), the model can sometimes hallucinate, lose track of syntax, or fail on complex prompts. It is an educational project demonstrating how language models work under the hood.
25
-
26
- ## How to Use
27
- Because this is a custom Rust implementation, you cannot load it using `AutoModel.from_pretrained()`.
28
- To run this model, you need the Rust source code and the `model.bin` file.
 
 
29
 
30
- ```bash
31
- # Clone the repo (example)
32
- cargo run --release
 
11
 
12
  # DeepCode-Rust-2M
13
 
14
+ This is a lightweight, custom language model built entirely from scratch in **Rust**. It does not rely on Python, PyTorch, or standard Hugging Face `transformers` libraries.
15
 
16
  ## Model Details
17
+ * **Parameters:** ~2 Million
18
  * **Architecture:** Decoder-only Transformer (6 layers, 256 embedding dim)
19
+ * **Format:** Serialized via `bincode` (requires the custom Rust inference engine)
 
 
20
 
21
+ ## Benchmark Results (Napkin Benchmark)
22
+ Tested on 6 basic prompts:
23
+ * **Python Addition:** 4/5 (Successfully generated `def add(a, b): return a + b`)
24
+ * **Python Multiplication:** 2/5 (Recognized `multiply`, but broken syntax)
25
+ * **Python Loop:** 0/5 (Stuck in a repetition loop)
26
+ * **HTML Structure:** 1/5 (Recognized tags, but no hierarchical structure)
27
+ * **HTML Button:** 1/5
28
+ * **Overall Score:** ~2 out of 5
29
 
30
+ ## Limitations
31
+ Due to its extremely small size, the model often suffers from repetition loops and fails to understand nested structures (like HTML trees). It is an educational project demonstrating how language models work under the hood.