DSDUDEd commited on
Commit
ae427a0
·
verified ·
1 Parent(s): 9bc344c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -19
README.md CHANGED
@@ -1,25 +1,23 @@
1
- ---
2
- license: mit
3
- library_name: transformers
4
- tags: [custom, transformer, scratch, chatbot]
5
- language: en
6
- ---
7
 
8
- # Dave
 
9
 
10
- **A fully custom AI trained from scratch.**
 
 
 
 
11
 
12
- Dave is a 100% custom-built transformer AI, trained entirely from scratch without pretrained models.
13
- It has 3,000 generated prompts and responses.
14
 
15
- ## Usage
16
  ```python
17
- from transformers import PreTrainedTokenizerFast
18
- import torch
19
- from your_model_file import SimpleTransformer
20
 
21
- tokenizer = PreTrainedTokenizerFast(tokenizer_file='./dave/tokenizer.json')
22
- model = SimpleTransformer(vocab_size=5000, d_model=128, nhead=4, num_layers=4)
23
- model.load_state_dict(torch.load('./dave/pytorch_model.bin'))
24
- model.eval()
25
- ```
 
 
 
1
+ # Dave – Fully Custom AI Model
 
 
 
 
 
2
 
3
+ **Model type:** Fully Custom Transformer from Scratch
4
+ **Purpose:** Conversational AI with a unique personality: fun, smart, coding-savvy, sometimes sad or depressed, talks about drugs and alcohol, lost his wife, happy about his kid, sometimes cringe, close friends, swears often.
5
 
6
+ **Training:**
7
+ - 3000 generated prompts and responses
8
+ - Custom tokenizer and transformer trained from scratch
9
+ - Trained entirely in Google Colab
10
+ - Saved as `pytorch_model.bin`, `config.json`, `tokenizer.json`
11
 
12
+ **Example usage:**
 
13
 
 
14
  ```python
15
+ from transformers import AutoTokenizer, AutoModelForCausalLM
 
 
16
 
17
+ tokenizer = AutoTokenizer.from_pretrained("DSDUDEd/Dave")
18
+ model = AutoModelForCausalLM.from_pretrained("DSDUDEd/Dave")
19
+
20
+ prompt = "Write a Python function to reverse a string."
21
+ inputs = tokenizer(prompt, return_tensors="pt")
22
+ outputs = model.generate(**inputs, max_new_tokens=64)
23
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))