hgrrg commited on
Commit
6bb2686
·
verified ·
1 Parent(s): cf060c5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -1
README.md CHANGED
@@ -2,4 +2,25 @@
2
  tags:
3
  - moe
4
  ---
5
- do not download
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  tags:
3
  - moe
4
  ---
5
+
6
+ ![mlem](https://cdn-uploads.huggingface.co/production/uploads/686e3bfc42698961ad2b7ea3/EbXMHh1sA3KVR4nnccQ9J.gif)
7
+
8
+ Wanna some meos ? Run this
9
+
10
+ ```
11
+ python
12
+ from transformers import AutoTokenizer, AutoModelForCausalLM
13
+ import torch
14
+
15
+ state_dict = torch.load("./meomeo/pytorch_model.bin", weights_only=False, map_location="cpu")
16
+
17
+ # Load from local folder
18
+ tokenizer = AutoTokenizer.from_pretrained("./meomeo", local_files_only=True)
19
+ model = AutoModelForCausalLM.from_pretrained("./meomeo", local_files_only=True)
20
+
21
+ # Simple inference
22
+ text = "Once upon a time,"
23
+ inputs = tokenizer(text, return_tensors="pt")
24
+ outputs = model.generate(**inputs, max_length=50)
25
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
26
+ ```