RichardErkhov commited on
Commit
c4d24c3
·
verified ·
1 Parent(s): dc422ae

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Quantization made by Richard Erkhov.
2
+
3
+ [Github](https://github.com/RichardErkhov)
4
+
5
+ [Discord](https://discord.gg/pvy7H8DZMG)
6
+
7
+ [Request more models](https://github.com/RichardErkhov/quant_request)
8
+
9
+
10
+ llama-2-tiny-random - bnb 4bits
11
+ - Model creator: https://huggingface.co/yujiepan/
12
+ - Original model: https://huggingface.co/yujiepan/llama-2-tiny-random/
13
+
14
+
15
+
16
+
17
+ Original model description:
18
+ ---
19
+ library_name: transformers
20
+ pipeline_tag: text-generation
21
+ inference: true
22
+ widget:
23
+ - text: Hello!
24
+ example_title: Hello world
25
+ group: Python
26
+ ---
27
+
28
+ # yujiepan/llama-2-tiny-random
29
+
30
+ This model is **randomly initialized**, using the config from [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/yujiepan/llama-2-tiny-random/blob/main/config.json) but with the following modifications:
31
+
32
+ ```json
33
+ {
34
+ "hidden_size": 8,
35
+ "intermediate_size": 32,
36
+ "num_attention_heads": 2,
37
+ "num_hidden_layers": 1,
38
+ "num_key_value_heads": 2,
39
+ }
40
+
41
+ ```
42
+