Trouter-Library commited on
Commit
2d56d40
·
verified ·
1 Parent(s): 882c823

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -9
README.md CHANGED
@@ -1,18 +1,51 @@
1
  # Kat-Gen1
2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ## Model Card
4
 
5
  | Attribute | Value |
6
  |-----------|-------|
7
- | Model Type | Causal Language Model |
8
- | Architecture | GPT-NeoX |
9
- | Parameters | ~1.3B |
10
- | Training Data | General domain text corpus |
11
- | Context Length | 2048 tokens |
12
- | License | Apache 2.0 |
13
- | Language | English |
14
- | Precision | FP16/FP32 |
15
- | Framework | PyTorch, Transformers |
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  ## Model Overview
18
 
 
1
  # Kat-Gen1
2
 
3
+ ---
4
+ license: apache-2.0
5
+ language:
6
+ - en
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - text-generation
10
+ - causal-lm
11
+ - pytorch
12
+ - transformers
13
+ library_name: transformers
14
+ datasets:
15
+ - custom
16
+ metrics:
17
+ - perplexity
18
+ - bleu
19
+ - rouge
20
+ base_model: gpt-neox
21
+ ---
22
+
23
  ## Model Card
24
 
25
  | Attribute | Value |
26
  |-----------|-------|
27
+ | **Model Name** | Kat-Gen1 |
28
+ | **Model ID** | Katisim/Kat-Gen1 |
29
+ | **Model Type** | Causal Language Model |
30
+ | **Architecture** | GPT-NeoX |
31
+ | **Parameters** | ~1.3B |
32
+ | **Training Data** | General domain text corpus |
33
+ | **Context Length** | 2048 tokens |
34
+ | **License** | Apache 2.0 |
35
+ | **Language** | English (en) |
36
+ | **Precision** | FP16/FP32 |
37
+ | **Framework** | PyTorch, Transformers |
38
+ | **Pipeline Tag** | text-generation |
39
+ | **Library** | transformers |
40
+ | **Tags** | text-generation, causal-lm, pytorch |
41
+ | **Datasets** | Custom corpus |
42
+ | **Metrics** | Perplexity, BLEU, ROUGE |
43
+ | **Model Format** | PyTorch (.bin), SafeTensors |
44
+ | **Tokenizer** | GPT-NeoX BPE |
45
+ | **Vocabulary Size** | 50,304 tokens |
46
+ | **Hidden Size** | 2048 |
47
+ | **Layers** | 24 |
48
+ | **Attention Heads** | 16 |
49
 
50
  ## Model Overview
51