Kaz-K commited on
Commit
2965cfa
·
verified ·
1 Parent(s): 7dfbfd7

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ extra_gated_fields:
3
+ Name: text
4
+ Affiliation: text
5
+ I want to use this model for: text
6
+
7
+ license: other
8
+ license_name: llm-jp-3-172b-tou
9
+ license_link: LICENSE
10
+ language:
11
+ - en
12
+ - ja
13
+ programming_language:
14
+ - C
15
+ - C++
16
+ - C#
17
+ - Go
18
+ - Java
19
+ - JavaScript
20
+ - Lua
21
+ - PHP
22
+ - Python
23
+ - Ruby
24
+ - Rust
25
+ - Scala
26
+ - TypeScript
27
+ pipeline_tag: text-generation
28
+ library_name: transformers
29
+ inference: false
30
+ ---
31
+ # LLM-jp: Restricted Access Models
32
+
33
+ This repository is for sharing restricted access with authorized partners of large language models developed by the [Research and Development Center for Large Language Models](https://llmc.nii.ac.jp/) at the [National Institute of Informatics](https://www.nii.ac.jp/en/).
34
+
35
+ The development was partially supported by [GENIAC](https://www.meti.go.jp/policy/mono_info_service/geniac/index.html).
36
+
37
+ | Model Variants |
38
+ | :--- |
39
+ | [llm-jp-3-172b]() |
40
+ | [llm-jp-3-172b-beta2]() |
41
+ | [llm-jp-3-172b-beta1]() |
42
+ | [llm-jp-3-13b]() |
43
+ | [llm-jp-3-3.7b]() |
44
+ | [llm-jp-3-1.8b]() |
45
+ | [llm-jp-3-VILA-14b]() |
46
+ | [llm-jp-3-8x13b-exp1]() |
47
+
48
+ Checkpoints format: Hugging Face Transformers
49
+
50
+ ## Required Libraries and Their Versions
51
+
52
+ - torch>=2.3.0
53
+ - transformers>=4.40.1
54
+ - tokenizers>=0.19.1
55
+ - accelerate>=0.29.3
56
+ - flash-attn>=2.5.8
57
+
58
+ ## Send Questions to
59
+
60
+ llm-jp(at)nii.ac.jp
61
+
62
+ ## License
63
+
64
+ [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)