cpatonn commited on
Commit
9f5a889
·
verified ·
1 Parent(s): eff7198

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md CHANGED
@@ -4,6 +4,44 @@ library_name: transformers
4
  base_model: internlm/JanusCoder-8B
5
  ---
6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  # JanusCoder-8B
8
 
9
  [💻Github Repo](https://github.com/InternLM/JanusCoder) • [🤗Model Collections](https://huggingface.co/collections/internlm/januscoder) • [📜Technical Report](https://www.arxiv.org/abs/2510.23538)
 
4
  base_model: internlm/JanusCoder-8B
5
  ---
6
 
7
+ # JanusCoder-14B AWQ - INT8
8
+
9
+ ## Model Details
10
+
11
+ ### Quantization Details
12
+
13
+ - **Quantization Method:** AWQ
14
+ - **Bits:** 8
15
+ - **Group Size:** 32
16
+ - **Calibration Dataset:** [nvidia/Llama-Nemotron-Post-Training-Dataset](https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset)
17
+ - **Quantization Tool:** [llm-compressor](https://github.com/vllm-project/llm-compressor)
18
+
19
+ ## Get Started
20
+
21
+ ### Prerequisite
22
+
23
+ ```bash
24
+ pip install -U vllm
25
+ ```
26
+
27
+ ### Basic Usage
28
+
29
+ ```bash
30
+ vllm serve cyankiwi/JanusCoder-14B-AWQ-8bit
31
+ ```
32
+
33
+ ## Additional Information
34
+
35
+ ### Changelog
36
+
37
+ - **v1.0.0** - Initial quantized release
38
+
39
+ ### Authors
40
+
41
+ - **Name:** cyankiwi
42
+
43
+ - **Contacts:** ton@cyan.kiwi
44
+
45
  # JanusCoder-8B
46
 
47
  [💻Github Repo](https://github.com/InternLM/JanusCoder) • [🤗Model Collections](https://huggingface.co/collections/internlm/januscoder) • [📜Technical Report](https://www.arxiv.org/abs/2510.23538)