Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ tags:
|
|
| 8 |
|
| 9 |
## Model Details
|
| 10 |
|
| 11 |
-
Arctic is a
|
| 12 |
Research Team. We are releasing model checkpoints for both the base and instruct-tuned versions of
|
| 13 |
Arctic under an Apache-2.0 license. This means you can use them freely in your own research,
|
| 14 |
prototypes, and products. Please see our blog
|
|
@@ -37,7 +37,7 @@ For the latest details about Snowflake Arctic including tutorials, etc. please r
|
|
| 37 |
|
| 38 |
Arctic combines a 10B dense transformer model with a residual 128x3.66B MoE MLP resulting in 480B
|
| 39 |
total and 17B active parameters chosen using a top-2 gating. For more details about Arctic's model
|
| 40 |
-
|
| 41 |
|
| 42 |
|
| 43 |
## Usage
|
|
@@ -62,4 +62,4 @@ pip install "deepspeed>=0.14.2"
|
|
| 62 |
The Arctic github page has several resources around running inference:
|
| 63 |
|
| 64 |
* Example with pure-HF: https://github.com/Snowflake-Labs/snowflake-arctic/blob/main/inference
|
| 65 |
-
* Tutorial using vLLM: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main/inference/vllm
|
|
|
|
| 8 |
|
| 9 |
## Model Details
|
| 10 |
|
| 11 |
+
Arctic is a dense-MoE Hybrid transformer architecture pre-trained from scratch by the Snowflake AI
|
| 12 |
Research Team. We are releasing model checkpoints for both the base and instruct-tuned versions of
|
| 13 |
Arctic under an Apache-2.0 license. This means you can use them freely in your own research,
|
| 14 |
prototypes, and products. Please see our blog
|
|
|
|
| 37 |
|
| 38 |
Arctic combines a 10B dense transformer model with a residual 128x3.66B MoE MLP resulting in 480B
|
| 39 |
total and 17B active parameters chosen using a top-2 gating. For more details about Arctic's model
|
| 40 |
+
Architecture, training process, data, etc. [see our series of cookbooks](https://www.snowflake.com/en/data-cloud/arctic/cookbook/).
|
| 41 |
|
| 42 |
|
| 43 |
## Usage
|
|
|
|
| 62 |
The Arctic github page has several resources around running inference:
|
| 63 |
|
| 64 |
* Example with pure-HF: https://github.com/Snowflake-Labs/snowflake-arctic/blob/main/inference
|
| 65 |
+
* Tutorial using vLLM: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main/inference/vllm
|