Update README.md
Browse files
README.md
CHANGED
|
@@ -4,7 +4,8 @@ pipeline_tag: text-generation
|
|
| 4 |
---
|
| 5 |
# Grok-1 (PyTorch Version)
|
| 6 |
|
| 7 |
-
This repository contains the model and weights of the **torch version** of Grok-1 open-weights model.
|
|
|
|
| 8 |
|
| 9 |
You could find the original weights released by [xAI](https://x.ai/blog) in [Hugging Face](https://huggingface.co/xai-org/grok-1) and the original model in the Grok open release [GitHub Repository](https://github.com/xai-org/grok-1/tree/main).
|
| 10 |
|
|
@@ -42,6 +43,5 @@ inputs = {
|
|
| 42 |
outputs = model.generate(**inputs)
|
| 43 |
```
|
| 44 |
|
| 45 |
-
You could find a complete example code of using the torch-version Grok-1 in ColossalAI [GitHub Repository](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/grok-1). We also applies parallelism techniques from ColossalAI framework (Tensor Parallelism for now) to accelerate the inference.
|
| 46 |
|
| 47 |
Note: A multi-GPU machine is required to test the model with the example code (For now, a 8x80G multi-GPU machine is required).
|
|
|
|
| 4 |
---
|
| 5 |
# Grok-1 (PyTorch Version)
|
| 6 |
|
| 7 |
+
This repository contains the model and weights of the **torch version** of Grok-1 open-weights model. You could find a complete example code of using the torch-version Grok-1 in [ColossalAI GitHub Repository](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/grok-1). We also applies parallelism techniques from ColossalAI framework (Tensor Parallelism for now) to accelerate the inference.
|
| 8 |
+
|
| 9 |
|
| 10 |
You could find the original weights released by [xAI](https://x.ai/blog) in [Hugging Face](https://huggingface.co/xai-org/grok-1) and the original model in the Grok open release [GitHub Repository](https://github.com/xai-org/grok-1/tree/main).
|
| 11 |
|
|
|
|
| 43 |
outputs = model.generate(**inputs)
|
| 44 |
```
|
| 45 |
|
|
|
|
| 46 |
|
| 47 |
Note: A multi-GPU machine is required to test the model with the example code (For now, a 8x80G multi-GPU machine is required).
|