Update README.md
Browse files
README.md
CHANGED
|
@@ -63,7 +63,7 @@ Features of this architecture:
|
|
| 63 |
|
| 64 |
### Step 1: Environment Setup
|
| 65 |
|
| 66 |
-
Since Hymba-1.5B-
|
| 67 |
|
| 68 |
- **[Local install]** Install the related packages using our provided `setup.sh` (support CUDA 12.1/12.4):
|
| 69 |
|
|
|
|
| 63 |
|
| 64 |
### Step 1: Environment Setup
|
| 65 |
|
| 66 |
+
Since Hymba-1.5B-Base employs [FlexAttention](https://pytorch.org/blog/flexattention/), which relies on Pytorch2.5 and other related dependencies, we provide two ways to setup the environment:
|
| 67 |
|
| 68 |
- **[Local install]** Install the related packages using our provided `setup.sh` (support CUDA 12.1/12.4):
|
| 69 |
|