Update README.md
Browse files
README.md
CHANGED
|
@@ -105,19 +105,10 @@ By releasing every intermediate model and post-training dataset, we give users t
|
|
| 105 |
|
| 106 |
## 📦 Installation
|
| 107 |
|
| 108 |
-
### 1. Clone the repository
|
| 109 |
```bash
|
| 110 |
git clone https://github.com/MLP-Lab/KORMo-tutorial.git
|
| 111 |
cd KORMo-tutorial
|
| 112 |
-
|
| 113 |
-
### 2. Create and activate a virtual environment (optional but recommended)
|
| 114 |
-
```bash
|
| 115 |
-
uv venv
|
| 116 |
-
source .venv/bin/activate
|
| 117 |
-
```
|
| 118 |
-
### 3. Install KORMo
|
| 119 |
-
```bash
|
| 120 |
-
uv pip install -e .
|
| 121 |
```
|
| 122 |
|
| 123 |
---
|
|
@@ -149,7 +140,7 @@ chat_prompt = tokenizer.apply_chat_template(
|
|
| 149 |
|
| 150 |
inputs = tokenizer(chat_prompt, return_tensors="pt").to(model.device)
|
| 151 |
|
| 152 |
-
with torch.
|
| 153 |
output_ids = model.generate(
|
| 154 |
**inputs,
|
| 155 |
max_new_tokens=1024,
|
|
|
|
| 105 |
|
| 106 |
## 📦 Installation
|
| 107 |
|
|
|
|
| 108 |
```bash
|
| 109 |
git clone https://github.com/MLP-Lab/KORMo-tutorial.git
|
| 110 |
cd KORMo-tutorial
|
| 111 |
+
bash setup/create_uv_venv.sh
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 112 |
```
|
| 113 |
|
| 114 |
---
|
|
|
|
| 140 |
|
| 141 |
inputs = tokenizer(chat_prompt, return_tensors="pt").to(model.device)
|
| 142 |
|
| 143 |
+
with torch.inference_mode():
|
| 144 |
output_ids = model.generate(
|
| 145 |
**inputs,
|
| 146 |
max_new_tokens=1024,
|