Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,54 @@ metrics:
|
|
| 8 |
- accuracy
|
| 9 |
base_model:
|
| 10 |
- google-t5/t5-base
|
| 11 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
- accuracy
|
| 9 |
base_model:
|
| 10 |
- google-t5/t5-base
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# Forge-T5-Base-s1
|
| 14 |
+
|
| 15 |
+
This model is initialized from the pre-trained [`google-t5/t5-base`](https://huggingface.co/google-t5/t5-base) and fine-tuned on the **AL-GR/AL-GR-v1** dataset using the [FORGE](https://github.com/AL-GR/FORGE) framework for **4 training epochs**.
|
| 16 |
+
|
| 17 |
+
## Evaluation Results on AL-GR/AL-GR-v1
|
| 18 |
+
|
| 19 |
+
| Model | HR@20 | HR@100 | HR@500 | HR@1000 |
|
| 20 |
+
|--------------------------|---------|---------|---------|---------|
|
| 21 |
+
| Forge-Qwen 2.5-0.5B-Base-s1 | 0.0506 | 0.1277 | 0.2602 | 0.3068 |
|
| 22 |
+
| **Forge-T5-Base-s1** | **0.0284** | **0.0689** | **0.1372** | **0.1557** |
|
| 23 |
+
|
| 24 |
+
> **Note**: HR@K denotes Hit Rate at K — the proportion of test queries for which the correct answer appears in the top-K retrieved/generated results.
|
| 25 |
+
|
| 26 |
+
## Usage
|
| 27 |
+
|
| 28 |
+
### 1. Download the Model
|
| 29 |
+
|
| 30 |
+
You can download this model locally using the `huggingface_hub` library:
|
| 31 |
+
|
| 32 |
+
```python
|
| 33 |
+
import os
|
| 34 |
+
os.environ["HF_ENDPOINT"] = "https://hf-mirror.com" # Optional: use mirror for faster download in some regions
|
| 35 |
+
os.environ["KMP_DUPLICATE_LIB_OK"] = "True"
|
| 36 |
+
|
| 37 |
+
from huggingface_hub import snapshot_download
|
| 38 |
+
|
| 39 |
+
snapshot_download(
|
| 40 |
+
repo_id='AL-GR/Forge-T5-Base-s1',
|
| 41 |
+
local_dir='{YOUR_LOCAL_DIR}', # Replace with your desired local path
|
| 42 |
+
local_dir_use_symlinks=False,
|
| 43 |
+
)
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
### 2. Update Configuration
|
| 47 |
+
|
| 48 |
+
After downloading, update the configuration file used by the FORGE framework. Specifically, replace the `load_checkpoint_from` field in the JSON config file:
|
| 49 |
+
|
| 50 |
+
**File**: `algr/config/generate_t5base_3layer_tiny.json`
|
| 51 |
+
|
| 52 |
+
**Update to**:
|
| 53 |
+
```json
|
| 54 |
+
"load_checkpoint_from": "{YOUR_LOCAL_DIR}"
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
> Replace `{YOUR_LOCAL_DIR}` with the actual local path where you downloaded the model.
|
| 58 |
+
|
| 59 |
+
---
|
| 60 |
+
|
| 61 |
+
For more details about the training setup, dataset, or evaluation protocol, please refer to the [FORGE framework repository](https://github.com/AL-GR/FORGE).
|