AL-GR commited on
Commit
7bb9c16
·
verified ·
1 Parent(s): 66341bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -1
README.md CHANGED
@@ -8,4 +8,54 @@ metrics:
8
  - accuracy
9
  base_model:
10
  - google-t5/t5-base
11
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  - accuracy
9
  base_model:
10
  - google-t5/t5-base
11
+ ---
12
+
13
+ # Forge-T5-Base-s1
14
+
15
+ This model is initialized from the pre-trained [`google-t5/t5-base`](https://huggingface.co/google-t5/t5-base) and fine-tuned on the **AL-GR/AL-GR-v1** dataset using the [FORGE](https://github.com/AL-GR/FORGE) framework for **4 training epochs**.
16
+
17
+ ## Evaluation Results on AL-GR/AL-GR-v1
18
+
19
+ | Model | HR@20 | HR@100 | HR@500 | HR@1000 |
20
+ |--------------------------|---------|---------|---------|---------|
21
+ | Forge-Qwen 2.5-0.5B-Base-s1 | 0.0506 | 0.1277 | 0.2602 | 0.3068 |
22
+ | **Forge-T5-Base-s1** | **0.0284** | **0.0689** | **0.1372** | **0.1557** |
23
+
24
+ > **Note**: HR@K denotes Hit Rate at K — the proportion of test queries for which the correct answer appears in the top-K retrieved/generated results.
25
+
26
+ ## Usage
27
+
28
+ ### 1. Download the Model
29
+
30
+ You can download this model locally using the `huggingface_hub` library:
31
+
32
+ ```python
33
+ import os
34
+ os.environ["HF_ENDPOINT"] = "https://hf-mirror.com" # Optional: use mirror for faster download in some regions
35
+ os.environ["KMP_DUPLICATE_LIB_OK"] = "True"
36
+
37
+ from huggingface_hub import snapshot_download
38
+
39
+ snapshot_download(
40
+ repo_id='AL-GR/Forge-T5-Base-s1',
41
+ local_dir='{YOUR_LOCAL_DIR}', # Replace with your desired local path
42
+ local_dir_use_symlinks=False,
43
+ )
44
+ ```
45
+
46
+ ### 2. Update Configuration
47
+
48
+ After downloading, update the configuration file used by the FORGE framework. Specifically, replace the `load_checkpoint_from` field in the JSON config file:
49
+
50
+ **File**: `algr/config/generate_t5base_3layer_tiny.json`
51
+
52
+ **Update to**:
53
+ ```json
54
+ "load_checkpoint_from": "{YOUR_LOCAL_DIR}"
55
+ ```
56
+
57
+ > Replace `{YOUR_LOCAL_DIR}` with the actual local path where you downloaded the model.
58
+
59
+ ---
60
+
61
+ For more details about the training setup, dataset, or evaluation protocol, please refer to the [FORGE framework repository](https://github.com/AL-GR/FORGE).