EunsuKim commited on
Commit
c66415f
·
verified ·
1 Parent(s): d9784f9

Delete BenchHub-Cat-7b-backup

Browse files
BenchHub-Cat-7b-backup/.gitattributes DELETED
@@ -1,35 +0,0 @@
1
- *.7z filter=lfs diff=lfs merge=lfs -text
2
- *.arrow filter=lfs diff=lfs merge=lfs -text
3
- *.bin filter=lfs diff=lfs merge=lfs -text
4
- *.bz2 filter=lfs diff=lfs merge=lfs -text
5
- *.ckpt filter=lfs diff=lfs merge=lfs -text
6
- *.ftz filter=lfs diff=lfs merge=lfs -text
7
- *.gz filter=lfs diff=lfs merge=lfs -text
8
- *.h5 filter=lfs diff=lfs merge=lfs -text
9
- *.joblib filter=lfs diff=lfs merge=lfs -text
10
- *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
- *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
- *.model filter=lfs diff=lfs merge=lfs -text
13
- *.msgpack filter=lfs diff=lfs merge=lfs -text
14
- *.npy filter=lfs diff=lfs merge=lfs -text
15
- *.npz filter=lfs diff=lfs merge=lfs -text
16
- *.onnx filter=lfs diff=lfs merge=lfs -text
17
- *.ot filter=lfs diff=lfs merge=lfs -text
18
- *.parquet filter=lfs diff=lfs merge=lfs -text
19
- *.pb filter=lfs diff=lfs merge=lfs -text
20
- *.pickle filter=lfs diff=lfs merge=lfs -text
21
- *.pkl filter=lfs diff=lfs merge=lfs -text
22
- *.pt filter=lfs diff=lfs merge=lfs -text
23
- *.pth filter=lfs diff=lfs merge=lfs -text
24
- *.rar filter=lfs diff=lfs merge=lfs -text
25
- *.safetensors filter=lfs diff=lfs merge=lfs -text
26
- saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
- *.tar.* filter=lfs diff=lfs merge=lfs -text
28
- *.tar filter=lfs diff=lfs merge=lfs -text
29
- *.tflite filter=lfs diff=lfs merge=lfs -text
30
- *.tgz filter=lfs diff=lfs merge=lfs -text
31
- *.wasm filter=lfs diff=lfs merge=lfs -text
32
- *.xz filter=lfs diff=lfs merge=lfs -text
33
- *.zip filter=lfs diff=lfs merge=lfs -text
34
- *.zst filter=lfs diff=lfs merge=lfs -text
35
- *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
BenchHub-Cat-7b-backup/README.md DELETED
@@ -1,78 +0,0 @@
1
- ---
2
- license: apache-2.0
3
- language:
4
- - en
5
- tags:
6
- - LLM
7
- - classification
8
- - instruction-tuned
9
- - multi-label
10
- - qwen
11
- datasets:
12
- - custom
13
- pipeline_tag: text-classification
14
- ---
15
-
16
-
17
- # BenchHub-Cat-7b
18
-
19
- <div style="text-align: center;">
20
- <img src="https://cdn-uploads.huggingface.co/production/uploads/6576ace7769f3ee9bd7b1b88/P_Csm4Gc5eOLYcq5I__0R.png" width="200"/>
21
- </div>
22
-
23
-
24
- **BenchHub-Cat-7b** is a category classification model based on **Qwen2.5-7B**, fine-tuned to assign natural language queries to structured category triplets: `(subject, skill, target)`.
25
-
26
- ## 🔧 Model Details
27
-
28
- - **Base Model**: [Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
29
- - **Task**: Structured multi-label classification (triple: subject, skill, target)
30
- - **Prompting Style**: Instruction-style with expected format output
31
- - **Training Framework**: [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) + DeepSpeed ZeRO-3
32
-
33
- ## 🧪 Training Configuration
34
-
35
- | Hyperparameter | Value |
36
- |--------------------------|----------------------|
37
- | Sequence Length | 8192 |
38
- | Learning Rate | 2 × 10⁻⁵ |
39
- | Batch Size (Effective) | 256 |
40
- | Epochs | 3 |
41
- | Scheduler | Cosine Decay |
42
- | Warmup Ratio | 0.05 |
43
- | Optimizer | Method from [19] |
44
- | Trainer | DeepSpeed ZeRO-3 |
45
- | Hardware | 4× A6000 48GB GPUs |
46
- | Training Time | ~5 hours per run |
47
-
48
- ## 🧠 Intended Use
49
-
50
- **Input**: Natural language question or instruction
51
- **Output**: Triplet `(subject, skill, target)`, such as:
52
-
53
- ```yaml
54
- { "subject_type": "history",
55
- "task_type": "reasoning",
56
- "target_type": "korea"}
57
- ````
58
-
59
-
60
- ## ✨ Prompt Example
61
-
62
- ```
63
- ### Instruction:
64
- Classify the following query into subject, skill, and target.
65
-
66
- ### Query:
67
- How did Confucianism shape education in East Asia?
68
-
69
- ### Output:
70
- { "subject_type": "history",
71
- "task_type": "reasoning",
72
- "target_type": "korea"}
73
- ```
74
-
75
- ## 📜 License
76
-
77
- Apache 2.0
78
-