MD-Mushfiqur123 commited on
Commit
b4e75bb
·
verified ·
1 Parent(s): 44335cf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -48
README.md CHANGED
@@ -1,62 +1,46 @@
1
  ---
2
- license: apache-2.0
3
  language:
4
- - bn
5
  - en
6
- base_model: Qwen/Qwen3.6-27B
7
  tags:
8
- - qwen3_5
9
- - fine-tuned
10
  model-index:
11
- - name: DropLychee-1.2
12
  results:
13
  - task:
14
- type: text-generation
15
- name: GPQA Diamond (zero-shot)
16
  dataset:
17
- name: GPQA Diamond
18
  type: Idavidrein/gpqa
 
19
  metrics:
20
- - type: acc_norm
21
- value: 42.0
22
- name: accuracy (normalized)
23
  - task:
24
- type: text-generation
25
- name: MMLU-Pro (5-shot)
26
- dataset:
27
  name: MMLU-Pro
 
28
  type: TIGER-Lab/MMLU-Pro
 
29
  metrics:
30
- - type: exact_match
31
- value: 64.0
32
- name: exact match
33
- ---
34
-
35
- # DropLychee 1.2
36
-
37
- Fine-tuned model based on Qwen3.6-27B (LoRA fine-tune, 500 steps).
38
-
39
- ## Evaluation
40
-
41
- Evaluated using [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) on 2026-07-12.
42
-
43
- | Benchmark | Score |
44
- |---|---|
45
- | GPQA Diamond (0-shot) | 42.0% (acc_norm) |
46
- | MMLU-Pro (5-shot) | 64.0% (exact_match) |
47
-
48
- Total evaluation time: ~2.3 hours on RTX PRO 6000 Blackwell (96GB).
49
-
50
- ## Usage
51
-
52
- \`\`\`python
53
- from unsloth import FastLanguageModel
54
-
55
- model, tokenizer = FastLanguageModel.from_pretrained(
56
- model_name="droplychee/DropLychee-1.2",
57
- max_seq_length=2048,
58
- dtype=None,
59
- load_in_4bit=False,
60
- )
61
- FastLanguageModel.for_inference(model)
62
- \`\`\`
 
1
  ---
 
2
  language:
 
3
  - en
 
4
  tags:
5
+ - model
6
+ - leaderboard
7
  model-index:
8
+ - name: আপনার-মডেলের-নাম
9
  results:
10
  - task:
11
+ type: multiple-choice # টাস্ক টাইপ (যেমন: text-generation, multiple-choice)
12
+ name: GPQA
13
  dataset:
 
14
  type: Idavidrein/gpqa
15
+ name: default # ডেটাসেটের সাবসেট (বেশিরভাগ ক্ষেত্রে 'default' বসালে চলে)
16
  metrics:
17
+ - type: accuracy # মেট্রিক্স টাইপ (accuracy, exact_match, pass@1 ইত্যাদি)
18
+ value: 87.8
 
19
  - task:
20
+ type: multiple-choice
 
 
21
  name: MMLU-Pro
22
+ dataset:
23
  type: TIGER-Lab/MMLU-Pro
24
+ name: default
25
  metrics:
26
+ - type: accuracy
27
+ value: 86.2
28
+ - task:
29
+ type: text-generation # কোডিং বেঞ্চমার্কের জন্য সাধারণত text-generation বা code-generation হয়
30
+ name: SWE Bench Pro
31
+ dataset:
32
+ type: ScaleAI/SWE-bench_Pro
33
+ name: default
34
+ metrics:
35
+ - type: resolved # SWE-bench এ সাধারণত resolved ব্যবহার করা হয়
36
+ value: 53.5
37
+ - task:
38
+ type: multiple-choice
39
+ name: MathArena AIME 2026
40
+ dataset:
41
+ type: MathArena/aime_2026
42
+ name: default
43
+ metrics:
44
+ - type: accuracy
45
+ value: 94.1
46
+ ---