MD-Mushfiqur123 commited on
Commit
44335cf
·
verified ·
1 Parent(s): 8257856

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - bn
5
+ - en
6
+ base_model: Qwen/Qwen3.6-27B
7
+ tags:
8
+ - qwen3_5
9
+ - fine-tuned
10
+ model-index:
11
+ - name: DropLychee-1.2
12
+ results:
13
+ - task:
14
+ type: text-generation
15
+ name: GPQA Diamond (zero-shot)
16
+ dataset:
17
+ name: GPQA Diamond
18
+ type: Idavidrein/gpqa
19
+ metrics:
20
+ - type: acc_norm
21
+ value: 42.0
22
+ name: accuracy (normalized)
23
+ - task:
24
+ type: text-generation
25
+ name: MMLU-Pro (5-shot)
26
+ dataset:
27
+ name: MMLU-Pro
28
+ type: TIGER-Lab/MMLU-Pro
29
+ metrics:
30
+ - type: exact_match
31
+ value: 64.0
32
+ name: exact match
33
+ ---
34
+
35
+ # DropLychee 1.2
36
+
37
+ Fine-tuned model based on Qwen3.6-27B (LoRA fine-tune, 500 steps).
38
+
39
+ ## Evaluation
40
+
41
+ Evaluated using [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) on 2026-07-12.
42
+
43
+ | Benchmark | Score |
44
+ |---|---|
45
+ | GPQA Diamond (0-shot) | 42.0% (acc_norm) |
46
+ | MMLU-Pro (5-shot) | 64.0% (exact_match) |
47
+
48
+ Total evaluation time: ~2.3 hours on RTX PRO 6000 Blackwell (96GB).
49
+
50
+ ## Usage
51
+
52
+ \`\`\`python
53
+ from unsloth import FastLanguageModel
54
+
55
+ model, tokenizer = FastLanguageModel.from_pretrained(
56
+ model_name="droplychee/DropLychee-1.2",
57
+ max_seq_length=2048,
58
+ dtype=None,
59
+ load_in_4bit=False,
60
+ )
61
+ FastLanguageModel.for_inference(model)
62
+ \`\`\`