MD-Mushfiqur123 commited on
Commit
1869ca7
·
verified ·
1 Parent(s): 5295478

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +181 -55
README.md CHANGED
@@ -1,57 +1,183 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- language:
3
- - en
4
- - bn
5
- license: apache-2.0
6
- tags:
7
- - unsloth
8
- - fine tune
9
- - heretic
10
- - uncensored
11
- - abliterated
12
- - multi-stage tuned.
13
- - all use cases
14
- - coder
15
- - creative
16
- - creative writing
17
- - fiction writing
18
- - plot generation
19
- - sub-plot generation
20
- - fiction writing
21
- - story generation
22
- - scene continue
23
- - storytelling
24
- - fiction story
25
- - science fiction
26
- - romance
27
- - all genres
28
- - story
29
- - writing
30
- - vivid prosing
31
- - vivid writing
32
- - fiction
33
- - roleplaying
34
- - bfloat16
35
- - all use cases
36
- datasets:
37
- - TeichAI/claude-4.5-opus-high-reasoning-250x
38
- - argilla/alpaca_bangla
39
- - nihalbaig/alpaca-bangla_validation
40
- - iamshnoo/alpaca-cleaned-bengali
41
- - fka/prompts.chat
42
- - wikimedia/wikipedia
43
- - KillerShoaib/DeepSeek-r1-Distill-Bangla-MMLU-Reasoning-Data
44
- - kawchar85/Bangla-Math
45
- - LAYEK-143/BANGLA-BOOK
46
- - Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
47
- - armand0e/claude-fable-5-claude-code
48
- - angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k
49
- - nlile/misc-merged-claude-code-traces-v1
50
- - armand0e/minimax-m3-claude-code-traces
51
- - Johnblick187/claude-sonnet-4.6-opus-4.8-mythos-5-fable-5-openai-finetuning-dataset
52
- - angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k
53
- - TeichAI/claude-4.5-opus-high-reasoning-250x
54
- - DIBT-Bengali/Bengali-Prompt-Evaluation-Data
55
- pipeline_tag: text-generation
56
- library_name: transformers
57
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Droplychee-40B
2
+
3
+ <div align="center">
4
+
5
+ # 🧠 Droplychee-40B
6
+
7
+ **An open multilingual instruction model based on the Qwen family.**
8
+
9
+ [![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](#license)
10
+ [![Status](https://img.shields.io/badge/Status-Under%20Development-orange)]()
11
+ [![Language](https://img.shields.io/badge/Languages-Bangla%20%7C%20English-green)]()
12
+
13
+ </div>
14
+
15
  ---
16
+
17
+ ## Overview
18
+
19
+ Droplychee-40B is a multilingual large language model developed by **Droplychee Core**. The model is built on the **Qwen** family through **full fine-tuning** with the goal of improving multilingual instruction following, reasoning, coding, and Bangla language capabilities.
20
+
21
+ This release is intended for research and early evaluation while the project continues to evolve.
22
+
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ---
24
+
25
+ ## Highlights
26
+
27
+ * 🌍 Multilingual (Bangla & English)
28
+ * 🧠 Instruction Following
29
+ * 💻 Coding Assistance
30
+ * ✨ General Reasoning
31
+ * 📚 Research Friendly
32
+ * 🔓 Open Development
33
+
34
+ ---
35
+
36
+ ## Model Details
37
+
38
+ | Property | Value |
39
+ | ----------------- | ------------------------ |
40
+ | Model Name | Droplychee-40B |
41
+ | Base Model | Qwen Family |
42
+ | Training Method | Full Fine-Tuning |
43
+ | Architecture | Decoder-only Transformer |
44
+ | Primary Languages | Bangla, English |
45
+ | Status | Under Development |
46
+ | Organization | Droplychee Core |
47
+
48
+ ---
49
+
50
+ ## Intended Uses
51
+
52
+ Droplychee-40B is designed for:
53
+
54
+ * Conversational AI
55
+ * Coding assistance
56
+ * Multilingual reasoning
57
+ * Bangla NLP
58
+ * Education
59
+ * Research
60
+ * AI Agents
61
+ * Document understanding
62
+
63
+ ---
64
+
65
+ ## Limitations
66
+
67
+ This model is currently under active development.
68
+
69
+ Users should expect:
70
+
71
+ * Possible factual errors
72
+ * Hallucinations
73
+ * Incomplete reasoning
74
+ * Benchmark results may change
75
+ * Future releases may significantly improve quality
76
+
77
+ ---
78
+
79
+ ## Training
80
+
81
+ Droplychee-40B was created through **full fine-tuning** of a model from the **Qwen family**.
82
+
83
+ Additional training details will be documented in future releases.
84
+
85
+ **TBD**
86
+
87
+ * Dataset composition
88
+ * Training tokens
89
+ * Optimizer
90
+ * Learning rate
91
+ * Batch size
92
+ * Epochs
93
+ * Sequence length
94
+
95
+ ---
96
+
97
+ ## Evaluation
98
+
99
+ Comprehensive benchmark results are not yet available.
100
+
101
+ Future evaluations are planned for:
102
+
103
+ * MMLU
104
+ * GSM8K
105
+ * HumanEval
106
+ * MBPP
107
+ * ARC
108
+ * IFEval
109
+ * BBH
110
+ * Bangla-specific benchmarks
111
+
112
+ ---
113
+
114
+ ## Usage (Transformers)
115
+
116
+ ```python
117
+ from transformers import AutoTokenizer, AutoModelForCausalLM
118
+
119
+ model_id = "droplychee/droplychee-40b"
120
+
121
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
122
+
123
+ model = AutoModelForCausalLM.from_pretrained(
124
+ model_id,
125
+ torch_dtype="auto",
126
+ device_map="auto"
127
+ )
128
+
129
+ messages = [
130
+ {"role": "user", "content": "Explain recursion with a Python example."}
131
+ ]
132
+
133
+ text = tokenizer.apply_chat_template(
134
+ messages,
135
+ tokenize=False,
136
+ add_generation_prompt=True
137
+ )
138
+
139
+ inputs = tokenizer(text, return_tensors="pt").to(model.device)
140
+
141
+ outputs = model.generate(
142
+ **inputs,
143
+ max_new_tokens=512
144
+ )
145
+
146
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
147
+ ```
148
+
149
+ ---
150
+
151
+ ## Citation
152
+
153
+ ```bibtex
154
+ @misc{droplychee40b2026,
155
+ title={Droplychee-40B},
156
+ author={Droplychee Core},
157
+ year={2026},
158
+ publisher={Hugging Face},
159
+ howpublished={\url{https://huggingface.co/droplychee}}
160
+ }
161
+ ```
162
+
163
+ ---
164
+
165
+ ## License
166
+
167
+ **TBD**
168
+
169
+ (Choose the appropriate license before the stable release.)
170
+
171
+ ---
172
+
173
+ ## Acknowledgements
174
+
175
+ Droplychee-40B builds upon the open-source AI ecosystem. We acknowledge the contributions of the Qwen team and the broader machine learning community.
176
+
177
+ ---
178
+
179
+ ## Contact
180
+
181
+ * Organization: **Droplychee Core**
182
+ * GitHub: https://github.com/DropLychee
183
+ * Hugging Face: https://huggingface.co/droplychee