Text Generation
Transformers
Safetensors
PyTorch
English
Bengali
qwen3_5
image-text-to-text
droplychee
qwen
qwen3
large-language-model
causal-lm
multilingual
instruction-tuned
reasoning
coding
long-context
conversational
Instructions to use droplychee/droplychee-1.0-27b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use droplychee/droplychee-1.0-27b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="droplychee/droplychee-1.0-27b") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("droplychee/droplychee-1.0-27b") model = AutoModelForMultimodalLM.from_pretrained("droplychee/droplychee-1.0-27b", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use droplychee/droplychee-1.0-27b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "droplychee/droplychee-1.0-27b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "droplychee/droplychee-1.0-27b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/droplychee/droplychee-1.0-27b
- SGLang
How to use droplychee/droplychee-1.0-27b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "droplychee/droplychee-1.0-27b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "droplychee/droplychee-1.0-27b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "droplychee/droplychee-1.0-27b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "droplychee/droplychee-1.0-27b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use droplychee/droplychee-1.0-27b with Docker Model Runner:
docker model run hf.co/droplychee/droplychee-1.0-27b
| license: apache-2.0 | |
| base_model: | |
| - Qwen/Qwen3.6-27B | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| language: | |
| - en | |
| - bn | |
| tags: | |
| - droplychee | |
| - qwen | |
| - qwen3 | |
| - large-language-model | |
| - causal-lm | |
| - multilingual | |
| - instruction-tuned | |
| - reasoning | |
| - coding | |
| - long-context | |
| - transformers | |
| - pytorch | |
| - safetensors | |
| widget: | |
| - text: "Explain quantum computing in simple terms." | |
| - text: "Write a Python REST API using FastAPI." | |
| - text: "বাংলায় কৃত্রিম বুদ্ধিমত্তা কী?" | |
| extra_gated_heading: false | |
| extra_gated_prompt: false | |
| model_name: Droplychee-1.0-27B | |
| --- | |
| <div align="center"> | |
| # Droplychee-1.0-27B | |
| ### Open Multilingual Large Language Model | |
| Built on **Qwen/Qwen3.6-27B** | |
| Developed by **Droplychee AI Research** | |
| Supports Long Context • Coding • Reasoning • Multilingual AI | |
| </div> | |
| --- | |
| # Overview | |
| Droplychee-1.0-27B is a multilingual decoder-only large language model developed by Droplychee AI Research. The model is built upon **Qwen/Qwen3.6-27B** and further refined through full supervised fine-tuning and model merging. | |
| It is designed for instruction following, multilingual understanding, reasoning, software development, AI agents, document analysis, and research applications. | |
| The model supports long-context inference of **up to 1,000,000 tokens**, depending on the inference framework and runtime configuration. | |
| --- | |
| # Highlights | |
| - Up to **1M Token Context** | |
| - English + Bangla + 40+ Languages | |
| - Instruction Tuned | |
| - Coding Optimized | |
| - Long Document Processing | |
| - AI Agent Ready | |
| - Hugging Face Transformers Compatible | |
| - Safetensors Format | |
| - Production Deployment Friendly | |
| --- | |
| # Model Details | |
| | Property | Value | | |
| |-----------|-------| | |
| | Model Name | Droplychee-1.0-27B | | |
| | Organization | Droplychee AI Research | | |
| | Base Model | Qwen/Qwen3.6-27B | | |
| | Model Type | Decoder-only Transformer | | |
| | Training | Full Fine-Tuning + Model Merge | | |
| | Context Length | Up to 1,000,000 Tokens (Configuration Dependent) | | |
| | Languages | English, Bangla, 40+ Languages | | |
| | Weight Format | Safetensors | | |
| | Library | Transformers | | |
| --- | |
| # Primary Capabilities | |
| Droplychee-1.0-27B is designed for: | |
| - General Question Answering | |
| - Coding Assistance | |
| - Software Engineering | |
| - Technical Documentation | |
| - AI Agents | |
| - Translation | |
| - Long Context Retrieval | |
| - Research Assistance | |
| - Summarization | |
| - Education | |
| - Content Generation | |
| - Enterprise AI | |
| --- | |
| # Quick Start | |
| ## Installation | |
| ```bash | |
| pip install -U transformers accelerate | |
| ``` | |
| ## Transformers | |
| ```python | |
| from transformers import AutoTokenizer | |
| from transformers import AutoModelForCausalLM | |
| model_id = "droplychee/droplychee-1.0-27b" | |
| tokenizer = AutoTokenizer.from_pretrained(model_id) | |
| model = AutoModelForCausalLM.from_pretrained( | |
| model_id, | |
| torch_dtype="auto", | |
| device_map="auto" | |
| ) | |
| messages = [ | |
| { | |
| "role": "user", | |
| "content": "Explain how transformers work." | |
| } | |
| ] | |
| text = tokenizer.apply_chat_template( | |
| messages, | |
| tokenize=False, | |
| add_generation_prompt=True | |
| ) | |
| inputs = tokenizer( | |
| text, | |
| return_tensors="pt" | |
| ).to(model.device) | |
| outputs = model.generate( | |
| **inputs, | |
| max_new_tokens=512, | |
| temperature=0.7 | |
| ) | |
| print( | |
| tokenizer.decode( | |
| outputs[0], | |
| skip_special_tokens=True | |
| ) | |
| ) | |
| ``` | |
| --- | |
| # Features | |
| ✔ Multilingual Language Understanding | |
| ✔ Long Context Processing | |
| ✔ Coding Assistance | |
| ✔ Technical Writing | |
| ✔ Mathematical Reasoning | |
| ✔ AI Agent Workflows | |
| ✔ Research Applications | |
| ✔ Enterprise Deployment | |
| ✔ Chat Applications | |
| ✔ Document Analysis | |
| --- | |
| # Long Context | |
| Droplychee-1.0-27B supports contexts up to **1,000,000 tokens** depending on runtime configuration and deployment framework. | |
| Actual usable context may vary based on: | |
| - Hardware | |
| - Inference Backend | |
| - Memory | |
| - Quantization | |
| - KV Cache Configuration | |
| --- | |
| # Supported Languages | |
| The model supports multilingual inference including: | |
| - English | |
| - Bangla | |
| - Arabic | |
| - Chinese | |
| - French | |
| - German | |
| - Hindi | |
| - Indonesian | |
| - Japanese | |
| - Korean | |
| - Portuguese | |
| - Russian | |
| - Spanish | |
| - Turkish | |
| - Vietnamese | |
| Support quality may vary between languages. | |
| --- | |
| # Intended Uses | |
| Recommended applications include: | |
| - Chatbots | |
| - Coding | |
| - Education | |
| - Research | |
| - AI Assistants | |
| - RAG Pipelines | |
| - Enterprise Knowledge Systems | |
| - Documentation | |
| - Translation | |
| - Automation | |
| --- | |
| # Limitations | |
| Like all language models, Droplychee-1.0-27B may: | |
| - Generate incorrect information | |
| - Produce hallucinated content | |
| - Reflect biases present in training data | |
| - Make reasoning errors | |
| - Produce inconsistent responses | |
| Users should independently verify important outputs. | |
| --- | |
| # Responsible AI | |
| This model is intended for research, education, and productivity applications. | |
| It should not be used as the sole basis for decisions involving: | |
| - Healthcare | |
| - Legal Advice | |
| - Financial Decisions | |
| - Emergency Response | |
| - Critical Infrastructure | |
| Human oversight is recommended. | |
| --- | |
| # Acknowledgements | |
| Droplychee-1.0-27B is built upon the open-weight **Qwen/Qwen3.6-27B** foundation model. | |
| We thank the Qwen team for their work in advancing open large language models. | |
| Droplychee AI Research performed the fine-tuning, model merging, documentation, evaluation, and release preparation. | |
| --- | |
| # Citation | |
| ```bibtex | |
| @misc{droplychee2026, | |
| title={Droplychee-1.0-27B}, | |
| author={Droplychee AI Research}, | |
| year={2026}, | |
| publisher={Hugging Face}, | |
| note={Built upon Qwen/Qwen3.6-27B}, | |
| howpublished={https://huggingface.co/droplychee/droplychee-1.0-27b} | |
| } | |
| ``` | |
| --- | |
| # License | |
| This repository inherits the licensing requirements of its base model and includes additional project materials released by Droplychee AI Research. Please review both this repository's license and the upstream base model license before using or redistributing the model. | |
| --- | |
| <div align="center"> | |
| **Droplychee AI Research** | |
| Building Open, Efficient, and Responsible AI. | |
| </div> | |
| --- | |
| # Usage | |
| ## Chat Template | |
| Droplychee-1.0-27B follows the chat template provided by the tokenizer. | |
| ```python | |
| from transformers import AutoTokenizer | |
| tokenizer = AutoTokenizer.from_pretrained( | |
| "droplychee/droplychee-1.0-27b" | |
| ) | |
| messages = [ | |
| { | |
| "role": "system", | |
| "content": "You are a helpful AI assistant." | |
| }, | |
| { | |
| "role": "user", | |
| "content": "Explain machine learning." | |
| } | |
| ] | |
| prompt = tokenizer.apply_chat_template( | |
| messages, | |
| tokenize=False, | |
| add_generation_prompt=True | |
| ) | |
| print(prompt) | |
| ``` | |
| --- | |
| # Generation Parameters | |
| Recommended starting parameters. | |
| | Parameter | Recommended | | |
| |------------|------------:| | |
| | Temperature | 0.7 | | |
| | Top-p | 0.9 | | |
| | Top-k | 40 | | |
| | Max New Tokens | 1024 | | |
| | Repetition Penalty | 1.05 | | |
| These values are suggestions only and may be adjusted depending on the application. | |
| --- | |
| # vLLM | |
| ```python | |
| from vllm import LLM | |
| from vllm import SamplingParams | |
| llm = LLM( | |
| model="droplychee/droplychee-1.0-27b" | |
| ) | |
| sampling = SamplingParams( | |
| temperature=0.7, | |
| top_p=0.9, | |
| max_tokens=512 | |
| ) | |
| outputs = llm.generate( | |
| "Explain quantum computing.", | |
| sampling | |
| ) | |
| print(outputs[0].outputs[0].text) | |
| ``` | |
| --- | |
| # OpenAI Compatible API | |
| ```python | |
| from openai import OpenAI | |
| client = OpenAI( | |
| base_url="http://localhost:8000/v1", | |
| api_key="EMPTY" | |
| ) | |
| response = client.chat.completions.create( | |
| model="droplychee/droplychee-1.0-27b", | |
| messages=[ | |
| { | |
| "role": "user", | |
| "content": "Write a Python HTTP server." | |
| } | |
| ] | |
| ) | |
| print(response.choices[0].message.content) | |
| ``` | |
| --- | |
| # Hardware Requirements | |
| Hardware requirements depend on: | |
| - Precision | |
| - Quantization | |
| - Context Length | |
| - Batch Size | |
| - Inference Framework | |
| Higher context lengths require substantially more memory than shorter contexts. | |
| --- | |
| # Quantization | |
| The model may be deployed using supported quantization formats provided by compatible inference frameworks. | |
| Common deployment formats include: | |
| - FP16 | |
| - BF16 | |
| - INT8 | |
| - GPTQ | |
| - AWQ | |
| - GGUF | |
| Availability depends on released model variants. | |
| --- | |
| # Deployment | |
| Droplychee-1.0-27B is intended to be compatible with modern inference frameworks including: | |
| - Hugging Face Transformers | |
| - vLLM | |
| - llama.cpp (compatible conversions) | |
| - Ollama (compatible conversions) | |
| - Text Generation Inference (TGI) | |
| Compatibility may depend on the model format being used. | |
| --- | |
| # Example Applications | |
| The model can be integrated into: | |
| - AI Chatbots | |
| - Software Development Tools | |
| - Coding Assistants | |
| - Educational Platforms | |
| - Enterprise Knowledge Bases | |
| - Search Assistants | |
| - Research Platforms | |
| - Document Processing Systems | |
| - Customer Support Systems | |
| - AI Agent Frameworks | |
| --- | |
| # Performance Notes | |
| Model quality depends on: | |
| - Prompt quality | |
| - Context quality | |
| - Generation parameters | |
| - Runtime configuration | |
| - Available compute resources | |
| Longer prompts may increase latency and memory usage. | |
| --- | |
| # Best Prompting Practices | |
| For best results: | |
| - Provide clear instructions. | |
| - Include relevant context. | |
| - Break complex tasks into smaller steps. | |
| - Specify the desired output format. | |
| - Avoid ambiguous requests. | |
| Well-structured prompts generally produce more reliable outputs. | |
| --- | |
| # Example Prompts | |
| ## Coding | |
| ``` | |
| Implement an LRU Cache in Python with unit tests. | |
| ``` | |
| --- | |
| ## Mathematics | |
| ``` | |
| Solve the following differential equation step by step. | |
| ``` | |
| --- | |
| ## Writing | |
| ``` | |
| Write a technical blog post explaining vector databases. | |
| ``` | |
| --- | |
| ## Translation | |
| ``` | |
| Translate the following English paragraph into fluent Bangla. | |
| ``` | |
| --- | |
| ## Summarization | |
| ``` | |
| Summarize the following research paper into concise bullet points. | |
| ``` | |
| --- | |
| ## Long Context | |
| ``` | |
| Read the following document and answer questions using only the provided information. | |
| ``` | |
| --- | |
| # Safety Considerations | |
| Developers should implement safeguards appropriate for their deployment environment. | |
| Recommended measures include: | |
| - Input validation | |
| - Output moderation | |
| - Rate limiting | |
| - Authentication | |
| - Human review for high-impact decisions | |
| --- | |
| # Known Limitations | |
| Droplychee-1.0-27B may: | |
| - Produce inaccurate information. | |
| - Misinterpret ambiguous prompts. | |
| - Generate hallucinated content. | |
| - Reflect biases present in training data. | |
| - Require multiple iterations for complex reasoning tasks. | |
| These limitations are common across modern large language models. | |
| --- | |
| # Roadmap | |
| Future development may include: | |
| - Improved multilingual quality | |
| - Expanded evaluation | |
| - Additional deployment formats | |
| - Optimization for inference efficiency | |
| - Improved long-context handling | |
| - Broader ecosystem integration | |
| Items listed here represent development goals rather than guaranteed future releases. | |
| --- | |
| # Support | |
| If you encounter issues: | |
| - Verify the model version. | |
| - Confirm framework compatibility. | |
| - Check available GPU memory. | |
| - Review tokenizer configuration. | |
| - Consult the project documentation. | |
| --- | |
| # Contributing | |
| Community contributions are welcome. | |
| Examples include: | |
| - Documentation improvements | |
| - Bug reports | |
| - Evaluation feedback | |
| - Example applications | |
| - Benchmark reproduction | |
| - Deployment guides | |
| Please follow the repository contribution guidelines before submitting pull requests. | |
| --- | |
| # Citation | |
| If you use Droplychee-1.0-27B in academic research or production systems, please cite the project using the provided `CITATION.cff`. | |
| --- | |
| # Acknowledgements | |
| This project builds upon the excellent work of the Qwen team through the open-weight Qwen/Qwen3.6-27B foundation model. | |
| We thank the open-source AI community for continued contributions to open research and responsible AI development. | |
| --- | |
| <div align="center"> | |
| ### Droplychee AI Research | |
| Open • Multilingual • Long Context • Responsible AI | |
| </div> | |
| --- | |
| # Architecture | |
| ## Overview | |
| Droplychee-1.0-27B is a decoder-only Transformer language model built upon the **Qwen/Qwen3.6-27B** foundation model and further refined through full supervised fine-tuning and model merging. | |
| The model is designed for multilingual language understanding, instruction following, reasoning, software engineering, long-context processing, and general-purpose text generation. | |
| The architecture remains compatible with the Hugging Face Transformers ecosystem. | |
| --- | |
| # High-Level Architecture | |
| ```text | |
| User Prompt | |
| │ | |
| ▼ | |
| Chat Template Builder | |
| │ | |
| ▼ | |
| Tokenizer (Qwen) | |
| │ | |
| ▼ | |
| Input Token Embeddings | |
| │ | |
| ▼ | |
| Rotary Position Embeddings (RoPE) | |
| │ | |
| ▼ | |
| ┌────────────────────────────────┐ | |
| │ Decoder Stack │ | |
| │ │ | |
| │ RMSNorm │ | |
| │ Multi-Head Self Attention │ | |
| │ Residual Connection │ | |
| │ Feed Forward Network │ | |
| │ Residual Connection │ | |
| └────────────────────────────────┘ | |
| │ | |
| ▼ | |
| Final RMSNorm | |
| │ | |
| ▼ | |
| LM Head | |
| │ | |
| ▼ | |
| Next Token Prediction | |
| ``` | |
| --- | |
| # Core Components | |
| The architecture consists of: | |
| - Tokenizer | |
| - Token Embedding Layer | |
| - Rotary Position Embeddings | |
| - Decoder Transformer Blocks | |
| - Multi-Head Self Attention | |
| - Feed Forward Networks | |
| - RMSNorm | |
| - Residual Connections | |
| - Language Modeling Head | |
| --- | |
| # Tokenization | |
| Droplychee-1.0-27B uses the tokenizer associated with its base model. | |
| Benefits include: | |
| - Efficient multilingual encoding | |
| - Strong programming language support | |
| - Unicode compatibility | |
| - High tokenization efficiency | |
| --- | |
| # Long Context | |
| Droplychee-1.0-27B supports contexts up to: | |
| **1,000,000 Tokens** | |
| Actual supported context depends on: | |
| - Runtime | |
| - Available memory | |
| - Inference backend | |
| - Configuration | |
| Long-context inference requires significantly more compute resources. | |
| --- | |
| # Attention Mechanism | |
| The model uses causal self-attention. | |
| Each generated token attends only to previous tokens. | |
| This enables: | |
| - Autoregressive generation | |
| - Instruction following | |
| - Long-form generation | |
| - Conversational reasoning | |
| --- | |
| # Positional Encoding | |
| The architecture uses Rotary Position Embeddings (RoPE). | |
| Advantages include: | |
| - Better extrapolation | |
| - Efficient computation | |
| - Stable long-context behavior | |
| - Improved positional awareness | |
| --- | |
| # Decoder Block | |
| Each decoder layer consists of: | |
| ```text | |
| Input | |
| │ | |
| ▼ | |
| RMSNorm | |
| │ | |
| ▼ | |
| Multi-Head Self Attention | |
| │ | |
| ▼ | |
| Residual Connection | |
| │ | |
| ▼ | |
| RMSNorm | |
| │ | |
| ▼ | |
| Feed Forward Network | |
| │ | |
| ▼ | |
| Residual Connection | |
| │ | |
| ▼ | |
| Output | |
| ``` | |
| --- | |
| # Language Modeling Head | |
| The final hidden representation is projected into vocabulary logits. | |
| The next token is sampled according to generation parameters. | |
| Common decoding strategies include: | |
| - Greedy | |
| - Top-k | |
| - Top-p | |
| - Temperature Sampling | |
| --- | |
| # Training Methodology | |
| Droplychee-1.0-27B was developed through: | |
| - Base Model Initialization | |
| - Full Supervised Fine-Tuning | |
| - Model Merging | |
| - Validation | |
| - Packaging | |
| - Release Preparation | |
| --- | |
| # Intended Tasks | |
| The model is suitable for: | |
| - Chat | |
| - Coding | |
| - Translation | |
| - Summarization | |
| - Reasoning | |
| - Documentation | |
| - AI Agents | |
| - Question Answering | |
| - Long Document Analysis | |
| --- | |
| # Ecosystem Compatibility | |
| Droplychee-1.0-27B is designed to integrate with: | |
| | Framework | Status | | |
| |-----------|--------| | |
| | Hugging Face Transformers | Supported | | |
| | vLLM | Supported | | |
| | Text Generation Inference | Supported | | |
| | llama.cpp* | Via compatible conversion | | |
| | Ollama* | Via compatible conversion | | |
| | OpenAI Compatible APIs | Supported through compatible servers | | |
| \*Requires compatible converted model formats where applicable. | |
| --- | |
| # Memory Considerations | |
| Memory usage depends on: | |
| - Precision | |
| - Batch Size | |
| - Sequence Length | |
| - KV Cache | |
| - Hardware | |
| Longer context windows increase memory requirements substantially. | |
| --- | |
| # Optimization | |
| The model supports optimization techniques available in compatible inference frameworks, including: | |
| - Flash Attention (where supported) | |
| - Continuous Batching | |
| - Tensor Parallelism | |
| - Pipeline Parallelism | |
| - KV Cache Optimization | |
| - Quantized Inference | |
| Support depends on the deployment backend. | |
| --- | |
| # Deployment Recommendations | |
| Recommended deployment scenarios include: | |
| - GPU Inference Servers | |
| - Research Clusters | |
| - Enterprise AI Platforms | |
| - Cloud Deployments | |
| - Local Development (using compatible quantized variants where available) | |
| --- | |
| # Responsible Deployment | |
| Before deploying the model in production: | |
| - Validate generated outputs. | |
| - Apply authentication and authorization controls. | |
| - Implement rate limiting. | |
| - Log requests where appropriate. | |
| - Monitor system performance. | |
| - Review outputs for high-impact use cases. | |
| --- | |
| # Evaluation | |
| The project emphasizes transparent evaluation. | |
| Performance should be assessed using standardized benchmarks appropriate for the intended application. | |
| Unless explicitly documented, no benchmark results should be assumed. | |
| --- | |
| # Future Development | |
| Future research directions may include: | |
| - Improved multilingual performance | |
| - Enhanced reasoning | |
| - Better coding capabilities | |
| - Expanded long-context evaluation | |
| - Additional deployment optimizations | |
| - Broader ecosystem support | |
| These represent development goals and should not be interpreted as guaranteed future releases. | |
| --- | |
| # Attribution | |
| Droplychee-1.0-27B is built upon the open-weight **Qwen/Qwen3.6-27B** foundation model. | |
| Droplychee AI Research is responsible for the fine-tuning, model merging, evaluation, documentation, and release of this model. | |
| --- | |
| <div align="center"> | |
| ## Built for Research • Coding • Multilingual AI • Long Context | |
| **Droplychee AI Research** | |
| </div> | |
| --- | |
| # Training | |
| ## Overview | |
| Droplychee-1.0-27B is based on **Qwen/Qwen3.6-27B** and further refined through **full supervised fine-tuning** followed by **model merging**. | |
| The objective of the project is to improve multilingual instruction following, reasoning, coding assistance, and long-context capabilities while maintaining compatibility with the upstream architecture. | |
| --- | |
| # Training Objectives | |
| The primary objectives include: | |
| - Improve instruction following | |
| - Enhance multilingual understanding | |
| - Strengthen coding capabilities | |
| - Improve reasoning consistency | |
| - Increase response quality | |
| - Support long-context applications | |
| - Maintain stable inference behavior | |
| --- | |
| # Fine-Tuning Pipeline | |
| ```text | |
| Base Model | |
| │ | |
| ▼ | |
| Dataset Collection | |
| │ | |
| ▼ | |
| Cleaning | |
| │ | |
| ▼ | |
| Deduplication | |
| │ | |
| ▼ | |
| Formatting | |
| │ | |
| ▼ | |
| Tokenization | |
| │ | |
| ▼ | |
| Supervised Fine-Tuning | |
| │ | |
| ▼ | |
| Validation | |
| │ | |
| ▼ | |
| Model Merge | |
| │ | |
| ▼ | |
| Evaluation | |
| │ | |
| ▼ | |
| Packaging | |
| │ | |
| ▼ | |
| Release | |
| ``` | |
| --- | |
| # Dataset | |
| Training data consists of instruction-oriented examples prepared for supervised learning. | |
| The dataset includes diverse tasks such as: | |
| - General conversation | |
| - Programming | |
| - Mathematics | |
| - Reasoning | |
| - Translation | |
| - Summarization | |
| - Technical writing | |
| - Educational content | |
| - Question answering | |
| - Long-form generation | |
| The exact composition and size of the dataset are not publicly disclosed. | |
| --- | |
| # Data Quality | |
| Training data undergoes multiple quality assurance stages, including: | |
| - Format validation | |
| - Duplicate reduction | |
| - Text normalization | |
| - Corrupted sample removal | |
| - Instruction formatting | |
| - Response consistency checks | |
| These processes are intended to improve training stability and overall data quality. | |
| --- | |
| # Multilingual Training | |
| The model is designed to support multilingual use cases, including English, Bangla, and additional languages. | |
| Language coverage and performance may vary depending on the availability and quality of training data. | |
| --- | |
| # Instruction Tuning | |
| Supervised fine-tuning focuses on improving the model's ability to: | |
| - Follow user instructions | |
| - Produce structured outputs | |
| - Answer questions | |
| - Generate code | |
| - Explain concepts | |
| - Perform multilingual tasks | |
| - Maintain conversational coherence | |
| --- | |
| # Model Merge | |
| Following supervised fine-tuning, model merging was applied as part of the training workflow. | |
| The objective of model merging is to combine learned improvements while preserving the strengths of the base model. | |
| Specific merge configurations are not disclosed in this release. | |
| --- | |
| # Context Extension | |
| The model is configured to support long-context inference up to **1,000,000 tokens**, subject to deployment configuration and inference backend capabilities. | |
| Practical limits depend on: | |
| - Available GPU memory | |
| - Inference framework | |
| - Runtime configuration | |
| - Sequence length | |
| - Batch size | |
| --- | |
| # Training Infrastructure | |
| Training was performed using modern GPU acceleration and distributed deep learning tooling. | |
| The exact hardware configuration is not disclosed in this release. | |
| --- | |
| # Optimization | |
| Training employs optimization techniques commonly used for large language models, such as: | |
| - Mixed-precision training | |
| - Gradient accumulation | |
| - Learning rate scheduling | |
| - Optimizer state management | |
| - Periodic checkpointing | |
| Implementation details may vary across training runs. | |
| --- | |
| # Validation | |
| Validation is performed throughout the training process to monitor model quality and detect regressions. | |
| Evaluation may include: | |
| - Instruction-following quality | |
| - Coding behavior | |
| - General reasoning | |
| - Multilingual responses | |
| - Stability across prompts | |
| Unless explicitly published, validation results are not included in this model card. | |
| --- | |
| # Inference Compatibility | |
| Droplychee-1.0-27B is intended to work with compatible inference frameworks, including: | |
| - Hugging Face Transformers | |
| - vLLM | |
| - Text Generation Inference | |
| - Compatible converted formats for llama.cpp and Ollama | |
| Support depends on the deployed model format. | |
| --- | |
| # Intended Applications | |
| Example applications include: | |
| - Conversational AI | |
| - Software development | |
| - Technical documentation | |
| - Research assistance | |
| - Educational tools | |
| - AI agents | |
| - Translation | |
| - Long-document analysis | |
| - Enterprise knowledge systems | |
| --- | |
| # Performance Considerations | |
| Performance depends on multiple factors, including: | |
| - Prompt quality | |
| - Context length | |
| - Hardware | |
| - Quantization | |
| - Inference framework | |
| - Generation parameters | |
| Longer contexts generally require more compute and memory resources. | |
| --- | |
| # Limitations | |
| The model may: | |
| - Produce factually incorrect information | |
| - Generate hallucinated content | |
| - Reflect biases present in training data | |
| - Make reasoning mistakes | |
| - Produce inconsistent outputs for ambiguous prompts | |
| Users should verify important outputs independently. | |
| --- | |
| # Responsible AI | |
| Droplychee-1.0-27B is intended to assist—not replace—human expertise. | |
| For high-impact domains such as healthcare, legal services, finance, and emergency response, human review is recommended before acting on generated outputs. | |
| --- | |
| # Reproducibility | |
| This repository provides documentation, usage examples, and deployment guidance to support reproducibility where practical. | |
| Some training artifacts, datasets, or internal configurations may not be publicly available. | |
| --- | |
| # Version Information | |
| | Field | Value | | |
| |--------|-------| | |
| | Version | 1.0 | | |
| | Model | Droplychee-1.0-27B | | |
| | Base Model | Qwen/Qwen3.6-27B | | |
| | Training | Full Supervised Fine-Tuning + Model Merge | | |
| | Context Length | Up to 1,000,000 Tokens | | |
| | Architecture | Decoder-only Transformer | | |
| --- | |
| # Future Work | |
| Potential future improvements include: | |
| - Expanded multilingual evaluation | |
| - Improved long-context efficiency | |
| - Additional deployment formats | |
| - Enhanced reasoning consistency | |
| - Broader benchmark coverage | |
| - Optimized inference performance | |
| Future work represents planned research directions and should not be interpreted as guaranteed features. | |
| --- | |
| <div align="center"> | |
| ### Droplychee AI Research | |
| Building Open, Efficient, and Responsible AI | |
| </div> | |
| --- | |
| # Evaluation | |
| ## Overview | |
| The evaluation of Droplychee-1.0-27B focuses on qualitative and practical capabilities across multilingual language understanding, instruction following, reasoning, coding, and long-context processing. | |
| The objective is to assess the model's usefulness in real-world applications rather than optimizing for a single benchmark. | |
| Unless otherwise stated, this repository does not claim independently verified benchmark scores. | |
| --- | |
| # Evaluation Philosophy | |
| The project emphasizes: | |
| - Transparency | |
| - Reproducibility | |
| - Practical usefulness | |
| - Responsible reporting | |
| - Human evaluation | |
| - Continuous improvement | |
| Performance should be interpreted within the context of the intended application. | |
| --- | |
| # Evaluation Categories | |
| The model may be evaluated across multiple capability areas, including: | |
| | Category | Description | | |
| |-----------|-------------| | |
| | Instruction Following | Ability to follow user requests | | |
| | Coding | Code generation and explanation | | |
| | Reasoning | Logical problem solving | | |
| | Mathematics | Mathematical understanding | | |
| | Translation | Multilingual translation | | |
| | Summarization | Long document summarization | | |
| | Conversation | Multi-turn dialogue | | |
| | Long Context | Extended context understanding | | |
| --- | |
| # Coding Evaluation | |
| Representative coding tasks include: | |
| - Python | |
| - JavaScript | |
| - TypeScript | |
| - C++ | |
| - Rust | |
| - Java | |
| - Go | |
| - SQL | |
| - HTML | |
| - CSS | |
| Typical evaluation areas: | |
| - Code generation | |
| - Code completion | |
| - Refactoring | |
| - Documentation | |
| - Debugging | |
| - Unit test generation | |
| - Algorithm implementation | |
| --- | |
| # Reasoning Evaluation | |
| Reasoning tasks may include: | |
| - Multi-step reasoning | |
| - Logical deduction | |
| - Planning | |
| - Chain-of-thought style prompting (where appropriate) | |
| - Structured problem solving | |
| The model's responses should be reviewed by humans for correctness in critical applications. | |
| --- | |
| # Mathematics | |
| Mathematical evaluation may include: | |
| - Arithmetic | |
| - Algebra | |
| - Geometry | |
| - Probability | |
| - Calculus | |
| - Statistics | |
| Generated solutions should be independently verified. | |
| --- | |
| # Multilingual Evaluation | |
| Droplychee-1.0-27B is intended to support multilingual inference. | |
| Example language categories include: | |
| - English | |
| - Bangla | |
| - Arabic | |
| - Chinese | |
| - French | |
| - German | |
| - Hindi | |
| - Japanese | |
| - Korean | |
| - Portuguese | |
| - Russian | |
| - Spanish | |
| - Turkish | |
| - Vietnamese | |
| Performance may vary across languages. | |
| --- | |
| # Long Context Evaluation | |
| The model is designed to support contexts up to **1,000,000 tokens** depending on deployment configuration. | |
| Representative long-context tasks include: | |
| - Book summarization | |
| - Research paper analysis | |
| - Repository understanding | |
| - Legal document analysis | |
| - Technical documentation | |
| - Large codebase navigation | |
| Practical performance depends on hardware and inference backend. | |
| --- | |
| # Safety Evaluation | |
| Safety-oriented evaluation may include: | |
| - Harmful request handling | |
| - Prompt injection resistance | |
| - Instruction adherence | |
| - Privacy awareness | |
| - Toxic content mitigation | |
| Safety remains an ongoing area of research and improvement. | |
| --- | |
| # Human Evaluation | |
| Human reviewers may assess responses based on: | |
| - Accuracy | |
| - Clarity | |
| - Completeness | |
| - Helpfulness | |
| - Consistency | |
| - Factual correctness | |
| - Instruction adherence | |
| Human evaluation provides valuable qualitative insights beyond automated benchmarks. | |
| --- | |
| # Benchmarking | |
| This repository does not publish benchmark scores unless explicitly documented. | |
| Users are encouraged to evaluate the model using benchmarks relevant to their own workloads. | |
| Possible evaluation suites include: | |
| - General language understanding | |
| - Coding benchmarks | |
| - Mathematical reasoning | |
| - Multilingual tasks | |
| - Long-context evaluation | |
| --- | |
| # Performance Factors | |
| Observed behavior may depend on: | |
| - Prompt design | |
| - Context length | |
| - Temperature | |
| - Sampling strategy | |
| - Hardware | |
| - Quantization | |
| - Inference framework | |
| Different deployment environments may produce different results. | |
| --- | |
| # Error Analysis | |
| Potential failure modes include: | |
| - Hallucinated information | |
| - Incorrect reasoning | |
| - Incomplete answers | |
| - Prompt misunderstanding | |
| - Translation inaccuracies | |
| - Code compilation errors | |
| These behaviors are common limitations of current large language models. | |
| --- | |
| # Responsible Interpretation | |
| Evaluation results should not be interpreted as guarantees of performance. | |
| Developers are encouraged to: | |
| - Test on their own datasets. | |
| - Validate outputs. | |
| - Measure production performance. | |
| - Conduct domain-specific evaluation. | |
| --- | |
| # Future Evaluation | |
| Planned evaluation efforts may include: | |
| - Expanded multilingual testing | |
| - Coding-focused assessment | |
| - Long-context benchmarks | |
| - Safety evaluation | |
| - Community benchmark submissions | |
| - External independent evaluations | |
| These represent future directions and not published results. | |
| --- | |
| # Conclusion | |
| Droplychee-1.0-27B is intended as a general-purpose multilingual language model for research and practical AI applications. | |
| The project encourages transparent evaluation, reproducible experimentation, and responsible deployment. Users should assess the model using benchmarks and datasets appropriate for their own use cases before production deployment. | |
| --- | |
| <div align="center"> | |
| ## Evaluation is an Ongoing Process | |
| **Measure • Verify • Improve** | |
| Droplychee AI Research | |
| </div> |