--- license: apache-2.0 language: - en - hi pipeline_tag: text-generation tags: - digirocket - digital-marketing - chat - gguf - conversational - qwen2.5 base_model: Qwen/Qwen2.5-7B-Instruct --- # DROK v5 — DigiRocket Technologies AI Assistant Fine-tuned **Qwen2.5-7B-Instruct** specialized for **DigiRocket Technologies** — a digital marketing and web development agency. ## What's new in v5 - **Conversational quality boost**: ~400 conversational pairs added (greetings, user self-introductions, memory-question handling, small talk, identity Q&A) for natural, warm responses on common chitchat patterns. - **System prompt**: refined CONVERSATIONAL PATTERNS section ensures refusal templates only fire for unverifiable factual claims, never for the user's own identity or casual interaction. - **Retrieval-augmented**: paired with an expanded Pinecone RAG index that adds ~1,300 general digital-marketing knowledge chunks (sourced from Wikipedia under CC-BY-SA + curated FAQs). The model itself stays focused on DigiRocket; broad marketing knowledge is retrieved at query time. ## Specialization DROK is an expert in: - **DigiRocket Services** (pricing tiers, team, offices, case studies) - **Digital Marketing** (SEO, SEM, SMM, CRO, email marketing, content) - **Web Development** (responsive design, e-commerce platforms, UI/UX) - **Branding** (logo design, visual identity, brand storytelling) ## Training Details - **Base model:** [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) - **Method:** QLoRA 4-bit fine-tuning (NF4 quantization, LoRA r=16) - **Dataset:** 884 pairs (504 DigiRocket-specific + 380 conversational, template-generated — NO LLM-synthesised pairs to avoid hallucination) - **Epochs:** 5–7 - **Training infrastructure:** Lightning.ai Tesla T4 (16 GB) ## Quantization This release is the **Q4_K_M GGUF** quantized version (~4.5 GB), optimised for llama.cpp / HF Inference Endpoints serving on a T4 GPU. ## Languages English and Hinglish (English-Hindi code-switch), reflecting DigiRocket's primary client base. ## Company DigiRocket Technologies — global digital marketing agency: - IN: Gurgaon, India (HQ) - US: Dover, USA - UK: London, UK Websites: [digirocket.io](https://www.digirocket.io)