Text Generation
GGUF
English
Bengali
gemma
finetuned
affiliate
screening
conversational
ollama
llama-cpp
unsloth
q4_k_m
Instructions to use imonetizeitbd/ai-manager with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use imonetizeitbd/ai-manager with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf imonetizeitbd/ai-manager:F16 # Run inference directly in the terminal: llama cli -hf imonetizeitbd/ai-manager:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf imonetizeitbd/ai-manager:F16 # Run inference directly in the terminal: llama cli -hf imonetizeitbd/ai-manager:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf imonetizeitbd/ai-manager:F16 # Run inference directly in the terminal: ./llama-cli -hf imonetizeitbd/ai-manager:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf imonetizeitbd/ai-manager:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf imonetizeitbd/ai-manager:F16
Use Docker
docker model run hf.co/imonetizeitbd/ai-manager:F16
- LM Studio
- Jan
- vLLM
How to use imonetizeitbd/ai-manager with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "imonetizeitbd/ai-manager" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "imonetizeitbd/ai-manager", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/imonetizeitbd/ai-manager:F16
- Ollama
How to use imonetizeitbd/ai-manager with Ollama:
ollama run hf.co/imonetizeitbd/ai-manager:F16
- Unsloth Studio
How to use imonetizeitbd/ai-manager with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for imonetizeitbd/ai-manager to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for imonetizeitbd/ai-manager to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for imonetizeitbd/ai-manager to start chatting
- Docker Model Runner
How to use imonetizeitbd/ai-manager with Docker Model Runner:
docker model run hf.co/imonetizeitbd/ai-manager:F16
- Lemonade
How to use imonetizeitbd/ai-manager with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull imonetizeitbd/ai-manager:F16
Run and chat with the model
lemonade run user.ai-manager-F16
List all available models
lemonade list
- Atomic Chat
| license: gemma | |
| base_model: unsloth/gemma-3-4b-it | |
| tags: | |
| - gguf | |
| - gemma | |
| - finetuned | |
| - affiliate | |
| - screening | |
| - conversational | |
| - ollama | |
| - llama-cpp | |
| - unsloth | |
| - q4_k_m | |
| language: | |
| - en | |
| - bn | |
| pipeline_tag: text-generation | |
| # π€ AI Manager - Affiliate Screening Assistant | |
| ## π Overview | |
| **AI Manager** is a fine-tuned version of Google's **Gemma-3-4B** model, specifically trained for **affiliate application screening**. It acts as an intelligent assistant that verifies affiliate applications, enforces network policies, and communicates in **English, Bangla, or Banglish** based on user preference. | |
| This model is designed for **Monir Hasan (Monir iMonetizeIt)**, Sales Manager & Affiliate Specialist at **iMonetizeIt**, a global CPA and Smartlink affiliate network. | |
| --- | |
| ## π― Use Cases | |
| - β **Affiliate Application Screening** β Verify applicant eligibility | |
| - β **Policy Enforcement** β Ensure compliance with network rules | |
| - β **Document Verification** β Check NID, screenshots, and other documents | |
| - β **Multi-language Support** β Respond in English, Bangla, or Banglish | |
| - β **Rule-based Decision Making** β Enforce 18+ age limit, desktop screenshots, etc. | |
| --- | |
| ## π οΈ Training Details | |
| | Parameter | Value | | |
| |-----------|-------| | |
| | **Base Model** | `unsloth/gemma-3-4b-it` | | |
| | **Fine-tuning Method** | QLoRA (4-bit quantization) | | |
| | **LoRA Rank (r)** | 32 | | |
| | **LoRA Alpha** | 64 | | |
| | **Trainable Parameters** | 65.5M (1.5% of total) | | |
| | **Dataset Size** | 584 training examples | | |
| | **Evaluation Size** | 64 validation examples | | |
| | **Epochs** | 4 | | |
| | **Batch Size** | 2 | | |
| | **Learning Rate** | 2e-4 | | |
| | **Optimizer** | AdamW 8-bit | | |
| | **Loss Function** | Cross-entropy with response-only masking | | |
| | **Hardware** | Kaggle T4 GPU (2x) | | |
| ### Training Progress | |
| | Epoch | Training Loss | Validation Loss | | |
| |-------|---------------|-----------------| | |
| | 1 | 2.439 | 1.902 | | |
| | 2 | 0.709 | 1.683 | | |
| | 3 | 0.453 | 1.695 | | |
| | 4 | 0.385 | 1.702 | | |
| --- | |
| ## π Model Files | |
| | File | Size | Description | | |
| |------|------|-------------| | |
| | `gemma-3-4b-it.Q4_K_M.gguf` | 2.49 GB | Quantized GGUF model (Q4_K_M) | | |
| | `gemma-3-4b-it.F16-mmproj.gguf` | 812 MB | Multimodal projection file | | |
| --- | |
| ## π How to Use | |
| ### Option 1: Ollama (Recommended) | |
| Create a `Modelfile`: | |
| ```dockerfile | |
| FROM https://huggingface.co/imonetizeitbd/ai-manager/resolve/main/gemma-3-4b-it.Q4_K_M.gguf | |
| TEMPLATE """<bos><start_of_turn>user | |
| {{ .Prompt }}<end_of_turn> | |
| <start_of_turn>model | |
| {{ .Response }}<end_of_turn>""" | |
| PARAMETER temperature 0.3 | |
| PARAMETER top_p 0.9 | |
| PARAMETER stop "<end_of_turn>" |