Sheikh / HF_UPLOAD_GUIDE.md
megharudushi's picture
Upload folder using huggingface_hub
7d3d63c verified

🚀 Bengali AI Hugging Face Upload Guide

📋 Prerequisites Complete ✅

Your Bengali AI model is fully prepared with all files:

  • ✅ Model weights (1.4GB)
  • ✅ Tokenizer files
  • ✅ Configuration files
  • ✅ Model card (README.md)

🔐 Authentication Required

To upload to Hugging Face, you need to authenticate. Choose one method:

Method 1: Command Line (Recommended)

# Install HF CLI
pip install huggingface_hub

# Login (will prompt for token)
huggingface-cli login

# Or set token directly
export HF_TOKEN=your_token_here

Method 2: Get Your Token

  1. Go to https://huggingface.co/settings/tokens
  2. Create a new token (read/write permissions)
  3. Copy the token

Method 3: Browser Login

from huggingface_hub import HfApi
api = HfApi()
api.login()  # Opens browser for login

📤 Upload Commands

Once authenticated, run this to upload:

# Navigate to your model directory
cd /path/to/your/workspace

# Upload to Hugging Face
huggingface-cli upload megharudushi/Sheikh ready_bengali_ai/ \
  --commit-message "Complete Bengali AI model with all files"

🎯 Alternative: Manual Upload

If CLI doesn't work, you can:

  1. Zip the model directory:

    zip -r bengali_ai_model.zip ready_bengali_ai/
    
  2. Upload via web interface:

📊 Model Information

Repository: megharudushi/Sheikh Files: 11 files including:

  • model.bin (1.4GB) - Model weights
  • tokenizer.json (3.4MB) - Tokenizer config
  • vocab.json (780KB) - Vocabulary
  • README.md - Model documentation
  • All other necessary configuration files

🌐 After Upload

Your model will be available at: https://huggingface.co/megharudushi/Sheikh

Anyone can then use it with:

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("megharudushi/Sheikh")
model = AutoModelForCausalLM.from_pretrained("megharudushi/Sheikh")

🔧 Troubleshooting

If upload fails:

  1. Check authentication: huggingface-cli whoami
  2. Verify repository name: megharudushi/Sheikh
  3. Check internet connection
  4. Try different upload method

If repository already exists:

  • The upload will update existing files
  • Use --force flag if needed: huggingface-cli upload megharudushi/Sheikh ready_bengali_ai/ --force

Your Bengali AI model is ready to share with the world! 🌍