Mocha Mini β˜•

Mocha Mini is a tiny but mighty sentence completion model designed for fast, creative text generation without the bloat. Perfect for small projects, prototyping, or just having fun with text.

Mocha Mini Banner


⚑ Features

  • 🏎 Ultra-Lightweight – fast loading, easy deployment.
  • ✍️ Sentence Completion – generate relevant endings from any text prompt.
  • πŸ›‘ Safetensors Format – secure, efficient, and easy to load.
  • 🎨 Custom Tokenization – uses stoi/itos for fully local control.

πŸ“‚ Project Structure

.
β”œβ”€β”€ mocha.safetensors # Model weights
β”œβ”€β”€ config.json
β”œβ”€β”€ generation_config.json
β”œβ”€β”€ itos.json         # Index-to-string mapping
β”œβ”€β”€ stoi.json         # String-to-index mapping
β”œβ”€β”€ logo.png          # Project logo
β”œβ”€β”€ banner.png        # Project banner
└── README.md

πŸš€ Quick Start

No official tokenizer? No problem β€” Mocha Mini just needs your stoi/itos for input/output mapping:

import torch
from transformers import AutoModelForCausalLM, AutoConfig

# Load config and model
config = AutoConfig.from_pretrained("theguywhosucks/mochaV1-base", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    "theguywhosucks/mochaV1-base",
    config=config,
    device_map="auto",
    load_in_8bit=True,  # INT8 quantization for speed & memory
    trust_remote_code=True,
    use_safetensors=True
)

# Use your custom stoi/itos for input/output
def stoi(text): ...
def tosi(indices): ...

prompt = "The future of AI is"
tokens = stoi(prompt)
# Model inference logic here

πŸ“Έ Assets

Mocha Mini Logo


πŸ›  Requirements

Install all dependencies:

pip install torch transformers safetensors bitsandbytes

πŸ“œ License

Licensed under the Mocha Proprietary License β€” usage, distribution, and modification are restricted. See LICENSE for details.


β˜• Mocha Mini – tiny, fast, and ready to complete your sentences.

Downloads last month
13
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for theguywhosucks/mochaV1-mini

Finetuned
(1)
this model

Collection including theguywhosucks/mochaV1-mini