MoCha V1
Collection
A first generation version of the MoCha sentence completion model.
β’
2 items
β’
Updated
β’
1
Mocha Mini is a tiny but mighty sentence completion model designed for fast, creative text generation without the bloat. Perfect for small projects, prototyping, or just having fun with text.
stoi/itos for fully local control..
βββ mocha.safetensors # Model weights
βββ config.json
βββ generation_config.json
βββ itos.json # Index-to-string mapping
βββ stoi.json # String-to-index mapping
βββ logo.png # Project logo
βββ banner.png # Project banner
βββ README.md
No official tokenizer? No problem β Mocha Mini just needs your stoi/itos for input/output mapping:
import torch
from transformers import AutoModelForCausalLM, AutoConfig
# Load config and model
config = AutoConfig.from_pretrained("theguywhosucks/mochaV1-base", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
"theguywhosucks/mochaV1-base",
config=config,
device_map="auto",
load_in_8bit=True, # INT8 quantization for speed & memory
trust_remote_code=True,
use_safetensors=True
)
# Use your custom stoi/itos for input/output
def stoi(text): ...
def tosi(indices): ...
prompt = "The future of AI is"
tokens = stoi(prompt)
# Model inference logic here
Install all dependencies:
pip install torch transformers safetensors bitsandbytes
Licensed under the Mocha Proprietary License β usage, distribution, and modification are restricted. See LICENSE for details.
β Mocha Mini β tiny, fast, and ready to complete your sentences.
Base model
theguywhosucks/mochaV1-base