Text Generation
Transformers
Safetensors
English
llama
reasoning
small
distillation
text-generation-inference
Instructions to use HBB-Community/HamBoBoGPT-1-Base_mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use HBB-Community/HamBoBoGPT-1-Base_mini with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="HBB-Community/HamBoBoGPT-1-Base_mini")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("HBB-Community/HamBoBoGPT-1-Base_mini") model = AutoModelForCausalLM.from_pretrained("HBB-Community/HamBoBoGPT-1-Base_mini") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use HBB-Community/HamBoBoGPT-1-Base_mini with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "HBB-Community/HamBoBoGPT-1-Base_mini" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "HBB-Community/HamBoBoGPT-1-Base_mini", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/HBB-Community/HamBoBoGPT-1-Base_mini
- SGLang
How to use HBB-Community/HamBoBoGPT-1-Base_mini with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "HBB-Community/HamBoBoGPT-1-Base_mini" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "HBB-Community/HamBoBoGPT-1-Base_mini", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "HBB-Community/HamBoBoGPT-1-Base_mini" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "HBB-Community/HamBoBoGPT-1-Base_mini", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use HBB-Community/HamBoBoGPT-1-Base_mini with Docker Model Runner:
docker model run hf.co/HBB-Community/HamBoBoGPT-1-Base_mini
Commit History
Update README.md 0f4329c verified
Jar with water commited on
Update README.md 84761a2 verified
Upload logo.png 5716762 verified
Update README.md 2876e43 verified
Copyright P commited on
Update README.md c2c6c60 verified
Copyright P commited on
Update README.md 4f6f57a verified
Copyright P commited on
Update README.md e49b875 verified
Copyright P commited on
Delete checkpoint-1000 a664404 verified
Copyright P commited on
Delete checkpoint-500 9e8c98e verified
Copyright P commited on
Upload 5 files 59c2054 verified
Copyright P commited on
Delete config.json eb008c7 verified
Copyright P commited on
Update README.md 8752cde verified
Copyright P commited on
Update config.json 6c73a50 verified
HBB Team Creations commited on
Upload config.json 81b1c03 verified
HBB Team Creations commited on
Update README.md 9af5329 verified
HBB Team Creations commited on
Update README.md db2e781 verified
HBB Team Creations commited on
Update README.md (#1) 56e2bfa
HBB Team Creations commited on
Upload 10 files 7966f77 verified
Copyright P commited on
Update README.md 12f6349 verified
Copyright P commited on
Update README.md 6a8d493 verified
Copyright P commited on
Update README.md 3ba1d12 verified
Copyright P commited on
Update README.md 35e0dbd verified
Copyright P commited on
Update README.md 7b05d30 verified
Copyright P commited on
Update README.md f71ad99 verified
Copyright P commited on
Update README.md a8adf04 verified
Copyright P commited on
initial commit f0ca5cf verified
Copyright P commited on