Text Generation
Transformers
PyTorch
Safetensors
bloom
Eval Results (legacy)
text-generation-inference
Instructions to use bigscience/bloomz-7b1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bigscience/bloomz-7b1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="bigscience/bloomz-7b1")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("bigscience/bloomz-7b1") model = AutoModelForCausalLM.from_pretrained("bigscience/bloomz-7b1") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use bigscience/bloomz-7b1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bigscience/bloomz-7b1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bigscience/bloomz-7b1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/bigscience/bloomz-7b1
- SGLang
How to use bigscience/bloomz-7b1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "bigscience/bloomz-7b1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bigscience/bloomz-7b1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "bigscience/bloomz-7b1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bigscience/bloomz-7b1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use bigscience/bloomz-7b1 with Docker Model Runner:
docker model run hf.co/bigscience/bloomz-7b1
Commit ·
ed75a42
1
Parent(s): 5754a9f
Logs
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- .gitattributes +1 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Answer_Given_options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Choose_Story_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Generate_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Novel_Correct_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Story_Continuation_and_Options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Answer_Given_options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Choose_Story_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Generate_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Novel_Correct_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Story_Continuation_and_Options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Answer_Given_options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Choose_Story_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Generate_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Novel_Correct_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Story_Continuation_and_Options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Answer_Given_options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Choose_Story_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Generate_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Novel_Correct_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Story_Continuation_and_Options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Answer_Given_options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Choose_Story_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Generate_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Novel_Correct_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Story_Continuation_and_Options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Answer_Given_options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Choose_Story_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Generate_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Novel_Correct_Ending/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Story_Continuation_and_Options/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/Replace/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/True_or_False/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/does_underscore_refer_to/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/stand_for/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/underscore_refer_to/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/Replace/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/True_or_False/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/does_underscore_refer_to/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/stand_for/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/underscore_refer_to/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/Replace/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/True_or_False/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/does_underscore_refer_to/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/stand_for/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/underscore_refer_to/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/Replace/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/True_or_False/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/does_underscore_refer_to/results.json +0 -0
- {evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/stand_for/results.json +0 -0
.gitattributes
CHANGED
|
@@ -31,3 +31,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 31 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 32 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 33 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 31 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 32 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 33 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 34 |
+
logs/logs/main_log.txt filter=lfs diff=lfs merge=lfs -text
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Answer_Given_options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Choose_Story_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Generate_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Novel_Correct_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/ar/Story_Continuation_and_Options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Answer_Given_options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Choose_Story_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Generate_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Novel_Correct_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/es/Story_Continuation_and_Options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Answer_Given_options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Choose_Story_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Generate_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Novel_Correct_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/eu/Story_Continuation_and_Options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Answer_Given_options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Choose_Story_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Generate_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Novel_Correct_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/hi/Story_Continuation_and_Options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Answer_Given_options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Choose_Story_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Generate_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Novel_Correct_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/id/Story_Continuation_and_Options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Answer_Given_options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Choose_Story_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Generate_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Novel_Correct_Ending/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xstory_cloze/zh/Story_Continuation_and_Options/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/Replace/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/True_or_False/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/does_underscore_refer_to/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/stand_for/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/en/underscore_refer_to/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/Replace/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/True_or_False/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/does_underscore_refer_to/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/stand_for/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/fr/underscore_refer_to/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/Replace/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/True_or_False/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/does_underscore_refer_to/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/stand_for/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/pt/underscore_refer_to/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/Replace/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/True_or_False/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/does_underscore_refer_to/results.json
RENAMED
|
File without changes
|
{evaluation_l1 → evaluation_bloomz-7b1/evaluation_l1}/Muennighoff_xwinograd/zh/stand_for/results.json
RENAMED
|
File without changes
|