Text Generation
Transformers
PyTorch
Safetensors
bloom
Eval Results (legacy)
text-generation-inference
Instructions to use bigscience/bloomz-7b1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bigscience/bloomz-7b1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="bigscience/bloomz-7b1")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("bigscience/bloomz-7b1") model = AutoModelForCausalLM.from_pretrained("bigscience/bloomz-7b1") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use bigscience/bloomz-7b1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bigscience/bloomz-7b1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bigscience/bloomz-7b1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/bigscience/bloomz-7b1
- SGLang
How to use bigscience/bloomz-7b1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "bigscience/bloomz-7b1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bigscience/bloomz-7b1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "bigscience/bloomz-7b1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bigscience/bloomz-7b1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use bigscience/bloomz-7b1 with Docker Model Runner:
docker model run hf.co/bigscience/bloomz-7b1
Commit ·
5754a9f
1
Parent(s): d3cba1f
Organize
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/en/prompt_body_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/en/prompt_review_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/en/prompt_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/es/prompt_body_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/es/prompt_review_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/es/prompt_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/fr/prompt_body_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/fr/prompt_review_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/fr/prompt_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/zh/prompt_body_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/zh/prompt_review_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/zh/prompt_title_to_star/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/aqua_rat/raw/Answer_questions_from_options/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/aqua_rat/raw/answer_quiz/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/aqua_rat/raw/select_the_best_option/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_believable/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_desc/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_likely/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_options/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/banking77/direct_to_which_department/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/banking77/help_page_topic/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/banking77/rephrase_as_banking_term/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blbooksgenre/title_genre_classifiction/classify/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blbooksgenre/title_genre_classifiction/multi-choice/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blbooksgenre/title_genre_classifiction/premise_context_first/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/grammatical_between_1_2/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/grammatical_between_A_B/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/grammatical_which_one_1_2/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/single_sentence_bad_yes_no/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/single_sentence_good_yes_no/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/claim_and_all_supporting_evidences/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/fifth_evidence_and_claim_itemization/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/first_evidence_and_claim_itemization/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/second_evidence_and_claim_itemization/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/third_evidence_claim_pair/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/codah/codah/affirmative_instruction_after_sentence_and_choices/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/codah/codah/affirmative_instruction_before_sentence_and_choices/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/codah/codah/interrogative_instruction_after_sentence_and_choices/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/commonsense_qa/answer_given_question_without_options/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/commonsense_qa/most_suitable_answer/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/commonsense_qa/question_answering/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/ambiguous/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/clarification_needed/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/directly_answer/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/score_give_number/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/score_how_much/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/craigslist_bargains/best_deal/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/craigslist_bargains/good_deal_for_seller/results.json +0 -0
- {evaluation_val → evaluation_bloomz-7b1/evaluation_val}/craigslist_bargains/good_deal_for_seller_no_list_price/results.json +0 -0
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/en/prompt_body_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/en/prompt_review_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/en/prompt_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/es/prompt_body_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/es/prompt_review_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/es/prompt_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/fr/prompt_body_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/fr/prompt_review_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/fr/prompt_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/zh/prompt_body_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/zh/prompt_review_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/amazon_reviews_multi/zh/prompt_title_to_star/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/aqua_rat/raw/Answer_questions_from_options/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/aqua_rat/raw/answer_quiz/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/aqua_rat/raw/select_the_best_option/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_believable/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_desc/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_likely/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/art/choose_hypothesis_options/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/banking77/direct_to_which_department/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/banking77/help_page_topic/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/banking77/rephrase_as_banking_term/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blbooksgenre/title_genre_classifiction/classify/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blbooksgenre/title_genre_classifiction/multi-choice/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blbooksgenre/title_genre_classifiction/premise_context_first/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/grammatical_between_1_2/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/grammatical_between_A_B/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/grammatical_which_one_1_2/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/single_sentence_bad_yes_no/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/blimp/adjunct_island/single_sentence_good_yes_no/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/claim_and_all_supporting_evidences/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/fifth_evidence_and_claim_itemization/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/first_evidence_and_claim_itemization/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/second_evidence_and_claim_itemization/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/climate_fever/third_evidence_claim_pair/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/codah/codah/affirmative_instruction_after_sentence_and_choices/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/codah/codah/affirmative_instruction_before_sentence_and_choices/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/codah/codah/interrogative_instruction_after_sentence_and_choices/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/commonsense_qa/answer_given_question_without_options/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/commonsense_qa/most_suitable_answer/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/commonsense_qa/question_answering/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/ambiguous/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/clarification_needed/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/directly_answer/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/score_give_number/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/conv_ai_3/score_how_much/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/craigslist_bargains/best_deal/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/craigslist_bargains/good_deal_for_seller/results.json
RENAMED
|
File without changes
|
{evaluation_val → evaluation_bloomz-7b1/evaluation_val}/craigslist_bargains/good_deal_for_seller_no_list_price/results.json
RENAMED
|
File without changes
|