Question Answering
Transformers
Safetensors
Chinese
English
llama
text-generation
custom_code
text-generation-inference
Instructions to use FlagAlpha/Atom-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FlagAlpha/Atom-7B with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="FlagAlpha/Atom-7B", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("FlagAlpha/Atom-7B", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("FlagAlpha/Atom-7B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload generation_config.json with huggingface_hub
Browse files- generation_config.json +1 -1
generation_config.json
CHANGED
|
@@ -4,5 +4,5 @@
|
|
| 4 |
"eos_token_id": 2,
|
| 5 |
"max_length": 4096,
|
| 6 |
"pad_token_id": 2,
|
| 7 |
-
"transformers_version": "4.
|
| 8 |
}
|
|
|
|
| 4 |
"eos_token_id": 2,
|
| 5 |
"max_length": 4096,
|
| 6 |
"pad_token_id": 2,
|
| 7 |
+
"transformers_version": "4.29.0"
|
| 8 |
}
|