Question Answering
Transformers
Safetensors
Chinese
English
llama
text-generation
custom_code
text-generation-inference
Instructions to use FlagAlpha/Atom-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FlagAlpha/Atom-7B with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="FlagAlpha/Atom-7B", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("FlagAlpha/Atom-7B", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("FlagAlpha/Atom-7B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload configuration.json with huggingface_hub
Browse files- configuration.json +11 -0
configuration.json
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"framework": "pytorch",
|
| 3 |
+
"task": "text-generation",
|
| 4 |
+
"model": {
|
| 5 |
+
"type": "Atom-13B"
|
| 6 |
+
},
|
| 7 |
+
"pipeline": {
|
| 8 |
+
"type": "Atom-7B-pipe"
|
| 9 |
+
},
|
| 10 |
+
"allow_remote": true
|
| 11 |
+
}
|