Instructions to use QuixiAI/Kraken with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use QuixiAI/Kraken with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="QuixiAI/Kraken", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("QuixiAI/Kraken", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -32,8 +32,6 @@ Extensible Configuration: Leverages a custom configuration setup that can be eas
|
|
| 32 |
**How to load and call Kraken model :**
|
| 33 |
```
|
| 34 |
from transformers import AutoModelForCausalLM
|
| 35 |
-
|
| 36 |
-
|
| 37 |
device = "cuda:0" ## Setup "cuda:0" if NVIDIA, "mps" if on Mac
|
| 38 |
|
| 39 |
# Load the model and config:
|
|
|
|
| 32 |
**How to load and call Kraken model :**
|
| 33 |
```
|
| 34 |
from transformers import AutoModelForCausalLM
|
|
|
|
|
|
|
| 35 |
device = "cuda:0" ## Setup "cuda:0" if NVIDIA, "mps" if on Mac
|
| 36 |
|
| 37 |
# Load the model and config:
|