Update README.md
Browse files
README.md
CHANGED
|
@@ -22,11 +22,11 @@ As Dolphy 1.0 and Qwen3 2507 Instruct models share the same base, Dolphy 1.0 is
|
|
| 22 |
You can also find this model in upcoming Dolphy AI releases.
|
| 23 |
|
| 24 |
**How to run locally**
|
|
|
|
| 25 |
For running locally we recommend using our GGUF models for fast inference. Nonetheless you can run the safetensors by using Hugging Face Transformers.
|
| 26 |
Our model requires no steps before inference and are ready.
|
| 27 |
|
| 28 |
```
|
| 29 |
-
{
|
| 30 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 31 |
|
| 32 |
model_name = "Dolphy-AI/Dolphy-1.0"
|
|
@@ -38,7 +38,7 @@ print("Type 'exit' to quit.\n")
|
|
| 38 |
while True:
|
| 39 |
user_input = input("Enter your prompt: ")
|
| 40 |
if user_input.lower() == "exit":
|
| 41 |
-
print("Goodbye!")
|
| 42 |
break
|
| 43 |
|
| 44 |
# Tokenize and generate
|
|
@@ -47,9 +47,8 @@ while True:
|
|
| 47 |
|
| 48 |
# Decode and print result
|
| 49 |
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
|
| 50 |
-
print("\
|
| 51 |
|
| 52 |
-
}
|
| 53 |
```
|
| 54 |
|
| 55 |
## Available Model files:
|
|
|
|
| 22 |
You can also find this model in upcoming Dolphy AI releases.
|
| 23 |
|
| 24 |
**How to run locally**
|
| 25 |
+
<br></br>
|
| 26 |
For running locally we recommend using our GGUF models for fast inference. Nonetheless you can run the safetensors by using Hugging Face Transformers.
|
| 27 |
Our model requires no steps before inference and are ready.
|
| 28 |
|
| 29 |
```
|
|
|
|
| 30 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 31 |
|
| 32 |
model_name = "Dolphy-AI/Dolphy-1.0"
|
|
|
|
| 38 |
while True:
|
| 39 |
user_input = input("Enter your prompt: ")
|
| 40 |
if user_input.lower() == "exit":
|
| 41 |
+
print("Goodbye! Thank you for using Dolphy 1.0")
|
| 42 |
break
|
| 43 |
|
| 44 |
# Tokenize and generate
|
|
|
|
| 47 |
|
| 48 |
# Decode and print result
|
| 49 |
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
|
| 50 |
+
print("\nDolphy 1.0 response:\n", response, "\n")
|
| 51 |
|
|
|
|
| 52 |
```
|
| 53 |
|
| 54 |
## Available Model files:
|