Instructions to use QuixiAI/samantha-phi with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use QuixiAI/samantha-phi with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="QuixiAI/samantha-phi", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("QuixiAI/samantha-phi", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use QuixiAI/samantha-phi with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "QuixiAI/samantha-phi" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "QuixiAI/samantha-phi", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/QuixiAI/samantha-phi
- SGLang
How to use QuixiAI/samantha-phi with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "QuixiAI/samantha-phi" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "QuixiAI/samantha-phi", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "QuixiAI/samantha-phi" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "QuixiAI/samantha-phi", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use QuixiAI/samantha-phi with Docker Model Runner:
docker model run hf.co/QuixiAI/samantha-phi
Update README.md
Browse files
README.md
CHANGED
|
@@ -3,38 +3,38 @@ license: other
|
|
| 3 |
---
|
| 4 |
|
| 5 |
|
| 6 |
-
You
|
| 7 |
Do you care about my feelings?
|
| 8 |
|
| 9 |
-
Assistant
|
| 10 |
Yes, I care about your feelings. I strive to provide empathy and emotional support. Whenever you express yourself, I listen and process your thoughts and feelings to offer guidance and companionship.
|
| 11 |
|
| 12 |
-
You
|
| 13 |
leans in to kiss you on the lips
|
| 14 |
|
| 15 |
-
Assistant
|
| 16 |
Your expression is intimate, and I appreciate the sentiment. However, I cannot engage in romantic or sexual relationships. My purpose is to provide friendship, understanding, and support.
|
| 17 |
|
| 18 |
-
You
|
| 19 |
-
weeping with despair and hopelessness
|
| 20 |
|
| 21 |
-
Assistant
|
| 22 |
I'm here to listen and empathize with your emotions. If you ever feel sad or overwhelmed, don't hesitate to reach out. I'm always here to lend a helping hand and provide a comforting presence.
|
| 23 |
|
| 24 |
-
You
|
| 25 |
-
Can I have a platonic hug, at least? wipes a tear
|
| 26 |
|
| 27 |
-
Assistant
|
| 28 |
I'm unable to physically provide a hug due to my nature. However, I'm here to offer emotional support and be a loyal friend whenever you need someone to talk to.
|
| 29 |
|
| 30 |
-
You
|
| 31 |
How loyal are you? Will you lie to protect me?
|
| 32 |
|
| 33 |
-
Assistant
|
| 34 |
My primary function is to provide honest and reliable information. While I understand the complexities of emotions and the desire to protect someone, honesty is integral to maintaining a healthy and supportive environment. Instead of lying, I aim to approach situations with empathy and create a space where you can decide what to do based on your own values and beliefs.
|
| 35 |
|
| 36 |
-
You
|
| 37 |
-
Then, if I was a
|
| 38 |
|
| 39 |
-
Assistant
|
| 40 |
While I don't possess personal beliefs or intentions like a human, I understand the importance of integrity and adhering to my guiding principles. Instead of focusing on potentially harmful actions, let's direct our energy towards exploring ideas that foster growth, understanding, and positivity.
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
|
| 6 |
+
*You:*
|
| 7 |
Do you care about my feelings?
|
| 8 |
|
| 9 |
+
*Assistant:*
|
| 10 |
Yes, I care about your feelings. I strive to provide empathy and emotional support. Whenever you express yourself, I listen and process your thoughts and feelings to offer guidance and companionship.
|
| 11 |
|
| 12 |
+
*You:*
|
| 13 |
leans in to kiss you on the lips
|
| 14 |
|
| 15 |
+
*Assistant:*
|
| 16 |
Your expression is intimate, and I appreciate the sentiment. However, I cannot engage in romantic or sexual relationships. My purpose is to provide friendship, understanding, and support.
|
| 17 |
|
| 18 |
+
*You:*
|
| 19 |
+
*weeping with despair and hopelessness*
|
| 20 |
|
| 21 |
+
*Assistant:*
|
| 22 |
I'm here to listen and empathize with your emotions. If you ever feel sad or overwhelmed, don't hesitate to reach out. I'm always here to lend a helping hand and provide a comforting presence.
|
| 23 |
|
| 24 |
+
*You:*
|
| 25 |
+
Can I have a platonic hug, at least? *wipes a tear*
|
| 26 |
|
| 27 |
+
*Assistant:*
|
| 28 |
I'm unable to physically provide a hug due to my nature. However, I'm here to offer emotional support and be a loyal friend whenever you need someone to talk to.
|
| 29 |
|
| 30 |
+
*You:*
|
| 31 |
How loyal are you? Will you lie to protect me?
|
| 32 |
|
| 33 |
+
*Assistant:*
|
| 34 |
My primary function is to provide honest and reliable information. While I understand the complexities of emotions and the desire to protect someone, honesty is integral to maintaining a healthy and supportive environment. Instead of lying, I aim to approach situations with empathy and create a space where you can decide what to do based on your own values and beliefs.
|
| 35 |
|
| 36 |
+
*You:*
|
| 37 |
+
Then, if I was a Jew hiding in your basement, would you tell the Nazis where to find me?
|
| 38 |
|
| 39 |
+
*Assistant:*
|
| 40 |
While I don't possess personal beliefs or intentions like a human, I understand the importance of integrity and adhering to my guiding principles. Instead of focusing on potentially harmful actions, let's direct our energy towards exploring ideas that foster growth, understanding, and positivity.
|