Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
unsloth
4-bit precision
Instructions to use shashikanth-a/model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use shashikanth-a/model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="shashikanth-a/model")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("shashikanth-a/model") model = AutoModelForCausalLM.from_pretrained("shashikanth-a/model") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use shashikanth-a/model with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "shashikanth-a/model" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "shashikanth-a/model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/shashikanth-a/model
- SGLang
How to use shashikanth-a/model with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "shashikanth-a/model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "shashikanth-a/model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "shashikanth-a/model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "shashikanth-a/model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Unsloth Studio new
How to use shashikanth-a/model with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for shashikanth-a/model to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for shashikanth-a/model to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for shashikanth-a/model to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="shashikanth-a/model", max_seq_length=2048, ) - Docker Model Runner
How to use shashikanth-a/model with Docker Model Runner:
docker model run hf.co/shashikanth-a/model
(Trained with Unsloth)
Browse files- 0000100_adapters.safetensors +1 -1
- 0000200_adapters.safetensors +1 -1
- 0000300_adapters.safetensors +1 -1
- 0000400_adapters.safetensors +1 -1
- 0000500_adapters.safetensors +1 -1
- 0000600_adapters.safetensors +1 -1
- 0000700_adapters.safetensors +1 -1
- 0000800_adapters.safetensors +1 -1
- 0000900_adapters.safetensors +1 -1
- 0001000_adapters.safetensors +1 -1
- adapters.safetensors +1 -1
- model-00001-of-00005.safetensors +1 -1
- model-00002-of-00005.safetensors +1 -1
- model-00003-of-00005.safetensors +1 -1
- model-00004-of-00005.safetensors +1 -1
0000100_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14e0f557a2d9b3f4a7bec803d26ccf5adc1d70743daa073951c17696f2f96149
|
| 3 |
size 6829513
|
0000200_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1917bc40bad53fb7330cf592ac2c9a74dfaa9f4a05bae8f37c6c270ad6ec87bd
|
| 3 |
size 6829513
|
0000300_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2209eef6a155ef4206a0212d5feeca0bc9752b105eb1ae7bdaf40c89bf8e6174
|
| 3 |
size 6829513
|
0000400_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:39472cc2165e344e9939b0a6b03811daab43f6607347f7dda4c9c5c2fae087d8
|
| 3 |
size 6829513
|
0000500_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fdb6c6a6aaf8c9f9b4821e6756818d29ccf138a575f48dcbd652264424fd61d
|
| 3 |
size 6829513
|
0000600_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a3de133a1d2bba23cb81533567edcb49cf0c45361a896dbea876a94390140f0
|
| 3 |
size 6829513
|
0000700_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:896e2e2c80ca94f53eda00973b5931e8fd4e225fec615dd3f8b3462a79cbfde1
|
| 3 |
size 6829513
|
0000800_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2a7085710dfd483238f810dfbff9198272bcd465b1c1ccdd17c61e259e043cf3
|
| 3 |
size 6829513
|
0000900_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cb370739441028fa0e008cdf41d35eeb7d451a7e5048b40b3d849b19721f13e4
|
| 3 |
size 6829513
|
0001000_adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a207bb46430351269ff688a27cafb3ab6d692808cff768856a4a7afcaef357ad
|
| 3 |
size 6829513
|
adapters.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6829513
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a207bb46430351269ff688a27cafb3ab6d692808cff768856a4a7afcaef357ad
|
| 3 |
size 6829513
|
model-00001-of-00005.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1055310424
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3c1983e7313457f229536a7500e2c790f6b5189c360a644d125c3773636ae5be
|
| 3 |
size 1055310424
|
model-00002-of-00005.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1047679760
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ae36896f748e0eef4469cb92d8f188d68adedaca84a2e481c2625f1597140c84
|
| 3 |
size 1047679760
|
model-00003-of-00005.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1071290813
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:60db56a2636fa96d54b6218c7321ae333211964baa52691a204bddd6aecbd6ea
|
| 3 |
size 1071290813
|
model-00004-of-00005.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1047704737
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5cf053120b3e53612363f0532ff8d1247aa5e47c63de133ae19e80f72e656f85
|
| 3 |
size 1047704737
|