Instructions to use realsanjeev/results with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use realsanjeev/results with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="realsanjeev/results")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("realsanjeev/results") model = AutoModelForSeq2SeqLM.from_pretrained("realsanjeev/results") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use realsanjeev/results with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "realsanjeev/results" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "realsanjeev/results", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/realsanjeev/results
- SGLang
How to use realsanjeev/results with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "realsanjeev/results" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "realsanjeev/results", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "realsanjeev/results" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "realsanjeev/results", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use realsanjeev/results with Docker Model Runner:
docker model run hf.co/realsanjeev/results
Commit History
Final-summerization-nepali 8ffb871 verified
Sanjeev Bhandari commited on
Training in progress, step 6500 9a07e69 verified
Sanjeev Bhandari commited on
Training in progress, step 6000 053080e verified
Sanjeev Bhandari commited on
Training in progress, step 5500 fd776cf verified
Sanjeev Bhandari commited on
Training in progress, step 5000 5a9f53e verified
Sanjeev Bhandari commited on
Training in progress, step 4500 0919026 verified
Sanjeev Bhandari commited on
Training in progress, step 4000 8851c18 verified
Sanjeev Bhandari commited on
Training in progress, step 3500 ad37bb1 verified
Sanjeev Bhandari commited on
Training in progress, step 3000 c7fb84c verified
Sanjeev Bhandari commited on
Training in progress, step 2500 600c75a verified
Sanjeev Bhandari commited on
Training in progress, step 2000 eb22245 verified
Sanjeev Bhandari commited on
Training in progress, step 1500 79b2943 verified
Sanjeev Bhandari commited on
Training in progress, step 1000 2b7b458 verified
Sanjeev Bhandari commited on
Training in progress, step 500 c18fbc2 verified
Sanjeev Bhandari commited on
Training in progress, step 2000 299c2d8 verified
Sanjeev Bhandari commited on
Training in progress, step 1500 5d39758 verified
Sanjeev Bhandari commited on
Training in progress, step 1000 fb0c23b verified
Sanjeev Bhandari commited on
Training in progress, step 500 e2bf22e verified
Sanjeev Bhandari commited on
Training in progress, step 6500 5b5385c verified
Sanjeev Bhandari commited on
Training in progress, step 6000 10846b0 verified
Sanjeev Bhandari commited on
Training in progress, step 5500 b4a4cd3 verified
Sanjeev Bhandari commited on
Training in progress, step 5000 c5cd962 verified
Sanjeev Bhandari commited on
Training in progress, step 4500 c490d08 verified
Sanjeev Bhandari commited on
Training in progress, step 4000 8e42f29 verified
Sanjeev Bhandari commited on
Training in progress, step 3500 04ce3c9 verified
Sanjeev Bhandari commited on
Training in progress, step 3000 e664eb7 verified
Sanjeev Bhandari commited on
Training in progress, step 2500 d411342 verified
Sanjeev Bhandari commited on
Training in progress, step 2000 99d9e82 verified
Sanjeev Bhandari commited on
Training in progress, step 1500 5c27c64 verified
Sanjeev Bhandari commited on
Training in progress, step 1000 cf9ee06 verified
Sanjeev Bhandari commited on
Training in progress, step 500 89d3ebf verified
Sanjeev Bhandari commited on
Training in progress, step 21000 7d78893 verified
Sanjeev Bhandari commited on
Training in progress, step 20500 47e4a2f verified
Sanjeev Bhandari commited on
Training in progress, step 20000 03e36ed verified
Sanjeev Bhandari commited on
Training in progress, step 19500 08122ee verified
Sanjeev Bhandari commited on
Training in progress, step 19000 0ce14d5 verified
Sanjeev Bhandari commited on
Training in progress, step 18500 8dfbd8f verified
Sanjeev Bhandari commited on
Training in progress, step 18000 f2f3782 verified
Sanjeev Bhandari commited on
Training in progress, step 17500 f3aa968 verified
Sanjeev Bhandari commited on
Training in progress, step 17000 3671148 verified
Sanjeev Bhandari commited on
Training in progress, step 16500 4865b64 verified
Sanjeev Bhandari commited on
Training in progress, step 16000 e04f78d verified
Sanjeev Bhandari commited on
Training in progress, step 15500 219d27d verified
Sanjeev Bhandari commited on
Training in progress, step 15000 c9cf6fa verified
Sanjeev Bhandari commited on
Training in progress, step 14500 1f884f6 verified
Sanjeev Bhandari commited on
Training in progress, step 14000 7902d4e verified
Sanjeev Bhandari commited on
Training in progress, step 13500 9fe790a verified
Sanjeev Bhandari commited on
Training in progress, step 13000 d73f38a verified
Sanjeev Bhandari commited on
Training in progress, step 12500 2fe0027 verified
Sanjeev Bhandari commited on