Text Generation
Transformers
PyTorch
code
gpt2
custom_code
Eval Results (legacy)
text-generation-inference
Instructions to use lambdasec/santafixer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lambdasec/santafixer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="lambdasec/santafixer", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("lambdasec/santafixer", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("lambdasec/santafixer", trust_remote_code=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use lambdasec/santafixer with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "lambdasec/santafixer" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lambdasec/santafixer", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/lambdasec/santafixer
- SGLang
How to use lambdasec/santafixer with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "lambdasec/santafixer" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lambdasec/santafixer", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "lambdasec/santafixer" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lambdasec/santafixer", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use lambdasec/santafixer with Docker Model Runner:
docker model run hf.co/lambdasec/santafixer
Commit History
Update README.md 11c4e7f
Update README.md b943618
Update README.md 7fc5167
Update README.md 130ff45
update model f4f68fd
Asankhaya Sharma commited on
Update README.md 12408c7
Update README.md 0adad45
update to latest fine tuned model 015ecc9
Asankhaya Sharma commited on
add new model ec03979
Asankhaya Sharma commited on
add new model and results json file ee532a8
Asankhaya Sharma commited on
Update README.md 45fcf9f
Update README.md 6840889
Upload pytorch_model.bin ce5fce5
Update README.md 29efba9
Update README.md 39f511d
Delete pytorch_model.bin dd081d7
Update README.md eb142f2
Update README.md 39e7ee3
Update config.json db3edca
Update README.md e8ea394
Update config.json 12c6544
Update README.md 2602324
Update README.md 9d42d7b
Update README.md 02654b6
Update README.md 418b98d
Update README.md 5c68b05
Update README.md 91a8630
Update README.md fe38445
Update README.md fda6687
Update README.md 15cd0e2
Update README.md 8b4238c
Update README.md 0fb759f
Update README.md 02086ab
Update README.md da3e60c
update finetuned model 7b84712
Asankhaya Sharma commited on