YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
test repo for pythia 800m with additional files from neox20b to try to get it to work
- Downloads last month
- 7
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
test repo for pythia 800m with additional files from neox20b to try to get it to work
Install from pip and serve model
# Install vLLM from pip: pip install vllm# Start the vLLM server: vllm serve "rexwang8/py800m"# Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rexwang8/py800m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'