Instructions to use appvoid/cortex with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use appvoid/cortex with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="appvoid/cortex", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("appvoid/cortex", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use appvoid/cortex with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "appvoid/cortex" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "appvoid/cortex", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/appvoid/cortex
- SGLang
How to use appvoid/cortex with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "appvoid/cortex" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "appvoid/cortex", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "appvoid/cortex" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "appvoid/cortex", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use appvoid/cortex with Docker Model Runner:
docker model run hf.co/appvoid/cortex
Commit History
22 days ago
-
Full resumable SparkBET-9M state at checkpoint-000000388000
Verified signaturefb8e7cd -
Full resumable SparkBET-9M state at checkpoint-000000387000
Verified signature93eab0f -
Full resumable SparkBET-9M state at checkpoint-000000386000
Verified signaturec459108 -
Full resumable SparkBET-9M state at checkpoint-000000385000
Verified signature5e93044 -
Full resumable SparkBET-9M state at checkpoint-000000384000
Verified signature702ab65 -
Full resumable SparkBET-9M state at checkpoint-000000383000
Verified signaturede91442 -
Full resumable SparkBET-9M state at checkpoint-000000382000
Verified signature1ff9fdb -
Full resumable SparkBET-9M state at checkpoint-000000381000
Verified signaturebec3197 -
Full resumable SparkBET-9M state at checkpoint-000000380000
Verified signature0350af7 -
Full resumable SparkBET-9M state at checkpoint-000000379000
Verified signaturef986123 -
Full resumable SparkBET-9M state at checkpoint-000000378000
Verified signature7e4bd02 -
Full resumable SparkBET-9M state at checkpoint-000000377000
Verified signature2a35908 -
Full resumable SparkBET-9M state at checkpoint-000000376000
Verified signature94cb24f -
Full resumable SparkBET-9M state at checkpoint-000000375000
Verified signatured572d3b -
Full resumable SparkBET-9M state at checkpoint-000000374000
Verified signature01d186d -
Full resumable SparkBET-9M state at checkpoint-000000373000
Verified signature1317006 -
Full resumable SparkBET-9M state at checkpoint-000000372000
Verified signatureacd4443 -
Full resumable SparkBET-9M state at checkpoint-000000371000
Verified signature890c95f -
Full resumable SparkBET-9M state at checkpoint-000000370000
Verified signature66e2bfc -
Full resumable SparkBET-9M state at checkpoint-000000369000
Verified signature8e87300 -
Full resumable SparkBET-9M state at checkpoint-000000368000
Verified signature4bdcf66 -
Full resumable SparkBET-9M state at checkpoint-000000367000
Verified signature51cf19b -
Full resumable SparkBET-9M state at checkpoint-000000366000
Verified signature79b6a21 -
Full resumable SparkBET-9M state at checkpoint-000000365000
Verified signature3244fd0 -
Full resumable SparkBET-9M state at checkpoint-000000364000
Verified signature1af3b51 -
Full resumable SparkBET-9M state at checkpoint-000000363000
Verified signaturec4ec0d1 -
Full resumable SparkBET-9M state at checkpoint-000000362000
Verified signature2c85dc8 -
Full resumable SparkBET-9M state at checkpoint-000000361000
Verified signaturee264ed8 -
Full resumable SparkBET-9M state at checkpoint-000000360000
Verified signature0b8980e -
Full resumable SparkBET-9M state at checkpoint-000000359000
Verified signature45ff32e -
Full resumable SparkBET-9M state at checkpoint-000000358000
Verified signature1b819a7 -
Full resumable SparkBET-9M state at checkpoint-000000357000
Verified signatured2f9f3d -
Full resumable SparkBET-9M state at checkpoint-000000356000
Verified signature236df12 -
Full resumable SparkBET-9M state at checkpoint-000000355000
Verified signatured457e5a -
Full resumable SparkBET-9M state at checkpoint-000000354000
Verified signatureb8b9254 -
Full resumable SparkBET-9M state at checkpoint-000000353000
Verified signatured9c7cfe -
Full resumable SparkBET-9M state at checkpoint-000000352000
Verified signature5deb852 -
Full resumable SparkBET-9M state at checkpoint-000000351000
Verified signature56514e7 -
Full resumable SparkBET-9M state at checkpoint-000000350000
Verified signaturec2c2507 -
Full resumable SparkBET-9M state at checkpoint-000000349000
Verified signature31befc0
23 days ago
-
Full resumable SparkBET-9M state at checkpoint-000000348000
Verified signatureb914de9 -
Full resumable SparkBET-9M state at checkpoint-000000347000
Verified signature677504b -
Full resumable SparkBET-9M state at checkpoint-000000346000
Verified signature2f9b299 -
Full resumable SparkBET-9M state at checkpoint-000000345000
Verified signature1eb3000 -
Full resumable SparkBET-9M state at checkpoint-000000344000
Verified signature5d4771f -
Full resumable SparkBET-9M state at checkpoint-000000343000
Verified signaturebd3445c -
Full resumable SparkBET-9M state at checkpoint-000000342000
Verified signature0de2bb7 -
Full resumable SparkBET-9M state at checkpoint-000000341000
Verified signaturec3145d7 -
Full resumable SparkBET-9M state at checkpoint-000000340000
Verified signature04f52a7 -
Full resumable SparkBET-9M state at checkpoint-000000339000
Verified signaturea208821