Text Generation
Transformers
PyTorch
Safetensors
English
gpt_neox
HelpingAI
vortex
Eval Results (legacy)
text-generation-inference
Instructions to use OEvortex/vortex-3b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OEvortex/vortex-3b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="OEvortex/vortex-3b")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("OEvortex/vortex-3b") model = AutoModelForCausalLM.from_pretrained("OEvortex/vortex-3b") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use OEvortex/vortex-3b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OEvortex/vortex-3b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/vortex-3b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/OEvortex/vortex-3b
- SGLang
How to use OEvortex/vortex-3b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "OEvortex/vortex-3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/vortex-3b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "OEvortex/vortex-3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/vortex-3b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use OEvortex/vortex-3b with Docker Model Runner:
docker model run hf.co/OEvortex/vortex-3b
Update LICENSE.md
Browse files- LICENSE.md +22 -21
LICENSE.md
CHANGED
|
@@ -1,48 +1,49 @@
|
|
| 1 |
************************************************
|
| 2 |
-
**** HelpingAI
|
| 3 |
************************************************
|
| 4 |
|
| 5 |
-
Version
|
|
|
|
| 6 |
|
| 7 |
-
###
|
| 8 |
|
| 9 |
-
|
| 10 |
|
| 11 |
### Grant of Rights
|
| 12 |
|
| 13 |
-
Under the
|
| 14 |
|
| 15 |
-
### Conditions
|
| 16 |
|
| 17 |
-
To
|
| 18 |
|
| 19 |
-
2.1. **
|
| 20 |
-
|
| 21 |
|
| 22 |
-
|
| 23 |
|
| 24 |
-
2.2. **Binary Form
|
| 25 |
-
|
| 26 |
|
| 27 |
-
|
| 28 |
|
| 29 |
2.3. **Notification of Changes.**
|
| 30 |
-
|
| 31 |
|
| 32 |
2.4. **Branding Attribution.**
|
| 33 |
-
|
| 34 |
|
| 35 |
-
2.5. **
|
| 36 |
-
|
| 37 |
|
| 38 |
2.6. **Limitation of Liability.**
|
| 39 |
-
|
| 40 |
|
| 41 |
2.7. **Governing Law.**
|
| 42 |
-
|
| 43 |
|
| 44 |
### Definitions
|
| 45 |
|
| 46 |
-
3.1. **"Source Code"**
|
| 47 |
|
| 48 |
-
3.2. **"Binaries"**
|
|
|
|
| 1 |
************************************************
|
| 2 |
+
**** HelpingAI License ****
|
| 3 |
************************************************
|
| 4 |
|
| 5 |
+
Version 2.0
|
| 6 |
+
Developed by Abhay Koul
|
| 7 |
|
| 8 |
+
### Preamble
|
| 9 |
|
| 10 |
+
The HelpingAI License governs the use of HelpingAI's digital assets, including but not limited to software, scripts, datasets, documents, images, audio recordings, videos. The HelpingAI License aims to provide clear, comprehensive terms for accessing, modifying, and sharing resources, while promoting ethical development practices.
|
| 11 |
|
| 12 |
### Grant of Rights
|
| 13 |
|
| 14 |
+
Under the HelpingAI License, HelpingAI grants you the rights to copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Content, provided you comply with the terms and conditions outlined in this document.
|
| 15 |
|
| 16 |
+
### Terms and Conditions
|
| 17 |
|
| 18 |
+
To exercise the rights granted in the previous section, you must adhere to the following terms and conditions:
|
| 19 |
|
| 20 |
+
2.1. **Redistribution of Source Code.**
|
| 21 |
+
If you redistribute the Source Code, you must include the complete HelpingAI License with your distribution. You must also add clear notifications in all modified files stating:
|
| 22 |
|
| 23 |
+
> "This Work is released under the HelpingAI License v2.0."
|
| 24 |
|
| 25 |
+
2.2. **Distribution in Binary Form.**
|
| 26 |
+
If you distribute Binaries derived from the Source Code, you must include the following statement in your distribution:
|
| 27 |
|
| 28 |
+
> "This Work is based on the HelpingAI Licensed Work, under the HelpingAI License v2.0."
|
| 29 |
|
| 30 |
2.3. **Notification of Changes.**
|
| 31 |
+
You must clearly indicate any modifications you make to the Source Code or Documentation, including detailed comments about the nature and extent of the changes. Include the date and originator of the modifications.
|
| 32 |
|
| 33 |
2.4. **Branding Attribution.**
|
| 34 |
+
You must not remove or alter any HelpingAI branding, logos, or notices included in the Content without explicit prior consent from HelpingAI.
|
| 35 |
|
| 36 |
+
2.5. **Disclaimer of Warranty.**
|
| 37 |
+
The Content is provided "AS IS," without any implied warranties, including but not limited to warranties of merchantability, fitness for a particular purpose, and non-infringement.
|
| 38 |
|
| 39 |
2.6. **Limitation of Liability.**
|
| 40 |
+
To the maximum extent permitted by law, neither HelpingAI nor any contributor shall be liable for any loss, personal injury, property damage, or any indirect, special, incidental, or consequential damages arising from or related to the use of the Content.
|
| 41 |
|
| 42 |
2.7. **Governing Law.**
|
| 43 |
+
This HelpingAI License shall be governed and construed in accordance with the laws of the jurisdiction where HelpingAI primarily operates.
|
| 44 |
|
| 45 |
### Definitions
|
| 46 |
|
| 47 |
+
3.1. **"Source Code"** refers to the preferred form for making modifications to the Content, typically represented by human-readable programming languages, scripts, or documentation formats.
|
| 48 |
|
| 49 |
+
3.2. **"Binaries"** refers to compiled forms of the Source Code, such as executables, libraries, or similar artifacts produced from the Source Code.
|