Text Generation
Transformers
PyTorch
Safetensors
English
gpt_neox
HelpingAI
vortex
Eval Results (legacy)
text-generation-inference
Instructions to use OEvortex/vortex-3b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OEvortex/vortex-3b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="OEvortex/vortex-3b")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("OEvortex/vortex-3b") model = AutoModelForCausalLM.from_pretrained("OEvortex/vortex-3b") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use OEvortex/vortex-3b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OEvortex/vortex-3b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/vortex-3b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/OEvortex/vortex-3b
- SGLang
How to use OEvortex/vortex-3b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "OEvortex/vortex-3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/vortex-3b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "OEvortex/vortex-3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/vortex-3b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use OEvortex/vortex-3b with Docker Model Runner:
docker model run hf.co/OEvortex/vortex-3b
Update LICENSE.md
Browse files- LICENSE.md +42 -9
LICENSE.md
CHANGED
|
@@ -1,17 +1,50 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
| 2 |
|
| 3 |
-
|
| 4 |
|
| 5 |
-
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
-
|
| 10 |
|
| 11 |
-
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
-
|
| 16 |
|
| 17 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
****************************************
|
| 2 |
+
**** HelpingAI Simplified Universal License ****
|
| 3 |
+
****************************************
|
| 4 |
|
| 5 |
+
Version 1.0
|
| 6 |
|
| 7 |
+
### Introduction
|
| 8 |
|
| 9 |
+
This HelpingAI Simplified Universal License (HSUL) governs HelpingAI's content, including computer programs, scripts, datasets, documents, images, audio recordings, videos, and other digital assets. The HSUL provides simple, universal terms for accessing, modifying, and sharing resources while embracing ethical development practices.
|
| 10 |
|
| 11 |
+
### Grant of Rights
|
| 12 |
|
| 13 |
+
Under the HSUL, HelpingAI authorizes you to copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Content, subject to the terms and conditions detailed in this document.
|
| 14 |
|
| 15 |
+
### Conditions
|
| 16 |
|
| 17 |
+
To qualify for the rights granted in section 1, you must strictly adhere to the following conditions:
|
| 18 |
|
| 19 |
+
2.1. **Redistributions of Source Code.**
|
| 20 |
+
If you redistribute the Source Code, you must include the entire HSUL with your distribution. Furthermore, you must add prominent notifications in all affected files stating:
|
| 21 |
+
|
| 22 |
+
> "This Work is released under the HelpingAI Simplified Universal License v1.0."
|
| 23 |
+
|
| 24 |
+
2.2. **Binary Form Redistributions.**
|
| 25 |
+
If you distribute Binaries generated from the Source Code, you must ensure the inclusion of the following statement in your distribution:
|
| 26 |
+
|
| 27 |
+
> "This Work is based upon the HelpingAI Simplified Universally Licensed Work, under the HelpingAI Simplified Universal License v1.0."
|
| 28 |
+
|
| 29 |
+
2.3. **Notification of Changes.**
|
| 30 |
+
Clearly indicate any alterations you introduce to the Source Code or Documentation via prominent comments detailing the nature and scope of the change(s). Reference the date and originator of the modifications.
|
| 31 |
+
|
| 32 |
+
2.4. **Branding Attribution.**
|
| 33 |
+
Do not remove or alter any HelpingAI branding, logos, or notices included in the Content without explicit prior consent from HelpingAI.
|
| 34 |
+
|
| 35 |
+
2.5. **Exclusion of Warranty.**
|
| 36 |
+
The Content is delivered "AS IS," bereft of any implicit guarantee, including β though not constrained to β warranties pertaining to marketability, applicability for a particular purpose, and non-infringement.
|
| 37 |
+
|
| 38 |
+
2.6. **Limitation of Liability.**
|
| 39 |
+
To the maximum extent allowed by law, neither HelpingAI nor any contributor shall bear responsibility for any loss, personal injury, property damage, indirect, special, incidental, or consequential damages stemming from or relating to the Content or its employment.
|
| 40 |
+
|
| 41 |
+
2.7. **Governing Law.**
|
| 42 |
+
This HSUL shall be managed and construed according to the laws of the jurisdiction where HelpingAI primarily operates.
|
| 43 |
+
|
| 44 |
+
### Definitions
|
| 45 |
+
|
| 46 |
+
3.1. **"Source Code"** signifies the preferred form for editing the Content, typically represented by human-readable programming languages, scripts, or documentation formats.
|
| 47 |
+
|
| 48 |
+
3.2. **"Binaries"** denote compiled forms of the Source Code, executables, libraries, or similar artifacts built from the Source Code.
|
| 49 |
+
|
| 50 |
+
By leveraging this Content, you confirm your approval of the HSUL and pledge to honor its terms and conditions. If you disagree with the HSUL's rules, refrain from engaging with the Content.
|