Instructions to use aixk/fastplus-50m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aixk/fastplus-50m with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="aixk/fastplus-50m")# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("aixk/fastplus-50m", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use aixk/fastplus-50m with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "aixk/fastplus-50m" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aixk/fastplus-50m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/aixk/fastplus-50m
- SGLang
How to use aixk/fastplus-50m with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "aixk/fastplus-50m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aixk/fastplus-50m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "aixk/fastplus-50m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aixk/fastplus-50m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use aixk/fastplus-50m with Docker Model Runner:
docker model run hf.co/aixk/fastplus-50m
Commit History
-
Create README.md
Verified signature3c82c46 -
Upload model_fastplus_4bit.vlite with huggingface_hub
Verified signature5c54820 -
Upload model_fastplus.vlite with huggingface_hub
Verified signature0e78dfd -
FastPlus Relativistic SVO Dynamic-Soft-Pooling Model Train Completed Safely
Verified signaturef775178 -
System: Prune old checkpoint folder checkpoint-2600 to save space
798ebfb -
FastPlus Backup checkpoint-3000 at global step 3000
826be65 -
System: Prune old checkpoint folder checkpoint-2400 to save space
4b6b409 -
FastPlus Backup checkpoint-2800 at global step 2800
af1b139 -
System: Prune old checkpoint folder checkpoint-2200 to save space
fd683af -
FastPlus Backup checkpoint-2600 at global step 2600
3b956cd -
System: Prune old checkpoint folder checkpoint-2000 to save space
d34a51d -
FastPlus Backup checkpoint-2400 at global step 2400
383f6d3 -
System: Prune old checkpoint folder checkpoint-1800 to save space
e968bad -
FastPlus Backup checkpoint-2200 at global step 2200
be9e9c8 -
System: Prune old checkpoint folder checkpoint-1600 to save space
54e9ced -
FastPlus Backup checkpoint-2000 at global step 2000
3913982 -
System: Prune old checkpoint folder checkpoint-1400 to save space
697be41 -
FastPlus Backup checkpoint-1800 at global step 1800
ec177f7 -
System: Prune old checkpoint folder checkpoint-1200 to save space
7c6852a -
FastPlus Backup checkpoint-1600 at global step 1600
9283a80 -
System: Prune old checkpoint folder checkpoint-1000 to save space
7904c62 -
FastPlus Backup checkpoint-1400 at global step 1400
e82b847 -
System: Prune old checkpoint folder checkpoint-800 to save space
3b5f627 -
FastPlus Backup checkpoint-1200 at global step 1200
bac9af2 -
System: Prune old checkpoint folder checkpoint-600 to save space
268dcf7 -
FastPlus Backup checkpoint-1000 at global step 1000
c18409b -
System: Prune old checkpoint folder checkpoint-400 to save space
445fe2b -
FastPlus Backup checkpoint-800 at global step 800
5473575 -
System: Prune old checkpoint folder checkpoint-200 to save space
42138f1 -
FastPlus Backup checkpoint-600 at global step 600
4ae25f1 -
FastPlus Backup checkpoint-400 at global step 400
1e8818f -
FastPlus Backup checkpoint-200 at global step 200
6e0589e
-
Upload folder using huggingface_hub
96f0199 -
initial commit
fa16631