Instructions to use aixk/fastplus-42m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aixk/fastplus-42m with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="aixk/fastplus-42m")# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("aixk/fastplus-42m", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use aixk/fastplus-42m with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "aixk/fastplus-42m" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aixk/fastplus-42m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/aixk/fastplus-42m
- SGLang
How to use aixk/fastplus-42m with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "aixk/fastplus-42m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aixk/fastplus-42m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "aixk/fastplus-42m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aixk/fastplus-42m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use aixk/fastplus-42m with Docker Model Runner:
docker model run hf.co/aixk/fastplus-42m
Commit History
-
Create README.md
Verified signatured675d8c -
Upload model_fastplus_40m_4bit.vlite with huggingface_hub
Verified signaturef29c680 -
Upload model_fastplus_40m.vlite with huggingface_hub
Verified signaturef28d614 -
FastPlus-40M Relativistic SVO Dynamic-Soft-Pooling Model Train Completed Safely
Verified signatured97374c -
System: Prune old checkpoint folder checkpoint-600 to save space
3555c4a -
FastPlus40m Backup checkpoint-968 at global step 968
37577d6 -
Upload folder using huggingface_hub
f5d0397 -
System: Prune old checkpoint folder checkpoint-484 to save space
5ae15f5 -
FastPlus40m Backup checkpoint-800 at global step 800
aa8a04a -
Upload folder using huggingface_hub
774090e -
System: Prune old checkpoint folder checkpoint-400 to save space
850a90b -
FastPlus40m Backup checkpoint-600 at global step 600
0daee4b -
Upload folder using huggingface_hub
796dbec -
Upload model_fastplus_40m_4bit.vlite with huggingface_hub
c4ac5a7 -
Upload model_fastplus_40m.vlite with huggingface_hub
0c88977 -
FastPlus-40M Relativistic SVO Dynamic-Soft-Pooling Model Train Completed Safely
5970389 -
System: Prune old checkpoint folder checkpoint-200 to save space
4de3521 -
FastPlus40m Backup checkpoint-484 at global step 484
f9079f3 -
FastPlus40m Backup checkpoint-400 at global step 400
a17f16c -
Upload folder using huggingface_hub
691b285 -
Upload folder using huggingface_hub
119200c -
FastPlus40m Backup checkpoint-200 at global step 200
92a171f -
Upload folder using huggingface_hub
7d21288 -
Upload folder using huggingface_hub
93dc417 -
Upload folder using huggingface_hub
92d2306 -
Upload folder using huggingface_hub
abc60ee
-
Delete checkpoint-1400
47135ae -
Delete checkpoint-1600
d839ffe -
System: Prune old checkpoint folder checkpoint-1200 to save space
f587e54 -
FastPlus40m Backup checkpoint-1600 at global step 1600
9fc6643 -
System: Prune old checkpoint folder checkpoint-1000 to save space
1ea795e -
FastPlus40m Backup checkpoint-1400 at global step 1400
7f07402 -
System: Prune old checkpoint folder checkpoint-800 to save space
f301426 -
FastPlus40m Backup checkpoint-1200 at global step 1200
e6b4332 -
System: Prune old checkpoint folder checkpoint-600 to save space
00957bd -
FastPlus40m Backup checkpoint-1000 at global step 1000
eee9e76 -
System: Prune old checkpoint folder checkpoint-400 to save space
d9f5c87 -
FastPlus40m Backup checkpoint-800 at global step 800
f9110e5 -
System: Prune old checkpoint folder checkpoint-200 to save space
2d647aa -
FastPlus40m Backup checkpoint-600 at global step 600
1b3b02c -
FastPlus40m Backup checkpoint-400 at global step 400
010c56d -
Upload folder using huggingface_hub
0c7d5a7 -
FastPlus40m Backup checkpoint-200 at global step 200
302ea9b -
Upload folder using huggingface_hub
b64400a -
initial commit
e10056e