Instructions to use wasmdashai/asg-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use wasmdashai/asg-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="wasmdashai/asg-v1", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("wasmdashai/asg-v1", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use wasmdashai/asg-v1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "wasmdashai/asg-v1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wasmdashai/asg-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/wasmdashai/asg-v1
- SGLang
How to use wasmdashai/asg-v1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "wasmdashai/asg-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wasmdashai/asg-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "wasmdashai/asg-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wasmdashai/asg-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use wasmdashai/asg-v1 with Docker Model Runner:
docker model run hf.co/wasmdashai/asg-v1
File size: 2,512 Bytes
dbfbe6a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 | {
"initial access": [
"Drive-by Compromise",
"Exploit Public-Facing Application",
"Exploitation of Remote Services",
"External Remote Services",
"Internet Accessible Device",
"Remote Services",
"Replication Through Removable Media",
"Rogue Master",
"Spearphishing Attachment",
"Supply Chain Compromise",
"Transient Cyber Asset",
"Wireless Compromise"
],
"execution": [
"Change Operating Mode",
"Command-Line Interface",
"Execution through API",
"Graphical User Interface",
"Hooking",
"Modify Controller Tasking",
"Native API",
"Scripting",
"User Execution"
],
"persistence": [
"Modify Program",
"Module Firmware",
"Project File Infection",
"System Firmware",
"Valid Accounts"
],
"privilege escalation": [
"Exploitation for Privilege Escalation"
],
"evasion": [
"Exploitation for Evasion",
"Indicator Removal on Host",
"Masquerading",
"Rootkit",
"Spoof Reporting Message"
],
"discovery": [
"Network Connection Enumeration",
"Network Sniffing",
"Remote System Discovery",
"Remote System Information Discovery",
"Wireless Sniffing"
],
"lateral movement": [
"Default Credentials",
"Lateral Tool Transfer",
"Program Download"
],
"collection": [
"Automated Collection",
"Data from Information Repositories",
"Detect Operating Mode",
"I/O Image",
"Man in the Middle",
"Monitor Process State",
"Point & Tag Identification",
"Program Upload",
"Screen Capture"
],
"command and control": [
"Commonly Used Port",
"Connection Proxy",
"Standard Application Layer Protocol"
],
"inhibit response function": [
"Activate Firmware Update Mode",
"Alarm Suppression",
"Block Command Message",
"Block Reporting Message",
"Block Serial COM",
"Data Destruction",
"Denial of Service",
"Device Restart/Shutdown",
"Manipulate I/O Image",
"Modify Alarm Settings",
"Service Stop"
],
"impair process control": [
"Brute Force I/O",
"Modify Parameter",
"Unauthorized Command Message"
],
"impact": [
"Damage to Property",
"Denial of Control",
"Denial of View",
"Loss of Availability",
"Loss of Control",
"Loss of Productivity and Revenue",
"Loss of Protection",
"Loss of Safety",
"Loss of View",
"Manipulation of Control",
"Manipulation of View",
"Theft of Operational Information"
]
} |