Instructions to use NobodyExistsOnTheInternet/bigseek_3p2t with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use NobodyExistsOnTheInternet/bigseek_3p2t with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="NobodyExistsOnTheInternet/bigseek_3p2t")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("NobodyExistsOnTheInternet/bigseek_3p2t") model = AutoModelForCausalLM.from_pretrained("NobodyExistsOnTheInternet/bigseek_3p2t", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use NobodyExistsOnTheInternet/bigseek_3p2t with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "NobodyExistsOnTheInternet/bigseek_3p2t" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "NobodyExistsOnTheInternet/bigseek_3p2t", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/NobodyExistsOnTheInternet/bigseek_3p2t
- SGLang
How to use NobodyExistsOnTheInternet/bigseek_3p2t with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "NobodyExistsOnTheInternet/bigseek_3p2t" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "NobodyExistsOnTheInternet/bigseek_3p2t", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "NobodyExistsOnTheInternet/bigseek_3p2t" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "NobodyExistsOnTheInternet/bigseek_3p2t", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use NobodyExistsOnTheInternet/bigseek_3p2t with Docker Model Runner:
docker model run hf.co/NobodyExistsOnTheInternet/bigseek_3p2t
| { | |
| "file_summaries": [ | |
| { | |
| "file": "model-00000-layer000-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00001-layer001-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00002-layer002-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00003-layer003-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00004-layer004-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00005-layer005-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00006-layer006-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00007-layer007-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00008-layer008-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00009-layer009-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00010-layer010-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00011-layer011-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00012-layer012-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00013-layer013-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00014-layer014-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00015-layer015-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00016-layer016-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00017-layer017-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00018-layer018-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00019-layer019-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00020-layer020-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00021-layer021-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00022-layer022-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00023-layer023-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00024-layer024-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00025-layer025-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00026-layer026-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00027-layer027-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00028-layer028-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00029-layer029-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00030-layer030-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00031-layer031-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00032-layer032-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00033-layer033-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00034-layer034-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00035-layer035-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00036-layer036-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00037-layer037-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00038-layer038-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00039-layer039-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00040-layer040-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00041-layer041-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00042-layer042-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00043-layer043-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00044-layer044-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00045-layer045-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00046-layer046-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00047-layer047-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00048-layer048-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00049-layer049-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00050-layer050-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00051-layer051-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00052-layer052-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00053-layer053-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00054-layer054-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00055-layer055-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00056-layer056-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00057-layer057-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00058-layer058-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00059-layer059-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00060-layer060-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00061-mtp000-routed-experts.safetensors", | |
| "file_tensors": 4608, | |
| "file_total_size": 50746687488, | |
| "indexed_size": 50746687488, | |
| "indexed_tensors": 4608, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00062-embed-head.safetensors", | |
| "file_tensors": 2, | |
| "file_total_size": 3706716160, | |
| "indexed_size": 3706716160, | |
| "indexed_tensors": 2, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00063-main-attention.safetensors", | |
| "file_tensors": 915, | |
| "file_total_size": 37940287488, | |
| "indexed_size": 37940287488, | |
| "indexed_tensors": 915, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00064-sparse-indexer.safetensors", | |
| "file_tensors": 210, | |
| "file_total_size": 625367040, | |
| "indexed_size": 625367040, | |
| "indexed_tensors": 210, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00065-shared-experts.safetensors", | |
| "file_tensors": 366, | |
| "file_total_size": 8061322752, | |
| "indexed_size": 8061322752, | |
| "indexed_tensors": 366, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00066-ffn-router.safetensors", | |
| "file_tensors": 122, | |
| "file_total_size": 709023744, | |
| "indexed_size": 709023744, | |
| "indexed_tensors": 122, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00067-mhc.safetensors", | |
| "file_tensors": 369, | |
| "file_total_size": 336278412, | |
| "indexed_size": 336278412, | |
| "indexed_tensors": 369, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00068-layer-norms.safetensors", | |
| "file_tensors": 123, | |
| "file_total_size": 1763328, | |
| "indexed_size": 1763328, | |
| "indexed_tensors": 123, | |
| "is_symlink": false | |
| }, | |
| { | |
| "file": "model-00069-mtp-non-experts.safetensors", | |
| "file_tensors": 39, | |
| "file_total_size": 4558633196, | |
| "indexed_size": 4558633196, | |
| "indexed_tensors": 39, | |
| "is_symlink": false | |
| } | |
| ], | |
| "files": 70, | |
| "model_type": "deepseek_v4", | |
| "n_routed_experts": 768, | |
| "num_experts_per_tok": 12, | |
| "num_hidden_layers": 61, | |
| "tensors": 287842, | |
| "total_size": 3202234016376, | |
| "total_size_gib": 2982.3128286525607 | |
| } | |