Instructions to use GeoV/GeoV-9b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use GeoV/GeoV-9b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="GeoV/GeoV-9b", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("GeoV/GeoV-9b", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use GeoV/GeoV-9b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "GeoV/GeoV-9b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "GeoV/GeoV-9b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/GeoV/GeoV-9b
- SGLang
How to use GeoV/GeoV-9b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "GeoV/GeoV-9b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "GeoV/GeoV-9b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "GeoV/GeoV-9b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "GeoV/GeoV-9b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use GeoV/GeoV-9b with Docker Model Runner:
docker model run hf.co/GeoV/GeoV-9b
69B tokens
Browse files- pytorch_model-00001-of-00010.bin +1 -1
- pytorch_model-00002-of-00010.bin +1 -1
- pytorch_model-00003-of-00010.bin +1 -1
- pytorch_model-00004-of-00010.bin +1 -1
- pytorch_model-00005-of-00010.bin +1 -1
- pytorch_model-00006-of-00010.bin +1 -1
- pytorch_model-00007-of-00010.bin +1 -1
- pytorch_model-00008-of-00010.bin +1 -1
- pytorch_model-00009-of-00010.bin +1 -1
- pytorch_model-00010-of-00010.bin +1 -1
pytorch_model-00001-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1942283571
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:718b53ded131330b0e1467e6bc267d90958c8d700c3099535f8d20a4c44fc3ab
|
| 3 |
size 1942283571
|
pytorch_model-00002-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1904665657
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7fcbad53a7007cb7d3000752ed7387853e837477bd730d09482d4ca98abf3541
|
| 3 |
size 1904665657
|
pytorch_model-00003-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2005313137
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f09ee3ec9126de91f6c4f3e8d6f5b61f379cee20804d70c8ad7e8d68c941a1c8
|
| 3 |
size 2005313137
|
pytorch_model-00004-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1904655819
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:60e045e024c197593129f3f3dc05db849f28bfea50b80d729dce3896fd2d6027
|
| 3 |
size 1904655819
|
pytorch_model-00005-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1904665721
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b4e4011930d13b4859f86887050930f15f64bd70f90e893e6953b466a282251f
|
| 3 |
size 1904665721
|
pytorch_model-00006-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2005313201
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0bb606d28db08e21b78de098436bb797d119c3c019e32dde6e17c0adc3d4e090
|
| 3 |
size 2005313201
|
pytorch_model-00007-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1904655819
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:db1d1b2f97ca734cbe085104666dd3a07c5c3964e1b2cbcba7814d9ef0b60000
|
| 3 |
size 1904655819
|
pytorch_model-00008-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1904665721
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c2fec0ea86931de11236105e59b1239e595a59fe969c2e4867c4888e5ad9d3a2
|
| 3 |
size 1904665721
|
pytorch_model-00009-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2005313201
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8540586e2923a53b97b5a3ee695cfde31d856382eb9946936dbdaceb9b0a8258
|
| 3 |
size 2005313201
|
pytorch_model-00010-of-00010.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1447340142
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14c94d86547fd6218fb393e8ac4688aaf5c06365e40ddcec5b32b8f75a8b324e
|
| 3 |
size 1447340142
|