Instructions to use physicsrob/torchwright-calculator-advanced-max-digits-3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use physicsrob/torchwright-calculator-advanced-max-digits-3 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="physicsrob/torchwright-calculator-advanced-max-digits-3")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("physicsrob/torchwright-calculator-advanced-max-digits-3")
model = AutoModelForCausalLM.from_pretrained("physicsrob/torchwright-calculator-advanced-max-digits-3", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use physicsrob/torchwright-calculator-advanced-max-digits-3 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "physicsrob/torchwright-calculator-advanced-max-digits-3"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "physicsrob/torchwright-calculator-advanced-max-digits-3",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/physicsrob/torchwright-calculator-advanced-max-digits-3

SGLang

How to use physicsrob/torchwright-calculator-advanced-max-digits-3 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "physicsrob/torchwright-calculator-advanced-max-digits-3" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "physicsrob/torchwright-calculator-advanced-max-digits-3",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "physicsrob/torchwright-calculator-advanced-max-digits-3" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "physicsrob/torchwright-calculator-advanced-max-digits-3",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use physicsrob/torchwright-calculator-advanced-max-digits-3 with Docker Model Runner:
```
docker model run hf.co/physicsrob/torchwright-calculator-advanced-max-digits-3
```

physicsrob commited on 10 days ago

Commit

2fabebe

verified ·

1 Parent(s): 47fa29e

Upload folder using huggingface_hub

Browse files

Files changed (4) hide show

config.json +5 -5
torchwright_truth.json → torchwright_schematic.json +12 -12
torchwright_truth_support.npz → torchwright_schematic_support.npz +0 -0
torchwright_truth_v1.schema.json → torchwright_schematic_v1.schema.json +3 -3

config.json CHANGED Viewed

@@ -27,11 +27,11 @@
   },
   "sliding_window": null,
   "tie_word_embeddings": true,
-  "torchwright_truth": {
-    "file": "torchwright_truth.json",
-    "format": "torchwright.truth.v1",
-    "schema": "torchwright_truth_v1.schema.json",
-    "support": "torchwright_truth_support.npz"
   },
   "transformers_version": "5.12.1",
   "use_cache": true,

   },
   "sliding_window": null,
   "tie_word_embeddings": true,
+  "torchwright_schematic": {
+    "file": "torchwright_schematic.json",
+    "format": "torchwright.schematic.v1",
+    "schema": "torchwright_schematic_v1.schema.json",
+    "support": "torchwright_schematic_support.npz"
   },
   "transformers_version": "5.12.1",
   "use_cache": true,

torchwright_truth.json → torchwright_schematic.json RENAMED Viewed

@@ -1,11 +1,11 @@
 {
-  "$schema": "./torchwright_truth_v1.schema.json",
   "artifact": {
     "architecture": "phi3",
     "files": {
       "config.json": {
-        "bytes": 979,
-        "sha256": "b98708e997dc75526660caf61401716c12b98f38640cedab25235a7743848f18"
       },
       "generation_config.json": {
         "bytes": 105,
@@ -143,19 +143,19 @@
         "bytes": 199,
         "sha256": "6f9df026786c39bfda75becfa45ea655ccad3ee7bf4c4e186777e11aa930758b"
       },
-      "torchwright_truth_support.npz": {
         "bytes": 909442,
         "sha256": "a1f439d473c33c5d6099ad815acc0dd18945e58fc49f06cc76d6cfc692098352"
       },
-      "torchwright_truth_v1.schema.json": {
-        "bytes": 3675,
-        "sha256": "d4007eb364d2fa3bacac9294c6c4ee3e49f503625673eac12531fef948868e51"
       }
     },
     "kind": "huggingface_causal_lm_bundle"
   },
   "build": {
-    "compiler_code_sha256": "fb4fe3f02cc24108f0e950625e742b591672bf2958abd5407e57fa599dec8f3e",
     "options": {
       "activation": "swish",
       "bias": false,
@@ -168,7 +168,7 @@
       "optimize": 2,
       "trim_heads": true
     },
-    "schedule_fingerprint": "f620872bb3af59effd05edd98f49dacedcf309170ae772c186731f99342b5e15",
     "schedule_provenance": {
       "delivery": "fresh",
       "optimize": 2,
@@ -186,7 +186,7 @@
     },
     "torchwright_version": "unknown"
   },
-  "format": "torchwright.truth.v1",
   "graphs": {
     "internal_nodes": [
       {
@@ -83337,7 +83337,7 @@
   },
   "integrity": {
     "scope": "every manifest section except this one",
-    "sha256": "57a3287230cc370b3f56c4a49a08a20bff9d07f52921c66326c174de04ec0dfd"
   },
   "intervention_contract": {
     "guarantee": "The manifest describes the unmodified compiled program. Interventions outside a node's stated value contract are not covered by torchwright's semantic or numerical guarantees.",
@@ -83700,7 +83700,7 @@
     }
   },
   "parameter_support": {
-    "file": "torchwright_truth_support.npz",
     "format": "torchwright.csr_support.v1",
     "sha256": "a1f439d473c33c5d6099ad815acc0dd18945e58fc49f06cc76d6cfc692098352",
     "tensors": {

 {
+  "$schema": "./torchwright_schematic_v1.schema.json",
   "artifact": {
     "architecture": "phi3",
     "files": {
       "config.json": {
+        "bytes": 999,
+        "sha256": "37717c2991cc4a4bf9b3ead11dc7c561a446d1d0bc664095fb209141061df64b"
       },
       "generation_config.json": {
         "bytes": 105,
         "bytes": 199,
         "sha256": "6f9df026786c39bfda75becfa45ea655ccad3ee7bf4c4e186777e11aa930758b"
       },
+      "torchwright_schematic_support.npz": {
         "bytes": 909442,
         "sha256": "a1f439d473c33c5d6099ad815acc0dd18945e58fc49f06cc76d6cfc692098352"
       },
+      "torchwright_schematic_v1.schema.json": {
+        "bytes": 3678,
+        "sha256": "1881c7400c00ee66e6e911c7416ceb573b31129cf24bb80d4055b9e2c647ec7f"
       }
     },
     "kind": "huggingface_causal_lm_bundle"
   },
   "build": {
+    "compiler_code_sha256": "639e918d8b7011d6f247de3e5696cc4faaa3b154fe081a266f956ddaa9e68e1c",
     "options": {
       "activation": "swish",
       "bias": false,
       "optimize": 2,
       "trim_heads": true
     },
+    "schedule_fingerprint": "eb50446425f1908588859783fa8f0bc7ce59ffc72b35c88bfed766caaa07b508",
     "schedule_provenance": {
       "delivery": "fresh",
       "optimize": 2,
     },
     "torchwright_version": "unknown"
   },
+  "format": "torchwright.schematic.v1",
   "graphs": {
     "internal_nodes": [
       {
   },
   "integrity": {
     "scope": "every manifest section except this one",
+    "sha256": "c9d231ab4e43cf241333b68a2232b11ac652b6016edeba9fce85bc512fdc79f6"
   },
   "intervention_contract": {
     "guarantee": "The manifest describes the unmodified compiled program. Interventions outside a node's stated value contract are not covered by torchwright's semantic or numerical guarantees.",
     }
   },
   "parameter_support": {
+    "file": "torchwright_schematic_support.npz",
     "format": "torchwright.csr_support.v1",
     "sha256": "a1f439d473c33c5d6099ad815acc0dd18945e58fc49f06cc76d6cfc692098352",
     "tensors": {

torchwright_truth_support.npz → torchwright_schematic_support.npz RENAMED Viewed

File without changes

torchwright_truth_v1.schema.json → torchwright_schematic_v1.schema.json RENAMED Viewed

@@ -1,7 +1,7 @@
 {
   "$schema": "https://json-schema.org/draft/2020-12/schema",
-  "$id": "https://github.com/physicsrob/torchwright/blob/main/torchwright/compiler/torchwright_truth_v1.schema.json",
-  "title": "torchwright compiled artifact truth manifest v1",
   "type": "object",
   "required": [
     "format",
@@ -21,7 +21,7 @@
     "reference_fixtures"
   ],
   "properties": {
-    "format": {"const": "torchwright.truth.v1"},
     "$schema": {"type": "string"},
     "integrity": {
       "type": "object",

 {
   "$schema": "https://json-schema.org/draft/2020-12/schema",
+  "$id": "https://github.com/physicsrob/torchwright/blob/main/torchwright/compiler/torchwright_schematic_v1.schema.json",
+  "title": "torchwright compiled artifact schematic v1",
   "type": "object",
   "required": [
     "format",
     "reference_fixtures"
   ],
   "properties": {
+    "format": {"const": "torchwright.schematic.v1"},
     "$schema": {"type": "string"},
     "integrity": {
       "type": "object",