Upload README.md with huggingface_hub

README.md

@@ -11,18 +11,17 @@ tags:
 - distributed-inference
 - local-inference
 - openai-compatible
-- queued
 ---
 
 <div align="center">
   <a href="https://www.meshllm.cloud">
-    <img src="https://huggingface.co/meshllm/DeepSeek-R1-Q4_K_M-layers/raw/main/mesh-llm-logo.svg" alt="Mesh LLM" width="220">
+    <img src="https://github.com/Mesh-LLM/mesh-llm/raw/main/docs/mesh-llm-logo.svg" alt="Mesh LLM" width="220">
   </a>
 
   <h1>DeepSeek-R1-Q4_K_M</h1>
 
   <p>
-    <strong>Queued GGUF layer package for Mesh LLM</strong>
+    <strong>Distributed GGUF inference package for Mesh LLM</strong>
   </p>
 
   <p>
@@ -32,13 +31,15 @@ tags:
   </p>
 </div>
 
-This repository has been reserved for a Mesh LLM layer package derived from [unsloth/DeepSeek-R1-GGUF](https://huggingface.co/unsloth/DeepSeek-R1-GGUF). The package artifacts are not uploaded yet; once generation completes, this card will be replaced with the full package manifest summary and quickstart.
+GGUF layer package for running **DeepSeek-R1-Q4_K_M** across a local Mesh LLM cluster.
+
+This package is derived from [unsloth/DeepSeek-R1-GGUF](https://huggingface.co/unsloth/DeepSeek-R1-GGUF) and keeps the original GGUF distribution split into per-layer artifacts for distributed inference.
 
 ## Highlights
 
-| Run locally | Pool multiple machines | OpenAI-compatible | Package status |
+| Run locally | Pool multiple machines | OpenAI-compatible | Package variant |
 |---|---|---|---|
-| Private inference on your hardware | Split layers across peers | Serve `/v1/chat/completions` locally | Queued `Q4_K_M` layer package |
+| Private inference on your hardware | Split layers across peers | Serve `/v1/chat/completions` locally | `Q4_K_M` layer package |
 
 ## Model Overview
 
@@ -49,17 +50,73 @@ This repository has been reserved for a Mesh LLM layer package derived from [uns
 | **Family** | DeepSeek |
 | **Parameter scale** | not recorded |
 | **Quantization** | `Q4_K_M` |
-| **Status** | Queued for layer-package generation |
-| **Queued at** | `2026-05-08T21:33:13.323775276+00:00` |
+| **Layer count** | 61 |
+| **Activation width** | 7168 |
+| **Package size** | 377.0 GB |
 | **Source file** | `DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf` |
 | **Package repo** | [meshllm/DeepSeek-R1-Q4_K_M-layers](https://huggingface.co/meshllm/DeepSeek-R1-Q4_K_M-layers) |
-| **Queue run** | [https://github.com/Mesh-LLM/mesh-llm/actions/runs/25580536970](https://github.com/Mesh-LLM/mesh-llm/actions/runs/25580536970) |
 
 ## Recommended Use
 
-- Come back after the layer package job finishes.
-- Use the source model card for architecture details, license terms, and sampling guidance.
-- Use Mesh LLM once this repo contains `model-package.json` and `layers/layer-*.gguf` artifacts.
+- Local and private inference with Mesh LLM.
+- Multi-machine serving when the full GGUF is too large for one host.
+- OpenAI-compatible chat/completions workflows through Mesh LLM's local API.
+
+For upstream architecture details, chat template guidance, sampling recommendations, license terms, and benchmark notes, see the source model card: [unsloth/DeepSeek-R1-GGUF](https://huggingface.co/unsloth/DeepSeek-R1-GGUF).
+
+## Quickstart
+
+```bash
+# Run this on each machine that should contribute memory/compute.
+mesh-llm serve --model "meshllm/DeepSeek-R1-Q4_K_M-layers" --split
+```
+
+```bash
+# Check the mesh and discover the OpenAI-compatible model name.
+curl -s http://localhost:3131/api/status
+curl -s http://localhost:3131/v1/models
+```
+
+```bash
+# Send an OpenAI-compatible chat request.
+curl -s http://localhost:3131/v1/chat/completions \
+  -H "Content-Type: application/json" \
+  -d '{
+    "model": "unsloth/DeepSeek-R1-GGUF:DeepSeek-R1-Q4_K_M",
+    "messages": [{"role": "user", "content": "Write a tiny hello-world function in Rust."}],
+    "max_tokens": 128
+  }'
+```
+
+## Package Variant
+
+| Property | Value |
+|---|---|
+| **Format** | `layer-package` |
+| **Canonical source ref** | `unsloth/DeepSeek-R1-GGUF@main/DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf` |
+| **Source revision** | `main` |
+| **Source SHA-256** | `d111d9e28b4035e6781906b6451b7866737b4a4ee734baa1575c55d8aa1b4200` |
+| **Skippy ABI** | `0.1.22` |
+| **Package manifest SHA-256** | `f5a62c4f2f5427ac6e083d7666313832cb61a2fc5d8dacfc317b540d8ac82e9d` |
+
+## What Is Included
+
+| Artifact | Path | Contents | SHA-256 |
+|---|---|---|---|
+| Manifest | `model-package.json` | Package schema, source identity, checksums | `f5a62c4f2f5427ac6e083d7666313832cb61a2fc5d8dacfc317b540d8ac82e9d` |
+| Metadata | `shared/metadata.gguf` | 0 tensors, 5.0 MB | `0e1bf01f20ef69f691126b69c633fd63977cd190bea4182a1c9f41d1537b0ad6` |
+| Embeddings | `shared/embeddings.gguf` | 1 tensors, 502.1 MB | `951352774cabdce1e5fe940b30ca85ac8440de68afb6c6eceb451524109991f1` |
+| Output head | `shared/output.gguf` | 2 tensors, 730.0 MB | `131fcb580fd1ba667733e39ffc806f819f54928621f40cd47405399a8b9abecb` |
+| Transformer layers | `layers/layer-*.gguf` | 61 layer artifacts, 1022 tensors, 375.8 GB | `see model-package.json` |
+
+## Validation
+
+Generated by the Mesh LLM HF Jobs splitter from `mesh-llm` ref `main`.
+Each artifact is checksummed as it is written, uploaded to this repository, and removed from the job workspace before the next artifact is produced.
+
+```bash
+skippy-model-package write-package "/source/DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf" --out-dir "/tmp/meshllm-layer-job-meshllm_DeepSeek-R1-Q4_K_M-layers-137/package"
+```
 
 ## Links