Instructions to use meshllm/DeepSeek-R1-Q4_K_M-layers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use meshllm/DeepSeek-R1-Q4_K_M-layers with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="meshllm/DeepSeek-R1-Q4_K_M-layers",
	filename="layers/layer-000.gguf",
)

llm.create_chat_completion(
	messages = [
		{
			"role": "user",
			"content": "What is the capital of France?"
		}
	]
)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use meshllm/DeepSeek-R1-Q4_K_M-layers with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf meshllm/DeepSeek-R1-Q4_K_M-layers
# Run inference directly in the terminal:
llama-cli -hf meshllm/DeepSeek-R1-Q4_K_M-layers

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf meshllm/DeepSeek-R1-Q4_K_M-layers
# Run inference directly in the terminal:
llama-cli -hf meshllm/DeepSeek-R1-Q4_K_M-layers

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf meshllm/DeepSeek-R1-Q4_K_M-layers
# Run inference directly in the terminal:
./llama-cli -hf meshllm/DeepSeek-R1-Q4_K_M-layers

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf meshllm/DeepSeek-R1-Q4_K_M-layers
# Run inference directly in the terminal:
./build/bin/llama-cli -hf meshllm/DeepSeek-R1-Q4_K_M-layers

Use Docker

docker model run hf.co/meshllm/DeepSeek-R1-Q4_K_M-layers

LM Studio
Jan

vLLM

How to use meshllm/DeepSeek-R1-Q4_K_M-layers with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "meshllm/DeepSeek-R1-Q4_K_M-layers"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meshllm/DeepSeek-R1-Q4_K_M-layers",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/meshllm/DeepSeek-R1-Q4_K_M-layers

Ollama
How to use meshllm/DeepSeek-R1-Q4_K_M-layers with Ollama:
```
ollama run hf.co/meshllm/DeepSeek-R1-Q4_K_M-layers
```

Unsloth Studio new

How to use meshllm/DeepSeek-R1-Q4_K_M-layers with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for meshllm/DeepSeek-R1-Q4_K_M-layers to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for meshllm/DeepSeek-R1-Q4_K_M-layers to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for meshllm/DeepSeek-R1-Q4_K_M-layers to start chatting

Docker Model Runner
How to use meshllm/DeepSeek-R1-Q4_K_M-layers with Docker Model Runner:
```
docker model run hf.co/meshllm/DeepSeek-R1-Q4_K_M-layers
```

Lemonade

How to use meshllm/DeepSeek-R1-Q4_K_M-layers with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull meshllm/DeepSeek-R1-Q4_K_M-layers

Run and chat with the model

lemonade run user.DeepSeek-R1-Q4_K_M-layers-{{QUANT_TAG}}

List all available models

lemonade list

DeepSeek-R1-Q4_K_M-layers / model-package.json

jamesdumay

Add layer package manifest from unsloth/DeepSeek-R1-GGUF (unsloth/DeepSeek-R1-GGUF:DeepSeek-R1-Q4_K_M)

2f9dcc1 verified 7 days ago

raw

history blame contribute delete

18.4 kB

	{
	"schema_version": 1,
	"model_id": "unsloth/DeepSeek-R1-GGUF:DeepSeek-R1-Q4_K_M",
	"source_model": {
	"path": "/source/DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf",
	"sha256": "d111d9e28b4035e6781906b6451b7866737b4a4ee734baa1575c55d8aa1b4200",
	"repo": "unsloth/DeepSeek-R1-GGUF",
	"revision": "main",
	"primary_file": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf",
	"canonical_ref": "unsloth/DeepSeek-R1-GGUF@main/DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf",
	"distribution_id": "DeepSeek-R1-Q4_K_M",
	"files": [
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00002-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00003-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00004-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00005-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00006-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00007-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00008-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	},
	{
	"path": "DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00009-of-00009.gguf",
	"size_bytes": null,
	"sha256": null
	}
	]
	},
	"format": "layer-package",
	"layer_count": 61,
	"activation_width": 7168,
	"shared": {
	"metadata": {
	"path": "shared/metadata.gguf",
	"tensor_count": 0,
	"tensor_bytes": 0,
	"artifact_bytes": 5237088,
	"sha256": "0e1bf01f20ef69f691126b69c633fd63977cd190bea4182a1c9f41d1537b0ad6"
	},
	"embeddings": {
	"path": "shared/embeddings.gguf",
	"tensor_count": 1,
	"tensor_bytes": 521256960,
	"artifact_bytes": 526494112,
	"sha256": "951352774cabdce1e5fe940b30ca85ac8440de68afb6c6eceb451524109991f1"
	},
	"output": {
	"path": "shared/output.gguf",
	"tensor_count": 2,
	"tensor_bytes": 760195072,
	"artifact_bytes": 765432256,
	"sha256": "131fcb580fd1ba667733e39ffc806f819f54928621f40cd47405399a8b9abecb"
	}
	},
	"layers": [
	{
	"layer_index": 0,
	"path": "layers/layer-000.gguf",
	"tensor_count": 12,
	"tensor_bytes": 362328064,
	"artifact_bytes": 367565888,
	"sha256": "55cbfae9935fa073e6b04f2204faaa53aa1fdf9b554fb64b9079da2bd523fc89"
	},
	{
	"layer_index": 1,
	"path": "layers/layer-001.gguf",
	"tensor_count": 12,
	"tensor_bytes": 362328064,
	"artifact_bytes": 367565888,
	"sha256": "ee0b56840dea9bd1b6e23b8a9c7ceddfcb5b4e047bc31e2e80540dfc11f6abd0"
	},
	{
	"layer_index": 2,
	"path": "layers/layer-002.gguf",
	"tensor_count": 12,
	"tensor_bytes": 362328064,
	"artifact_bytes": 367565888,
	"sha256": "70679f20e2805f96181cdf3ebe99f4bc7cdbaf998405a1af48415c7ee3617327"
	},
	{
	"layer_index": 3,
	"path": "layers/layer-003.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "78231e107169ebf41b3a6222c2f9ca5ea8863ce8509cf36a588dfa6b94aa8c58"
	},
	{
	"layer_index": 4,
	"path": "layers/layer-004.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "591c38e05744e57a01b67c494a9646cbb5acab3a5b33c6311e9a22b783e6ef42"
	},
	{
	"layer_index": 5,
	"path": "layers/layer-005.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "0c3e74bd2ed1a97971e670c18a166335f531e24a39ffb2cfac579284180bd9e3"
	},
	{
	"layer_index": 6,
	"path": "layers/layer-006.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "714943eb68af768033d37d245a56d016104724d5da173103522bcec6e7193ba7"
	},
	{
	"layer_index": 7,
	"path": "layers/layer-007.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "b564081a595b77875fa887ba81ec0c0e414642355845c74141e7c56b2d2a1267"
	},
	{
	"layer_index": 8,
	"path": "layers/layer-008.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "7c1cef8986545b81d646a1f3594ac803d5ebb9cfad4e8dd777449195fedab52f"
	},
	{
	"layer_index": 9,
	"path": "layers/layer-009.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "5fafba43e2d30f8157033546e421b2db51bb7b9fe8722939ff2394888dabdf57"
	},
	{
	"layer_index": 10,
	"path": "layers/layer-010.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "17b2d5b6229817b688d81292e72f3431df22e8fa510ba563912fa077c35cfd6f"
	},
	{
	"layer_index": 11,
	"path": "layers/layer-011.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "dc5155f5fe4c8eb355b4593852b7f4f217b6e37bfe8d997849423aeb475bbcf9"
	},
	{
	"layer_index": 12,
	"path": "layers/layer-012.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "67f6c9020455e377b7f82419deab0a3d5fec1fa85fc9185af3f4249d34a41bd0"
	},
	{
	"layer_index": 13,
	"path": "layers/layer-013.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "231d9cb77e59e16acc0744f378f8ecc48c37a4d569a1449cc68f3bf17017cd3c"
	},
	{
	"layer_index": 14,
	"path": "layers/layer-014.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "d4dffe0c555d6412ae48c55c11ce96485113a7e59c2067bb434e80cbc5df880d"
	},
	{
	"layer_index": 15,
	"path": "layers/layer-015.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "5eefbfbbe1955305e96efd8fcc2095483ceecc3587595acd62eddbb2d360dd80"
	},
	{
	"layer_index": 16,
	"path": "layers/layer-016.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "b79ab04d5cc7ab8e6ff71a3a5023af20f5e2af16ecf547af2d0c2b2d7e59bf9b"
	},
	{
	"layer_index": 17,
	"path": "layers/layer-017.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "cba9bdbe14c45bede60308c0119a83f5d23b91ede766d3841e28f35f9f41b574"
	},
	{
	"layer_index": 18,
	"path": "layers/layer-018.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "f833f7fac0691a92c30eb602a3f3e40d272ad4976a01c82a83aa76edbbf0bd7a"
	},
	{
	"layer_index": 19,
	"path": "layers/layer-019.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "5d3a098d9c8e6f041a78328aafd9702f941c9958fbf8f63944ff527c81bd9414"
	},
	{
	"layer_index": 20,
	"path": "layers/layer-020.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "d78e295442aa9667c92480c8e5195f1ce5752dc9ebb46810674beb718d4ad6e6"
	},
	{
	"layer_index": 21,
	"path": "layers/layer-021.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "47e008c84283f7acecfb1ceb03e6ba55c549fb4faa586b128172c3dedf11ec91"
	},
	{
	"layer_index": 22,
	"path": "layers/layer-022.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "78692143cba0da78b566a02d9cb26ee81c95e2a04b9c8e27d57a20ade0be4010"
	},
	{
	"layer_index": 23,
	"path": "layers/layer-023.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "e2af4f2c3c6ebc997640165cc30691833dd4e48514a647938eda005467c48d50"
	},
	{
	"layer_index": 24,
	"path": "layers/layer-024.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "2801c22c534bfa8b483b5be1b41e6a9e6d2a72520d47e82da99f171a34df006a"
	},
	{
	"layer_index": 25,
	"path": "layers/layer-025.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "f9635adf78078d923ec8868aabec3679c6cb87c7a32d0ebacf0dc5eaba27a9d5"
	},
	{
	"layer_index": 26,
	"path": "layers/layer-026.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "6c93de15313c412cc715df0bcb81c969bc429a8ad7a93f81fd249bddc43d8cc0"
	},
	{
	"layer_index": 27,
	"path": "layers/layer-027.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "a33271f645ab82755bc70e480348564282a70954725d7c0c24ef3778ab3e5712"
	},
	{
	"layer_index": 28,
	"path": "layers/layer-028.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "35a03b55e4b78d508efdbde4544dbca4e80e7156d47f4c01e5b2798bd95c100c"
	},
	{
	"layer_index": 29,
	"path": "layers/layer-029.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "363bc045308d3a8d4c72ae665631faa8feac6db7f8e8d8e3861d96d5850ac473"
	},
	{
	"layer_index": 30,
	"path": "layers/layer-030.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "20615604e641c8c1ab2468aa09481067e8621dddc7aaedb9aa2f0fb62de0313d"
	},
	{
	"layer_index": 31,
	"path": "layers/layer-031.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "4ccd278992a4c72ebf60240f496dc2dfe5c279d1aac68aef3126ca7df331b886"
	},
	{
	"layer_index": 32,
	"path": "layers/layer-032.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "e049366231c833095bcb0d481cab78808226bba8a9b8aab8aa086db135f5c65d"
	},
	{
	"layer_index": 33,
	"path": "layers/layer-033.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "892e0a4e1dfbf4baa7f6d54771eb543f5324ba84ad8176920f6e19d89ef7d071"
	},
	{
	"layer_index": 34,
	"path": "layers/layer-034.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "586763b14db263f57e6c7f1ddd9c8b1ba659dac9e7f2fd4634e930062c9285e9"
	},
	{
	"layer_index": 35,
	"path": "layers/layer-035.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "b9b33b9b06130b1a2d8e78a541703e927e2adb9c75a66c9c0010e7790df49e46"
	},
	{
	"layer_index": 36,
	"path": "layers/layer-036.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "0f338008904c4da3af11b18256e17160124ed7998b3d72bea2f86b5de4c00cb7"
	},
	{
	"layer_index": 37,
	"path": "layers/layer-037.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "3026978939ee692dc48723df7e9137efeee52da08f2b2deb5dd0a1d148274ba6"
	},
	{
	"layer_index": 38,
	"path": "layers/layer-038.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "404301fa2703e215f9d9751af0cb4407eaab4c71d31940733bfdffaa81ec4812"
	},
	{
	"layer_index": 39,
	"path": "layers/layer-039.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "d764f66f787f4c02b58b17b9105bde8ba7b42dd34bbca5da3c24a4064309c7aa"
	},
	{
	"layer_index": 40,
	"path": "layers/layer-040.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "60f33831b16074319ce5c1142533507700c40409ef5c6a7953009d7c31e2020d"
	},
	{
	"layer_index": 41,
	"path": "layers/layer-041.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "380cb727cdf8c7636af9c11aa7c8fdf6a4519c80da30707a26f791beec1d140d"
	},
	{
	"layer_index": 42,
	"path": "layers/layer-042.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "e1a7e8564341ace8682c792820c36b9ddc77295332aa688dd0dcc780e03b5ace"
	},
	{
	"layer_index": 43,
	"path": "layers/layer-043.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "65d439040e3f3759523e55a76c98379f532964e1563c429597b1b9bcb493970d"
	},
	{
	"layer_index": 44,
	"path": "layers/layer-044.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "0585cdd4b049ecabcfc766ff162e71114dfca0e66645383e2fbe8f81d062a831"
	},
	{
	"layer_index": 45,
	"path": "layers/layer-045.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "0c47e264dddaabefe99e7729901474e8ed7fafa37022d334a15b2f638f3e5657"
	},
	{
	"layer_index": 46,
	"path": "layers/layer-046.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "c3fd4e47281601b0e78814edc60fd13fe5fd25ac0c534e214be4a17563661f38"
	},
	{
	"layer_index": 47,
	"path": "layers/layer-047.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "fa0a2ff92a3901157e8bbf64aee4db53f81be751dfa6ce3556620973069e4599"
	},
	{
	"layer_index": 48,
	"path": "layers/layer-048.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "fafb718871b8e7f17bbacb7873184e6d8b01fb6d6ef1232a8042f6707188d0f4"
	},
	{
	"layer_index": 49,
	"path": "layers/layer-049.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "d71fb1fcded6ad64c5f2e3bd9ecc198f32b517d54da1212f5dc52225ccdcacd7"
	},
	{
	"layer_index": 50,
	"path": "layers/layer-050.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "a8cc8f4acfb37a9aa6565c580cd17649437471d8374612411cdd5ba8c3c05407"
	},
	{
	"layer_index": 51,
	"path": "layers/layer-051.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "77e8dd090630b3aff67292eeafa0e66d039932445259b2cb6422533d4683e281"
	},
	{
	"layer_index": 52,
	"path": "layers/layer-052.gguf",
	"tensor_count": 17,
	"tensor_bytes": 6479213568,
	"artifact_bytes": 6484451744,
	"sha256": "d5ca178d9efe8c0c8b8b8f0aadadc7582407202578557307096c96b085df07e5"
	},
	{
	"layer_index": 53,
	"path": "layers/layer-053.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "c7083c49bdcb8eec433f8bf676fcbc8bb1b5360551aa658285b1bc740f735f42"
	},
	{
	"layer_index": 54,
	"path": "layers/layer-054.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "475f9d8f7b19b70a655b9ce9d1625a4c361b5d883c49c9a6bf017da2f6072383"
	},
	{
	"layer_index": 55,
	"path": "layers/layer-055.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "b7d2c75bbbfafd4a9c95732694c6aa13c566a6fde0a1309afd5e653672d1a385"
	},
	{
	"layer_index": 56,
	"path": "layers/layer-056.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "0232d4bdfe7d7d3a13ba04d72d58b84a79c8be6e5a772db5e27eda0320e9a17c"
	},
	{
	"layer_index": 57,
	"path": "layers/layer-057.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "93618f57feb2ed23810f8b1d9cdc876eb6f1a16375cf02af5dca7a2831e5a9b6"
	},
	{
	"layer_index": 58,
	"path": "layers/layer-058.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "4bfcb7376267cf869f8797ac6612622c67d8de3c946b00b321c05e562b26beb1"
	},
	{
	"layer_index": 59,
	"path": "layers/layer-059.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "3c30af4b338fe4cce8065dccfdf1fa363acb3f83b866134edb44218c333bc214"
	},
	{
	"layer_index": 60,
	"path": "layers/layer-060.gguf",
	"tensor_count": 17,
	"tensor_bytes": 7451882496,
	"artifact_bytes": 7457120672,
	"sha256": "e4127ee8cb33545f41edcd851c3a1ca67b0dc85f8a15fc8c5d07e74328252091"
	}
	],
	"skippy_abi_version": "0.1.22",
	"created_at_unix_secs": 1778492492
	}