Image-Text-to-Text
GGUF
mesh-llm
layer-package
skippy
distributed-inference
local-inference
openai-compatible
experimental
imatrix
conversational
Instructions to use lyssquant/inkling-UD-Q2_K_XL-layers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use lyssquant/inkling-UD-Q2_K_XL-layers with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16 # Run inference directly in the terminal: llama cli -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16 # Run inference directly in the terminal: llama cli -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16 # Run inference directly in the terminal: ./llama-cli -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Use Docker
docker model run hf.co/lyssquant/inkling-UD-Q2_K_XL-layers:BF16
- LM Studio
- Jan
- vLLM
How to use lyssquant/inkling-UD-Q2_K_XL-layers with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "lyssquant/inkling-UD-Q2_K_XL-layers" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lyssquant/inkling-UD-Q2_K_XL-layers", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/lyssquant/inkling-UD-Q2_K_XL-layers:BF16
- Ollama
How to use lyssquant/inkling-UD-Q2_K_XL-layers with Ollama:
ollama run hf.co/lyssquant/inkling-UD-Q2_K_XL-layers:BF16
- Unsloth Studio
How to use lyssquant/inkling-UD-Q2_K_XL-layers with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for lyssquant/inkling-UD-Q2_K_XL-layers to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for lyssquant/inkling-UD-Q2_K_XL-layers to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for lyssquant/inkling-UD-Q2_K_XL-layers to start chatting
- Pi
How to use lyssquant/inkling-UD-Q2_K_XL-layers with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "lyssquant/inkling-UD-Q2_K_XL-layers:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use lyssquant/inkling-UD-Q2_K_XL-layers with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "lyssquant/inkling-UD-Q2_K_XL-layers:BF16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use lyssquant/inkling-UD-Q2_K_XL-layers with Docker Model Runner:
docker model run hf.co/lyssquant/inkling-UD-Q2_K_XL-layers:BF16
- Lemonade
How to use lyssquant/inkling-UD-Q2_K_XL-layers with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Run and chat with the model
lemonade run user.inkling-UD-Q2_K_XL-layers-BF16
List all available models
lemonade list
- Hermes Agent
How to use lyssquant/inkling-UD-Q2_K_XL-layers with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default lyssquant/inkling-UD-Q2_K_XL-layers:BF16
Run Hermes
hermes
- Atomic Chat
| { | |
| "schema_version": 1, | |
| "model_id": "unsloth/inkling-GGUF:UD-Q2_K_XL", | |
| "source_model": { | |
| "path": "/source/UD-Q2_K_XL/inkling-UD-Q2_K_XL-00001-of-00008.gguf", | |
| "sha256": "8b153eb6a470303f227ef2ba5b515e4e53cc51be65f4395490aa6e37f377bebf", | |
| "repo": "unsloth/inkling-GGUF", | |
| "revision": "d3e9ffca48751dbe8b59dab5cfa364621257c682", | |
| "primary_file": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00001-of-00008.gguf", | |
| "canonical_ref": "unsloth/inkling-GGUF@d3e9ffca48751dbe8b59dab5cfa364621257c682/UD-Q2_K_XL/inkling-UD-Q2_K_XL-00001-of-00008.gguf", | |
| "distribution_id": "inkling-UD-Q2_K_XL", | |
| "files": [ | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00001-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00002-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00003-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00004-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00005-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00006-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00007-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q2_K_XL/inkling-UD-Q2_K_XL-00008-of-00008.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| } | |
| ] | |
| }, | |
| "format": "layer-package", | |
| "layer_count": 66, | |
| "activation_width": 6144, | |
| "shared": { | |
| "metadata": { | |
| "path": "shared/metadata.gguf", | |
| "tensor_count": 1, | |
| "tensor_bytes": 24576, | |
| "artifact_bytes": 13011040, | |
| "sha256": "c2332ae2f8fc2a711861bae5c96720592aee75cdf7868a3bade02bc513f03bf5" | |
| }, | |
| "embeddings": { | |
| "path": "shared/embeddings.gguf", | |
| "tensor_count": 2, | |
| "tensor_bytes": 849149952, | |
| "artifact_bytes": 862136480, | |
| "sha256": "2021ca206c89e66637e4e048caea5c5b181413ce4e9b045fb6aff8db315f7a7a" | |
| }, | |
| "output": { | |
| "path": "shared/output.gguf", | |
| "tensor_count": 3, | |
| "tensor_bytes": 694788096, | |
| "artifact_bytes": 707774656, | |
| "sha256": "0ca256c69c9c311dfb5671643f9edaff62de8706453a68aa34b953aaac6f8b21" | |
| } | |
| }, | |
| "projectors": [ | |
| { | |
| "kind": "mmproj", | |
| "path": "projectors/mmproj-BF16.gguf", | |
| "tensor_count": 10, | |
| "tensor_bytes": 183262464, | |
| "artifact_bytes": 183264288, | |
| "sha256": "662c925e1df293cfba16ffd6bd53dac31d3c73160ba65dff7270d7a70f351e91" | |
| } | |
| ], | |
| "layers": [ | |
| { | |
| "layer_index": 0, | |
| "path": "layers/layer-000.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 428385284, | |
| "artifact_bytes": 441372864, | |
| "sha256": "8651944f86569113f7964498ea240daaeb5aeb43e5780bbf9decf640a239d20b" | |
| }, | |
| { | |
| "layer_index": 1, | |
| "path": "layers/layer-001.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 428385284, | |
| "artifact_bytes": 441372864, | |
| "sha256": "fc009caf18af642ef1798cefbb23c85bcb682311cec1b67661a51c0f14bdfa66" | |
| }, | |
| { | |
| "layer_index": 2, | |
| "path": "layers/layer-002.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198592, | |
| "sha256": "143fe7028b60c5905a59f14eb36643ee4546dc2483069d435a8bc7ff5d41177a" | |
| }, | |
| { | |
| "layer_index": 3, | |
| "path": "layers/layer-003.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198592, | |
| "sha256": "73cab90bb1fee73725690855103623237253b7e9832c27e7bddf789fce5da746" | |
| }, | |
| { | |
| "layer_index": 4, | |
| "path": "layers/layer-004.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198592, | |
| "sha256": "85d3e7e1eeeda25292460d30c244ebc05d5ab898b1aaff05f2420559ec91ed82" | |
| }, | |
| { | |
| "layer_index": 5, | |
| "path": "layers/layer-005.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876672, | |
| "sha256": "922bce46894cf894b04a8f5dbc0ff9e9acebbdea09dece428f481170336b3978" | |
| }, | |
| { | |
| "layer_index": 6, | |
| "path": "layers/layer-006.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198592, | |
| "sha256": "a13195d50b80c0f64d57658a36a5358984653a19bdaa7123413c8832e431b392" | |
| }, | |
| { | |
| "layer_index": 7, | |
| "path": "layers/layer-007.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198592, | |
| "sha256": "d943ca0cc8b8b0e9f155b590f6b16e5427321ddb110c7c5fb679a67a40113739" | |
| }, | |
| { | |
| "layer_index": 8, | |
| "path": "layers/layer-008.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198592, | |
| "sha256": "e37c5d6b719b43cf8b1612858f68617ca7a4aaeca6256f316887125a137e495c" | |
| }, | |
| { | |
| "layer_index": 9, | |
| "path": "layers/layer-009.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198592, | |
| "sha256": "771660a8479f785ec39c8b1032163ee139f1099a42f2dac084763a5f88eef7df" | |
| }, | |
| { | |
| "layer_index": 10, | |
| "path": "layers/layer-010.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "09d7f5f6470608d194047c171b739e7a32ee56c7d8a4146d520e580c0e38577f" | |
| }, | |
| { | |
| "layer_index": 11, | |
| "path": "layers/layer-011.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "228159f4039f3a31ee48c9f92933bf2a36439529732115bc93be726ff5674123" | |
| }, | |
| { | |
| "layer_index": 12, | |
| "path": "layers/layer-012.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "bc2078614fda35c2995f015f7b6d50453e1e4a0d5a48516faaebb8c0ca6700f1" | |
| }, | |
| { | |
| "layer_index": 13, | |
| "path": "layers/layer-013.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "5f2c416d32641124f0f9be9fe6d90e2bd65842ddbd8030cd9b0f5a8e37a163d2" | |
| }, | |
| { | |
| "layer_index": 14, | |
| "path": "layers/layer-014.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "661018528f6b274e45b3f25c49d0452ba505a67a6d57db703058bdbaab069d2b" | |
| }, | |
| { | |
| "layer_index": 15, | |
| "path": "layers/layer-015.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "7f2765c2ea3a403fc5b3d3054f5b288d3bbb593c7f45b03bf250f5ee9589b81c" | |
| }, | |
| { | |
| "layer_index": 16, | |
| "path": "layers/layer-016.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "2baab6c9f535af392b4977210a7e71bdc00bdae394aaac0c16214b669bb8e6f7" | |
| }, | |
| { | |
| "layer_index": 17, | |
| "path": "layers/layer-017.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "565ecf6a8dcd585b395e53cee95f54cba310adecb3305555e5354ebb056e04c5" | |
| }, | |
| { | |
| "layer_index": 18, | |
| "path": "layers/layer-018.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "bf4d3672a11467d10ade17ef8cf324fcee125cd9a85d6f35c20804c672af67a4" | |
| }, | |
| { | |
| "layer_index": 19, | |
| "path": "layers/layer-019.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "ae1c706042521ec39e8e94290071e81ed34173780c37ef1dfcec6104930c72e6" | |
| }, | |
| { | |
| "layer_index": 20, | |
| "path": "layers/layer-020.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "60c25db537c32223ff4bb3d07de8f20a7c68f092a74c1623d2b5cb7ba366d365" | |
| }, | |
| { | |
| "layer_index": 21, | |
| "path": "layers/layer-021.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "e0ca26a196dc37753aca779977e9f38c916d2a57085714d4ebc647a6b012e3a5" | |
| }, | |
| { | |
| "layer_index": 22, | |
| "path": "layers/layer-022.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "200a0d3454774cc8c6018f1f726b401ffb98072d4b1890163c5253b825101566" | |
| }, | |
| { | |
| "layer_index": 23, | |
| "path": "layers/layer-023.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "70416918a9e2ea591e6721941f6a2a3783d10fa0aaffcf141cb014819ade8638" | |
| }, | |
| { | |
| "layer_index": 24, | |
| "path": "layers/layer-024.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "15e43e635316a23141ce6b96db90b9d8763945de16c1e7294b47b29ba5d55439" | |
| }, | |
| { | |
| "layer_index": 25, | |
| "path": "layers/layer-025.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "371221cb15cd2fc86f7857225b050052a16607270d66e7ac393ef2727919a3ed" | |
| }, | |
| { | |
| "layer_index": 26, | |
| "path": "layers/layer-026.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "a1cb733531ff8b690d04b781ef738334dae694a18f3fbb7869115c45303a1cf2" | |
| }, | |
| { | |
| "layer_index": 27, | |
| "path": "layers/layer-027.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "a36c41a47fff6c1a62efc58ee83b90af44b1682d7feb14f20dbeb7d993c9da4f" | |
| }, | |
| { | |
| "layer_index": 28, | |
| "path": "layers/layer-028.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "be08d6a5ef16796044335b64d26b605e299c7b774f52dfda340e4add54eaea29" | |
| }, | |
| { | |
| "layer_index": 29, | |
| "path": "layers/layer-029.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "2e077fae794dc4ce208aea53449988f7cb8475468a94dbdc9f333730b305c629" | |
| }, | |
| { | |
| "layer_index": 30, | |
| "path": "layers/layer-030.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "06c3fcb8bf50e8731b38bfaadf6c946f7079761e8b65ff9fa6700e361b3b7745" | |
| }, | |
| { | |
| "layer_index": 31, | |
| "path": "layers/layer-031.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "2d7808f6d446a9623e44fd6058bf06810fa2baed1eadbbe20cb1f27344553379" | |
| }, | |
| { | |
| "layer_index": 32, | |
| "path": "layers/layer-032.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "8d3692a994f7c9f8cfda97af88bc19722a51a1e15927c52b65c1f53f82792605" | |
| }, | |
| { | |
| "layer_index": 33, | |
| "path": "layers/layer-033.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "48f66cb8a959bd19ff23da8c461254708352c0442e686069c838464449916217" | |
| }, | |
| { | |
| "layer_index": 34, | |
| "path": "layers/layer-034.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "e84f9bf768de55677df15e0591eb0e8d09dbf56ffb0a08b43ff84b2fbc182d7f" | |
| }, | |
| { | |
| "layer_index": 35, | |
| "path": "layers/layer-035.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "3bc4f06ca1601f579aba6c2a3e2428e239223e894d4c564dca5a97b946ab1c25" | |
| }, | |
| { | |
| "layer_index": 36, | |
| "path": "layers/layer-036.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "312ac075b2af5b6b052f10d93e3b583c0a3701d6d5f92d616819b02d85ec5be2" | |
| }, | |
| { | |
| "layer_index": 37, | |
| "path": "layers/layer-037.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "33130440e296f1606986dd3fdef70c4add903971232471ba367969bb8339c390" | |
| }, | |
| { | |
| "layer_index": 38, | |
| "path": "layers/layer-038.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "edf0464d29ea62c555507124344c756af311af6e55e398b4f3cf1dc707f66605" | |
| }, | |
| { | |
| "layer_index": 39, | |
| "path": "layers/layer-039.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "b438c1ed89ff66938f8f74100000d816e1543a3b93e05aa2291c07ff9c51820b" | |
| }, | |
| { | |
| "layer_index": 40, | |
| "path": "layers/layer-040.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 5546436612, | |
| "artifact_bytes": 5559424608, | |
| "sha256": "111a5aea0d7c2d8956273fdf82c05d2613fd26420efe570adbf23958d26552f7" | |
| }, | |
| { | |
| "layer_index": 41, | |
| "path": "layers/layer-041.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "3939d1a386f9e3b7ebfa72b725a62df37e6f71f5b24e67188a05292c35abcbe1" | |
| }, | |
| { | |
| "layer_index": 42, | |
| "path": "layers/layer-042.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "3abfa4c16e8888bc5c6b25be670cc12c8ab81e82f0fcf373e545cb309f1c4770" | |
| }, | |
| { | |
| "layer_index": 43, | |
| "path": "layers/layer-043.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "0a6b4e68660495840a33466d31093071fa15127d47a16115500a7c1d802c421e" | |
| }, | |
| { | |
| "layer_index": 44, | |
| "path": "layers/layer-044.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "210385b00193f3d0c36268004801d2d5c64cdbab9353f0b3ac97901a2ca60eed" | |
| }, | |
| { | |
| "layer_index": 45, | |
| "path": "layers/layer-045.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "8727dbcb33fcbd1c2435885bb5963d579100343c0fa57978febfb73d043c4473" | |
| }, | |
| { | |
| "layer_index": 46, | |
| "path": "layers/layer-046.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "0d3880357ab5e686d2c7c12179613fca9e7cca295ee10245a832904b34707567" | |
| }, | |
| { | |
| "layer_index": 47, | |
| "path": "layers/layer-047.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "4e76c95ffd9e2f59bfab8b7e8c137cb82369185d4d4fbec68bfa1add37e38732" | |
| }, | |
| { | |
| "layer_index": 48, | |
| "path": "layers/layer-048.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "a2097293eec17d5e0fdad17a2fbd631da9a638ff0cabf8847f5c11eb0d4d178b" | |
| }, | |
| { | |
| "layer_index": 49, | |
| "path": "layers/layer-049.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "92e112ae5004de66ec16eb3be3e8ebf30a09c36c2cb29475a03f93ae21d79e61" | |
| }, | |
| { | |
| "layer_index": 50, | |
| "path": "layers/layer-050.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "85f1ca85422a70317d947954b354adbb5f3782258601f4d2ea63576cab1a38c5" | |
| }, | |
| { | |
| "layer_index": 51, | |
| "path": "layers/layer-051.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "3e89e49bb645a721472eeefc133fab6e5dd84ce45cae2fb562700f4e0e3985bc" | |
| }, | |
| { | |
| "layer_index": 52, | |
| "path": "layers/layer-052.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "c403a2d8f4a665ef768dbdb3a3d5a781cc6c426009c6d01331a705dbb74c58c5" | |
| }, | |
| { | |
| "layer_index": 53, | |
| "path": "layers/layer-053.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4818888708, | |
| "artifact_bytes": 4831876704, | |
| "sha256": "2163a788478a5b98394dbdbb1c974ef7b4de3258302892fa145f5d3faa5e3bca" | |
| }, | |
| { | |
| "layer_index": 54, | |
| "path": "layers/layer-054.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "29e35878760e9ea55986f928305e53ad5a377ac9a77551a703432d41cd39acee" | |
| }, | |
| { | |
| "layer_index": 55, | |
| "path": "layers/layer-055.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "1221d7c0c5f83ba400eb23000dcea6bcb8c1b0ba17994d13959848623b9ad12e" | |
| }, | |
| { | |
| "layer_index": 56, | |
| "path": "layers/layer-056.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "4aaaef7ffe54c4ad0c2b41559b1186030ba35e0a811dc64da41998cf748efb2e" | |
| }, | |
| { | |
| "layer_index": 57, | |
| "path": "layers/layer-057.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "9cf7b697858f40012ad3d9e10ab686aaa041888f940133a5df868437ef3796b1" | |
| }, | |
| { | |
| "layer_index": 58, | |
| "path": "layers/layer-058.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "5cbb2189ddf85b4f3a69e538ea95185a5c8ed80dbfebce3f8366661ed9c74706" | |
| }, | |
| { | |
| "layer_index": 59, | |
| "path": "layers/layer-059.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 5536114692, | |
| "artifact_bytes": 5549102688, | |
| "sha256": "4e18edae016464ad32f592c7d84b972382b47a52868325b45c1c2d868f13926f" | |
| }, | |
| { | |
| "layer_index": 60, | |
| "path": "layers/layer-060.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 5546436612, | |
| "artifact_bytes": 5559424608, | |
| "sha256": "51d5984630c28a0fe2c313069982656982dbc4209471cb8a683ae6f12f1d9a68" | |
| }, | |
| { | |
| "layer_index": 61, | |
| "path": "layers/layer-061.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4829210628, | |
| "artifact_bytes": 4842198624, | |
| "sha256": "cc75d78739a69ec59700ca84f8a00b0c95ad75c644dcc4c4ae9a012ac9bc3c39" | |
| }, | |
| { | |
| "layer_index": 62, | |
| "path": "layers/layer-062.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 5546436612, | |
| "artifact_bytes": 5559424608, | |
| "sha256": "ee7fa7a3de582bf0eec03f8efe9ccb29dbd9e8b6a3695e9f28ca501e66da998e" | |
| }, | |
| { | |
| "layer_index": 63, | |
| "path": "layers/layer-063.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 5546436612, | |
| "artifact_bytes": 5559424608, | |
| "sha256": "8cf159145898e3e45e207a2dd1447c2545e5c9c36321d9a6e5b45e7a38341238" | |
| }, | |
| { | |
| "layer_index": 64, | |
| "path": "layers/layer-064.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 5546436612, | |
| "artifact_bytes": 5559424608, | |
| "sha256": "461672cfbe32df0e1fb27cdaf3af0e309bf2cf2ae78e41f309b5f5f518fcd073" | |
| }, | |
| { | |
| "layer_index": 65, | |
| "path": "layers/layer-065.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 6477670404, | |
| "artifact_bytes": 6490658400, | |
| "sha256": "3b3858330bfff0f2b3d98e6ffe81e80943520ef8f923210986a983629d8b0e1a" | |
| } | |
| ], | |
| "skippy_abi_version": "0.1.30", | |
| "created_at_unix_secs": 1784267175 | |
| } | |