Text Generation
GGUF
mesh-llm
layer-package
skippy
distributed-inference
local-inference
openai-compatible
conversational
Instructions to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers # Run inference directly in the terminal: llama cli -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers # Run inference directly in the terminal: llama cli -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers # Run inference directly in the terminal: ./llama-cli -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers # Run inference directly in the terminal: ./build/bin/llama-cli -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Use Docker
docker model run hf.co/meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
- LM Studio
- Jan
- vLLM
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
- Ollama
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with Ollama:
ollama run hf.co/meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
- Unsloth Studio
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers to start chatting
- Pi
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with Docker Model Runner:
docker model run hf.co/meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
- Lemonade
How to use meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers
Run and chat with the model
lemonade run user.Kimi-K2.7-Code-UD-Q4_K_XL-layers-{{QUANT_TAG}}List all available models
lemonade list
Add layer package manifest from unsloth/Kimi-K2.7-Code-GGUF (unsloth/Kimi-K2.7-Code-GGUF:UD-Q4_K_XL)
5e0589b verified | { | |
| "schema_version": 1, | |
| "model_id": "unsloth/Kimi-K2.7-Code-GGUF:UD-Q4_K_XL", | |
| "source_model": { | |
| "path": "/source/UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00001-of-00014.gguf", | |
| "sha256": "65f0aca336f876902323a90e2aff32cac76d071b2cdd818c6a8d78be8fc2c680", | |
| "repo": "unsloth/Kimi-K2.7-Code-GGUF", | |
| "revision": "main", | |
| "primary_file": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00001-of-00014.gguf", | |
| "canonical_ref": "unsloth/Kimi-K2.7-Code-GGUF@main/UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00001-of-00014.gguf", | |
| "distribution_id": "Kimi-K2.7-Code-UD-Q4_K_XL", | |
| "files": [ | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00001-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00002-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00003-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00004-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00005-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00006-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00007-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00008-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00009-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00010-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00011-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00012-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00013-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Kimi-K2.7-Code-UD-Q4_K_XL-00014-of-00014.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| } | |
| ] | |
| }, | |
| "format": "layer-package", | |
| "layer_count": 61, | |
| "activation_width": 7168, | |
| "shared": { | |
| "metadata": { | |
| "path": "shared/metadata.gguf", | |
| "tensor_count": 0, | |
| "tensor_bytes": 0, | |
| "artifact_bytes": 6913184, | |
| "sha256": "18cf1a16577311975d58524344203f54b2edb61e086581699f0c2a2c658147e0" | |
| }, | |
| "embeddings": { | |
| "path": "shared/embeddings.gguf", | |
| "tensor_count": 1, | |
| "tensor_bytes": 1247805440, | |
| "artifact_bytes": 1254718656, | |
| "sha256": "66368df5cf3f85a7a14fddafe1817a4c0bae08b204f9e7ee4171c6379a9272fb" | |
| }, | |
| "output": { | |
| "path": "shared/output.gguf", | |
| "tensor_count": 2, | |
| "tensor_bytes": 1247834112, | |
| "artifact_bytes": 1254747392, | |
| "sha256": "88119cba4f946a2ad3cc15e62a2bc304cd1a302b53f1ebf15561eaa92fb8fc55" | |
| } | |
| }, | |
| "layers": [ | |
| { | |
| "layer_index": 0, | |
| "path": "layers/layer-000.gguf", | |
| "tensor_count": 13, | |
| "tensor_bytes": 528642048, | |
| "artifact_bytes": 535556032, | |
| "sha256": "c072d610be4f2c902fa0197f49d2d63323b78ca819def21bd6332bfead755f3e" | |
| }, | |
| { | |
| "layer_index": 1, | |
| "path": "layers/layer-001.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "ba24c6327e60f26830156fe462924e32a17ceca1bde8ac13c1198d79eb63b822" | |
| }, | |
| { | |
| "layer_index": 2, | |
| "path": "layers/layer-002.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "f6d68aaf051be532e73c5528e3932d97b65b61b5d39fa293d987a2fdbdcb473c" | |
| }, | |
| { | |
| "layer_index": 3, | |
| "path": "layers/layer-003.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "86dc1e93e96c8979b17f534e517ff8a832f87b9a24ef06cbce2b01b2ee6945cf" | |
| }, | |
| { | |
| "layer_index": 4, | |
| "path": "layers/layer-004.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "41b6c8b06d85db109d092508bd1ded6b31b3a7f9e204670f089a8923f7e097bc" | |
| }, | |
| { | |
| "layer_index": 5, | |
| "path": "layers/layer-005.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "0cc62a58f2e2a4a0139e0491fe79b3cfbbd2c5a1b2b47d4fbe68f8f7ad159f4f" | |
| }, | |
| { | |
| "layer_index": 6, | |
| "path": "layers/layer-006.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "99ab76a5f34f8ad2d0ddc85e42fc2575b606ab231777a00dafba294acfc98a01" | |
| }, | |
| { | |
| "layer_index": 7, | |
| "path": "layers/layer-007.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "5b5d1d59b147da8fab9a7265a098fa18247ce465ea70370fdbab16b1e4a5282e" | |
| }, | |
| { | |
| "layer_index": 8, | |
| "path": "layers/layer-008.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "16be9085d1bb7aba7884f4caed07013341b21d2032b09b82518da078264fae8c" | |
| }, | |
| { | |
| "layer_index": 9, | |
| "path": "layers/layer-009.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "44644eb469fdf28686e2b5f8ab7e1f5ed9bf1cc20dc08d26c67f4c68e962873f" | |
| }, | |
| { | |
| "layer_index": 10, | |
| "path": "layers/layer-010.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "9f8e91f63bc12d5a6cf40b4c648dffa891cf0ed5dc5e233f2e69f854857c7b14" | |
| }, | |
| { | |
| "layer_index": 11, | |
| "path": "layers/layer-011.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "1befbcd553133f1ef75c123dc084da80995a8c301223ad3e7d1de11189baf225" | |
| }, | |
| { | |
| "layer_index": 12, | |
| "path": "layers/layer-012.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "87d5a82386355791f244eca4bf8fed2b85e91b1c3bcd129cc60c350818018a9b" | |
| }, | |
| { | |
| "layer_index": 13, | |
| "path": "layers/layer-013.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "9539378cacaf31e374aea150551ac3d2b2b8eb9a00e117c12ddd352839eabd68" | |
| }, | |
| { | |
| "layer_index": 14, | |
| "path": "layers/layer-014.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "34d196d474163f30096fe5af1f9a5eb39b4d7abf656d99357dfda7f058e77db1" | |
| }, | |
| { | |
| "layer_index": 15, | |
| "path": "layers/layer-015.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "401baa8924768dbfd3812e34fa2a8a027040f95a5a47165f12818096b847f90a" | |
| }, | |
| { | |
| "layer_index": 16, | |
| "path": "layers/layer-016.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "d198b3cc40a1e9cd6bafbd0902ec6f5569ed60ce5b256df7c937d88224ecaddc" | |
| }, | |
| { | |
| "layer_index": 17, | |
| "path": "layers/layer-017.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "c7a1e47e2c6a3bc8defb02e7a12751145db06f0bb775fdc64737a3a6261ca01f" | |
| }, | |
| { | |
| "layer_index": 18, | |
| "path": "layers/layer-018.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "d59f28cbe4bb3f8b51b498e6b1d4d7cce40cc4d15d2f1016dfb88f119c6fb827" | |
| }, | |
| { | |
| "layer_index": 19, | |
| "path": "layers/layer-019.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "37821c3088119a9080aee8fd974d56eea8e8ceddda8092b7fc99971c6126b304" | |
| }, | |
| { | |
| "layer_index": 20, | |
| "path": "layers/layer-020.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "9a5b6231cec03cff8b863fbc8a979f497739b0edf45451c5ae0060d964d895ac" | |
| }, | |
| { | |
| "layer_index": 21, | |
| "path": "layers/layer-021.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "3f7e220afb8a9dcdb668c323dc1672b010b1ef89620aa1a049a29d761b25768f" | |
| }, | |
| { | |
| "layer_index": 22, | |
| "path": "layers/layer-022.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "700be9285cf3ab4d6d7bb70641130522260518c053bb03a501e24e8463fd28dd" | |
| }, | |
| { | |
| "layer_index": 23, | |
| "path": "layers/layer-023.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "1e83b5e47f1de1a95ea9c7b18df1727404c889c26bc91f98da05a779bd8b9f6e" | |
| }, | |
| { | |
| "layer_index": 24, | |
| "path": "layers/layer-024.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "c0f998389317a3f55559f2ebf661fdd721b338e217b3324d2d2f88085da6811c" | |
| }, | |
| { | |
| "layer_index": 25, | |
| "path": "layers/layer-025.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "0494629f1e164e1332fe9d5f3e9d7cefb4661e695d787842e12861036649041a" | |
| }, | |
| { | |
| "layer_index": 26, | |
| "path": "layers/layer-026.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "76d662774a6f71c918e7fafab3e0352ca455be91cdd68eb38a5fad1c6a639746" | |
| }, | |
| { | |
| "layer_index": 27, | |
| "path": "layers/layer-027.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "4af95149b1254938cbf408a4113f2741696719e40efb2cc2ea00b48d69160125" | |
| }, | |
| { | |
| "layer_index": 28, | |
| "path": "layers/layer-028.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "cebd3d359e0dce60980bada865a0cd41470b0a77487bd3d5e651966e55ca5d60" | |
| }, | |
| { | |
| "layer_index": 29, | |
| "path": "layers/layer-029.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "ee61cfe5c7d63391f44a025833b10a4f692c24ca358ed441a0a7ea851879d085" | |
| }, | |
| { | |
| "layer_index": 30, | |
| "path": "layers/layer-030.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "8ec2140bd6d1483de1f08d81d8c27bce627b2e1e74dedb007f3cb281de7bb706" | |
| }, | |
| { | |
| "layer_index": 31, | |
| "path": "layers/layer-031.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "4a0c46870d83d37682e7bc23842f16ad4ff6fc86347e5cce0f4b0188309f376f" | |
| }, | |
| { | |
| "layer_index": 32, | |
| "path": "layers/layer-032.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "172aa5cc38a194b022c043c256dcfc0674910ec7a6bccc9a8d5a9a3f2f294cc5" | |
| }, | |
| { | |
| "layer_index": 33, | |
| "path": "layers/layer-033.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "d2b107223dd059df1a0e14065102b818a8392fc72b256555e3f404c11b861df2" | |
| }, | |
| { | |
| "layer_index": 34, | |
| "path": "layers/layer-034.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "a29065af21a7ac9c8858a7e2fb4eeb1f36a5562f89b5c34e587d57f9a68d7df9" | |
| }, | |
| { | |
| "layer_index": 35, | |
| "path": "layers/layer-035.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "752e766747b000683892a7411f7be12dfa31638a9d1b359841ec60a4039b007e" | |
| }, | |
| { | |
| "layer_index": 36, | |
| "path": "layers/layer-036.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "ca2623ec747bcfd65ed9631fd16905cec176be3aed6f8ac03598cd1e59d36881" | |
| }, | |
| { | |
| "layer_index": 37, | |
| "path": "layers/layer-037.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "efc48da529e240135d21190c526a2570ab2b4e72cdf1d07f8c569e3951e6fe76" | |
| }, | |
| { | |
| "layer_index": 38, | |
| "path": "layers/layer-038.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "7ab5b650a02065707e933bff7eec84d2ba9e738f8956a29f3c3463014a0c73f7" | |
| }, | |
| { | |
| "layer_index": 39, | |
| "path": "layers/layer-039.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "62860567b3ad6bc963c983f394da5809dbbcd58008d86d98ebbf91be4b41cbb0" | |
| }, | |
| { | |
| "layer_index": 40, | |
| "path": "layers/layer-040.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "aa393f0d82e4251af56d77acc27bddd4e16b4fed3100278947f2391fb1415c49" | |
| }, | |
| { | |
| "layer_index": 41, | |
| "path": "layers/layer-041.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "4fb4c4cc8122bad74e34b381801bbef72e336fed4ccd8482e9478f6da9cc3740" | |
| }, | |
| { | |
| "layer_index": 42, | |
| "path": "layers/layer-042.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "b49907be0779a374fc21eb8c237c2054d3f0e73495b83d6302d09b490f061383" | |
| }, | |
| { | |
| "layer_index": 43, | |
| "path": "layers/layer-043.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "296208fe15afbacab1fb4634d637d746f218e08c82228f77da4b88ca3d05663e" | |
| }, | |
| { | |
| "layer_index": 44, | |
| "path": "layers/layer-044.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "779d9f26cfbe9c6c9dd4195d58303b40e92dd7e48e32a0f8d73dd710d587d542" | |
| }, | |
| { | |
| "layer_index": 45, | |
| "path": "layers/layer-045.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "e4ffe390e877a88a587d895541d228b9787a8a649204751e2f2d27903d628094" | |
| }, | |
| { | |
| "layer_index": 46, | |
| "path": "layers/layer-046.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "d1c38973346fde14c945329dca9669c37b5497f9b7a857b344ec99ebcf1afdda" | |
| }, | |
| { | |
| "layer_index": 47, | |
| "path": "layers/layer-047.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "230cc09bf0b1cab4e40ec32a00c3f495d107d7da22094306a0ab59a672fc8aa8" | |
| }, | |
| { | |
| "layer_index": 48, | |
| "path": "layers/layer-048.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "cfd62d8ed0210053346248a9e342173fd65b5dd0e8eea18ae23ad44314acd040" | |
| }, | |
| { | |
| "layer_index": 49, | |
| "path": "layers/layer-049.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "03d3d4e438ea7324e7b3827422dc81c63b49f29df5399e07e12b2d9e67b74bb9" | |
| }, | |
| { | |
| "layer_index": 50, | |
| "path": "layers/layer-050.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "e8b5890ecd6be2f0aebb8dcf299b2a23026e054a9522beac4eee3bc4249e26a3" | |
| }, | |
| { | |
| "layer_index": 51, | |
| "path": "layers/layer-051.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "ea82dec73ab0c21bbafc6b5c065c600e53e54229411973a809738e6bc1ef3eb2" | |
| }, | |
| { | |
| "layer_index": 52, | |
| "path": "layers/layer-052.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "d59d76813ef8183630c5a34a8e6edebc76713e9207771f8c14c225f3a71a83f9" | |
| }, | |
| { | |
| "layer_index": 53, | |
| "path": "layers/layer-053.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "54134d1483f8f4478c585bc144bb65fddee7f73bd43e9f81099677b348d9a31c" | |
| }, | |
| { | |
| "layer_index": 54, | |
| "path": "layers/layer-054.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "747f0827c5e0472476686406fafc674ebbb4f55dcd7e3398b0d6d42fc0f5b9fc" | |
| }, | |
| { | |
| "layer_index": 55, | |
| "path": "layers/layer-055.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "6d95139a5f14deb5cf48ea403ced4611b505abb97bf5302011f3d2c3bf546ca0" | |
| }, | |
| { | |
| "layer_index": 56, | |
| "path": "layers/layer-056.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "95d145899dcbe20adafedc546a24a0c1991ea54460f2f39ed3508c685f50692a" | |
| }, | |
| { | |
| "layer_index": 57, | |
| "path": "layers/layer-057.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "aa3c9fbb5d74b2c35294a2ddead2bffaafda9f427f5448514ab7d96c8264e990" | |
| }, | |
| { | |
| "layer_index": 58, | |
| "path": "layers/layer-058.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "b2a35f76d5424b98eddebd4065b8c5e88790591484e6501c12d8af55bc2ecff0" | |
| }, | |
| { | |
| "layer_index": 59, | |
| "path": "layers/layer-059.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "fd96b716a3be6101b0c8414eb29e20516c1ae3b8817993d6d603e2c41586800f" | |
| }, | |
| { | |
| "layer_index": 60, | |
| "path": "layers/layer-060.gguf", | |
| "tensor_count": 18, | |
| "tensor_bytes": 9677993472, | |
| "artifact_bytes": 9684907808, | |
| "sha256": "a9138848ed3f0a84e359e397215436449ab698654deb82d979076d3152599e17" | |
| } | |
| ], | |
| "skippy_abi_version": "0.1.26", | |
| "created_at_unix_secs": 1781468413 | |
| } | |