Image-Text-to-Text
GGUF
mesh-llm
layer-package
skippy
distributed-inference
local-inference
openai-compatible
imatrix
conversational
Instructions to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16 # Run inference directly in the terminal: llama cli -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16 # Run inference directly in the terminal: llama cli -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16 # Run inference directly in the terminal: ./llama-cli -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Use Docker
docker model run hf.co/lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
- LM Studio
- Jan
- vLLM
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "lyssquant/Inkling-Small-UD-Q4_K_XL-layers" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lyssquant/Inkling-Small-UD-Q4_K_XL-layers", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
- Ollama
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with Ollama:
ollama run hf.co/lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
- Unsloth Studio
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for lyssquant/Inkling-Small-UD-Q4_K_XL-layers to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for lyssquant/Inkling-Small-UD-Q4_K_XL-layers to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for lyssquant/Inkling-Small-UD-Q4_K_XL-layers to start chatting
- Pi
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with Docker Model Runner:
docker model run hf.co/lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
- Lemonade
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Run and chat with the model
lemonade run user.Inkling-Small-UD-Q4_K_XL-layers-BF16
List all available models
lemonade list
- Hermes Agent
How to use lyssquant/Inkling-Small-UD-Q4_K_XL-layers with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default lyssquant/Inkling-Small-UD-Q4_K_XL-layers:BF16
Run Hermes
hermes
- Atomic Chat
| { | |
| "schema_version": 1, | |
| "model_id": "unsloth/Inkling-Small-GGUF:UD-Q4_K_XL", | |
| "source_model": { | |
| "path": "/source/UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "sha256": "a51ac3f439198f2817219edd582be4b600c273be24e78cbd58ebff982d9f007e", | |
| "repo": "unsloth/Inkling-Small-GGUF", | |
| "revision": "1a19ef82883cb7b9c581b93c30ea252dabbf658d", | |
| "primary_file": "UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "canonical_ref": "unsloth/Inkling-Small-GGUF@1a19ef82883cb7b9c581b93c30ea252dabbf658d/UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "distribution_id": "Inkling-Small-UD-Q4_K_XL", | |
| "files": [ | |
| { | |
| "path": "UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00002-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00003-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00004-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Inkling-Small-UD-Q4_K_XL-00005-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| } | |
| ] | |
| }, | |
| "format": "layer-package", | |
| "layer_count": 42, | |
| "activation_width": 4096, | |
| "shared": { | |
| "metadata": { | |
| "path": "shared/metadata.gguf", | |
| "tensor_count": 1, | |
| "tensor_bytes": 16384, | |
| "artifact_bytes": 13003264, | |
| "sha256": "a30882bd63c7d3509acbe80f89fa3af26d2ea768a48d16aa29b39d0c31c57a65" | |
| }, | |
| "embeddings": { | |
| "path": "shared/embeddings.gguf", | |
| "tensor_count": 2, | |
| "tensor_bytes": 874872832, | |
| "artifact_bytes": 887859776, | |
| "sha256": "5e25470fcee8342e220fcf4a9d580afe7b1bbcce3a6bf1173b528a7c20074a72" | |
| }, | |
| "output": { | |
| "path": "shared/output.gguf", | |
| "tensor_count": 3, | |
| "tensor_bytes": 874889216, | |
| "artifact_bytes": 887876224, | |
| "sha256": "66187e4186cab8645b1353feecdaaed350372202998a95ef5bbf860d38bd9a9d" | |
| } | |
| }, | |
| "projectors": [ | |
| { | |
| "kind": "mmproj", | |
| "path": "projectors/mmproj-BF16.gguf", | |
| "tensor_count": 10, | |
| "tensor_bytes": 138681600, | |
| "artifact_bytes": 138684128, | |
| "sha256": "05d4475a956030be87b099865d6552a541a476db8cc3e266fcfa7c5a24846248" | |
| }, | |
| { | |
| "kind": "mmproj", | |
| "path": "projectors/mmproj-F16.gguf", | |
| "tensor_count": 10, | |
| "tensor_bytes": 138681600, | |
| "artifact_bytes": 138684128, | |
| "sha256": "bf1e6afc9889151b3fee61119d3ee2cd224b59a1d881cdf87e33962f64aecc7e" | |
| }, | |
| { | |
| "kind": "mmproj", | |
| "path": "projectors/mmproj-F32.gguf", | |
| "tensor_count": 10, | |
| "tensor_bytes": 277309440, | |
| "artifact_bytes": 277311968, | |
| "sha256": "653c88aab6699d65ecd45d82303a74a467309dcb8e837e0c9e18f394f4ee3def" | |
| } | |
| ], | |
| "layers": [ | |
| { | |
| "layer_index": 0, | |
| "path": "layers/layer-000.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 260948996, | |
| "artifact_bytes": 273936992, | |
| "sha256": "10b8a1662fee6e098acdd48c460af81a99d9e0b1a13dbc8ca68ae67c962900bc" | |
| }, | |
| { | |
| "layer_index": 1, | |
| "path": "layers/layer-001.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 260948996, | |
| "artifact_bytes": 273936992, | |
| "sha256": "95dd8c1b7a97c861f44447afeb5ddb5c04d4dcd092c9f4f00eea13371728dbee" | |
| }, | |
| { | |
| "layer_index": 2, | |
| "path": "layers/layer-002.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047456, | |
| "sha256": "1e0278515ee112355b9ae33127e5686a3e0135ae5f75180c19c2748aada61eb7" | |
| }, | |
| { | |
| "layer_index": 3, | |
| "path": "layers/layer-003.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047456, | |
| "sha256": "cb6a7c32d81e02e7e486061382e7601a8f6deb6a9bd19d878473b38682d9a073" | |
| }, | |
| { | |
| "layer_index": 4, | |
| "path": "layers/layer-004.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047456, | |
| "sha256": "03dfbdbce2f99a5d039144454bdd5220265b4fb2df8168ca04fa4046f3e92055" | |
| }, | |
| { | |
| "layer_index": 5, | |
| "path": "layers/layer-005.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997091844, | |
| "artifact_bytes": 4010080224, | |
| "sha256": "9d521378088732c69e76f12782d98f5bf404ca6c964b1933050111681def945f" | |
| }, | |
| { | |
| "layer_index": 6, | |
| "path": "layers/layer-006.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047456, | |
| "sha256": "af29757390e076b698f2a2aa94f32729b7b72e3ca0ff3c27567d1023bf8a7b82" | |
| }, | |
| { | |
| "layer_index": 7, | |
| "path": "layers/layer-007.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047456, | |
| "sha256": "918586261f9a47e304411beb9576c393e2bee3ceaf2bd267d742668235af68b2" | |
| }, | |
| { | |
| "layer_index": 8, | |
| "path": "layers/layer-008.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047456, | |
| "sha256": "49eb71a43f1a01749397010ee46eb15e29701f9d2b602b7abf2feeedbd15c6ea" | |
| }, | |
| { | |
| "layer_index": 9, | |
| "path": "layers/layer-009.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047456, | |
| "sha256": "e1fdc36263602cf43c16418c4e1080840c666817890562b05134402242cfa3e0" | |
| }, | |
| { | |
| "layer_index": 10, | |
| "path": "layers/layer-010.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "ac01d78c9bbe3bd381bfd1c3275e7f47012669de3582df0f1e57f3cf1365b8cc" | |
| }, | |
| { | |
| "layer_index": 11, | |
| "path": "layers/layer-011.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997091844, | |
| "artifact_bytes": 4010080256, | |
| "sha256": "956d164976a4fbc73fa122e59b04ba6552ac7196075f0428947266dcd86cf8aa" | |
| }, | |
| { | |
| "layer_index": 12, | |
| "path": "layers/layer-012.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "1dab1b6aaa0dee4945381e2bda888ca807d95e44cfd6c94daea3e367f3930f2f" | |
| }, | |
| { | |
| "layer_index": 13, | |
| "path": "layers/layer-013.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "7954f469e69d51cbf54d04aecfb61d81abb1aa6ded29fff9451cc37b41b0aae4" | |
| }, | |
| { | |
| "layer_index": 14, | |
| "path": "layers/layer-014.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "0d782479b5f7e2569f104a10eea4d4f2a02837dea7b6370d7489d5c280b24bad" | |
| }, | |
| { | |
| "layer_index": 15, | |
| "path": "layers/layer-015.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "c5bcba4945782b8d60b2b1284149daa80fcbe2dc9dd7ba1f53873a3c60268034" | |
| }, | |
| { | |
| "layer_index": 16, | |
| "path": "layers/layer-016.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "373f9900606024af02d26b24d58551eb5bfff6597391a212f8428cca5bc95b20" | |
| }, | |
| { | |
| "layer_index": 17, | |
| "path": "layers/layer-017.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997091844, | |
| "artifact_bytes": 4010080256, | |
| "sha256": "cff3feec2fd4782203f92f287ddb6de0990b4d33e651b5d2bd99d4a7bbcf40ea" | |
| }, | |
| { | |
| "layer_index": 18, | |
| "path": "layers/layer-018.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "d670c5ec610d43cb136f2d468abcef1c8ae01a4475ccb3ac9a7f1469664210a7" | |
| }, | |
| { | |
| "layer_index": 19, | |
| "path": "layers/layer-019.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "94f20b6b2328c366386d9224c3ac51fd69d5621aadbc06aeab5bbd36d0985e6f" | |
| }, | |
| { | |
| "layer_index": 20, | |
| "path": "layers/layer-020.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "0c70a4dbbc20ecd760fd2e4d1374d00cc33e818604180cd1bee969a7a150ae6e" | |
| }, | |
| { | |
| "layer_index": 21, | |
| "path": "layers/layer-021.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "0abc882fb5c3594a56748106e789b52e8dbd27b8887fda15520766657165db88" | |
| }, | |
| { | |
| "layer_index": 22, | |
| "path": "layers/layer-022.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "b184532a4ca036a2116a3233f275dfe33590b1c8c2a3f343b92003ad0ab8fc23" | |
| }, | |
| { | |
| "layer_index": 23, | |
| "path": "layers/layer-023.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997091844, | |
| "artifact_bytes": 4010080256, | |
| "sha256": "6fdcf3a2bb2daf9dbbc5da090c63675eb3e04b7ee09253618de58cd3a580c414" | |
| }, | |
| { | |
| "layer_index": 24, | |
| "path": "layers/layer-024.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "a00dcf1439dae24f1c60b6c148ffc210c493c475ba2b9163c3a0e1e320972b07" | |
| }, | |
| { | |
| "layer_index": 25, | |
| "path": "layers/layer-025.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "cab2eb051c6c363d216b3558e0cca89b4ba65f0aa80e71bbcdb03d0d5e056ee1" | |
| }, | |
| { | |
| "layer_index": 26, | |
| "path": "layers/layer-026.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "281b80a093b68f561b07e7ab94e1d71b1f50989f70386d5e62eebb209c09f954" | |
| }, | |
| { | |
| "layer_index": 27, | |
| "path": "layers/layer-027.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "6907dd14a3bd92b8e5652e822d735154f3b440770d0e6a4bf42653c7c0b7727a" | |
| }, | |
| { | |
| "layer_index": 28, | |
| "path": "layers/layer-028.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "65ffedc9064b1ed07c6a12eea73b32ecf26b1d34a2a65b8fd103f7fc9f4b0b43" | |
| }, | |
| { | |
| "layer_index": 29, | |
| "path": "layers/layer-029.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997091844, | |
| "artifact_bytes": 4010080256, | |
| "sha256": "f46543cae54ae9048d63eda3e0f6b36318bbadd378635415cd89ae5c4c2c970d" | |
| }, | |
| { | |
| "layer_index": 30, | |
| "path": "layers/layer-030.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "b5cba6d8b48d9ce26173635c182a52acb2b1538aec203701177ef76b7eb92e5a" | |
| }, | |
| { | |
| "layer_index": 31, | |
| "path": "layers/layer-031.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "b63f8c54bbdea6ef3c235700070ee3823b2f448e5254b731faacbe47be4573d8" | |
| }, | |
| { | |
| "layer_index": 32, | |
| "path": "layers/layer-032.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "e32d18d90e5ca4b80c42ba8cf373da7053374deee83663efd18b930bd626a293" | |
| }, | |
| { | |
| "layer_index": 33, | |
| "path": "layers/layer-033.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "4e0e35e0c3464c9df0f80d3354dd18ce0d59c844329d2bf072814312ddc4efba" | |
| }, | |
| { | |
| "layer_index": 34, | |
| "path": "layers/layer-034.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "df5f0d219c7f8e59a9efe16be7469eb19fe1eec6c80e425afaa864842357567e" | |
| }, | |
| { | |
| "layer_index": 35, | |
| "path": "layers/layer-035.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997091844, | |
| "artifact_bytes": 4010080256, | |
| "sha256": "a5aa9f99f5e7c7b47e0891074937d2babe5e9f751ce6d05308d2a1931fed1c75" | |
| }, | |
| { | |
| "layer_index": 36, | |
| "path": "layers/layer-036.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "ec8f73acf148ef1492d922e5f2f7c9fd5f7293ddbd46047ccb745bf39915f79e" | |
| }, | |
| { | |
| "layer_index": 37, | |
| "path": "layers/layer-037.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "2ed585a50615cf0e2668bb7cd736cfd2a12e5abafd6c0d029ece08d56a96e264" | |
| }, | |
| { | |
| "layer_index": 38, | |
| "path": "layers/layer-038.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "80f8160c275313acc0560a7f4753f870933d95198f627d8af4734b1499fba1d9" | |
| }, | |
| { | |
| "layer_index": 39, | |
| "path": "layers/layer-039.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 3997059076, | |
| "artifact_bytes": 4010047488, | |
| "sha256": "b65e2ad1b2027faba40708bd6457e102d8deeb0b6c16d11cbe6054fc5f79cfe3" | |
| }, | |
| { | |
| "layer_index": 40, | |
| "path": "layers/layer-040.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4282271748, | |
| "artifact_bytes": 4295260160, | |
| "sha256": "6dcf4d6a4d2180b6da1713ee8b2da20cefc013b35efad47ebd0a833dd7c45770" | |
| }, | |
| { | |
| "layer_index": 41, | |
| "path": "layers/layer-041.gguf", | |
| "tensor_count": 24, | |
| "tensor_bytes": 4819175428, | |
| "artifact_bytes": 4832163840, | |
| "sha256": "4baaf7962e42325b32e63d1efdb23576c94f08fa1712001ce12e87acd044e1e7" | |
| } | |
| ], | |
| "skippy_abi_version": "0.1.35", | |
| "created_at_unix_secs": 1785785881 | |
| } | |