Text Generation
GGUF
mesh-llm
layer-package
skippy
distributed-inference
local-inference
openai-compatible
imatrix
conversational
Instructions to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers", filename="layers/layer-000.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers # Run inference directly in the terminal: llama-cli -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers # Run inference directly in the terminal: llama-cli -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers # Run inference directly in the terminal: ./llama-cli -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers # Run inference directly in the terminal: ./build/bin/llama-cli -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Use Docker
docker model run hf.co/meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
- LM Studio
- Jan
- vLLM
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
- Ollama
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with Ollama:
ollama run hf.co/meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
- Unsloth Studio
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers to start chatting
- Pi
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Run Hermes
hermes
- Docker Model Runner
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with Docker Model Runner:
docker model run hf.co/meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
- Lemonade
How to use meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers
Run and chat with the model
lemonade run user.Trinity-Large-Preview-UD-Q4_K_XL-layers-{{QUANT_TAG}}List all available models
lemonade list
Add layer package manifest from unsloth/Trinity-Large-Preview-GGUF (unsloth/Trinity-Large-Preview-GGUF:UD-Q4_K_XL)
3caa668 verified | { | |
| "schema_version": 1, | |
| "model_id": "unsloth/Trinity-Large-Preview-GGUF:UD-Q4_K_XL", | |
| "source_model": { | |
| "path": "/source/UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "sha256": "13632564d2e8a57be6a4bcde297cbecb97f5e9a40ffc06b8057877f3301b694d", | |
| "repo": "unsloth/Trinity-Large-Preview-GGUF", | |
| "revision": "main", | |
| "primary_file": "UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "canonical_ref": "unsloth/Trinity-Large-Preview-GGUF@main/UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "distribution_id": "Trinity-Large-Preview-UD-Q4_K_XL", | |
| "files": [ | |
| { | |
| "path": "UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00001-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00002-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00003-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00004-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| }, | |
| { | |
| "path": "UD-Q4_K_XL/Trinity-Large-Preview-UD-Q4_K_XL-00005-of-00005.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| } | |
| ] | |
| }, | |
| "format": "layer-package", | |
| "layer_count": 60, | |
| "activation_width": 3072, | |
| "shared": { | |
| "metadata": { | |
| "path": "shared/metadata.gguf", | |
| "tensor_count": 0, | |
| "tensor_bytes": 0, | |
| "artifact_bytes": 7329088, | |
| "sha256": "9ee98b39241a826751b809f398a339e1ce248c882be1aa69dd25987349a018da" | |
| }, | |
| "embeddings": { | |
| "path": "shared/embeddings.gguf", | |
| "tensor_count": 1, | |
| "tensor_bytes": 345931776, | |
| "artifact_bytes": 353260928, | |
| "sha256": "0a090b2ce10bf3f42027d6cfe98fa725d2c275e518cc1de0464fe12c10709b68" | |
| }, | |
| "output": { | |
| "path": "shared/output.gguf", | |
| "tensor_count": 2, | |
| "tensor_bytes": 504496128, | |
| "artifact_bytes": 511825344, | |
| "sha256": "d9789c03eab663ee059faf1dfd1a6f2b36476f8407be5e7beece8572d8d5efe3" | |
| } | |
| }, | |
| "layers": [ | |
| { | |
| "layer_index": 0, | |
| "path": "layers/layer-000.gguf", | |
| "tensor_count": 14, | |
| "tensor_bytes": 109683712, | |
| "artifact_bytes": 117013632, | |
| "sha256": "4c8d78d76cd7ac850b822c9fb3f193b294413d7b13df5573f2bc322e2d03a3d4" | |
| }, | |
| { | |
| "layer_index": 1, | |
| "path": "layers/layer-001.gguf", | |
| "tensor_count": 14, | |
| "tensor_bytes": 117154816, | |
| "artifact_bytes": 124484736, | |
| "sha256": "ed1bec04e8f69f6e90a91781969801539150fe679ca277414507af2226071b31" | |
| }, | |
| { | |
| "layer_index": 2, | |
| "path": "layers/layer-002.gguf", | |
| "tensor_count": 14, | |
| "tensor_bytes": 109683712, | |
| "artifact_bytes": 117013632, | |
| "sha256": "187e07a7acc8a7fa5da864cb615bfd6adbf393bf6769cc9662d3c03dbab01208" | |
| }, | |
| { | |
| "layer_index": 3, | |
| "path": "layers/layer-003.gguf", | |
| "tensor_count": 14, | |
| "tensor_bytes": 108872704, | |
| "artifact_bytes": 116202624, | |
| "sha256": "1ef75b990eb9b450dee45601f8de245634407c52e9442de1d8344d71593a7384" | |
| }, | |
| { | |
| "layer_index": 4, | |
| "path": "layers/layer-004.gguf", | |
| "tensor_count": 14, | |
| "tensor_bytes": 109683712, | |
| "artifact_bytes": 117013632, | |
| "sha256": "a7143df9cc7175654838f524751bac941b846c92688a8ceb11b6dfb429e266e2" | |
| }, | |
| { | |
| "layer_index": 5, | |
| "path": "layers/layer-005.gguf", | |
| "tensor_count": 14, | |
| "tensor_bytes": 108872704, | |
| "artifact_bytes": 116202624, | |
| "sha256": "90b222289c2a5e53150e4399be6bdd308f769f6a48e73be283d32853c22117ba" | |
| }, | |
| { | |
| "layer_index": 6, | |
| "path": "layers/layer-006.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4756662272, | |
| "artifact_bytes": 4763992544, | |
| "sha256": "57787f30536714a0fc34974364e22899c78fbadf81eb4912f8ec69b0b453b0de" | |
| }, | |
| { | |
| "layer_index": 7, | |
| "path": "layers/layer-007.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4134619136, | |
| "artifact_bytes": 4141949408, | |
| "sha256": "32697075924050585ba8912a44eebb66281bb73cba83b1c24e60fca0f5976b28" | |
| }, | |
| { | |
| "layer_index": 8, | |
| "path": "layers/layer-008.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4435798016, | |
| "artifact_bytes": 4443128288, | |
| "sha256": "a275f417a3bd1b65412a51b7f3816bbaf7a670ce8d9e491e6d1c20bc82009a7e" | |
| }, | |
| { | |
| "layer_index": 9, | |
| "path": "layers/layer-009.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4756662272, | |
| "artifact_bytes": 4763992544, | |
| "sha256": "e088df65d605e008f27c3cad22a980516d2184bb6e30f481fedcd9efa1157f5f" | |
| }, | |
| { | |
| "layer_index": 10, | |
| "path": "layers/layer-010.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "11eda7bc85dbd924b1c24fecba78c82fdee3bd7e11c1a4f4c00d82441e5696be" | |
| }, | |
| { | |
| "layer_index": 11, | |
| "path": "layers/layer-011.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4445947904, | |
| "artifact_bytes": 4453278208, | |
| "sha256": "c97edeefe23e21bbb1810933df4a6f397e51f26aa285abcde5c925bda152f723" | |
| }, | |
| { | |
| "layer_index": 12, | |
| "path": "layers/layer-012.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4756662272, | |
| "artifact_bytes": 4763992576, | |
| "sha256": "0678d675e842f69644091c0a1ae613070ccbddeac8a1236a63c7c74ce34a9724" | |
| }, | |
| { | |
| "layer_index": 13, | |
| "path": "layers/layer-013.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "0cd4c1f889fc4dfd60b6c1569c0275d1fe9c55f3a3551dea5faf6ff07639f119" | |
| }, | |
| { | |
| "layer_index": 14, | |
| "path": "layers/layer-014.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4445947904, | |
| "artifact_bytes": 4453278208, | |
| "sha256": "3a30811234ae85a234eba98d1ab13ade1f82387600ab4f026965d90de6fdae16" | |
| }, | |
| { | |
| "layer_index": 15, | |
| "path": "layers/layer-015.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4756662272, | |
| "artifact_bytes": 4763992576, | |
| "sha256": "874f1cdbb4a859af3a9ba2743c6cb9f41fa26f0a58a9e76d572edd2a6190a956" | |
| }, | |
| { | |
| "layer_index": 16, | |
| "path": "layers/layer-016.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4446365696, | |
| "artifact_bytes": 4453696000, | |
| "sha256": "2ec79ddddf52c9c147b146db98be303428b1ae930aa0dc9641319f3025ee1ea1" | |
| }, | |
| { | |
| "layer_index": 17, | |
| "path": "layers/layer-017.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4133808128, | |
| "artifact_bytes": 4141138432, | |
| "sha256": "8d3458eefd629e89cc6855d6e20bfabd2b845a1bb9251d808e51c34ce973ee1c" | |
| }, | |
| { | |
| "layer_index": 18, | |
| "path": "layers/layer-018.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4764526592, | |
| "artifact_bytes": 4771856896, | |
| "sha256": "80303379b5665205168606c902c35a1d1c8cfeed77116d870fdefece3f70021f" | |
| }, | |
| { | |
| "layer_index": 19, | |
| "path": "layers/layer-019.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4446365696, | |
| "artifact_bytes": 4453696000, | |
| "sha256": "ca2302478ad633fe7214b4dc907fdbe8209187b2436aae56dfec746a7b2233bf" | |
| }, | |
| { | |
| "layer_index": 20, | |
| "path": "layers/layer-020.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4438083584, | |
| "artifact_bytes": 4445413888, | |
| "sha256": "560a53c37a5aecf09a2b1aa45427586a3b2c27293230f74e2cff7b286a71f18b" | |
| }, | |
| { | |
| "layer_index": 21, | |
| "path": "layers/layer-021.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4756662272, | |
| "artifact_bytes": 4763992576, | |
| "sha256": "b8da3ca6e2cbe8d69b6851d85ca2190a3f7941472ac23972b487d28adb822c4d" | |
| }, | |
| { | |
| "layer_index": 22, | |
| "path": "layers/layer-022.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4438894592, | |
| "artifact_bytes": 4446224896, | |
| "sha256": "27cf41e96c8e7cd4de3c99e8ccbc02582710c916dc4d2f9319d9ece1f70a35e2" | |
| }, | |
| { | |
| "layer_index": 23, | |
| "path": "layers/layer-023.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4435798016, | |
| "artifact_bytes": 4443128320, | |
| "sha256": "6536f25a9af0cd79e4dc2e0de53746119ce862fae4fa9d03d6b74336101e3a10" | |
| }, | |
| { | |
| "layer_index": 24, | |
| "path": "layers/layer-024.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4756662272, | |
| "artifact_bytes": 4763992576, | |
| "sha256": "afcbd90a047cb7c26f0124abb87279829d4a46ade36e3c86ac117b32ff2362c5" | |
| }, | |
| { | |
| "layer_index": 25, | |
| "path": "layers/layer-025.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4134619136, | |
| "artifact_bytes": 4141949440, | |
| "sha256": "678e0c6ef3f8314266bb13fc2d9836b876a6afb288f9101c7795939ec15b9c7c" | |
| }, | |
| { | |
| "layer_index": 26, | |
| "path": "layers/layer-026.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "e529ebf832ddae429741269c1c39a7589c9a05ef9d8a9966a0373ae921b0506a" | |
| }, | |
| { | |
| "layer_index": 27, | |
| "path": "layers/layer-027.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "24392d7baad3247aff64629eb7c9e27a3832f864a13e0dc04d36c07b0eb538c7" | |
| }, | |
| { | |
| "layer_index": 28, | |
| "path": "layers/layer-028.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "5d1520788c29b80ed78a6d1273d522759290a18c55ccfeb7f4fbcaed3c55791b" | |
| }, | |
| { | |
| "layer_index": 29, | |
| "path": "layers/layer-029.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "29a95d5511421af2bb486f29ec2cd785502ef7bd127273e165bcef57a5eae13e" | |
| }, | |
| { | |
| "layer_index": 30, | |
| "path": "layers/layer-030.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "cae7190fdbfe6a5b86062d334c607a7ac7d5b8ba07f267c795b9db73b6a307d1" | |
| }, | |
| { | |
| "layer_index": 31, | |
| "path": "layers/layer-031.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "ffa2170b5524d6a86561b8d43a7c7dc5fac6afde340f91bee3b1b0d9ed085b34" | |
| }, | |
| { | |
| "layer_index": 32, | |
| "path": "layers/layer-032.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "fe869c67ee1ab1edaec9c51c33739e316a77dcd35403a99599d050d5a12b0800" | |
| }, | |
| { | |
| "layer_index": 33, | |
| "path": "layers/layer-033.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "27fee762fed48d01bdcba79470a4757e653680efda4ce99dc70201c94510cfaf" | |
| }, | |
| { | |
| "layer_index": 34, | |
| "path": "layers/layer-034.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "5350728c0285e371f9b3f74dd21e393c8517a83bba93c6c7f2ef11bb5f1bae73" | |
| }, | |
| { | |
| "layer_index": 35, | |
| "path": "layers/layer-035.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "86f0e8a63dfca0ca6f831aa3f75234232a37851ed2f24a15500a1e5b9127ee0a" | |
| }, | |
| { | |
| "layer_index": 36, | |
| "path": "layers/layer-036.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "83e49bdaad90d28cd193c7f3bc1d71919ccb6ec03c47ffad744aef925a0bbf63" | |
| }, | |
| { | |
| "layer_index": 37, | |
| "path": "layers/layer-037.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "09b871a168fa67c21d425b61c1cddb4e767b1f85b3e103c11625c6e10313668f" | |
| }, | |
| { | |
| "layer_index": 38, | |
| "path": "layers/layer-038.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "980177e7db6f65489f4ac0ae5fb933192901bc5fd34af04b197640c1de1219b2" | |
| }, | |
| { | |
| "layer_index": 39, | |
| "path": "layers/layer-039.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "b50267481fae05972482e94937fe628799c4886c63c331e34b761f3aa1f0bbba" | |
| }, | |
| { | |
| "layer_index": 40, | |
| "path": "layers/layer-040.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4134619136, | |
| "artifact_bytes": 4141949440, | |
| "sha256": "11376407305fc0d979b98672eb96a53c7e19bfce22d38947539098b057a44c06" | |
| }, | |
| { | |
| "layer_index": 41, | |
| "path": "layers/layer-041.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4134619136, | |
| "artifact_bytes": 4141949440, | |
| "sha256": "b1a977a55ac458f59d288c61250d8f6000986424d6b20ecdc8fb819edf9f22bd" | |
| }, | |
| { | |
| "layer_index": 42, | |
| "path": "layers/layer-042.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "3db5fed1c57370dcd6ad2a5a51148320f0790c44eea0e27e058a98eda639a1ae" | |
| }, | |
| { | |
| "layer_index": 43, | |
| "path": "layers/layer-043.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "3c0a4c9e161343a6053ad834dbcef647279857d2428d989fe1eaed637ce0ddad" | |
| }, | |
| { | |
| "layer_index": 44, | |
| "path": "layers/layer-044.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "4f2994a500992250d3a32bdc77dcd2ec5393d101dc791fd490eb4299edaf56ad" | |
| }, | |
| { | |
| "layer_index": 45, | |
| "path": "layers/layer-045.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "20d3cd893027bcddabd949f031ebbb919d9d4c4d31b38829850af0b07796c5cb" | |
| }, | |
| { | |
| "layer_index": 46, | |
| "path": "layers/layer-046.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "f9ed039e0ff07058deed55d9f0284da3f2f9927f93095f8af6133fc46a2518eb" | |
| }, | |
| { | |
| "layer_index": 47, | |
| "path": "layers/layer-047.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "3c2bbbe15c8d37d16ad39594570c9d549d472efdcfc8b5e0b20103e787f5a30f" | |
| }, | |
| { | |
| "layer_index": 48, | |
| "path": "layers/layer-048.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "8dad6ef8b8379ebc676852621b64a5cd7390985e7e9872608d76c77b705c277d" | |
| }, | |
| { | |
| "layer_index": 49, | |
| "path": "layers/layer-049.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "9da1a8abd65e15ceefbdde48ba4b7f06cf8eb60340876098f263bd0d8bf34a90" | |
| }, | |
| { | |
| "layer_index": 50, | |
| "path": "layers/layer-050.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4436609024, | |
| "artifact_bytes": 4443939328, | |
| "sha256": "1744b9a8b86940bf6915d9d5ea954f84736e52fd83106ffd97a30fafe95e465f" | |
| }, | |
| { | |
| "layer_index": 51, | |
| "path": "layers/layer-051.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "f603fa611f67459a99a7eff28d13ec9566bfa83dc63dfadd0030c337f5c01371" | |
| }, | |
| { | |
| "layer_index": 52, | |
| "path": "layers/layer-052.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "86041e70ac25adb2db57e0bbb88d16b2bc6326c561a926c8827800b33ecebd1a" | |
| }, | |
| { | |
| "layer_index": 53, | |
| "path": "layers/layer-053.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "c8355f507e96b0a1658d5ae79090de943937b8c163e6ec78b5f82b56d7539a7d" | |
| }, | |
| { | |
| "layer_index": 54, | |
| "path": "layers/layer-054.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "c75a3652e59db651dd60844eb10aa307ed643456fde5e014ff18e8fb65dd1a9d" | |
| }, | |
| { | |
| "layer_index": 55, | |
| "path": "layers/layer-055.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "1d1aef1aeeeae9280aa8d82f7e7688406181a2202e26e972f45dd0006563c367" | |
| }, | |
| { | |
| "layer_index": 56, | |
| "path": "layers/layer-056.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "303c8569ff578f6cb7a998004d0e68140867f03e602f5963c4b00e897c009ae1" | |
| }, | |
| { | |
| "layer_index": 57, | |
| "path": "layers/layer-057.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "d9d8b1e4e0ce7b9c4d86d43f5a52c438b5f2313c23db41e4a08c37b93534fc27" | |
| }, | |
| { | |
| "layer_index": 58, | |
| "path": "layers/layer-058.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4757473280, | |
| "artifact_bytes": 4764803584, | |
| "sha256": "e29df4c276ce46a674ea36a2c2624989fa680ee4c7e92917bc354ad3ee3348da" | |
| }, | |
| { | |
| "layer_index": 59, | |
| "path": "layers/layer-059.gguf", | |
| "tensor_count": 19, | |
| "tensor_bytes": 4759906304, | |
| "artifact_bytes": 4767236608, | |
| "sha256": "ea7c6f0b38138bb7ff1d4c3eb4228741392a2e9cd35d22f02dd224d380ad930e" | |
| } | |
| ], | |
| "skippy_abi_version": "0.1.22", | |
| "created_at_unix_secs": 1778545961 | |
| } | |