Instructions to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Use Docker

docker model run hf.co/magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

LM Studio
Jan

vLLM

How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "magiccodingman/Qwen3.8-27B-MagicQuant-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "magiccodingman/Qwen3.8-27B-MagicQuant-GGUF",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Ollama
How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with Ollama:
```
ollama run hf.co/magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M
```

Unsloth Studio

How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for magiccodingman/Qwen3.8-27B-MagicQuant-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for magiccodingman/Qwen3.8-27B-MagicQuant-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for magiccodingman/Qwen3.8-27B-MagicQuant-GGUF to start chatting

How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with Docker Model Runner:
```
docker model run hf.co/magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M
```

Lemonade

How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.Qwen3.8-27B-MagicQuant-GGUF-Q4_K_M

List all available models

lemonade list

Hermes Agent

How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use magiccodingman/Qwen3.8-27B-MagicQuant-GGUF with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "magiccodingman/Qwen3.8-27B-MagicQuant-GGUF:Q4_K_M" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Qwen3.8-27B-MagicQuant-GGUF / magicquant-manifest /magicquant.hybrid-map.json

magiccodingman

Upload folder using huggingface_hub

e59b904 verified 1 day ago

Raw

History Blame Contribute Delete

27.9 kB

	[
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-Q6_K_1.gguf",
	"DisplayName": "MQ-Q6_K_1",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "Q6_K",
	"OriginalReferenceBaseline": "Unsloth-UD-Q6_K_XL",
	"TensorGroups": {
	"embeddings": "Unsloth-UD-Q6_K_XL",
	"lm_head": "Unsloth-UD-Q6_K_XL",
	"attn_q": "Unsloth-UD-Q6_K_XL",
	"attn_kv": "Unsloth-UD-Q5_K_XL",
	"attn_output": "Unsloth-UD-Q6_K_XL",
	"ffn_up_gate": "Unsloth-UD-Q6_K_XL",
	"ffn_down": "Unsloth-UD-Q6_K_XL"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-ud-q6_k_xl.gguf:232aedc0f6972d7a662cd49fdd947553355d0293421f529fc72332ba1203f94a\|attn_kv=effective-map:c66920e650fba1bce6a7f2ecaa1394966a6e0395e9b18e18c533aa919ae863db\|attn_output=effective:Q8_0\|attn_q=effective:Q8_0\|embeddings=effective:Q6_K\|ffn_down=effective:Q8_0\|ffn_up_gate=effective:Q6_K\|lm_head=effective:Q8_0\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": false,
	"Warnings": [],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 25941640896,
	"ExpectedSizeGB": 25.941640896,
	"ExpectedSizeGiB": 24.16003578901291,
	"ActualSizeBytes": 25941640896,
	"ActualSizeGB": 25.941640896,
	"ActualSizeGiB": 24.16003578901291,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	},
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-Q6_K_2.gguf",
	"DisplayName": "MQ-Q6_K_2",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "Q6_K",
	"OriginalReferenceBaseline": "Unsloth-Q6_K",
	"TensorGroups": {
	"embeddings": "Unsloth-Q6_K",
	"lm_head": "Q8_0",
	"attn_q": "Unsloth-Q6_K",
	"attn_kv": "Unsloth-UD-Q5_K_XL",
	"attn_output": "Unsloth-Q6_K",
	"ffn_up_gate": "Unsloth-Q6_K",
	"ffn_down": "Unsloth-Q6_K"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-q6_k.gguf:34ed9335317b85d0819be2de3d7607d698f231df067f93f6002b6000004d7f00\|attn_kv=effective-map:c66920e650fba1bce6a7f2ecaa1394966a6e0395e9b18e18c533aa919ae863db\|attn_output=effective:Q6_K\|attn_q=effective:Q6_K\|embeddings=effective:Q6_K\|ffn_down=effective:Q6_K\|ffn_up_gate=effective:Q6_K\|lm_head=effective:Q8_0\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": false,
	"Warnings": [],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 23213909696,
	"ExpectedSizeGB": 23.213909695999998,
	"ExpectedSizeGiB": 21.61963814496994,
	"ActualSizeBytes": 23213909696,
	"ActualSizeGB": 23.213909695999998,
	"ActualSizeGiB": 21.61963814496994,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	},
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-Q5_K_1.gguf",
	"DisplayName": "MQ-Q5_K_1",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "Q5_K",
	"OriginalReferenceBaseline": "Unsloth-UD-Q5_K_XL",
	"TensorGroups": {
	"embeddings": "Unsloth-UD-Q5_K_XL",
	"lm_head": "Unsloth-UD-Q5_K_XL",
	"attn_q": "Unsloth-UD-Q5_K_XL",
	"attn_kv": "Unsloth-UD-Q5_K_XL",
	"attn_output": "Q8_0",
	"ffn_up_gate": "Unsloth-UD-Q5_K_XL",
	"ffn_down": "Unsloth-UD-Q5_K_XL"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-ud-q5_k_xl.gguf:04dc0eff7b638f905e63fc1ca7a3255b412df5e996b049c0203744910b771c18\|attn_kv=effective-map:c66920e650fba1bce6a7f2ecaa1394966a6e0395e9b18e18c533aa919ae863db\|attn_output=effective:Q8_0\|attn_q=effective-map:0053a621e96598bce4460d1012e339f388643c8d6903c7a4218db8edb6785dc3\|embeddings=effective:Q5_K\|ffn_down=effective:Q6_K\|ffn_up_gate=effective:Q5_K\|lm_head=effective:Q6_K\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": false,
	"Warnings": [],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 20386768576,
	"ExpectedSizeGB": 20.386768576,
	"ExpectedSizeGiB": 18.986657798290253,
	"ActualSizeBytes": 20386768576,
	"ActualSizeGB": 20.386768576,
	"ActualSizeGiB": 18.986657798290253,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	},
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-Q4_K_M_1.gguf",
	"DisplayName": "MQ-Q4_K_M_1",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "Q4_K_M",
	"OriginalReferenceBaseline": "Unsloth-UD-Q4_K_XL",
	"TensorGroups": {
	"embeddings": "Unsloth-UD-Q4_K_XL",
	"lm_head": "Unsloth-UD-Q4_K_XL",
	"attn_q": "Unsloth-UD-Q5_K_XL",
	"attn_kv": "Unsloth-UD-Q4_K_XL",
	"attn_output": "Unsloth-UD-Q4_K_XL",
	"ffn_up_gate": "Unsloth-UD-Q4_K_XL",
	"ffn_down": "Unsloth-UD-Q4_K_XL"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-ud-q4_k_xl.gguf:4cc12114fbc7bf0a8fa1ad97dcdae91b5923c438b9054dd26324b72a10084a47\|attn_kv=effective-map:4c6434eb7f8875992cbcbcb6e5cb42adb963d7ab69b465a052d830d25b755735\|attn_output=effective:Q5_K\|attn_q=effective-map:0053a621e96598bce4460d1012e339f388643c8d6903c7a4218db8edb6785dc3\|embeddings=effective:Q4_K\|ffn_down=effective:Q5_K\|ffn_up_gate=effective-map:6f2b36156b38d63d651e6bc64dc651d959e30c55c561cea09b12af215b39a2de\|lm_head=effective:Q6_K\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": false,
	"Warnings": [],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 18105992896,
	"ExpectedSizeGB": 18.105992896000004,
	"ExpectedSizeGiB": 16.862519919872284,
	"ActualSizeBytes": 18105992896,
	"ActualSizeGB": 18.105992896000004,
	"ActualSizeGiB": 16.862519919872284,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	},
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-IQ4_NL_1.gguf",
	"DisplayName": "MQ-IQ4_NL_1",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "IQ4_NL",
	"OriginalReferenceBaseline": "Unsloth-Q4_K_M",
	"TensorGroups": {
	"embeddings": "Unsloth-Q4_K_M",
	"lm_head": "Unsloth-Q4_K_M",
	"attn_q": "Unsloth-IQ4_NL",
	"attn_kv": "Unsloth-Q4_K_M",
	"attn_output": "Unsloth-Q4_K_M",
	"ffn_up_gate": "Unsloth-Q4_K_M",
	"ffn_down": "Unsloth-Q5_K_S"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-q4_k_m.gguf:81ac0ff49a1400dc21a089afea19878cb0ef351c4a786a7d4781248628c45b55\|attn_kv=effective-map:cfa3c7e22dab45e0a77aa3f407191b17d8ccab5105a1460e42258ae2afe0a200\|attn_output=effective:Q4_K\|attn_q=effective-map:e43136b54864568dfe78842f7bfcef25590cb8130b81a7dc7323cc805bf5054d\|embeddings=effective:Q4_K\|ffn_down=effective:Q5_K\|ffn_up_gate=effective:Q4_K\|lm_head=effective:Q6_K\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": false,
	"Warnings": [],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 17062823616,
	"ExpectedSizeGB": 17.062823616000003,
	"ExpectedSizeGiB": 15.890992820262909,
	"ActualSizeBytes": 17062823616,
	"ActualSizeGB": 17.062823616000003,
	"ActualSizeGiB": 15.890992820262909,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	},
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-IQ4_XS_1.gguf",
	"DisplayName": "MQ-IQ4_XS_1",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "IQ4_XS",
	"OriginalReferenceBaseline": "Unsloth-IQ4_NL",
	"TensorGroups": {
	"embeddings": "Unsloth-IQ4_NL",
	"lm_head": "Unsloth-IQ4_NL",
	"attn_q": "Unsloth-IQ4_NL",
	"attn_kv": "Unsloth-IQ4_NL",
	"attn_output": "Unsloth-IQ4_NL",
	"ffn_up_gate": "Unsloth-Q4_K_M",
	"ffn_down": "Unsloth-IQ4_NL"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-iq4_nl.gguf:00dfea690b294aed2a9e69b2f9d301e375710d2f30d02d333bbf0b5d101564d4\|attn_kv=effective-map:2cd5cb986fcd2ae41531f3dc414cf9ab3ba5491f274ba58bcff791edb30616a9\|attn_output=effective-map:383e223b3e3ef3921855bbbc0523636e06425f2f40bee5f3cdbdb5b2714518fa\|attn_q=effective-map:e43136b54864568dfe78842f7bfcef25590cb8130b81a7dc7323cc805bf5054d\|embeddings=effective:Q4_K\|ffn_down=effective-map:24d6750b04df18a75532eeb901ab597a76400a9df46b08d1fbb21ff30bb4b1f3\|ffn_up_gate=effective:Q4_K\|lm_head=effective:Q6_K\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": false,
	"Warnings": [],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 16337626816,
	"ExpectedSizeGB": 16.337626816,
	"ExpectedSizeGiB": 15.215600669384003,
	"ActualSizeBytes": 16337626816,
	"ActualSizeGB": 16.337626816,
	"ActualSizeGiB": 15.215600669384003,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	},
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-IQ2_M_1.gguf",
	"DisplayName": "MQ-IQ2_M_1",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "IQ2_M",
	"OriginalReferenceBaseline": "Unsloth-UD-IQ3_XXS",
	"TensorGroups": {
	"embeddings": "Unsloth-UD-IQ3_XXS",
	"lm_head": "Unsloth-UD-IQ3_XXS",
	"attn_q": "Unsloth-UD-IQ3_XXS",
	"attn_kv": "Unsloth-Q4_K_S",
	"attn_output": "Unsloth-UD-IQ3_XXS",
	"ffn_up_gate": "Unsloth-UD-IQ3_XXS",
	"ffn_down": "Unsloth-UD-IQ3_XXS"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-ud-iq3_xxs.gguf:2cd579fcd506fe2b727b139668a821d1b4c0c8ebea771e17f1a4434e21f7203a\|attn_kv=effective-map:9c255134fc941fed5bdfd21da67c95bdd0f027b1fd545533ca3ee82592875e0d\|attn_output=effective:IQ3_S\|attn_q=effective-map:4f52877ec1569763b619ba16f8b728f4fc0e15d0bc3fa5493e6d2a7dd66e6d13\|embeddings=effective:unknown:Q2_K\|ffn_down=effective:IQ3_S\|ffn_up_gate=effective-map:ea33d3de7804e178645189aa31fe006d26af48d8fe9b269994d4d8f3be269e41\|lm_head=effective:Q5_K\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": true,
	"Warnings": [
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027Q2_K\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027Q2_K\u0027 was preserved as raw metadata."
	],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 11960702656,
	"ExpectedSizeGB": 11.960702655999999,
	"ExpectedSizeGiB": 11.139272391796112,
	"ActualSizeBytes": 11960702656,
	"ActualSizeGB": 11.960702655999999,
	"ActualSizeGiB": 11.139272391796112,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	},
	{
	"ExportedFileName": "Qwen3.8-27B-MQ-IQ2_M_2.gguf",
	"DisplayName": "MQ-IQ2_M_2",
	"ProviderSource": "MagicQuant",
	"BaselineFamily": "IQ2_M",
	"OriginalReferenceBaseline": "Unsloth-UD-Q2_K_XL",
	"TensorGroups": {
	"embeddings": "Unsloth-UD-Q2_K_XL",
	"lm_head": "Unsloth-UD-Q2_K_XL",
	"attn_q": "Unsloth-UD-Q2_K_XL",
	"attn_kv": "Unsloth-UD-Q4_K_XL",
	"attn_output": "Unsloth-UD-Q2_K_XL",
	"ffn_up_gate": "Unsloth-UD-Q2_K_XL",
	"ffn_down": "Unsloth-UD-Q2_K_XL"
	},
	"EffectiveQuantStateKey": "base=custom:qwen3.8-27b:unsloth/qwen3.8-27b-gguf:qwen3.8-27b-ud-q2_k_xl.gguf:b5bebf7e541e47a28e290c5d6a6f8386c4cd5aff49c2e2f221a373bcc1018b6f\|attn_kv=effective-map:4c6434eb7f8875992cbcbcb6e5cb42adb963d7ab69b465a052d830d25b755735\|attn_output=effective:IQ3_S\|attn_q=effective-map:fb26f6e49dfbbf3e40336ec9c28f288af9f8b135b38848a42b496576bd01067a\|embeddings=effective:unknown:Q2_K\|ffn_down=effective-map:d46f77aa733e601b350720a0ceb16b444564b5049c2b6e9d778ea910329c24ed\|ffn_up_gate=effective-map:b92537268535282a0eb1ee3f4f83dcee763d8d0935ad7f7ea35f2bfd6e536ce7\|lm_head=effective:unknown:Q3_K\|moe_experts=base\|moe_router=base",
	"HasUnknownMappings": true,
	"Warnings": [
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027IQ1_M\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027Q3_K\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027Q2_K\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027Q2_K\u0027 was preserved as raw metadata.",
	"Unknown or partially unmapped learned tensor state \u0027Q3_K\u0027 was preserved as raw metadata."
	],
	"UsedImatrix": true,
	"ExpectedSizeBytes": 10769770176,
	"ExpectedSizeGB": 10.769770176000002,
	"ExpectedSizeGiB": 10.030130088329315,
	"ActualSizeBytes": 10769770176,
	"ActualSizeGB": 10.769770176000002,
	"ActualSizeGiB": 10.030130088329315,
	"OriginalExternalSource": "https://huggingface.co/unsloth/Qwen3.8-27B-GGUF"
	}
	]