Correct card to the corrected Ollama record: remove Aider 73.7 / GPT-4o catalog claims and concurrency figures, correct Files table to actual repo contents, correct license from MIT to Apache-2.0
Browse files
README.md
CHANGED
|
@@ -33,18 +33,21 @@ tags:
|
|
| 33 |
|
| 34 |
## Summary
|
| 35 |
|
| 36 |
-
|
|
|
|
|
|
|
| 37 |
|
| 38 |
**Model ID:** Thox-ai/thox-cluster-code
|
| 39 |
**Base model:** Qwen2.5-Coder 32B by Alibaba Cloud
|
| 40 |
**Runnable build:** Ollama - `ollama run Thox-ai/thox-cluster-code`
|
| 41 |
-
**License
|
| 42 |
|
| 43 |
## Files
|
| 44 |
|
| 45 |
| File | Size | Purpose |
|
| 46 |
|---|---:|---|
|
| 47 |
| `.gitattributes` | 1,519 B | Repository file |
|
|
|
|
| 48 |
|
| 49 |
|
| 50 |
## MeshStack Origin
|
|
@@ -80,17 +83,16 @@ runtime configuration, and this documentation.
|
|
| 80 |
| Base model | Qwen2.5-Coder 32B (Alibaba Cloud) |
|
| 81 |
| Parameters | 32B |
|
| 82 |
| Size | 20 GB (Ollama listing) |
|
| 83 |
-
| Deployment |
|
| 84 |
| Context window | 128K tokens (served num_ctx 131072 in the Ollama configuration; the Ollama latest-tag figure of 32K is a display artifact) |
|
| 85 |
| Quantization | Q4_K_M (GGUF) |
|
| 86 |
-
|
|
| 87 |
-
| Languages | 92 programming languages |
|
| 88 |
|
| 89 |
## Intended Use
|
| 90 |
|
| 91 |
-
- Software teams
|
| 92 |
-
- Startups and DevOps teams
|
| 93 |
-
- QA
|
| 94 |
|
| 95 |
## How to Use
|
| 96 |
|
|
@@ -124,12 +126,12 @@ section will be updated with method and results when a THOX-run
|
|
| 124 |
evaluation lands; until then, treat quoted figures as the original
|
| 125 |
catalog's claims, not as independently verified measurements.
|
| 126 |
|
| 127 |
-
Catalog notes for this model:
|
| 128 |
|
| 129 |
## Limitations
|
| 130 |
|
| 131 |
- Specialized for software engineering; not a general-purpose chat model
|
| 132 |
-
-
|
| 133 |
- Generated code requires human review before production use
|
| 134 |
|
| 135 |
- All processing is local by design; the model has no access to online
|
|
@@ -139,7 +141,7 @@ Catalog notes for this model: Catalog-reported: Aider benchmark 73.7 for code re
|
|
| 139 |
|
| 140 |
## Hardware Reference (from the original card)
|
| 141 |
|
| 142 |
-
Per device: minimum 32 GB RAM, 30 GB storage, NVIDIA Jetson Orin AGX (32GB VRAM), 10 Gbps network. Recommended 64 GB RAM, 50 GB NVMe SSD
|
| 143 |
|
| 144 |
## License Terms
|
| 145 |
|
|
|
|
| 33 |
|
| 34 |
## Summary
|
| 35 |
|
| 36 |
+
A THOX configuration and distribution of Qwen2.5-Coder 32B for local software-engineering work and MeshStack deployments. Configuration-derived: THOX did not train these weights. Qwen2.5-Coder is Alibaba's code-specialized model family; per Alibaba's model record it covers 92 programming languages.
|
| 37 |
+
|
| 38 |
+
> **Correction notice.** This card previously described the model as "GPT-4o competitive" and quoted an Aider score and team ROI figures; those were inherited catalog claims with no THOX-run evaluation behind them and have been removed. No benchmark, throughput, latency, concurrency, uptime, cost-saving, or compliance figure is claimed for this release. Earlier versions of this card also stated the license as MIT; that was incorrect (see License Terms).
|
| 39 |
|
| 40 |
**Model ID:** Thox-ai/thox-cluster-code
|
| 41 |
**Base model:** Qwen2.5-Coder 32B by Alibaba Cloud
|
| 42 |
**Runnable build:** Ollama - `ollama run Thox-ai/thox-cluster-code`
|
| 43 |
+
**License:** Apache License 2.0 (see License Terms)
|
| 44 |
|
| 45 |
## Files
|
| 46 |
|
| 47 |
| File | Size | Purpose |
|
| 48 |
|---|---:|---|
|
| 49 |
| `.gitattributes` | 1,519 B | Repository file |
|
| 50 |
+
| `README.md` | 7,711 | This model card |
|
| 51 |
|
| 52 |
|
| 53 |
## MeshStack Origin
|
|
|
|
| 83 |
| Base model | Qwen2.5-Coder 32B (Alibaba Cloud) |
|
| 84 |
| Parameters | 32B |
|
| 85 |
| Size | 20 GB (Ollama listing) |
|
| 86 |
+
| Deployment | Local inference via Ollama; distributed orchestration via MeshStack (separate from this download) |
|
| 87 |
| Context window | 128K tokens (served num_ctx 131072 in the Ollama configuration; the Ollama latest-tag figure of 32K is a display artifact) |
|
| 88 |
| Quantization | Q4_K_M (GGUF) |
|
| 89 |
+
| Languages | 92 programming languages (per Alibaba's model record) |
|
|
|
|
| 90 |
|
| 91 |
## Intended Use
|
| 92 |
|
| 93 |
+
- Software teams analysing repositories and reviewing code locally
|
| 94 |
+
- Startups and DevOps teams prototyping and working with infrastructure-as-code
|
| 95 |
+
- QA and test-automation assistance on private codebases
|
| 96 |
|
| 97 |
## How to Use
|
| 98 |
|
|
|
|
| 126 |
evaluation lands; until then, treat quoted figures as the original
|
| 127 |
catalog's claims, not as independently verified measurements.
|
| 128 |
|
| 129 |
+
Catalog notes for this model: No THOX-run evaluation has been published for this model. Catalog claims that appeared here previously (an Aider score and a GPT-4o comparison) were removed; they were inherited catalog claims with no THOX-run evaluation behind them.
|
| 130 |
|
| 131 |
## Limitations
|
| 132 |
|
| 133 |
- Specialized for software engineering; not a general-purpose chat model
|
| 134 |
+
- Local deployment only in this distribution; behavior and speed depend entirely on the operator's hardware and configuration
|
| 135 |
- Generated code requires human review before production use
|
| 136 |
|
| 137 |
- All processing is local by design; the model has no access to online
|
|
|
|
| 141 |
|
| 142 |
## Hardware Reference (from the original card)
|
| 143 |
|
| 144 |
+
Per device: minimum 32 GB RAM, 30 GB storage, NVIDIA Jetson Orin AGX class GPU (32GB VRAM), 10 Gbps network for clustered use. Recommended 64 GB RAM, 50 GB NVMe SSD.
|
| 145 |
|
| 146 |
## License Terms
|
| 147 |
|