File size: 2,420 Bytes
17b0eaa bfdfe3d 17b0eaa bfdfe3d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 | ---
title: README
emoji: 馃К
colorFrom: green
colorTo: purple
sdk: static
pinned: false
---
<p align="center">
<a href="https://doses.ai">
<img src="https://huggingface.co/spaces/Doses-AI/README/resolve/main/assets/doses-ai-banner.png" alt="Doses AI - Private intelligence for medicine" width="100%">
</a>
</p>
<p align="center"><strong>Open medical intelligence, built to run locally.</strong></p>
<p align="center">
<a href="https://doses.ai"><strong>Website</strong></a>
路
<a href="https://huggingface.co/Doses-AI/Pestle-27B-Ternary-GGUF"><strong>Flagship model</strong></a>
路
<a href="https://doses.ai/pestle-27b-ternary-technical-report/"><strong>Technical report</strong></a>
路
<a href="https://github.com/DosesAI/mortar.cpp"><strong>Runtime</strong></a>
</p>
## Featured release
### [Pestle-27B-Ternary-GGUF](https://huggingface.co/Doses-AI/Pestle-27B-Ternary-GGUF)
A 27B open-weight medical model packaged as an 8.48 GB runnable GGUF. Pestle is designed for private local and on-premises systems spanning clinical knowledge, biomedical evidence work, pharmaceutical retrieval, and coding.
**Apache 2.0** 路 **27B parameters** 路 **8.48 GB GGUF** 路 **CPU, Metal and CUDA**
[Weights and model card](https://huggingface.co/Doses-AI/Pestle-27B-Ternary-GGUF) 路 [Technical report](https://doses.ai/pestle-27b-ternary-technical-report/) 路 [Run with mortar.cpp](https://github.com/DosesAI/mortar.cpp)
## Research
- **Low-bit model compression** - ternary and compact representations for capable local models.
- **Medical model evaluation** - matched benchmarking across clinical knowledge, biomedical QA, retrieval, and general capabilities.
- **Local inference** - practical execution across CPU, Apple Silicon, and NVIDIA GPUs without a required cloud dependency.
## Open source
| Project | What it is | Links |
|:--|:--|:--|
| **Pestle-27B-Ternary** | Open-weight 27B medical research model | [Model](https://huggingface.co/Doses-AI/Pestle-27B-Ternary-GGUF) 路 [Report](https://doses.ai/pestle-27b-ternary-technical-report/) |
| **mortar.cpp** | Local CPU, Metal, and CUDA runtime for Pestle | [GitHub](https://github.com/DosesAI/mortar.cpp) |
<sub>Research preview. Doses AI models are not medical devices and are not intended to replace qualified professional judgment. Contact: <a href="mailto:malik@doses.ai">malik@doses.ai</a>.</sub>
|