arvindabacus commited on
Commit
fa82a64
·
verified ·
1 Parent(s): a071511

Figures: LiveBench Mathematics 90.1 (was 91.3), overall 77.4 / +3.2, matching the 2026-06-25 leaderboard

Browse files

Regenerated the category-profile and vs-base charts from the published LiveBench numbers; the README delta text follows.

README.md CHANGED
@@ -26,7 +26,7 @@ tags:
26
 
27
  ## 1. Model Introduction
28
 
29
- Smaug-Flash is an agentic-coding finetune of [DeepSeek-V4-Flash-0731](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731), finetuned by Abacus.AI. It improves end-to-end agentic performance by a wide margin (+14.3 on LiveBench agentic-coding, +10.1 on Terminal Bench 2.1 under the DeepSeek harness, +13.7 on AutomationBench, +19 on NL2Repo-Bench) while improving general capability (+3.4 overall LiveBench). The weights load exactly like the official release: same layout, same quantization formats, same context length (1M), same reasoning interface.
30
 
31
  This card describes the training approach and the evaluation results. Dataset contents are not disclosed; training data consists of curated agentic loop traces from various sources - public repositories, traces synthesized from real world agentic product use cases, augmented with synthetic data variations.
32
 
 
26
 
27
  ## 1. Model Introduction
28
 
29
+ Smaug-Flash is an agentic-coding finetune of [DeepSeek-V4-Flash-0731](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731), finetuned by Abacus.AI. It improves end-to-end agentic performance by a wide margin (+14.3 on LiveBench agentic-coding, +10.1 on Terminal Bench 2.1 under the DeepSeek harness, +13.7 on AutomationBench, +19 on NL2Repo-Bench) while improving general capability (+3.2 overall LiveBench). The weights load exactly like the official release: same layout, same quantization formats, same context length (1M), same reasoning interface.
30
 
31
  This card describes the training approach and the evaluation results. Dataset contents are not disclosed; training data consists of curated agentic loop traces from various sources - public repositories, traces synthesized from real world agentic product use cases, augmented with synthetic data variations.
32
 
figures/smaug_flash_livebench_categories.png CHANGED

Git LFS Details

  • SHA256: 5c1a8ab165593d6ec1741d91b23edc66a91af520f308cfd940bd4c91c23cc4cd
  • Pointer size: 131 Bytes
  • Size of remote file: 281 kB

Git LFS Details

  • SHA256: 5aa4eae2cfe63afa76d47508eade56e89615d5656699e7b4ab64214acd63ba4a
  • Pointer size: 131 Bytes
  • Size of remote file: 308 kB
figures/smaug_flash_vs_base_bars.png CHANGED

Git LFS Details

  • SHA256: 2640827f2f76afce9679489e272c1d1368ba04cc9ad3ad96a987593a10bf2d73
  • Pointer size: 131 Bytes
  • Size of remote file: 117 kB

Git LFS Details

  • SHA256: 6672eb6ea94819b1b4a5e158524da6103fcce5ebd6c45596477a0e70862cb9d8
  • Pointer size: 131 Bytes
  • Size of remote file: 146 kB