[marstin-dev] drop sage1.1 for mistral4l on validation set; update tab headline metric

#7
Thinking Machines Lab org
•
edited 2 days ago

Updates the evaluation table to match https://thinkingmachines.ai/model-card/inkling-2-small/:

  • Tax Agent Bench uses its new headline metric (e.g. Inkling 2 Small 38.9%, DeepSeek-V4.1-Flash-1017 44.4%); best and second-best highlights are unchanged.
  • SAGE v1.1: Mistral Large 4's score is removed (original number is validation set not test)

No other changes to the README.

marstin-thinky changed pull request status to merged

Sign up or log in to comment