ServiceNow-AI

company

AI & ML interests

None defined yet.

Recent Activity

bradnow updated a Space 1 day ago

ServiceNow-AI/NowAI-Bench

Hari-sub authored a paper about 1 month ago

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

anilmadamala authored a paper about 1 month ago

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

View all activity

Papers

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Do Enterprise Systems Need Learned World Models? The Importance of Context to Infer Dynamics

View all Papers

Articles

Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech

EVA-Bench Data 2.0: 3 Domains, 121 Tools, 213 Scenarios

vLLM V0 to V1: Correctness Before Corrections in RL

A New Framework for Evaluating Voice Agents (EVA)

Introducing SyGra Studio

🚀 SyGra V2.0.0

AprielGuard: A Guardrail for Safety and Adversarial Robustness in Modern LLM Systems

Apriel-1.6-15b-Thinker: Cost-efficient Frontier Multimodal Performance

Apriel-H1: The Surprising Key to Distilling Efficient Reasoning Models

SyGra: The One-Stop Framework for Building Data for LLMs and SLMs

View all articles

updated a Space 1 day ago

NowAI-Bench

Explore enterprise AI benchmark leaderboards and scores

published an article 15 days ago

Article

Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech

ServiceNow-AI

•

15 days ago

• 44

published a dataset 15 days ago

ServiceNow-AI/asr_codeswitched

Viewer • Updated 16 days ago • 918 • 288 • 5

updated a dataset 16 days ago

ServiceNow-AI/asr_codeswitched

Viewer • Updated 16 days ago • 918 • 288 • 5

authored a paper about 1 month ago

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Paper • 2605.13841 • Published May 13 • 75

authored a paper about 1 month ago

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Paper • 2605.13841 • Published May 13 • 75

authored a paper about 1 month ago

Developing Safe and Responsible Large Language Models -- A Comprehensive Framework

Paper • 2404.01399 • Published Apr 1, 2024 • 1

authored a paper about 1 month ago

Azimuth: Systematic Error Analysis for Text Classification

Paper • 2212.08216 • Published Dec 16, 2022

authored a paper about 1 month ago

Azimuth: Systematic Error Analysis for Text Classification

Paper • 2212.08216 • Published Dec 16, 2022

authored 2 papers about 1 month ago

M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models

Paper • 2406.16783 • Published Jun 24, 2024 • 4

Prompting with Phonemes: Enhancing LLM Multilinguality for non-Latin Script Languages

Paper • 2411.02398 • Published Nov 4, 2024 • 1

authored 4 papers about 1 month ago

DNA Bench: When Silence is Smarter -- Benchmarking Over-Reasoning in Reasoning LLMs

Paper • 2503.15793 • Published Mar 20, 2025

Cats Confuse Reasoning LLM: Query Agnostic Adversarial Triggers for Reasoning Models

Paper • 2503.01781 • Published Mar 3, 2025 • 2

Apriel-Nemotron-15B-Thinker

Paper • 2508.10948 • Published Aug 13, 2025 • 6

AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMs

Paper • 2509.08031 • Published Sep 9, 2025 • 21

authored 2 papers about 1 month ago

AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMs

Paper • 2509.08031 • Published Sep 9, 2025 • 21

RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedback

Paper • 2510.06186 • Published Oct 7, 2025 • 1

authored a paper about 1 month ago

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Paper • 2605.13841 • Published May 13 • 75

authored a paper about 1 month ago

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Paper • 2605.13841 • Published May 13 • 75

authored a paper about 1 month ago

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Paper • 2605.13841 • Published May 13 • 75