UC Berkeley HCI

university

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

csdl authored a paper about 1 month ago

DigitalCoach: Communication and Grounding Gaps in Human and Agentic Computer Use Coaching

csdl updated a dataset about 1 month ago

berkeley-hci/digital-coach

davidchan authored a paper about 2 months ago

CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions

View all activity

csdl

authored a paper about 1 month ago

DigitalCoach: Communication and Grounding Gaps in Human and Agentic Computer Use Coaching

Paper • 2606.31980 • Published Jun 30 • 1

csdl

updated a dataset about 1 month ago

berkeley-hci/digital-coach

Viewer • Updated Sep 9 • 22.8k • 1.34k • 2

authored a paper about 2 months ago

CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions

Paper • 2608.28958 • Published Aug 29 • 7

csdl

published a dataset about 2 months ago

berkeley-hci/digital-coach

Viewer • Updated Sep 9 • 22.8k • 1.34k • 2

updated 2 datasets 2 months ago

berkeley-hci/A11y-CUA

Updated Aug 5 • 1.63k • 4

berkeley-hci/Reduced-A11y-CUA

Updated Aug 5 • 534

published a dataset 6 months ago

berkeley-hci/Reduced-A11y-CUA

Updated Aug 5 • 534

published a dataset 8 months ago

berkeley-hci/A11y-CUA

Updated Aug 5 • 1.63k • 4

authored a paper 10 months ago

DesignPref: Capturing Personal Preferences in Visual Design Generation

Paper • 2511.20513 • Published Nov 25, 2025 • 1

authored 2 papers about 1 year ago

TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action

Paper • 2505.01583 • Published May 2, 2025 • 8

Morae: Proactively Pausing UI Agents for User Choices

Paper • 2508.21456 • Published Aug 29, 2025 • 5

authored a paper over 1 year ago

TULIP: Towards Unified Language-Image Pretraining

Paper • 2503.15485 • Published Mar 19, 2025 • 49

authored a paper over 1 year ago

CodeA11y: Making AI Coding Assistants Useful for Accessible Web Development

Paper • 2502.10884 • Published Feb 15, 2025

authored a paper almost 2 years ago

AutoPresent: Designing Structured Visuals from Scratch

Paper • 2501.00912 • Published Jan 1, 2025 • 8

authored a paper about 2 years ago

DreamStruct: Understanding Slides and User Interfaces via Synthetic Data Generation

Paper • 2410.00201 • Published Sep 30, 2024

authored 4 papers about 2 years ago

Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition

Paper • 2403.19822 • Published Mar 28, 2024

ALOHa: A New Measure for Hallucination in Captioning Models

Paper • 2404.02904 • Published Apr 3, 2024

Virtual Personas for Language Models via an Anthology of Backstories

Paper • 2407.06576 • Published Jul 9, 2024 • 1

Visual Haystacks: Answering Harder Questions About Sets of Images

Paper • 2407.13766 • Published Jul 18, 2024 • 2

posted an update about 2 years ago

Post

671

🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning.

Check it out!
tsunghanwu/visual_haystacks
https://visual-haystacks.github.io/
https://arxiv.org/abs/2407.13766
https://github.com/visual-haystacks/vhs_benchmark