File size: 1,752 Bytes
b6b364b
c54f29e
 
 
b6b364b
 
c54f29e
b6b364b
c54f29e
 
 
 
 
b6b364b
 
c54f29e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
---
title: MOSS-VL-Realtime
emoji: πŸ‘οΈ
colorFrom: gray
colorTo: indigo
sdk: gradio
sdk_version: 6.15.1
app_file: app.py
short_description: Live streaming video chat β€” ask while the model watches
python_version: "3.12"
startup_duration_timeout: 1h
models:
  - OpenMOSS-Team/MOSS-VL-Realtime
---

# MOSS-VL-Realtime β€” Live Session

A realtime demo of [OpenMOSS-Team/MOSS-VL-Realtime](https://huggingface.co/OpenMOSS-Team/MOSS-VL-Realtime),
a multimodal vision-language model specialized for **realtime streaming video understanding**.

## How it works

1. **Stage a media** on the left β€” upload a video or image, or record from your camera
   (screen recordings can be uploaded as video files).
2. **Start a session** β€” the model watches the stream frame by frame at real playback pace.
3. **Chat while it watches** β€” type in the input box and press Enter; your question is pushed
   *into the running stream* and the model answers mid-stream. After the stream ends the
   session stays open for follow-up questions (until idle timeout or Stop).

The chat log shows one bubble per model response round, stamped with the video timestamp
at which it was produced. The `{ } Raw` toggle switches the log to the underlying event
stream (frames, silences, rounds, prompts).

One media per session β€” changing the staged media ends the live session, and starting a
new session clears the log (the finished transcript stays on screen until then).

## MCP

This Space is an MCP server exposing one tool, `analyze(media, prompt, ...)` β€” a stateless
single-shot analysis of a video/image path or URL.

## Local development

```bash
pip install "gradio[mcp]==6.15.1" pillow
MOSS_DEMO_MOCK=1 python app.py   # scripted model, no GPU/torch needed
```