File size: 2,338 Bytes
188cf7e
d3d0e0e
 
 
 
188cf7e
 
 
d3d0e0e
 
 
 
 
 
188cf7e
 
d3d0e0e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
188cf7e
d3d0e0e
 
 
 
 
 
 
188cf7e
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
---
title: DAO  Data Agent Observatory
emoji: 🔬
colorFrom: blue
colorTo: purple
sdk: docker
app_port: 8501
pinned: false
tags:
  - streamlit
  - docker
  - data-agents
  - observability
  - kdd
---

# DAO — Data Agent Observatory

DAO — Data Agent Observatory is team1647's creative-track submission for making data-agent execution inspectable, reproducible, and judge-friendly.

This Hugging Face Space runs the DAO Streamlit application from the packaged team1647 submission. DAO turns benchmark run artifacts into an observability cockpit where reviewers can inspect run quality, task reasoning, evidence, replay, confidence, reliability, and future-proofing workflows without treating the data agent as a black box.

## Demo Mode

This Space is designed to support a demo-first review flow.

If precomputed run artifacts are present, reviewers can inspect:

1. **Run Intelligence** — run-level quality, reliability, resource usage, failures, validation, and artifact completeness.
2. **Task Intelligence** — task-level reasoning, replay, evidence, confidence, verification, and raw trace inspection.
3. **Future Proof** — evidence-backed steering, checkpoint review, rerun planning, and comparison workflows.

Artifact inspection does not require API credentials.

## Live Execution

Live task execution requires model API secrets to be configured by the Space owner.

Expected secrets / variables include:

```text
MODEL_API_URL
MODEL_API_KEY
MODEL_NAME
```

Optional OpenAI-compatible variables may also be used if supported by the active config:

OPENAI_API_KEY
OPENAI_API_BASE
OPENAI_MODEL

If secrets are not configured, the Space should still allow inspection of bundled demo artifacts.

Streamlit Entry Point

The application starts from:

src/data_agent_baseline/observatory/app.py

The container serves Streamlit on:

0.0.0.0:8501

Hugging Face provides HTTPS externally, so the container does not need to generate or serve a self-signed certificate.

Suggested Review Flow
Open the Space.
Select a bundled run if available.
Start with Run Intelligence for aggregate run-level diagnosis.
Open Task Intelligence for task-level reasoning, replay, and evidence inspection.
Open Future Proof for evidence packs, steering, rerun planning, and comparisons.
Use live execution only if model secrets are configured.