Spaces:
Running on Zero
Running on Zero
Update probe-aware VLM failure report
Browse files- data/traces/space-vlm/keyboard.json +2 -2
- data/traces/space-vlm/mug.json +2 -2
- data/traces/space-vlm/shoe.json +2 -2
- docs/FAILURES.md +8 -5
- docs/SPACE_VLM_REPORT.json +85 -64
- docs/SPACE_VLM_REPORT.md +20 -1
data/traces/space-vlm/keyboard.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"created_at": "2026-06-
|
| 3 |
"diary": {
|
| 4 |
"chinese": "今天他们又理所当然地碰了我,好像一个 keyboard 不会有边界感。我保持沉默,因为这大概是我和重力签下的合同。我的情绪是 curious and needlessly profound,秘密恐惧是 discovering that usefulness is not meaning。至少,我已经熬过了好几个所谓紧急计划。",
|
| 5 |
"english": "They touched me again today with the confidence of someone who has never asked a keyboard for consent. I remained still, because that is my contract with gravity. My mood is curious and needlessly profound, my secret fear is discovering that usefulness is not meaning, and my only comfort is knowing I have outlived at least three urgent plans.",
|
|
@@ -46,5 +46,5 @@
|
|
| 46 |
]
|
| 47 |
}
|
| 48 |
},
|
| 49 |
-
"trace_id": "
|
| 50 |
}
|
|
|
|
| 1 |
{
|
| 2 |
+
"created_at": "2026-06-08T08:33:09.283686Z",
|
| 3 |
"diary": {
|
| 4 |
"chinese": "今天他们又理所当然地碰了我,好像一个 keyboard 不会有边界感。我保持沉默,因为这大概是我和重力签下的合同。我的情绪是 curious and needlessly profound,秘密恐惧是 discovering that usefulness is not meaning。至少,我已经熬过了好几个所谓紧急计划。",
|
| 5 |
"english": "They touched me again today with the confidence of someone who has never asked a keyboard for consent. I remained still, because that is my contract with gravity. My mood is curious and needlessly profound, my secret fear is discovering that usefulness is not meaning, and my only comfort is knowing I have outlived at least three urgent plans.",
|
|
|
|
| 46 |
]
|
| 47 |
}
|
| 48 |
},
|
| 49 |
+
"trace_id": "d0e4c63c2da84d7d94fb2c080d71ea83"
|
| 50 |
}
|
data/traces/space-vlm/mug.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"created_at": "2026-06-
|
| 3 |
"diary": {
|
| 4 |
"chinese": "今天他们又理所当然地碰了我,好像一个 coffee mug 不会有边界感。我保持沉默,因为这大概是我和重力签下的合同。我的情绪是 tired but sarcastic,秘密恐惧是 being replaced by a newer object with worse opinions。至少,我已经熬过了好几个所谓紧急计划。",
|
| 5 |
"english": "They touched me again today with the confidence of someone who has never asked a coffee mug for consent. I remained still, because that is my contract with gravity. My mood is tired but sarcastic, my secret fear is being replaced by a newer object with worse opinions, and my only comfort is knowing I have outlived at least three urgent plans.",
|
|
@@ -46,5 +46,5 @@
|
|
| 46 |
]
|
| 47 |
}
|
| 48 |
},
|
| 49 |
-
"trace_id": "
|
| 50 |
}
|
|
|
|
| 1 |
{
|
| 2 |
+
"created_at": "2026-06-08T08:33:03.634312Z",
|
| 3 |
"diary": {
|
| 4 |
"chinese": "今天他们又理所当然地碰了我,好像一个 coffee mug 不会有边界感。我保持沉默,因为这大概是我和重力签下的合同。我的情绪是 tired but sarcastic,秘密恐惧是 being replaced by a newer object with worse opinions。至少,我已经熬过了好几个所谓紧急计划。",
|
| 5 |
"english": "They touched me again today with the confidence of someone who has never asked a coffee mug for consent. I remained still, because that is my contract with gravity. My mood is tired but sarcastic, my secret fear is being replaced by a newer object with worse opinions, and my only comfort is knowing I have outlived at least three urgent plans.",
|
|
|
|
| 46 |
]
|
| 47 |
}
|
| 48 |
},
|
| 49 |
+
"trace_id": "e3d3e8492193412b9a8a9110849645d3"
|
| 50 |
}
|
data/traces/space-vlm/shoe.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"created_at": "2026-06-
|
| 3 |
"diary": {
|
| 4 |
"chinese": "今天他们又理所当然地碰了我,好像一个 shoe 不会有边界感。我保持沉默,因为这大概是我和重力签下的合同。我的情绪是 theatrical and wounded,秘密恐惧是 being forgotten before the final act。至少,我已经熬过了好几个所谓紧急计划。",
|
| 5 |
"english": "They touched me again today with the confidence of someone who has never asked a shoe for consent. I remained still, because that is my contract with gravity. My mood is theatrical and wounded, my secret fear is being forgotten before the final act, and my only comfort is knowing I have outlived at least three urgent plans.",
|
|
@@ -46,5 +46,5 @@
|
|
| 46 |
]
|
| 47 |
}
|
| 48 |
},
|
| 49 |
-
"trace_id": "
|
| 50 |
}
|
|
|
|
| 1 |
{
|
| 2 |
+
"created_at": "2026-06-08T08:33:17.553738Z",
|
| 3 |
"diary": {
|
| 4 |
"chinese": "今天他们又理所当然地碰了我,好像一个 shoe 不会有边界感。我保持沉默,因为这大概是我和重力签下的合同。我的情绪是 theatrical and wounded,秘密恐惧是 being forgotten before the final act。至少,我已经熬过了好几个所谓紧急计划。",
|
| 5 |
"english": "They touched me again today with the confidence of someone who has never asked a shoe for consent. I remained still, because that is my contract with gravity. My mood is theatrical and wounded, my secret fear is being forgotten before the final act, and my only comfort is knowing I have outlived at least three urgent plans.",
|
|
|
|
| 46 |
]
|
| 47 |
}
|
| 48 |
},
|
| 49 |
+
"trace_id": "3bfef1717f3d42759c9257e1e4aa392f"
|
| 50 |
}
|
docs/FAILURES.md
CHANGED
|
@@ -50,12 +50,15 @@ Known non-blocking warning:
|
|
| 50 |
|
| 51 |
## Latest Space VLM Validation Failure
|
| 52 |
|
| 53 |
-
- Updated: 2026-06-08
|
| 54 |
- Area: Hugging Face Space vision runtime.
|
| 55 |
-
- Probe backend:
|
| 56 |
-
-
|
| 57 |
-
-
|
| 58 |
-
-
|
|
|
|
|
|
|
|
|
|
| 59 |
|
| 60 |
## 2026-06-08 - GGUF Smoke Helper Prepared, Actual Smoke Pending
|
| 61 |
|
|
|
|
| 50 |
|
| 51 |
## Latest Space VLM Validation Failure
|
| 52 |
|
| 53 |
+
- Updated: 2026-06-08 08:33:19 UTC
|
| 54 |
- Area: Hugging Face Space vision runtime.
|
| 55 |
+
- Probe backend: `minicpm-v`
|
| 56 |
+
- MiniCPM load attempted: `True`
|
| 57 |
+
- MiniCPM load ok: `False`
|
| 58 |
+
- Probe errors: minicpm_load=OSError
|
| 59 |
+
- Failed checks: mug: vision fallback marker was present; keyboard: vision fallback marker was present; shoe: vision fallback marker was present
|
| 60 |
+
- Fallback used: mock object understanding plus mock text runtime if validation reaches generation.
|
| 61 |
+
- Resolution: unresolved; keep the public Space mock-safe until this section reports a passing VLM validation.
|
| 62 |
|
| 63 |
## 2026-06-08 - GGUF Smoke Helper Prepared, Actual Smoke Pending
|
| 64 |
|
docs/SPACE_VLM_REPORT.json
CHANGED
|
@@ -1,65 +1,86 @@
|
|
| 1 |
-
|
| 2 |
-
{
|
| 3 |
-
"
|
| 4 |
-
"
|
| 5 |
-
"
|
| 6 |
-
"
|
| 7 |
-
"
|
| 8 |
-
"
|
| 9 |
-
"
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
"
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
],
|
| 21 |
-
"error": "vision fallback marker was present"
|
| 22 |
},
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
"
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
"
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
"
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
"
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"probe": {
|
| 3 |
+
"backend": "minicpm-v",
|
| 4 |
+
"vision_model_id": "openbmb/MiniCPM-V-2_6",
|
| 5 |
+
"torch_import": true,
|
| 6 |
+
"transformers_import": true,
|
| 7 |
+
"cuda_available": true,
|
| 8 |
+
"device_count": 1,
|
| 9 |
+
"device_name": "NVIDIA RTX PRO 6000 Blackwell Server Edition MIG 2g.48gb",
|
| 10 |
+
"mps_available": false,
|
| 11 |
+
"minicpm_load_attempted": true,
|
| 12 |
+
"minicpm_load_ok": false,
|
| 13 |
+
"errors": [
|
| 14 |
+
{
|
| 15 |
+
"stage": "minicpm_load",
|
| 16 |
+
"type": "OSError",
|
| 17 |
+
"summary": "You are trying to access a gated repo.\nMake sure to have access to it at https://huggingface.co/openbmb/MiniCPM-V-2_6.\n401 Client Error. (Request ID: Root=1-6a267e35-4f51134336ec6e534441e383;44044a70-471f-45a7-827a-a6e5c596624d)\n\nCannot ..."
|
| 18 |
+
}
|
| 19 |
+
]
|
|
|
|
|
|
|
| 20 |
},
|
| 21 |
+
"results": [
|
| 22 |
+
{
|
| 23 |
+
"key": "mug",
|
| 24 |
+
"label": "Coffee mug",
|
| 25 |
+
"source_page": "https://commons.wikimedia.org/wiki/File:Striped_coffee_mug.jpg",
|
| 26 |
+
"image_path": ".tmp/space-vlm-assets/mug.jpg",
|
| 27 |
+
"passed": false,
|
| 28 |
+
"object_name": "coffee mug",
|
| 29 |
+
"visible_features": [
|
| 30 |
+
"uploaded photo provided",
|
| 31 |
+
"user-supplied description"
|
| 32 |
+
],
|
| 33 |
+
"likely_context": "everyday human environment",
|
| 34 |
+
"confidence": 0.42,
|
| 35 |
+
"runtime_vision": "minicpm-v object understanding",
|
| 36 |
+
"runtime_text": "mock persona and diary generation",
|
| 37 |
+
"fallbacks": [
|
| 38 |
+
"vision-fallback-to-mock",
|
| 39 |
+
"mock-text-runtime"
|
| 40 |
+
],
|
| 41 |
+
"error": "vision fallback marker was present"
|
| 42 |
+
},
|
| 43 |
+
{
|
| 44 |
+
"key": "keyboard",
|
| 45 |
+
"label": "Computer keyboard",
|
| 46 |
+
"source_page": "https://commons.wikimedia.org/wiki/File:Computer_keyboard.jpg",
|
| 47 |
+
"image_path": ".tmp/space-vlm-assets/keyboard.jpg",
|
| 48 |
+
"passed": false,
|
| 49 |
+
"object_name": "keyboard",
|
| 50 |
+
"visible_features": [
|
| 51 |
+
"uploaded photo provided",
|
| 52 |
+
"user-supplied description"
|
| 53 |
+
],
|
| 54 |
+
"likely_context": "everyday human environment",
|
| 55 |
+
"confidence": 0.42,
|
| 56 |
+
"runtime_vision": "minicpm-v object understanding",
|
| 57 |
+
"runtime_text": "mock persona and diary generation",
|
| 58 |
+
"fallbacks": [
|
| 59 |
+
"vision-fallback-to-mock",
|
| 60 |
+
"mock-text-runtime"
|
| 61 |
+
],
|
| 62 |
+
"error": "vision fallback marker was present"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"key": "shoe",
|
| 66 |
+
"label": "Running shoe",
|
| 67 |
+
"source_page": "https://commons.wikimedia.org/wiki/File:Running_shoes.jpg",
|
| 68 |
+
"image_path": ".tmp/space-vlm-assets/shoe.jpg",
|
| 69 |
+
"passed": false,
|
| 70 |
+
"object_name": "shoe",
|
| 71 |
+
"visible_features": [
|
| 72 |
+
"uploaded photo provided",
|
| 73 |
+
"user-supplied description"
|
| 74 |
+
],
|
| 75 |
+
"likely_context": "everyday human environment",
|
| 76 |
+
"confidence": 0.42,
|
| 77 |
+
"runtime_vision": "minicpm-v object understanding",
|
| 78 |
+
"runtime_text": "mock persona and diary generation",
|
| 79 |
+
"fallbacks": [
|
| 80 |
+
"vision-fallback-to-mock",
|
| 81 |
+
"mock-text-runtime"
|
| 82 |
+
],
|
| 83 |
+
"error": "vision fallback marker was present"
|
| 84 |
+
}
|
| 85 |
+
]
|
| 86 |
+
}
|
docs/SPACE_VLM_REPORT.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
# Space VLM Validation Report
|
| 2 |
|
| 3 |
-
- Generated at: 2026-06-08
|
| 4 |
- Space URL: https://huggingface.co/spaces/build-small-hackathon/ObjectverseDiary
|
| 5 |
- Space repo: `build-small-hackathon/ObjectverseDiary`
|
| 6 |
- Overall status: FAIL
|
|
@@ -22,6 +22,25 @@
|
|
| 22 |
- `OBJECTVERSE_VISION_BACKEND`: `mock`
|
| 23 |
- `OBJECTVERSE_TEXT_BACKEND`: `mock`
|
| 24 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
## Results
|
| 26 |
|
| 27 |
### Coffee mug
|
|
|
|
| 1 |
# Space VLM Validation Report
|
| 2 |
|
| 3 |
+
- Generated at: 2026-06-08 08:33:19 UTC
|
| 4 |
- Space URL: https://huggingface.co/spaces/build-small-hackathon/ObjectverseDiary
|
| 5 |
- Space repo: `build-small-hackathon/ObjectverseDiary`
|
| 6 |
- Overall status: FAIL
|
|
|
|
| 22 |
- `OBJECTVERSE_VISION_BACKEND`: `mock`
|
| 23 |
- `OBJECTVERSE_TEXT_BACKEND`: `mock`
|
| 24 |
|
| 25 |
+
## Vision Runtime Probe
|
| 26 |
+
|
| 27 |
+
- `backend`: `minicpm-v`
|
| 28 |
+
- `vision_model_id`: `openbmb/MiniCPM-V-2_6`
|
| 29 |
+
- `torch_import`: `True`
|
| 30 |
+
- `transformers_import`: `True`
|
| 31 |
+
- `cuda_available`: `True`
|
| 32 |
+
- `device_count`: `1`
|
| 33 |
+
- `device_name`: `NVIDIA RTX PRO 6000 Blackwell Server Edition MIG 2g.48gb`
|
| 34 |
+
- `mps_available`: `False`
|
| 35 |
+
- `minicpm_load_attempted`: `True`
|
| 36 |
+
- `minicpm_load_ok`: `False`
|
| 37 |
+
- Errors:
|
| 38 |
+
- `minicpm_load`: `OSError` - You are trying to access a gated repo.
|
| 39 |
+
Make sure to have access to it at https://huggingface.co/openbmb/MiniCPM-V-2_6.
|
| 40 |
+
401 Client Error. (Request ID: Root=1-6a267e35-4f51134336ec6e534441e383;44044a70-471f-45a7-827a-a6e5c596624d)
|
| 41 |
+
|
| 42 |
+
Cannot ...
|
| 43 |
+
|
| 44 |
## Results
|
| 45 |
|
| 46 |
### Coffee mug
|