Spaces:
Running
Running
Commit History
6 days ago
-
Progress reports for the analysis step
Analysing a three-hour transcript takes several minutes with no output. It now reports each stage: loading the language model, finding places, people and events turn by turn (with the time left), the model drafting the brief (a "still working" line every 30 seconds until it answers), checking quotes and headings, and placing. The notebook's analyse cell keeps the latest state in <ID>/out/progress.json like the transcription cell. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE8c6b0a2 -
Transcription on GPU: provide the CUDA 12 libraries faster-whisper needs
Colab's system CUDA is now newer than the CUDA 12 that faster-whisper's engine (CTranslate2) is built for, so libcublas.so.12 was missing at the first GPU step. The setup cell installs nvidia-cublas-cu12 and cuDNN 9 from pip; CuratorBot loads them before the speech model, and the notebook also puts them on LD_LIBRARY_PATH for the run. A missing GPU library during transcription now gets the same explanation as one during model loading. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEdca0e6c -
Notebook: keep the GitHub token out of commands and errors; setup cell can be rerun
The token was part of the git clone command, so a failed clone printed it. It now travels in git's environment configuration only, failures show git's last message without it, and a rerun pulls the latest code instead of failing on an existing clone. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEd03c298 -
Progress reports for long runs; notebook shows command output and the real error
- New curatorbot/progress.py: timestamped stage lines and a progress.json. - Audio extraction reports each part; transcription reports every 30 s with the time left; language detection reports its stretches. - A speech model that will not load says whether GPU libraries are the cause. - prepare_interview.py --progress-file; the notebook keeps progress in Drive (<ID>/out/progress.json) and streams command output, so failures show their reason instead of only an exit code. - Runbook: progress, and Lancaster's Hex cluster for larger batches. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE34aa951 -
Open in Colab badge on the notebook and in the README
Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE3883b9b -
Take Box deliveries as they come: inventory, recordings at any depth, batch notebook
- New curatorbot/intake.py and 'curatorbot inventory': one entry per submission folder, recordings found at any depth, missing parts, other files, durations; ids from accession numbers (with -BOX) or folder names. - prepare_interview.py --media accepts folders. - Notebook rewritten around CuratorBot/box/ (Box folders as downloaded): inventory, choose submissions, transcribe (resumable), analyse as-is or after review, compare; spaces in folder names handled. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE68f1146
7 days ago
-
End-to-end path: Colab notebook for recordings, transcript comparison, faster language ID
- notebooks/prepare_on_colab.ipynb rewritten: new id for the Box copy, evaluation settings, transcript saved to Drive at once, analyse as-is or after review, compare with the museum transcript. - New 'curatorbot compare': WER (jiwer), turns, and how many place names in the reference narrator turns survive automatic transcription. - Language ID once per 30-second stretch instead of per chunk (a few hundred passes for a three-hour interview, not thousands). - Rule headings ranked after the model's in the back-test. - Runbook section D and evaluation-log section E1 for the end-to-end test. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEcf6fdf5
18 days ago
-
Model providers: Claude via OpenRouter by default, OpenAI fallback, any OpenAI-compatible endpoint
- New default provider openrouter (anthropic/claude-sonnet-5.5), with openai/gpt-4.1-mini tried once on outages, rate limits or unreadable answers; account errors (bad key, no credit) are not retried. - New 'compatible' provider for an institution's own gateway or local open models (vLLM, Ollama) via CURATORBOT_LLM_BASE_URL. - Plain-English errors for curators; details go to the server log. - /api/health and the How it works tab show the model and any fallback. - docs/model-providers.md explains the choice and data protection. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEfa829bf
21 days ago
-
Real-data demo: intake queue, catalogue comparison, private interview data
- Intake queue as the landing page: new submissions first, then released interviews with their catalogue scores, then the synthetic example - Interview status (under review, released, synthetic) in briefs, CLI and UI - Catalogue comparison tab for released interviews: headings found, missed (separating vocabulary gaps from model misses) and extra suggestions with their evidence - Real briefs load from a private Hugging Face dataset at start-up (and on /api/reload), so partner material never enters the code repository - Importer for the museum's released PDF transcripts (speaker initials, page headers and footers), so released interviews skip transcription - Runbook for the two data tracks; data policy and deployment guide updated; Colab notebook takes a status and a donor or catalogue file Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEc1d045b
26 days ago
-
Colab notebook: clone the private repository with a token from Colab secrets
Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE5543653 -
CuratorBot prototype: pipeline, hosted demo and project kit
- curatorbot package: Q/A transcripts, spatio-textual 0.4.1 annotation, period gazetteer with review reasons, Anthropic/OpenAI agent with quote and vocabulary validators, heading back-test, CLI - FastAPI app and viewer for a Hugging Face Docker Space, with passcode- protected live analysis and optional short-clip transcription - Synthetic demonstration interview (DEMO-0001) - Tooling for released interviews: GPU prepare script and Colab notebook - Docs (deployment, data policy, brief schema) and a project kit for the Claude and ChatGPT projects; CI and Space deploy workflows Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE3bf43cb