Spaces:
Running
Running
Commit History
7 days ago
-
Condition C harvest: find test interviews by record number or title as well as accession number
The EHRI export does not carry the accession numbers the catalogue files use, so nothing was excluded. Test interviews are now matched by accession number, the irn record number in the catalogue URL, or exact title (which also catches a second record of the same interview); excluded records are listed. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEc7c7f6c -
Evaluation condition C: vocabulary from the rest of the catalogued collection
scripts/harvest_ehri_headings.py reads the EHRI portal's EAD export of a collection (USHMM oral histories, about 1,150 interviews), collects each interview's subject, place, corporate and genre headings, leaves out the interviews under test, and writes a vocabulary with a report of how many of each test interview's headings remain available. CURATORBOT_VOCABULARY replaces the bundled demo list with such a file (or, later, an authority export). Method notes for conditions A, B and C in the evaluation log. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE15f22eb -
Compare: place names stop at sentence ends; evaluation log: end-to-end test E1
The place-name check read capitalised words across a full stop ("Warsaw. There"), so one place was counted several times and reported as missed. Names are now read within sentences and one place said in several forms counts once. E1 results logged: the Kochalski interview from the six Box video parts, analysed from the automatic transcript. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEf8b32e0 -
Progress reports for the analysis step
Analysing a three-hour transcript takes several minutes with no output. It now reports each stage: loading the language model, finding places, people and events turn by turn (with the time left), the model drafting the brief (a "still working" line every 30 seconds until it answers), checking quotes and headings, and placing. The notebook's analyse cell keeps the latest state in <ID>/out/progress.json like the transcription cell. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE8c6b0a2 -
Transcription on GPU: provide the CUDA 12 libraries faster-whisper needs
Colab's system CUDA is now newer than the CUDA 12 that faster-whisper's engine (CTranslate2) is built for, so libcublas.so.12 was missing at the first GPU step. The setup cell installs nvidia-cublas-cu12 and cuDNN 9 from pip; CuratorBot loads them before the speech model, and the notebook also puts them on LD_LIBRARY_PATH for the run. A missing GPU library during transcription now gets the same explanation as one during model loading. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEdca0e6c -
Transcription: decode audio without PyAV so current Colab works
faster-whisper's own decoder passes an argument that newer PyAV releases no longer accept, so transcription stopped right after loading the model. The audio (already a 16 kHz mono WAV from media.prepare) is now read with the standard library, other files through ffmpeg, and handed to faster-whisper as samples; language detection reuses the same samples. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE0d5453b -
Progress reports for long runs; notebook shows command output and the real error
- New curatorbot/progress.py: timestamped stage lines and a progress.json. - Audio extraction reports each part; transcription reports every 30 s with the time left; language detection reports its stretches. - A speech model that will not load says whether GPU libraries are the cause. - prepare_interview.py --progress-file; the notebook keeps progress in Drive (<ID>/out/progress.json) and streams command output, so failures show their reason instead of only an exit code. - Runbook: progress, and Lancaster's Hex cluster for larger batches. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE34aa951 -
Take Box deliveries as they come: inventory, recordings at any depth, batch notebook
- New curatorbot/intake.py and 'curatorbot inventory': one entry per submission folder, recordings found at any depth, missing parts, other files, durations; ids from accession numbers (with -BOX) or folder names. - prepare_interview.py --media accepts folders. - Notebook rewritten around CuratorBot/box/ (Box folders as downloaded): inventory, choose submissions, transcribe (resumable), analyse as-is or after review, compare; spaces in folder names handled. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE68f1146
8 days ago
-
End-to-end path: Colab notebook for recordings, transcript comparison, faster language ID
- notebooks/prepare_on_colab.ipynb rewritten: new id for the Box copy, evaluation settings, transcript saved to Drive at once, analyse as-is or after review, compare with the museum transcript. - New 'curatorbot compare': WER (jiwer), turns, and how many place names in the reference narrator turns survive automatic transcription. - Language ID once per 30-second stretch instead of per chunk (a few hundred passes for a three-hour interview, not thousands). - Rule headings ranked after the model's in the back-test. - Runbook section D and evaluation-log section E1 for the end-to-end test. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAEcf6fdf5 -
Heading limit 20, phonetic place names, unnamed places counted separately
- CURATORBOT_MAX_HEADINGS (default 20, was a fixed 12); back-test adds the model's own R-precision. - Places marked '(ph)' are matched approximately (sound swaps, then close spellings in the collection's countries) and flagged uncertain with the spelling heard. GeoNames index widened to places of 500+ people in those countries; nearest place to a named anchor wins ties. - Journeys with unnamed places are labelled 'Not named in the testimony' and counted apart from named places not found. - Docs: protocol v4 in the evaluation log, schema, .env example. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE162cea3 -
Places, headings and scoring improvements from the first evaluation
Places - New curatorbot/places.py: period gazetteer first, then GeoNames towns (offline, diacritic-insensitive, alternate names), then approximate placement near a place the narrator names ('Pomortsy, near Lodz') or at a country centre. Each place records its source and precision. - Journeys gain fromNear/toNear; none is dropped silently: unplaced ends are shown as 'Not placed: needs a curator'. Coverage counts per brief. - Map frames the journeys, avoids label collisions, marks approximate places with dashed rings and points off-map arrows towards their destination. Headings - Prompt covers the whole life, pairs specific and broader place headings, and leaves generic form headings to a rule. - Form headings proposed by rule (data/form_headings.json), using a grounded narrator-gender quote; labelled 'Added by rule' in the viewer. Vocabulary and scoring - Base vocabulary: bare chronological terms removed, current 'Jewish ghettos--' forms, generic form headings added. E…3861ad6 -
Validators: match headings ignoring a final full stop; count bad quotes and out-of-vocabulary headings separately
- 'Poland--Emigration and immigration' was stopped because the vocabulary form ends with a full stop. Headings now match ignoring case, spacing and a final full stop, and are stored in the vocabulary's own form. - validation now records quotes_rejected and out_of_vocabulary as well as the combined 'rejected'; How it works shows both. - New 'curatorbot revalidate' command reapplies the validators and the back-test to a saved brief without a model call. - The page now loads the viewer's script and styles with a version tag, so browsers pick up a new deploy without a hard refresh. - Evaluation log: corrected the quote claim and explained the stopped item. Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE05cb6a1
27 days ago
-
CuratorBot prototype: pipeline, hosted demo and project kit
- curatorbot package: Q/A transcripts, spatio-textual 0.4.1 annotation, period gazetteer with review reasons, Anthropic/OpenAI agent with quote and vocabulary validators, heading back-test, CLI - FastAPI app and viewer for a Hugging Face Docker Space, with passcode- protected live analysis and optional short-clip transcription - Synthetic demonstration interview (DEMO-0001) - Tooling for released interviews: GPU prepare script and Colab notebook - Docs (deployment, data policy, brief schema) and a project kit for the Claude and ChatGPT projects; CI and Space deploy workflows Claude-Session: https://claude.ai/code/session_01AteuhwysR4rHp4fqUteLAE3bf43cb