What Git Does Not Record: Provenance Legibility in Two AI-Assisted Research Repositories
Abstract
Repository traces of AI use in computational research are partially visible and unreliable for measuring involvement, requiring auditable provenance systems.
Publishers and funders increasingly ask authors to disclose how AI tools contributed to a piece of research. In computational work the repository is where an author or an auditor would look for the answer, and we ask what it can actually supply. We audit two single-investigator repositories by the same author in the same field, each carrying a different class of agent residue: a prescriptive trace of standing rule files and a narrative trace of a running agent scratchpad, in repositories of 466 and 103 commits. The two are legible in opposite ways. 85.6% of the lines ever committed to the prescriptive trace are visible at the current revision, and a standing rule states a conclusion and discards the episode behind it; the narrative trace records episodes and shows 21.8%. Counted by revision the gap is far smaller: 15 of the prescriptive trace's 41 revisions leave no visible line, against 18 of the narrative trace's 41. The Co-Authored-By trailer, the field an automated audit reads, is one of three AI trailer keys Project A carries and covers 66 of the 121 commits carrying any. In Project B it has low sensitivity against an explicit within-repository proxy: 39 commits revise a file maintained to hold an agent's working notes and 1 (2.6%) carries the trailer. Project A's repository-level rate is unstable in time too, stepping from 2.7% to 17.7% across a boundary we did not specify in advance. Repository channels disagree, and neither rate can be read as an involvement rate; we do not isolate the cause, and say so. We give a field-by-field account of which provenance claims such traces support, which they cannot, and which they answer confidently and wrongly, construct an auditable evidence ledger, and derive the requirements this places on any system meant to record research provenance as it happens.
Community
What Git Does Not Record: Provenance Legibility in Two AI-Assisted Research Repositories โ examining what version control does not capture about provenance in AI-assisted research, with the accompanying git-provenance-auditor tool linked below.
One commit in 39 carrying the trailer is a striking number. It matches what I'd expect: people disclose when it's easy and skip it when it isn't. Recording provenance as the work happens, instead of reconstructing it from git later, seems like the only version an auditor could trust.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes? (2026)
- What the Window Does Not Contain: Auditing Provenance in a Document-Grounded Instability Benchmark (2026)
- Research-Native by Construction: Minimal Nodes, Re-verifiable Workflows, and Compounding Memory for Long-Horizon Scientific Agents (2026)
- Reproducibility in the Age of Agentic AI: Context Engineering at the Timescale of a Codebase (2026)
- Scan the Skill, Govern the Action: Composing Registry Verdicts with Runtime Consequence Control (2026)
- Tracekit: Tamper-Evident Intent-Reasoning-Action Auditing for AI Agents (2026)
- Who Approved This? Coding Agents, Human Accounts, and Merge-Gate Evidence at a Fintech Startup (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.28655 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper