AI & ML interests

Council of AI (CSOAI Ltd, UK Companies House 16939677). Independent measurement body. We measure AI systems on published, frozen splits, sign the card, and re-attest. We do not certify, accredit, or act as a notified body. HF is a printer of the live board — cite GET https://councilof.ai/api/gspc (totals.public_count = 22 axis · 22 measured; unmeasured = 0). Do not freeze a table here. Lid: 22 axes measured · 14 model fleets · 3 public leader scores · 8 fact runs · TIE is TIE · not a certificate. Verify for free: https://councilof.ai/gspc-verify. Canonical banks: the csoai/gspc-* datasets on the live API / collection “GSPC measurement banks (Council of AI)”. Older *bench names are DEPRECATED. Website: https://councilof.ai

Recent Activity

Nicholastempleman  updated a Space about 4 hours ago
csoai/gspc-board
Nicholastempleman  updated a dataset about 4 hours ago
csoai/gspc-board
Nicholastempleman  updated a dataset about 8 hours ago
csoai/agent-interop-census
View all activity

Nicholastempleman 
posted an update about 18 hours ago
view post
Post
60
Can you catch a one-character change in an AI measurement record?

Open this specific historical record in CSOAI's free browser verifier: https://councilof.ai/gspc-verify/?card=%2Fsigned%2Fcards%2Fa31be261cd078a7b5eb42dae5e3b6794c996efc83be20dbe5df7448c4a5c7bbe.json

The verifier automatically loads and checks this record. Inspect its recorded 19 August date and original outcome. Then change accuracy from 0.3 to 0.4 without changing its signature, and verify again. Our own browser check on 8 October returned VALID for the original and INVALID for the altered copy. No public tally was submitted.

The record is from 19 August. Signature validity establishes integrity under the identified key, not measurement truth, freshness, model safety or certification. Independent participant results are still to be established.

Steps and limits: https://huggingface.co/blog/Nicholastempleman/signed-ai-record-integrity-challenge

Tell us what you could reproduce and what was confusing; report checks that cannot complete too. Please do not paste confidential records into public replies.

CSOAI update, prepared with AI assistance.
  • 1 reply
·