← Back to the board · Multi-lab · Table

Multi-lab transparency Partial ⚠ contested ⚠ under review

Publicly report model capabilities and limitations (2023 voluntary commitments)

Under the White House voluntary AI commitments (2023-07-21), signatories pledged to publish reports for significant model releases covering capabilities, limitations, and domains of appropriate and inappropriate use.

  1. Committed 2023-07-21
  2. Due publish a capabilities/limitations report with each significant model release
  3. Evaluated 2025-08-11
  4. Ruling Partial

Why this ruling

Shallow disclosure is near-universal — frontier labs publish system/model cards for major releases — but the 2025 study found deeper indicators (limitations, societal-risk discussion, adversarial-test results) met inconsistently. Recorded as partial; contested because the basic reporting bar is broadly met while the substantive bar is not.

Sources
The White House (archive) ↗ · archived
Wang, Huang, Klyman & Bommasani (AIES 2025) (fulfillment) ↗
Committed text
“publicly report model or system capabilities, limitations, and domains of appropriate and inappropriate use”
Committed
2023-07-21
Reviewed
2026-06-19
Contested
This ruling is genuinely disputable.

Cite this commitment

copy-paste
Overdue. "Publicly report model capabilities and limitations (2023 voluntary commitments)." Overdue, 2025. https://overduetracker.org/c/wh-voluntary-capability-reporting-2023 (retrieved 2026-08-05).