← Back to the board · Multi-lab · Table

Multi-lab transparency Partial ⚠ contested

Publicly report model capabilities and limitations (2023 voluntary commitments)

Under the White House voluntary AI commitments (2023-07-21), signatories pledged to publish reports for significant model releases covering capabilities, limitations, and domains of appropriate and inappropriate use.

  1. Committed 2023-07-21
  2. Due publish a capabilities/limitations report with each significant model release
  3. Evaluated 2025-08-11
  4. Ruling partial

Why this ruling

Shallow disclosure is near-universal — frontier labs publish system/model cards for major releases — but the 2025 study found deeper indicators (limitations, societal-risk discussion, adversarial-test results) met inconsistently. Recorded as partial; contested because the basic reporting bar is broadly met while the substantive bar is not.

Source
Wang, Huang, Klyman & Bommasani (AIES 2025) ↗
Committed
2023-07-21
As of
2026-06-19
Contested
This ruling is genuinely disputable.

Cite this commitment

Overdue. "Publicly report model capabilities and limitations (2023 voluntary commitments)." Overdue, 2025. https://overduetracker.org/c/wh-voluntary-capability-reporting-2023 (retrieved 2026-06-19).