A new standard called AEF-1 has been introduced to govern how independent third parties assess AI models. xAI, OpenAI, and Anthropic have all signed on as supporters of the effort. The move signals growing industry coordination around external evaluation practices.
Google DeepMind says it is running the first double-blind evaluation setup for AI systems, hiding the identities of both the model being tested and the reviewers. The approach is meant to reduce bias when humans judge model outputs. Few details were given about scope or timeline.
WHY IT MATTERS ↘Double-blind evaluation could make AI benchmarks and safety claims more credible by reducing reviewer and brand bias, raising the evidentiary bar for labs that rely on self-reported or non-blinded results. If it becomes standard, expect higher evaluation costs and slower release cycles, but also stronger leverage for third-party auditors and regulators demanding comparable evidence.