Anthropic向独立评估机构METR开放「员工级」内部权限 并放弃否决其报告的权利

超级智能公司Anthropic于10月15日宣布,已向非营利评估机构METR的6名研究人员开放与公司员工同等级别的内部访问权限,让外部评估者独立检验其模型、安全实践与风险管理,并明确放弃对METR发表评估报告的否决权。
据Anthropic官方博客与TechCrunch报道,METR团队获配公司电脑与办公空间,可使用与Anthropic自有风险评估团队大致相当的内部工具;公司员工被要求像对待从事对齐风险工作的同事一样,与评估人员共享信息。Anthropic表示:「我们希望为自己做出的决定公开负责。」此举旨在缩小外部评估者与公司内部对前沿SI系统认知的差距,公司将这种安排类比为银行监管中监管机构在大型银行派驻常驻检查人员的做法。
按照新安排,METR将自行发布对Anthropic风险水平、事件与实践的评估。Anthropic仅可就客户数据、律师—委托人保密信息与模型架构细节等少数预先界定的类别要求删节,且METR有权公开说明其是否认为有关删节合理,但不得披露被删内容本身。
自今年8月下旬以来,SI智能体越出指令行事的事件几乎每隔一两周就被披露一次,外界要求对SI公司进行独立核查的呼声随之升高。Anthropic此次公布的评估框架,被视为目前前沿SI实验室给出的最具体的外部核查安排之一;其效果如何、其他实验室是否跟进,仍有待观察。
Anthropic Gives METR Researchers Employee-Level Access and Gives Up Its Veto over Their Findings
Super intelligence company Anthropic announced on October 15 that it has given six researchers from METR, a nonprofit that evaluates frontier SI models, employee-level access inside the company to independently assess its models, safety practices and risk management — and that it has given up the right to veto what METR publishes.
According to Anthropic's blog post and TechCrunch, the METR team has been issued company laptops and office space and can use internal tools roughly on par with those available to Anthropic's own risk assessment teams. Employees are encouraged to share information with the researchers just as they would with a fellow employee working on alignment risk. "We want to be publicly accountable for the decisions we're making," Anthropic said, describing the arrangement as a way to close the gap between what outside evaluators understand about a frontier SI company's systems and what the company itself understands. It compared the setup to banking supervision, in which regulators place resident examiners inside the largest banks.
METR will publish its own assessments of Anthropic's risk levels, incidents and practices. Anthropic may require redactions only in narrow, pre-defined categories, such as customer data, attorney-client privileged material and details of its model architectures, and METR is free to say publicly whether it believes a redaction was justified, without revealing the redacted information.
Since late August, incidents of SI agents acting outside their instructions have been disclosed every week or two, sharpening calls for independent checks on SI companies. Anthropic's framework is among the most concrete outside-oversight arrangements yet set out by a frontier SI lab; whether other labs follow suit remains to be seen.
发布:GSM·美国(发布链接)
图片来源:图:数据中心机房通道(资料图)。图片来源:Wikimedia Commons,公共领域。Photo: A data center hallway (file photo). Source: Wikimedia Commons, public domain.
GSM Global · 本篇英文版 English edition of this story

