Anthropic grants outside evaluator METR employee-level access in AI safety push – CNBC TV18

Anthropic has given nonprofit METR employee-level access to its systems and is in talks with others including Hugging Face, as AI companies pitch external evaluators as a way to safely advance the technology without slowing its development.

\n\n

The developer of Claude models is also working with biosecurity nonprofit SecureBio and Accenture's AI business Faculty as evaluators, it said in a blog post on Thursday.

\n\n

Reuters exclusively reported earlier this week that Anthropic and OpenAI had sought significant control over what outside reviewers could publish, concerned that the findings could leak trade secrets.

\n\n

A person familiar with the matter told Reuters that talks with Anthropic had evolved recently, with the company becoming more open in negotiations.

\n\n

A key sticking point between evaluators and AI labs is that information the companies might consider crucial intellectual property can also be relevant to assessing a model's risks, leading to disputes and redactions, a separate person familiar with the discussions told Reuters.

\n\n

Experts have also said the independence of evaluators is a concern, as Anthropic ​and OpenAI choose who gets to carry out the reviews.

\n\n

The outcome of the talks ⁠will help determine how the world scrutinizes a technology that some of its creators warn…

Original source: https://www.cnbctv18.com/technology/

Leave a Reply

Your email address will not be published. Required fields are marked *