Anthropic and OpenAI have sought significant control over what outside evaluators can publish, concerned that findings could reveal trade secrets, according to two people familiar with the discussions.
\n\nAnthropic CEO Dario Amodei said last month that external evaluators should have the right to publish key findings ”without editorial control.” OpenAI agreed days later, saying assessors should have “editorial independence.”
\n\nThe AI companies are worried that evaluator staff working inside the companies’ walls as part of so-called embedded evaluation could take proprietary information to rivals, according to the people, who declined to be named as the matter was private.
\n\nMeasures under discussion to prevent intellectual-property leaks include having lab employees observe embedded teams as they work and preventing evaluators embedded at one lab from working at another simultaneously, one of the people added.
\n\nBut what labs consider crucial intellectual property can overlap with information relevant to judging a model’s risk, which can lead to arguments and redactions, said a separate person with knowledge of past dealings with the labs.
\n\nExperts have said independence of evaluators is a concern as Anthropic and OpenAI choose who gets to carry out the reviews. Reuters is reporting details of these negotiations between the evaluators and…
Original source: https://www.cnbctv18.com/technology/
