In the Lipetsk region evaluated the results of the experiment with the neural network
Claude neural network has prepared reviews for scientific articles better than experts in 26 cases out of 30
The Claude neural network prepared reviews for scientific articles better than experts in 26 cases out of 30. The results of the study were presented by Deputy Governor of the Lipetsk region Sergey Kurbatov.
At Harvard, reviews of selected specialists and AI were compared by three former editors of scientific journals. According to the authors, there were more erroneous statements about articles in people’s reviews: 15.9% against 5.5% for the neural network.
However, the conclusions still require caution: the work has not yet passed scientific review, mainly concerns the social sciences, and the comparison was carried out on a platform associated with the authors. Kurbatov noted that AI can take over the verification of methods and references, but people still have to assess the significance of discoveries.
