MIT Logo

A comparison of ChatGPT-generated articles with human-written articles

Abstract:

This scientific article poses a comparison of artificially-generated vs. human-generated articles. The artificially-generated articles were created by ChatGPT, a well-known entity produced by OpenAI. However, with use many have discovered that it makes significant errors in output and therefore should not truly be relied upon. The articles were independently analysed by two fellowship-trained musculoskeletal radiologists and graded from 1 to 5 (1 being bad and inaccurate to 5 being excellent and accurate).

“In total, 4 of the 5 articles written by ChatGPT were significantly inaccurate with fictitious references. One of the papers was well written, with a good introduction and discussion; however, all references were fictitious.” Therefore the ChatGPT proved that they could not measure up to text created by humans in its attempt to accurately cite references.

Author:
Ariyaratne, S., Iyengar, K.P., Nischal, N.
Year:
2023
Domain:
Dimension:
Region:
Data Type: ,
Keywords: , ,
MIT Political Science
MIT Political Science
ECIR
GSS