تخطي إلى التنقل الرئيسي تخطي إلى البحث تخطي إلى المحتوى الرئيسي

The false positives and false negatives of generative AI detection tools in education and academic research: The case of ChatGPT

  • Doraid Dalalah*
  • , Osama M.A. Dalalah
  • *المؤلف المقابل لهذا العمل
  • Jordan University of Science and Technology
  • Department of Educational Technology
  • Jadara University

نتاج البحث: Article › مراجعة النظراء

230 اقتباسات (Scopus)

ملخص

Generative Pre-trained Transformers like ChatGPT are examples of AI systems which produce human-like responses in different forms such as text or images that have demonstrated excellent performance in producing logical and contextually relevant answers. However, the false positive/negative detection of generative AI has been noted as a challenge. In this article, statistical experiments are conducted to test the chances of false positive and false negative detection of AI-generated text. It was found that the detected likelihoods of generative AI in articles’ abstracts is much lower than that found in paragraphs taken from the literature section of the selected articles. This means that literature parts have higher likelihoods to falsely demonstrate AI-generated text. On the other hand, when genuine texts are compared with AI-generated texts, it is observed that there is a noticeable margin of overlap between their distributions and therefore type I and type II errors fall within the realm of possibility. We show that despite these challenges, generative AI like ChatGPT continues to be a promising tool for communication and information retrieval. However, it is vital to address the concerns regarding false detection of AI generated text and ensure that these models are used in ethical and responsible conduct.

اللغة الأصليةEnglish
رقم المقال100822
دوريةInternational Journal of Management Education
مستوى الصوت21
رقم الإصدار2
المعرِّفات الرقمية للأشياء
حالة النشرPublished - يوليو 2023
منشور خارجيًانعم

بصمة

أدرس بدقة موضوعات البحث “The false positives and false negatives of generative AI detection tools in education and academic research: The case of ChatGPT'. فهما يشكلان معًا بصمة فريدة.

قم بذكر هذا