Challenges and Limitations of Using Artificial Intelligence Generated Content (AIGC) with ChatGPT in Programming Curriculum: A Systematic Literature Review

TLDR

Key issues identified included increased plagiarism risk due to AI-generated unique code, accuracy and reliability concerns of AI outputs, privacy and data security risks, curriculum changes to incorporate prompt engineering and critical thinking, and challenges in traditional assessment methods.

Abstract

This systematic literature review examined the challenges and limitations of integrating Artificial Intelligence Generated Content (AIGC) tools into programming curricula. Following Kitchenham's framework, a comprehensive search was conducted across ACM Digital Library and Web of Science databases to select 22 relevant peer-reviewed papers. Key issues identified included increased plagiarism risk due to AI-generated unique code, accuracy and reliability concerns of AI outputs, privacy and data security risks, curriculum changes to incorporate prompt engineering and critical thinking, and challenges in traditional assessment methods. Additionally, the review highlighted the potential over-reliance on AI tools, which could hinder the development of fundamental programming skills. Implementation challenges and inadequate training for educators further complicate the integration process. Addressing these challenges is crucial for leveraging the benefits of AIGC tools while maintaining academic integrity and enhancing learning outcomes in programming education. Future research should focus on developing strategies to mitigate these issues and ensure the responsible use of AI in education.