paper-with-me

홈 › Papers

Benefits and Risks of Using ChatGPT4 as a Teaching Assistant for Computer Science Students

2024-11-08 · Yaiza Aragonés-Soria, Julia Kotovich, Chitsutha Soomlek, Manuel Oriol

Upon release, ChatGPT3.5 shocked the software engineering community by its ability to generate answers to specialized questions about coding. Immediately, many educators wondered if it was possible to use the chatbot as a support tool that helps students answer their programming questions. This article evaluates this possibility at three levels: fundamental Computer Science knowledge (basic algorithms and data structures), core competency (design patterns), and advanced knowledge (quantum computing). In each case, we ask normalized questions several times to ChatGPT3.5, then look at the correctness of answers, and finally check if this creates issues. The main result is that the performances of ChatGPT3.5 degrades drastically as the specialization of the domain increases: for basic algorithms it returns answers that are almost always correct, for design patterns the generated code contains many code smells and is generally of low quality, but it is still sometimes able to fix it (if asked), and for quantum computing it is often blatantly wrong.

📄 PDF Abstract BibTeX arXiv:2411.16690

Code (0)

등록된 구현이 없습니다.

Tasks

Chatbot

Similar Papers 제목 키워드 기반

Utilizing ChatGPT in a Data Structures and Algorithms Course: A Teaching Assistant's Perspective

2024-10-11 · Pooriya Jamie, Reyhaneh Hajihashemi, Sharareh Alipour

Integrating large language models (LLMs) like ChatGPT into computer science education offers transformative potential for complex courses such as data structures and algorithms (DSA). This study examines ChatGPT as a sup…

Problem Decomposition

Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?

2023-12-12 · Anishka, Atharva Mehta, Nipun Gupta, Aarav Balachandran 외

The emergence of Large language models (LLMs) is expected to have a major impact on education. This paper explores the potential of using ChatGPT, an LLM, as a virtual Teaching Assistant (TA) in an Introductory Programmi…

Jill Watson: A Virtual Teaching Assistant powered by ChatGPT

2024-05-17 · Karan Taneja, Pratyusha Maiti, Sandeep Kakar, Pranav Guruprasad 외

Conversational AI agents often require extensive datasets for training that are not publicly released, are limited to social chit-chat or handling a specific domain, and may not be easily extended to accommodate the late…

Do AI assistants help students write formal specifications? A study with ChatGPT and the B-Method

2025-01-20 · Alfredo Capozucca, Daniil Yampolskyi, Alexander Goldberg, Maximiliano Cristiá

This paper investigates the role of AI assistants, specifically OpenAI's ChatGPT, in teaching formal methods (FM) to undergraduate students, using the B-method as a formal specification technique. While existing studies …

Student Mastery or AI Deception? Analyzing ChatGPT's Assessment Proficiency and Evaluating Detection Strategies

2023-11-27 · Kevin Wang, Seth Akins, Abdallah Mohammed, Ramon Lawrence

Generative AI systems such as ChatGPT have a disruptive effect on learning and assessment. Computer science requires practice to develop skills in problem solving and programming that are traditionally developed using as…