생성형 인공지능의 공학 문제 풀이 성능 연구-기계설계 분야 적용 사례

• 영문명: A Study on Engineering Problem-Solving Performance of Generative AI: An Application Case in the Field of Mechanical Design
• 발행기관: 한국공학교육학회
• 저자명: 김충환(Chung-Hwan Kim)
• 간행물 정보: 『공학교육연구』제28권 제2호, 27~36쪽, 전체 10쪽
• 주제분류: 공학 > 기타공학
• 파일형태: PDF
• 발행일자: 2025.03.31

국문 초록

This study evaluated the performance of generative AI in solving mechanical engineering problems and its potential for improvement via error compensation. The research used questions from the civil servants competitive exam and the selection exam for secondary school level teachers to conduct experiments using Zero-shot(questions only) and Few-shot(questions and related contents) prompts. The study employed a controlled group pretest-posttest experimental design for the civil service exams and a single group post-test design for the secondary teacher exam. The results using Google's NotebookLM indicated that Zero-shot prompts yielded a correct answer rate of 60-75% on the civil servants exams, while Few-shot prompts yielded 88%-95%, a 25% and 24% rise for grade 7 and 9 exams, respectively. The Few-shot prompts significantly improved the accuracy, with a 40% increase in the secondary teacher exam. The study concludes that providing relevant materials through Few-shot prompts is crucial when using generative AI for engineering problem-solving. It also emphasizes the importance of verifying the reliability of the information provided and validating the AI's results. This highlights the necessity for accurate and trustworthy information when students or educators use generative AI for self-directed learning in engineering problem-solving.

목차

Ⅰ. 서 론

Ⅱ. 이론적 배경

Ⅲ. 실험 설계

Ⅳ. 실험 결과 및 분석

Ⅴ. 결론 및 논의, 제언

참고문헌

키워드

Engineering graduates Decision tree analysis Major-job match Horizontal mismatch Gender