Assessing Concepts, Procedures, and Cognitive Demand of ChatGPT-generated Mathematical Tasks

Bima Sapkota, Liza Bondurant
1430 148

Abstract


In November 2022, ChatGPT, an Artificial Intelligence (AI) large language model (LLM) capable of generating human-like responses, was launched. ChatGPT has a variety of promising applications in education, such as using it as thought-partner in generating curricular resources. However, scholars also recognize that the use of ChatGPT raises concerns, such as outputs that are inaccurate, nonsensical, or vague. We, two mathematics teacher educators, engaged in a collaborative self-study using qualitative descriptive approaches to investigate the procedures, concepts, and cognitive demand of ChatGPT-generated mathematical tasks focused on fraction multiplication using the area model approach. We found that the ChatGPT-generated tasks were mostly procedural and not cognitively demanding. Moreover, despite ten variations of input prompts, ChatGPT did not produce any tasks that used the area model approach for fraction multiplication. Rather, it generated tasks focused on procedural approaches. Alarmingly, some tasks were conceptually and/or procedurally inaccurate and vague. We suggest that educators cannot fully rely on ChatGPT to generate cognitively demanding fraction multiplication tasks using the area model. We offer recommendations for educators’ strategic use of ChatGPT to generate cognitively demanding mathematical tasks.


Keywords


Fraction multiplication, Area model, Mathematical tasks, ChatGPT

Full Text:

PDF

References


Sapkota, B. & Bondurant, L. (2024). Assessing concepts, procedures, and cognitive demand of ChatGPT-generated mathematical tasks. International Journal of Technology in Education (IJTE), 7(2), 218-238. https://doi.org/10.46328/ijte.677




DOI: https://doi.org/10.46328/ijte.677

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Abstracting/Indexing

Web of Science (ESCI) Index                        

                                    

  

International Journal of Technology in Education (IJTE) - ISSN:2689-2758

affiliated with

International Society for Technology, Education and Science (ISTES)

www.istes.org


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.