Strengths, Weaknesses, Opportunities, and Threats of Using ChatGPT in Scientific Research
DOI:
https://doi.org/10.46328/ijte.618Keywords:
AI Ethics, Artificial Intelligence, ChatGPT, Large Language Model, Prompt Engineering, Scientific Research, SWOT AnalysisAbstract
The versatility of ChatGPT extends across diverse domains, including scientific research. This study delves into the transformative prospects of integrating ChatGPT into scientific research, achieved through a SWOT analysis. The analysis explores the model's strengths, which encompass a vast knowledge base, language proficiency, information retrieval, and the capacity for continuous learning. Conversely, it exposes its weaknesses, including a lack of contextual understanding, potential overreliance on training data, limitations in verifying information, and constrained critical thinking abilities. Amidst these factors, opportunities arise, such as facilitating literature reviews, fostering collaborative brainstorming, enabling seamless language translation and interpretation, and amplifying knowledge dissemination. Nonetheless, a spectrum of threats looms, encompassing concerns related to plagiarism, ethical quandaries, the propagation of misinformation, and even the potential erosion of higher-order cognitive thinking. These multifaceted aspects necessitate comprehensive consideration. Recommendations for researchers embarking on ChatGPT integration include a balanced approach that harmonizes AI and human ingenuity, thereby upholding research integrity. The potential of ChatGPT to reshape scientific inquiry can only be realized through conscientious use and ongoing oversight.References
AlAfnan, M. A., Dishari, S., Jovic, M., & Lomidze, K. (2023). ChatGPT as an educational tool: Opportunities, challenges, and recommendations for communication, business writing, and composition courses. Journal of Artificial Intelligence and Technology 3(2), 60–68. https://doi.org/10.37965/jait.2023.0184
Alkaissi, H., & McFarlane, S. (2023). Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus, 15(2), e35179. https://doi.org/10.7759/cureus.35179
Arvanitis, L., Sadeghi, M., & Brewster, J. (2023, March). Despite OpenAI’s promises, the company’s new AI tool produces misinformation more frequently, and more persuasively, than its predecessor. NewsGuard. https://www.newsguardtech.com/misinformation-monitor/march-2023/
Azaria, A., Azoulay, R., & Reches, S. (2023). ChatGPT is a remarkable tool for experts. arXiv. https://doi.org/10.48550/arXiv.2306.03102
Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., ... & Fung, P. (2023). A multitask, multilingual, multimodal evaluation of ChatGPT on reasoning, hallucination, and interactivity. arXiv. https://doi.org/10.48550/arXiv.2302.04023
Benzaghta, M. A., Elwalda, A., Mousa, M. M., Erkan, I., & Rahman, M. (2021). SWOT analysis applications: An integrative literature review. Journal of Global Business Insights, 6(1), 55-73. https://www.doi.org/10.5038/2640-6489.6.1.1148
Bin-Hady, W.R.A., Al-Kadi, A., Hazaea, A. and Ali, J.K.M. (2023). Exploring the dimensions of ChatGPT in english language learning: A global perspective. Library Hi Tech. https://doi.org/10.1108/LHT-05-2023-0200
Chowdhury, N., & Rahman, S. (2023). A brief review of ChatGPT: Limitations, challenges and ethical-social implications. Chongqing University of Posts and Telecommunications. https://doi.org/10.5281/zenodo.7629888
Chubb, J., Cowling, P. & Reed, D. (2022). Speeding up to keep up: Exploring the use of AI in the research process. AI & Society 37, 1439–1457. https://doi.org/10.1007/s00146-021-01259-0
Dale, R. (2021). GPT-3: What’s it good for?. Natural Language Engineering, 27(1), 113-118. https://doi.org/10.1017/S1351324920000601
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023). ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health. Frontiers in Public Health, 11, 1166120. https://doi.org/10.3389/fpubh.2023.1166120
Dehouche, N. (2021). Plagiarism in the age of massive Generative Pre-trained Transformers (GPT-3). Ethics in Science and Environmental Politics, 21, 17-23. https://doi.org/10.3354/esep00195
DeRose, A. (2023, May 20). These companies have banned or limited ChatGPT at work. https://www.hr-brew.com/stories/2023/05/11/these-companies-have-banned-chatgpt-in-the-office
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., ... & Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
Eaton, S. E. (2023). https://www.universityworldnews.com/post.php?story=20230228133041549
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1-15. https://doi.org/10.1080/14703297.2023.2195846
Frey, C.B., & Osborne, M.A. (2017). The future of employment: How susceptible are jobs to computerisation?. Technological Forecasting and Social Change, 114, 254-280. https://doi.org/10.1016/j.techfore.2016.08.019
Furman, J., & Seaman, R. (2019). AI and the economy. Innovation Policy and the Economy, 19(1), 1-191. https://www.journals.uchicago.edu/doi/epdf/10.1086/699936
Gao, Y., Wang, R., & Hou, F. (2023). Unleashing the power of ChatGPT for translation: An empirical study. arXiv. https://doi.org/10.48550/arXiv.2304.02182
Gilson, A., Safranek, C.W., Huang, T., Socrates, V., Chi, L., Taylor, R.A., & Chartash, D. (2023). How does ChatGPT perform on the United States Medical Licensing Examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education 9. https://doi.org/10.2196/45312
Giray, L. (2023). Prompt engineering with ChatGPT: A guide for academic writers. Annals of Biomedical Engineering, 1-5. https://doi.org/10.1007/s10439-023-03272-4
Goodin, D. (2023). Hackers are selling a service that bypasses ChatGPT restrictions on malware. https://arstechnica.com/information-technology/2023/02/now-open-fee-based-telegram-service-that-uses-chatgpt-to-generate-malware
Helms, M. M., & Nixon, J. (2010). Exploring SWOT analysis–where are we now? A review of academic research from the last decade. Journal of strategy and management, 3(3), 215-251. https://doi.org/10.1108/17554251011064837
Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: writing better scientific review articles. American Journal of Cancer Research, 13(4), 1148. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/pdf/ajcr0013-1148.pdf
Iskender, A. (2023). Holy or unholy? Interview with open AI’s ChatGPT. European Journal of Tourism Research, 34, 3414-3414. https://doi.org/10.54055/ejtr.v34i.3169
Jain, S., & Jain, R. (2019). Role of artificial intelligence in higher education: An empirical investigation. International Journal of Research and Analytical Reviews, 6(2), 144-150. http://ijrar.com/upload_issue/ijrar_issue_20544069.pdf
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., ... & Fung, P. (2023). Survey of hallucination in natural language generation. arXiv. https://doi.org/10.48550/arXiv.2202.03629
Jiao, W., Wang, W., Huang, J. T., Wang, X., & Tu, Z. P. (2023). Is ChatGPT a good translator? Yes with GPT-4 as the engine. arXiv. https://doi.org/10.48550/arXiv.2301.08745
Kalla, D., & Smith, N. (2023). Study and analysis of ChatGPT and its impact on different fields of study. International Journal of Innovative Science and Research Technology, 8(3), 827-833. https://ssrn.com/abstract=4402499
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. arXiv. https://doi.org/10.35542/osf.io/5er8f
Kengam, J. (2020). Artificial intelligence in education. Bournemouth University. http://dx.doi.org/10.13140/RG.2.2.16375.65445
Khalil, M., & Er, E. (2023). Will ChatGPT get you caught? Rethinking of plagiarism detection. arXiv. https://doi.org/10.48550/arXiv.2302.04335
Khan, S. (2023, June 15). Ethical implications of ChatGPT: Misinformation, manipulation, and biases. YourStory. https://yourstory.com/2023/05/ethical-implications-of-chatgpt-language-processing-misinformation
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, https://doi.org/10.1177/00336882231162868
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., & Tseng, V. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digital Health, 2(2), e0000198. https://doi.org/10.1371/journal.pdig.0000198
Lyu, C., Xu, J., & Wang, L. (2023). New trends in machine translation using large language models: Case examples with ChatGP. arXiv. https://doi.org/10.48550/arXiv.2305.01181
Mauran, C. (2023, May 2). Samsung bans ChatGPT, AI chatbots after data leak blunder. https://mashable.com/article/samsung-chatgpt-leak-leads-to-employee-ban
McGee, R. (2023). Is ChatGPT biased against conservatives? An empirical study. Social Science Research Network. http://dx.doi.org/10.2139/ssrn.4359405
Mijwil, M., Aljanabi, M., & Ali, A. H. (2023). ChatGPT: Exploring the role of cybersecurity in the protection of medical information. Mesopotamian Journal of Cybersecurity, 18-21. http://dx.doi.org/10.58496/MJCS/2023/004
Naik, N., Hameed, B.M.Z., Shetty, D.K., Swain, D., Shah, M., Paul, R., Aggarwal, K., Ibrahim, S., Patil, V., Smriti, K., Shetty, S., Rai, B.P., Chlosta, P., & Somani, B.K. (2022). Legal and ethical consideration in artificial intelligence in healthcare: Who takes responsibility?. Frontiers in Surgery 9. https://doi.org/10.3389/fsurg.2022.862322
Nandalwar, J., Vinay, S., Pallavi, P., & Priti, K. (2023). An intelligent approach for automating data inputs on web portals for several apex / statutory bodies in the field education using robotics. and machine learning. International Journal for Multidisciplinary Research 5(3). https://doi.org/10.36948/ijfmr.2023.v05i02.2397
Opara, E., Mfon-Ette Theresa, A., & Aduke, T. C. (2023). ChatGPT for teaching, learning and research: Prospects and challenges. Global Academic Journal of Humanities and Social Sciences, 5(2), 33-40. https://doi.org/10.36348/gajhss.2023.v05i02.001
Qasem, F. (2023). ChatGPT in scientific and academic research: Future fears and reassurances. Library Hi Tech News 40(3), 30-32. https://doi.org/10.1108/LHTN-03-2023-0043
Rahimi, F., Abadi, A.T.B. (2023). ChatGPT and publication ethics. Archives of Medical Research 54(3), 272-274. https://doi.org/10.1016/j.arcmed.2023.03.004
Rahman, M., Terano, H. J. R., Rahman, N., Salamzadeh, A., & Rahaman, S. (2023). ChatGPT and academic research: A review and recommendations based on practical examples. Journal of Education, Management and Development Studies, 3(1), 1-12. https://doi.org/10.52631/jemds.v3i1.175
Rahman, M., Terano, H. J. R., Rahman, N., Salamzadeh, A., & Rahaman, S. (2023). ChatGPT and academic research: A review and recommendations based on practical examples. Journal of Education, Management and Development Studies, 3(1), 1-12. https://doi.org/10.52631/jemds.v3i1.175
Roumeliotis, K.I., & Tselikas, N.D. (2023). ChatGPT and open-ai models: A preliminary review. Future Internet 15(6), 192. https://doi.org/10.3390/fi15060192
Rozado, D. (2023). The political biases of ChatGPT. Social Sciences, 12(3), 148. https://doi.org/10.3390/socsci12030148
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of Applied Learning & Teaching, 6(1), 342-363. https://doi.org/10.37074/jalt.2023.6.1.9
Santra, P. P., & Majhi, D. (2023). Scholarly Communication and Machine-Generated Text: Is it Finally AI vs AI in Plagiarism Detection?. Journal of Information and Knowledge, 173-181. https://doi.org/10.17821/srels%2F2023%2Fv60i3%2F171028
Shidaganti, G., Sanjana, R., Shuubeksh, K., Monish Raman, V.R., & Thakshith, V. (2023). ChatGPT: Information retrieval from image using robotic process automation and ocr. 2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2023, pp. 1264-1270. https://doi.org/10.1109/ICICCS56967.2023.10142461.
Simpson, D. (2023). Educators, students, and plagiarism in age of AI. BMJ, 381. https://doi.org/10.1136/bmj.p1403
Stojanov, A. (2023). Learning with ChatGPT 3.5 as a more knowledgeable other: An autoethnographic study. International Journal of Educational Technology in Higher Education 20, 35 (2023). https://doi.org/10.1186/s41239-023-00404-7
Strubell, E., Ganesh, A., & McCallum, A. (2019). Energy and policy considerations for deep learning in NLP. In the 57th Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.48550/arXiv.1906.02243
Ufuk, F. (2023). The role and limitations of large language models such as ChatGPT in clinical settings and medical journalism. Radiology, 307(3), e230276. https://doi.org/10.1148/radiol.230276
Van der Vorst, T., & Jelicic, N. (2019). Artificial Intelligence in Education: Can AI bring the full potential of personalized learning to education? [Paper presentation]. 30th European Conference of the International Telecommunications Society. Finland. https://www.econstor.eu/bitstream/10419/205222/1/van-der-Vorst-Jelicic.pdf
Wardat, Y., Tashtoush, M. A., AlAli, R., & Jarrah, A. M. (2023). ChatGPT: A revolutionary tool for teaching and learning mathematics. Eurasia Journal of Mathematics, Science and Technology Education, 19(7), e2286. https://doi.org/10.29333/ejmste/13272
Wu, T., He, S., Liu, J., Sun, S., Liu, K., Han, Q-L., A & Tang, Y. (2023). Brief overview of ChatGPT: The history, status quo and potential future development. in IEEE/CAA Journal of Automatica Sinica, 10(5), 1122-1136. https://doi.org/10.1109/JAS.2023.123618
Zhai, X. (2022). ChatGPT user experience: Implications for education. https://dx.doi.org/10.2139/ssrn.4312418
Downloads
Published
Issue
Section
License
Articles may be used for research, teaching, and private study purposes. Authors alone are responsible for the contents of their articles. The journal owns the copyright of the articles. The publisher shall not be liable for any loss, actions, claims, proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of the research material.
The author(s) of a manuscript agree that if the manuscript is accepted for publication in the International Journal of Technology in Education (IJTE), the published article will be copyrighted using a Creative Commons “Attribution 4.0 International” license. This license allows others to freely copy, distribute, and display the copyrighted work, and derivative works based upon it, under certain specified conditions.
Authors are responsible for obtaining written permission to include any images or artwork for which they do not hold copyright in their articles, or to adapt any such images or artwork for inclusion in their articles. The copyright holder must be made explicitly aware that the image(s) or artwork will be made freely available online as part of the article under a Creative Commons “Attribution 4.0 International” license.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
