Strengths, Weaknesses, Opportunities, and Threats of Using ChatGPT in Scientific Research

Louie Giray; Jomarie Jacob; Daxjhed Louis Gumalin

doi:10.46328/ijte.618

Strengths, Weaknesses, Opportunities, and Threats of Using ChatGPT in Scientific Research

Louie Giray, Jomarie Jacob, Daxjhed Louis Gumalin

806 228

Abstract

The versatility of ChatGPT extends across diverse domains, including scientific research. This study delves into the transformative prospects of integrating ChatGPT into scientific research, achieved through a SWOT analysis. The analysis explores the model's strengths, which encompass a vast knowledge base, language proficiency, information retrieval, and the capacity for continuous learning. Conversely, it exposes its weaknesses, including a lack of contextual understanding, potential overreliance on training data, limitations in verifying information, and constrained critical thinking abilities. Amidst these factors, opportunities arise, such as facilitating literature reviews, fostering collaborative brainstorming, enabling seamless language translation and interpretation, and amplifying knowledge dissemination. Nonetheless, a spectrum of threats looms, encompassing concerns related to plagiarism, ethical quandaries, the propagation of misinformation, and even the potential erosion of higher-order cognitive thinking. These multifaceted aspects necessitate comprehensive consideration. Recommendations for researchers embarking on ChatGPT integration include a balanced approach that harmonizes AI and human ingenuity, thereby upholding research integrity. The potential of ChatGPT to reshape scientific inquiry can only be realized through conscientious use and ongoing oversight.

Keywords

AI Ethics, Artificial Intelligence, ChatGPT, Large Language Model, Prompt Engineering, Scientific Research, SWOT Analysis

Full Text:

PDF

References

AlAfnan, M. A., Dishari, S., Jovic, M., & Lomidze, K. (2023). ChatGPT as an educational tool: Opportunities, challenges, and recommendations for communication, business writing, and composition courses. Journal of Artificial Intelligence and Technology 3(2), 60–68. https://doi.org/10.37965/jait.2023.0184

Alkaissi, H., & McFarlane, S. (2023). Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus, 15(2), e35179. https://doi.org/10.7759/cureus.35179

Arvanitis, L., Sadeghi, M., & Brewster, J. (2023, March). Despite OpenAI’s promises, the company’s new AI tool produces misinformation more frequently, and more persuasively, than its predecessor. NewsGuard. https://www.newsguardtech.com/misinformation-monitor/march-2023/

Azaria, A., Azoulay, R., & Reches, S. (2023). ChatGPT is a remarkable tool for experts. arXiv. https://doi.org/10.48550/arXiv.2306.03102

Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., ... & Fung, P. (2023). A multitask, multilingual, multimodal evaluation of ChatGPT on reasoning, hallucination, and interactivity. arXiv. https://doi.org/10.48550/arXiv.2302.04023

Benzaghta, M. A., Elwalda, A., Mousa, M. M., Erkan, I., & Rahman, M. (2021). SWOT analysis applications: An integrative literature review. Journal of Global Business Insights, 6(1), 55-73. https://www.doi.org/10.5038/2640-6489.6.1.1148

Bin-Hady, W.R.A., Al-Kadi, A., Hazaea, A. and Ali, J.K.M. (2023). Exploring the dimensions of ChatGPT in english language learning: A global perspective. Library Hi Tech. https://doi.org/10.1108/LHT-05-2023-0200

Chowdhury, N., & Rahman, S. (2023). A brief review of ChatGPT: Limitations, challenges and ethical-social implications. Chongqing University of Posts and Telecommunications. https://doi.org/10.5281/zenodo.7629888

Chubb, J., Cowling, P. & Reed, D. (2022). Speeding up to keep up: Exploring the use of AI in the research process. AI & Society 37, 1439–1457. https://doi.org/10.1007/s00146-021-01259-0

Dale, R. (2021). GPT-3: What’s it good for?. Natural Language Engineering, 27(1), 113-118. https://doi.org/10.1017/S1351324920000601

De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023). ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health. Frontiers in Public Health, 11, 1166120. https://doi.org/10.3389/fpubh.2023.1166120

Dehouche, N. (2021). Plagiarism in the age of massive Generative Pre-trained Transformers (GPT-3). Ethics in Science and Environmental Politics, 21, 17-23. https://doi.org/10.3354/esep00195

DeRose, A. (2023, May 20). These companies have banned or limited ChatGPT at work. https://www.hr-brew.com/stories/2023/05/11/these-companies-have-banned-chatgpt-in-the-office

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., ... & Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642

Eaton, S. E. (2023). https://www.universityworldnews.com/post.php?story=20230228133041549

Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1-15. https://doi.org/10.1080/14703297.2023.2195846

Frey, C.B., & Osborne, M.A. (2017). The future of employment: How susceptible are jobs to computerisation?. Technological Forecasting and Social Change, 114, 254-280. https://doi.org/10.1016/j.techfore.2016.08.019

Furman, J., & Seaman, R. (2019). AI and the economy. Innovation Policy and the Economy, 19(1), 1-191. https://www.journals.uchicago.edu/doi/epdf/10.1086/699936

Gao, Y., Wang, R., & Hou, F. (2023). Unleashing the power of ChatGPT for translation: An empirical study. arXiv. https://doi.org/10.48550/arXiv.2304.02182

Gilson, A., Safranek, C.W., Huang, T., Socrates, V., Chi, L., Taylor, R.A., & Chartash, D. (2023). How does ChatGPT perform on the United States Medical Licensing Examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education 9. https://doi.org/10.2196/45312

Giray, L. (2023). Prompt engineering with ChatGPT: A guide for academic writers. Annals of Biomedical Engineering, 1-5. https://doi.org/10.1007/s10439-023-03272-4

Goodin, D. (2023). Hackers are selling a service that bypasses ChatGPT restrictions on malware. https://arstechnica.com/information-technology/2023/02/now-open-fee-based-telegram-service-that-uses-chatgpt-to-generate-malware

Helms, M. M., & Nixon, J. (2010). Exploring SWOT analysis–where are we now? A review of academic research from the last decade. Journal of strategy and management, 3(3), 215-251. https://doi.org/10.1108/17554251011064837

Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: writing better scientific review articles. American Journal of Cancer Research, 13(4), 1148. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/pdf/ajcr0013-1148.pdf

Iskender, A. (2023). Holy or unholy? Interview with open AI’s ChatGPT. European Journal of Tourism Research, 34, 3414-3414. https://doi.org/10.54055/ejtr.v34i.3169

Jain, S., & Jain, R. (2019). Role of artificial intelligence in higher education: An empirical investigation. International Journal of Research and Analytical Reviews, 6(2), 144-150. http://ijrar.com/upload_issue/ijrar_issue_20544069.pdf

Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., ... & Fung, P. (2023). Survey of hallucination in natural language generation. arXiv. https://doi.org/10.48550/arXiv.2202.03629

Jiao, W., Wang, W., Huang, J. T., Wang, X., & Tu, Z. P. (2023). Is ChatGPT a good translator? Yes with GPT-4 as the engine. arXiv. https://doi.org/10.48550/arXiv.2301.08745

Kalla, D., & Smith, N. (2023). Study and analysis of ChatGPT and its impact on different fields of study. International Journal of Innovative Science and Research Technology, 8(3), 827-833. https://ssrn.com/abstract=4402499

Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. arXiv. https://doi.org/10.35542/osf.io/5er8f

Kengam, J. (2020). Artificial intelligence in education. Bournemouth University. http://dx.doi.org/10.13140/RG.2.2.16375.65445

Khalil, M., & Er, E. (2023). Will ChatGPT get you caught? Rethinking of plagiarism detection. arXiv. https://doi.org/10.48550/arXiv.2302.04335

Khan, S. (2023, June 15). Ethical implications of ChatGPT: Misinformation, manipulation, and biases. YourStory. https://yourstory.com/2023/05/ethical-implications-of-chatgpt-language-processing-misinformation

Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, https://doi.org/10.1177/00336882231162868

Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., & Tseng, V. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digital Health, 2(2), e0000198. https://doi.org/10.1371/journal.pdig.0000198

Lyu, C., Xu, J., & Wang, L. (2023). New trends in machine translation using large language models: Case examples with ChatGP. arXiv. https://doi.org/10.48550/arXiv.2305.01181

Mauran, C. (2023, May 2). Samsung bans ChatGPT, AI chatbots after data leak blunder. https://mashable.com/article/samsung-chatgpt-leak-leads-to-employee-ban

McGee, R. (2023). Is ChatGPT biased against conservatives? An empirical study. Social Science Research Network. http://dx.doi.org/10.2139/ssrn.4359405

Mijwil, M., Aljanabi, M., & Ali, A. H. (2023). ChatGPT: Exploring the role of cybersecurity in the protection of medical information. Mesopotamian Journal of Cybersecurity, 18-21. http://dx.doi.org/10.58496/MJCS/2023/004

Naik, N., Hameed, B.M.Z., Shetty, D.K., Swain, D., Shah, M., Paul, R., Aggarwal, K., Ibrahim, S., Patil, V., Smriti, K., Shetty, S., Rai, B.P., Chlosta, P., & Somani, B.K. (2022). Legal and ethical consideration in artificial intelligence in healthcare: Who takes responsibility?. Frontiers in Surgery 9. https://doi.org/10.3389/fsurg.2022.862322

Nandalwar, J., Vinay, S., Pallavi, P., & Priti, K. (2023). An intelligent approach for automating data inputs on web portals for several apex / statutory bodies in the field education using robotics. and machine learning. International Journal for Multidisciplinary Research 5(3). https://doi.org/10.36948/ijfmr.2023.v05i02.2397

Opara, E., Mfon-Ette Theresa, A., & Aduke, T. C. (2023). ChatGPT for teaching, learning and research: Prospects and challenges. Global Academic Journal of Humanities and Social Sciences, 5(2), 33-40. https://doi.org/10.36348/gajhss.2023.v05i02.001

Qasem, F. (2023). ChatGPT in scientific and academic research: Future fears and reassurances. Library Hi Tech News 40(3), 30-32. https://doi.org/10.1108/LHTN-03-2023-0043

Rahimi, F., Abadi, A.T.B. (2023). ChatGPT and publication ethics. Archives of Medical Research 54(3), 272-274. https://doi.org/10.1016/j.arcmed.2023.03.004

Rahman, M., Terano, H. J. R., Rahman, N., Salamzadeh, A., & Rahaman, S. (2023). ChatGPT and academic research: A review and recommendations based on practical examples. Journal of Education, Management and Development Studies, 3(1), 1-12. https://doi.org/10.52631/jemds.v3i1.175

Roumeliotis, K.I., & Tselikas, N.D. (2023). ChatGPT and open-ai models: A preliminary review. Future Internet 15(6), 192. https://doi.org/10.3390/fi15060192

Rozado, D. (2023). The political biases of ChatGPT. Social Sciences, 12(3), 148. https://doi.org/10.3390/socsci12030148

Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of Applied Learning & Teaching, 6(1), 342-363. https://doi.org/10.37074/jalt.2023.6.1.9

Santra, P. P., & Majhi, D. (2023). Scholarly Communication and Machine-Generated Text: Is it Finally AI vs AI in Plagiarism Detection?. Journal of Information and Knowledge, 173-181. https://doi.org/10.17821/srels%2F2023%2Fv60i3%2F171028

Shidaganti, G., Sanjana, R., Shuubeksh, K., Monish Raman, V.R., & Thakshith, V. (2023). ChatGPT: Information retrieval from image using robotic process automation and ocr. 2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2023, pp. 1264-1270. https://doi.org/10.1109/ICICCS56967.2023.10142461.

Simpson, D. (2023). Educators, students, and plagiarism in age of AI. BMJ, 381. https://doi.org/10.1136/bmj.p1403

Stojanov, A. (2023). Learning with ChatGPT 3.5 as a more knowledgeable other: An autoethnographic study. International Journal of Educational Technology in Higher Education 20, 35 (2023). https://doi.org/10.1186/s41239-023-00404-7

Strubell, E., Ganesh, A., & McCallum, A. (2019). Energy and policy considerations for deep learning in NLP. In the 57th Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.48550/arXiv.1906.02243

Ufuk, F. (2023). The role and limitations of large language models such as ChatGPT in clinical settings and medical journalism. Radiology, 307(3), e230276. https://doi.org/10.1148/radiol.230276

Van der Vorst, T., & Jelicic, N. (2019). Artificial Intelligence in Education: Can AI bring the full potential of personalized learning to education? [Paper presentation]. 30th European Conference of the International Telecommunications Society. Finland. https://www.econstor.eu/bitstream/10419/205222/1/van-der-Vorst-Jelicic.pdf

Wardat, Y., Tashtoush, M. A., AlAli, R., & Jarrah, A. M. (2023). ChatGPT: A revolutionary tool for teaching and learning mathematics. Eurasia Journal of Mathematics, Science and Technology Education, 19(7), e2286. https://doi.org/10.29333/ejmste/13272

Wu, T., He, S., Liu, J., Sun, S., Liu, K., Han, Q-L., A & Tang, Y. (2023). Brief overview of ChatGPT: The history, status quo and potential future development. in IEEE/CAA Journal of Automatica Sinica, 10(5), 1122-1136. https://doi.org/10.1109/JAS.2023.123618

Zhai, X. (2022). ChatGPT user experience: Implications for education. https://dx.doi.org/10.2139/ssrn.4312418

DOI: https://doi.org/10.46328/ijte.618