A Scale Development Study for The Evaluation of Digital Content
DOI:
https://doi.org/10.46328/ijte.1074Keywords:
web 2.0 tools, rubric, assessment, digital content, validity and reliabilityAbstract
This study aimed to develop a rubric for evaluating digital contents specifically Web 2.0 tools in education to improve the quality of digital content, as well as to assess the rubric’s validity and reliability. Data were collected from pre-service science teachers in their third year. In the development process, expert opinions were sought, and the rubric’s items, criteria, and proficiency levels were created based on relevant literature. The draft rubric was used to evaluate digital contents prepared by these pre-service teachers, followed by analyzes to ensure validity and reliability. Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), Cronbach’s Alpha, and Kappa analyzes were performed on the collected data. EFA revealed that the 25-item rubric explained 52.70% of the total variance, with factor loadings between .498 and .862 across three factors. CFA results showed a χ2/sd value of 1.437 and an RMSEA value of .071. The rubric’s internal consistency was measured with a Cronbach’s Alpha coefficient of .785. To further assess reliability, kappa analysis indicated a moderate inter-rater agreement with a kappa value of .64. Based on these results, the EWES rubric is considered both a valid and reliable evaluation tool.
References
Duran, O. & Oguz Unver, A. (2025). A scale development study for the evaluation of digital content. International Journal of Technology in Education (IJTE), 8(2), 482-501. https://doi.org/10.46328/ijte.1074
Downloads
Published
Issue
Section
License
Copyright (c) 2025 International Journal of Technology in Education
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Articles may be used for research, teaching, and private study purposes. Authors alone are responsible for the contents of their articles. The journal owns the copyright of the articles. The publisher shall not be liable for any loss, actions, claims, proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of the research material.
The author(s) of a manuscript agree that if the manuscript is accepted for publication in the International Journal of Technology in Education (IJTE), the published article will be copyrighted using a Creative Commons “Attribution 4.0 International” license. This license allows others to freely copy, distribute, and display the copyrighted work, and derivative works based upon it, under certain specified conditions.
Authors are responsible for obtaining written permission to include any images or artwork for which they do not hold copyright in their articles, or to adapt any such images or artwork for inclusion in their articles. The copyright holder must be made explicitly aware that the image(s) or artwork will be made freely available online as part of the article under a Creative Commons “Attribution 4.0 International” license.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
