The construction and validation of a Questionnaire of Gamification Skills in Teachers (QGST)
(https://doi.org/10.55612/s-5002-053-001)
Abstract
The objective of this study is to propose and validate a questionnaire that identifies gamification skills in teachers. In order to develop this instrument, a two-phase sequential exploratory design was used. In the qualitative phase, the specialized literature on gamification was reviewed, then the structure of the questionnaire, the dimensions and its indicators were obtained through the design of the items and the assessment of a panel of experts who validated the instrument. In the case of the quantitative phase, a pilot study was conducted with 203 teachers who used technology and active methodologies in their undergraduate and postgraduate classes; internal consistency tests, item analysis and both exploratory and confirmatory factor analysis were carried out with the obtained data. Among the results, it was found that the level and behavior of the items was adequate, their internal consistency is satisfactory, and the factor analyses allowed us to identify three dimensions and 22 items that allowed the proper identification of teachers' gamification skills, resulting in a valid and reliable tool for teachers who wish to get started with this new methodology.
Keywords: measurement, teacher, skills, gamification, questionnaire
References
1. ECLAC: Digital technologies for a new future, Santiago, (2021)
2. Ananga P.. Pedagogical Considerations of E-Learning in Education for Development in the Face of COVID-19, International Journal of Technology in Education and Science, 4, pp. 310–321. (2020). https://doi.org/10.46328/ijtes.v4i4.123
3. Martell C., Sequenzia M.: Working the Dialectic: Teaching and Learning Teacher Research in Social Studies. Routledge, pp. 407–416 (2016). https://doi.org/101080/0013172520161206156
4. Macanchí P., Mariana L., Marlene B., Campoverde M.: Educational, pedagogical and didactic innovation. Conceptions for practice in higher education, Universidad y Sociedad, 12, pp. 396–403, (2020)
5. Biasi B., Deming D., Moser P., Chatterji A., Lerner J., Stern S., Andrews M.: Education and Innovation, Cambridge, MA, (2021).https://doi.org/10.3386/w28544
6. Buckley P., Doyle E.: Gamification and student motivation, Interactive Learning Environments, 24, pp. 1162–1175 (2016). https://doi.org/10.1080/10494820.2014.964263
7. Basten D.: Gamification. IEEE Software, 34, pp. 76–81 (2017). https://doi.org/10.1109/MS.2017.3571581
8. Rodríguez-García, A., Arias-Gago A.: Review of methodological proposals: A categorical grouping taxonomy, Alteridad, 15, pp. 146–160 (2020). https://doi.org/10.17163/alt.v15n2.2020.01
9. Deterding S., Khaled R., Nacke L., Dixon D.: Gamification: toward a definition. Chi 2011, pp.12–15 (2011)
10. Deterding, S.: How to Do Gameful Design, CHI PLAY '17, New York, ACM Press, pp. 581–583 (2017). https://doi.org/10.1145/3130859.3131446
11. Zichermann G., Cunningham C.: Gamification by Design, O’Reilly, Sebastopol (2011)
12. Huotari K., Hamari J.: Defining Gamification-A Service Marketing Perspective, MindTrek’12, pp. 17-22 (2012). https://doi.org/10.1145/2393132.2393137
13. Carvalho C., Coelho A.: Game-Based Learning, Gamification in Education and Serious Games, Computers, 11, pp. 1-4 (2022). https://doi.org/10.3390/computers11030036
14. Huang R., Ritzhaupt A., Sommer M., Zhu J., Stephen A., Valle N., Hampton J., Jingwei L.: The impact of gamification in educational settings on student learning outcomes: a meta-analysis, Educational Technology Research and Development, 68, pp. 1875–1901 (2020). https://doi.org/10.1007/s11423-020-09807-z
15. Koivisto J., Hamari J.: The rise of motivational information systems: A review of gamification research, International Journal of Information Management, 45, pp. 191–210. (2019). https://doi.org/10.1016/j.ijinfomgt.2018.10.013
16. González-Fernández A., Francisco-Ignacio R., Fernández-Sánchez M.: Models of Instructional Design in Gamification: A Systematic Review of the Literature, Education Sciences, 12, pp. 1-13 (2022). https://doi.org/10.3390/educsci12010044
17. Martí-Parreño J., Galbis-Córdova A., Currás-Pérez R.: Teachers’ beliefs about gamification and competencies development: A concept mapping approach, Innovations in Education and Teaching International, 58, pp. 84–94 (2019). https://doi.org/10.1080/14703297.2019.1683464
18. Cavalcante S., Ferreira A., De Sales V.: Teacher training in digital culture through gamification, Educar em Revista, 36, pp. 1-21 (2020). https://doi.org/10.1590/0104-4060.75857
19. Tenório K., Dermeval D., Monteiro M., Peixoto A., Da Silva A.: Exploring Design Concepts to Enable Teachers to Monitor and Adapt Gamification in Adaptive Learning Systems: A Qualitative Research Approach, International Journal of Artificial Intelligence in Education, 258, pp. 1–25 (2021). https://doi.org/10.1007/s40593-021-00274-y
20. Terje V., Poom-Valickis K., Rumma K., Aus K.: Transforming Higher Education Learning Ecosystem: Teachers’ Perspective, IxD&A, 46, pp. 47–69 (2020). https://doi.org/10.55612/s-5002-046-003
21. Werbach K., Hunter D.: For the Win. The Power of Gamification and Game Thinking in Business, Education, Goverment and Social Impact, 2, Philadelphia, Wharton School Press (2020)
22. Kapp K.: The Gamification of Learning and Instruction: Game-based Methods and Strategies for Training and Education, 1, New York, Pfeiffer (2012)
23. Plass J., Homer B., Kinzer C.: Foundations of Game-Based Learning, Educational Psychologist, 50, pp. 258–283, (2015). https://doi.org/10.1080/00461520.2015.1122533
24. Kim J., Castelli D.: Effects of Gamification on Behavioral Change in Education: A Meta-Analysis, International Journal of Environmental Research and Public Health, 18, pp. 1-13, (2021). https://doi.org/10.3390/ijerph18073550
25. Khan Z., Dyer J., Bjelobaba S., Gomes S., Dlabolová D., Sivasubramaniam S., Biju S., Hysaj A., Harish P.: Initiating count down-gamification of academic integrity, International Journal for Educational Integrity, 17, pp. 1-15, (2021). https://doi.org/10.1007/s40979-020-00068-0
26. Chapman J., Rich P.: Does educational gamification improve students’ motivation? If so, which game elements work best?, Journal of Education for Business, 93, pp. 315–322 (2018). https://doi.org/10.1080/08832323.2018.1490687
27. Khoshkangini R., Valetto G., Marconi A., Pistore M.: Automatic generation and recommendation of personalized challenges for gamification, User Modeling and User-Adapted Interaction, 31, pp. 1–34 (2020). https://doi.org/10.1007/s11257-019-09255-2
28. Fernandez-Rio J., de las Heras E., González T., Trillo V., Palomares J.: Gamification and physical education, Viability and preliminary views from students and teachers, Physical Education and Sport Pedagogy, 25, pp. 509–524 (2020). https://doi.org/10.1080/17408989.2020.1743253
29. Furdu I., Tomozei C., Köse U.: Pros and Cons Gamification and Gaming in Classroom, BRAIN, 8, pp. 56–62 (2017)
30. Rodrigues L., Pereira F., Toda A., Palomino P., Pessoa M., Galvão L., Fernandes D., Oliveira E., Cristea A., Isotani S.: Gamification suffers from the novelty effect but benefits from the familiarization effect: Findings from a longitudinal study, International Journal of Educational Technology in Higher Education, 19, pp. 1–25 (2022). https://doi.org/10.1186/s41239-021-00314-6
31. Alsaad F., Durugbo C.: Gamification-as-Innovation: A Review, International Journal of Innovation and Technology Management, 18, pp. 1-28 (2021). https://doi.org/10.1142/S0219877021300020
32. Seaborn K., Fels D.: Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74 pp. 14–31(2015). https://doi.org/10.1016/j.ijhcs.2014.09.006
33. Chand V., Kuril S., Shukla A.: Dialoguing with teacher-educators, valorizing teacher innovations. London Review of Education 18 pp. 451–466 (2020). https://doi.org/10.14324/LRE.18.3.09
34. Pollock J., Tolone L., Nunnally G.: How Innovative Teachers Can Start Teaching Innovation, https://www.ascd.org/el/articles/how-innovative-teachers-can-start-teaching-innovation (2021)
35. López P., Rodrigues-Silva J., Alsina Á., Carmona E., Lloret F., Albright J.: Brazilian and Spanish Mathematics Teachers’ Predispositions towards Gamification in STEAM Education, Education Sciences 2021, 11, pp. 1-17 (2021). https://doi.org/10.3390/educsci11100618
36. Larson K.: Serious Games and Gamification in the Corporate Training Environment: a Literature Review, TechTrends, 64 pp. 319–328 (2019). https://doi.org/10.1007/s11528-019-00446-7
37. Martín-Párraga L., Palacios-Rodríguez A., Gallego-Pérez Ó.: Do we play or gamify? Evaluation of gamification training experience to improve the digital competence of university teaching staff, Alteridad, 17 pp. 36–49 (2022). https://doi.org/10.17163/alt.v17n1.2022.03
38. Kingsley T., Grabner-Hagen M.: Vocabulary by Gamification, The Reading Teacher, 71 pp. 545–555 (2018). https://doi.org/10.1002/trtr.1645
39. Albertazzi D., Ferreira M., Forcellini F.: A Wide View on Gamification. Technology, Knowledge and Learning, 24, pp. 191–202 (2019). https://doi.org/10.1007/s10758-018-9374-z
40. Ribeiro L., Montanaro P. A gamificação gamificada: desenvolvimento de um curso para capacitação de docentes, Revista on line de Política e Gestão Educacional, 21 pp. 1626–1637 (2017). https://doi.org/10.22633/rpge.v21.n.esp3.2017.10074
41. Rebelo S., Isaías P.: Gamification as an Engagement Tool in E-Learning Websites, Journal of Information Technology Education, Research, 19, pp. 833–854 (2020). https://doi.org/10.28945/4653
42. Elena Parra-Gonzálezy M., Segura-Robles A.: Translation and validation of the Gameful Experience Scale (GAMEX), Bordón Revista de Pedagogía, 71, pp. 87–99 (2019). https://doi.org/10.13042/Bordon.2019.70783
43. Högberg J., Hamari J., Wästlund E.: Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use, User Modeling and User-Adapted Interaction, 29, pp. 619–660 (2019). https://doi.org/10.1007/s11257-019-09223-w
44. Akgün Ö., Topal M.: Adaptation of the Gamification User Types Hexad Scale into Turkish, International Journal of Assessment Tools in Education, 5, pp. 389–402 (2018). https://doi.org/10.21449/ijate.379139
45. Manero B., Torrente J., Freire M., Fernández-Manjón B.: An instrument to build a gamer clustering framework according to gaming preferences and habits, Computers in Human Behavior, 62, pp. 353–363 (2016). https://doi.org/10.1016/j.chb.2016.03.085
46. Tondello G., Mora A., Marczewski A., Nacke L. Empirical validation of the Gamification User Types Hexad scale in English and Spanish, International Journal of Human-Computer Studies, 127, pp. 95–111 (2019). https://doi.org/10.1016/j.ijhcs.2018.10.002
47. Hamari J., Koivisto J.: Measuring flow in gamification: Dispositional Flow Scale-2, Computers in Human Behavior, 40, pp. 133–143 (2014). https://doi.org/10.1016/j.chb.2014.07.048
48. Sailer M., Hense J., Mayr S., Mandl H.: How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction, Computers in Human Behavior, 69, pp. 371–380 (2017). https://doi.org/10.1016/j.chb.2016.12.033
49. Chou Y. Actionable Gamification: Beyond Points, Badges and Leaderboards, 1st ed. Octalysis, New York (2015)
50. Zhernovnykova O., Peretiaha L., Kovtun A., Korduban M., Nalyvaiko O., Nalyvaiko N.: The technology of prospective teachers’ digital competence formation by means of gamification, Information Technologies and Learning Tools, 75, pp. 170–185 (2020)
51. Franco-Mariscal A., Cebrián-Robles D., Rodríguez-Losada N.: Impact of a Training Programme on the e-rubric Evaluation of Gamification Resources with Pre-Service Secondary School Science Teachers, Technology, Knowledge and Learning, 704, pp. 1–34 (2021). https://doi.org/10.1007/s10758-021-09588-1
52. Kusuma G., Wigati E., Utomo Y., Putera L.: Analysis of Gamification Models in Education Using MDA Framework, Procedia Computer Science, 135, pp. 385–392 (2018). https://doi.org/10.1016/j.procs.2018.08.187
53. Buckley P., Noonan S., Geary C., Mackessy T., Nagle E.: An Empirical Study of Gamification Frameworks, Journal of Organizational and End User Computing, 31, pp. 22–38 (2019). https://doi.org/10.4018/JOEUC.2019010102
54. Kaplan D.: The SAGE Handbook of Quantitative Methodology for the Social Sciences, SAGE, New York, (2012)
55. Mittal N., Alavi S.: Construction and psychometric analysis of teachers mobile learning acceptance questionnaire, Interactive Technology and Smart Education, 17, pp. 171–196 (2020). https://doi.org/10.1108/ITSE-07-2019-0039
56. Deterding S., Dixon D., Khaled R., Nacke L.: From Game Design Elements to Gamefulness: Defining “Gamification”, MindTrek’11, pp. 9-15 (2011). https://doi.org/10.1145/2181037.2181040
57. Luo Z.: Gamification for educational purposes: What are the factors contributing to varied effectiveness?, Education and Information Technologies, 27, pp. 891–915 (2022). https://doi.org/10.1007/s10639-021-10642-9
58. de Liaño B. Pascual-Ezama D.: La metodología Delphi como técnica de estudio de la validez de contenido, Annals of Psychology, 28, pp. 1011–1020 (2012). https://doi.org/10.6018/analesps.28.3.156211
59. Schjoedt, L., Sangboon, K.: Control Variables: Problematic Issues and Best Practices. The Palgrave Handbook of Research Design in Business and Management, pp. 239-261 (2015).https://doi.org/10.1057/9781137484956_15
60. Medina-Díaz M., Verdejo-Carrión A.: Validity and reliability in student learning evaluation throughout active methodologies, Alteridad, 15, pp. 270–284 (2020). https://doi.org/10.17163/alt.v15n2.2020.10
61. Pozuelos F., García F., Conde S.: Evaluation Innovative Practices in University Education. Validation of Instrument, Educación XX1, 24, pp. 69–91 (2021)
62. Stockemer D.: Quantitative Methods for the Social Sciences, Springer (2019). https://doi.org/10.1007/978-3-319-99118-4
63. Sloan L., Quan-Haase A., Kitchin R., Beninger K.: The SAGE Social Media Research Methods, Cardiff, (2017). https://doi.org/10.4135/9781473983847
64. Hancock G., An J.: A Closed-Form Alternative for Estimating ωReliability under Unidimensionality, Measurement: Interdisciplinary Research and Perspectives, 18, pp. 1–14 (2020). https://doi.org/10.1080/15366367.2019.1656049
65. Ledesma R., Ferrando P., Tosi J.: The Use of Exploratory Factor Analysis in RIDEP. Guidelines for Authors and Reviewers, RIDEP, 52 pp 173–180 (2019). https://doi.org/10.21865/RIDEP52.3.13
66. Rojas-Torres L.: Robustness of Confirmatory Factor Analysis Fit Indices to Outliers, Revista de Matemática: Teoría y Aplicaciones, 27, pp. 383–404 (2020). https://doi.org/10.15517/rmta.v27i2.33677
67. Morata-Ramirez M., Holgado F., Barbero-García M., Mendez G.: Confirmatory factor analysis. Recommendations for unweighted least squares method related to Chi-Square and RMSEA, Acción Psicológica, 12, pp. 79–90 (2015). https://doi.org/10.5944/ap.12.1.14362