The construction and validation of a Questionnaire of Gamification Skills in Teachers (QGST)

William Reyes Cabrera, Jesús Pinto Sosa, Ricardo Hernández-Dzib

pp. 7 - 26, download






The objective of this study is to propose and validate a questionnaire that identifies gamification skills in teachers. In order to develop this instrument, a two-phase sequential exploratory design was used. In the qualitative phase, the specialized literature on gamification was reviewed, then the structure of the questionnaire, the dimensions and its indicators were obtained through the design of the items and the assessment of a panel of experts who validated the instrument. In the case of the quantitative phase, a pilot study was conducted with 203 teachers who used technology and active methodologies in their undergraduate and postgraduate classes; internal consistency tests, item analysis and both exploratory and confirmatory factor analysis were carried out with the obtained data. Among the results, it was found that the level and behavior of the items was adequate, their internal consistency is satisfactory, and the factor analyses allowed us to identify three dimensions and 22 items that allowed the proper identification of teachers' gamification skills, resulting in a valid and reliable tool for teachers who wish to get started with this new methodology. 


Keywords: measurement, teacher, skills, gamification, questionnaire



1. ECLAC: Digital technologies for a new future, Santiago, (2021)

2. Ananga P.. Pedagogical Considerations of E-Learning in Education for Development in the Face of COVID-19, International Journal of Technology in Education and Science, 4, pp. 310–321. (2020).

3. Martell C., Sequenzia M.: Working the Dialectic: Teaching and Learning Teacher Research in Social Studies. Routledge, pp. 407–416 (2016).

4. Macanchí P., Mariana L., Marlene B., Campoverde M.: Educational, pedagogical and didactic innovation. Conceptions for practice in higher education, Universidad y Sociedad, 12, pp. 396–403, (2020)

5. Biasi B., Deming D., Moser P., Chatterji A., Lerner J., Stern S., Andrews M.: Education and Innovation, Cambridge, MA, (2021).

6. Buckley P., Doyle E.: Gamification and student motivation, Interactive Learning Environments, 24, pp. 1162–1175 (2016).

7. Basten D.: Gamification. IEEE Software, 34, pp. 76–81 (2017).

8. Rodríguez-García, A., Arias-Gago A.: Review of methodological proposals: A categorical grouping taxonomy, Alteridad, 15, pp.  146–160 (2020).

9. Deterding S., Khaled R., Nacke L., Dixon D.: Gamification: toward a definition. Chi 2011, pp.12–15 (2011)

10. Deterding, S.: How to Do Gameful Design, CHI PLAY '17, New York, ACM Press, pp. 581–583 (2017).

11. Zichermann G., Cunningham C.: Gamification by Design, O’Reilly, Sebastopol (2011)

12. Huotari K., Hamari J.: Defining Gamification-A Service Marketing Perspective, MindTrek’12, pp. 17-22 (2012).

13. Carvalho C., Coelho A.: Game-Based Learning, Gamification in Education and Serious Games, Computers, 11, pp. 1-4 (2022).

14. Huang R., Ritzhaupt A., Sommer M., Zhu J., Stephen A., Valle N., Hampton J., Jingwei L.: The impact of gamification in educational settings on student learning outcomes: a meta-analysis, Educational Technology Research and Development, 68, pp. 1875–1901 (2020).

15. Koivisto J., Hamari J.: The rise of motivational information systems: A review of gamification research, International Journal of Information Management, 45, pp. 191–210. (2019).

16. González-Fernández A., Francisco-Ignacio R., Fernández-Sánchez M.: Models of Instructional Design in Gamification: A Systematic Review of the Literature, Education Sciences, 12, pp. 1-13 (2022).

17. Martí-Parreño J., Galbis-Córdova A., Currás-Pérez R.: Teachers’ beliefs about gamification and competencies development: A concept mapping approach, Innovations in Education and Teaching International, 58, pp. 84–94 (2019).

18. Cavalcante S., Ferreira A., De Sales V.: Teacher training in digital culture through gamification, Educar em Revista, 36, pp. 1-21 (2020).

19. Tenório K., Dermeval D., Monteiro M., Peixoto A., Da Silva A.: Exploring Design Concepts to Enable Teachers to Monitor and Adapt Gamification in Adaptive Learning Systems: A Qualitative Research Approach, International Journal of Artificial Intelligence in Education, 258, pp.  1–25 (2021).

20. Terje V., Poom-Valickis K., Rumma K., Aus K.: Transforming Higher Education Learning Ecosystem: Teachers’ Perspective, IxD&A, 46, pp. 47–69 (2020).

21. Werbach K., Hunter D.: For the Win. The Power of Gamification and Game Thinking in Business, Education, Goverment and Social Impact, 2, Philadelphia, Wharton School Press (2020)

22. Kapp K.: The Gamification of Learning and Instruction: Game-based Methods and Strategies for Training and Education, 1, New York, Pfeiffer (2012)

23. Plass J., Homer B., Kinzer C.: Foundations of Game-Based Learning, Educational Psychologist, 50, pp. 258–283, (2015).

24. Kim J., Castelli D.: Effects of Gamification on Behavioral Change in Education: A Meta-Analysis, International Journal of Environmental Research and Public Health, 18, pp. 1-13, (2021).

25. Khan Z., Dyer J., Bjelobaba S., Gomes S., Dlabolová D., Sivasubramaniam S., Biju S., Hysaj A., Harish P.: Initiating count down-gamification of academic integrity, International Journal for Educational Integrity, 17, pp. 1-15, (2021).

26. Chapman J., Rich P.: Does educational gamification improve students’ motivation? If so, which game elements work best?, Journal of Education for Business, 93, pp. 315–322 (2018).

27. Khoshkangini R., Valetto G., Marconi A., Pistore M.: Automatic generation and recommendation of personalized challenges for gamification, User Modeling and User-Adapted Interaction, 31, pp. 1–34 (2020).

28. Fernandez-Rio J., de las Heras E., González T., Trillo V., Palomares J.: Gamification and physical education, Viability and preliminary views from students and teachers, Physical Education and Sport Pedagogy, 25, pp. 509–524 (2020).

29. Furdu I., Tomozei C., Köse U.: Pros and Cons Gamification and Gaming in Classroom, BRAIN, 8, pp. 56–62 (2017)

30. Rodrigues L., Pereira F., Toda A., Palomino P., Pessoa M., Galvão L., Fernandes D., Oliveira E., Cristea A., Isotani S.: Gamification suffers from the novelty effect but benefits from the familiarization effect: Findings from a longitudinal study, International Journal of Educational Technology in Higher Education, 19, pp. 1–25 (2022).

31. Alsaad F., Durugbo C.: Gamification-as-Innovation: A Review, International Journal of Innovation and Technology Management, 18, pp. 1-28 (2021).

32. Seaborn K., Fels D.: Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74 pp. 14–31(2015).

33. Chand V., Kuril S., Shukla A.: Dialoguing with teacher-educators, valorizing teacher innovations. London Review of Education 18 pp. 451–466 (2020).

34. Pollock J., Tolone L., Nunnally G.: How Innovative Teachers Can Start Teaching Innovation, (2021)

35. López P., Rodrigues-Silva J., Alsina Á., Carmona E., Lloret F., Albright J.: Brazilian and Spanish Mathematics Teachers’ Predispositions towards Gamification in STEAM Education, Education Sciences 2021, 11, pp. 1-17 (2021).

36. Larson K.: Serious Games and Gamification in the Corporate Training Environment: a Literature Review, TechTrends, 64 pp. 319–328 (2019).

37. Martín-Párraga L., Palacios-Rodríguez A., Gallego-Pérez Ó.: Do we play or gamify? Evaluation of gamification training experience to improve the digital competence of university teaching staff, Alteridad, 17 pp. 36–49 (2022).

38. Kingsley T., Grabner-Hagen M.: Vocabulary by Gamification, The Reading Teacher, 71 pp. 545–555 (2018).

39. Albertazzi D., Ferreira M., Forcellini F.: A Wide View on Gamification. Technology, Knowledge and Learning, 24, pp. 191–202 (2019).

40. Ribeiro L., Montanaro P. A gamificação gamificada: desenvolvimento de um curso para capacitação de docentes, Revista on line de Política e Gestão Educacional, 21 pp. 1626–1637 (2017).

41. Rebelo S., Isaías P.: Gamification as an Engagement Tool in E-Learning Websites, Journal of Information Technology Education, Research, 19, pp. 833–854 (2020).

42. Elena Parra-Gonzálezy M., Segura-Robles A.: Translation and validation of the Gameful Experience Scale (GAMEX), Bordón Revista de Pedagogía, 71, pp. 87–99 (2019).

43. Högberg J., Hamari J., Wästlund E.: Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use, User Modeling and User-Adapted Interaction, 29, pp. 619–660 (2019).

44. Akgün Ö., Topal M.: Adaptation of the Gamification User Types Hexad Scale into Turkish, International Journal of Assessment Tools in Education, 5, pp. 389–402 (2018).

45. Manero B., Torrente J., Freire M., Fernández-Manjón B.: An instrument to build a gamer clustering framework according to gaming preferences and habits, Computers in Human Behavior, 62, pp. 353–363 (2016).

46. Tondello G., Mora A., Marczewski A., Nacke L. Empirical validation of the Gamification User Types Hexad scale in English and Spanish, International Journal of Human-Computer Studies, 127, pp. 95–111 (2019).

47. Hamari J., Koivisto J.: Measuring flow in gamification: Dispositional Flow Scale-2, Computers in Human Behavior, 40, pp. 133–143 (2014).

48. Sailer M., Hense J., Mayr S., Mandl H.: How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction, Computers in Human Behavior, 69, pp. 371–380 (2017).

49. Chou Y. Actionable Gamification: Beyond Points, Badges and Leaderboards, 1st ed. Octalysis, New York (2015)

50. Zhernovnykova O., Peretiaha L., Kovtun A., Korduban M., Nalyvaiko O., Nalyvaiko N.: The technology of prospective teachers’ digital competence formation by means of gamification, Information Technologies and Learning Tools, 75, pp. 170–185 (2020)

51. Franco-Mariscal A., Cebrián-Robles D., Rodríguez-Losada N.: Impact of a Training Programme on the e-rubric Evaluation of Gamification Resources with Pre-Service Secondary School Science Teachers, Technology, Knowledge and Learning, 704, pp. 1–34 (2021).

52. Kusuma G., Wigati E., Utomo Y., Putera L.: Analysis of Gamification Models in Education Using MDA Framework, Procedia Computer Science, 135, pp. 385–392 (2018).

53. Buckley P., Noonan S., Geary C., Mackessy T., Nagle E.: An Empirical Study of Gamification Frameworks, Journal of Organizational and End User Computing, 31, pp. 22–38 (2019).

54. Kaplan D.: The SAGE Handbook of Quantitative Methodology for the Social Sciences, SAGE, New York, (2012)

55. Mittal N., Alavi S.: Construction and psychometric analysis of teachers mobile learning acceptance questionnaire, Interactive Technology and Smart Education, 17, pp. 171–196 (2020).

56. Deterding S., Dixon D., Khaled R., Nacke L.: From Game Design Elements to Gamefulness: Defining “Gamification”, MindTrek’11, pp. 9-15 (2011).

57. Luo Z.: Gamification for educational purposes: What are the factors contributing to varied effectiveness?, Education and Information Technologies, 27, pp. 891–915 (2022).

58. de Liaño B. Pascual-Ezama D.: La metodología Delphi como técnica de estudio de la validez de contenido, Annals of Psychology, 28, pp. 1011–1020 (2012).

59.  Schjoedt, L., Sangboon, K.: Control Variables: Problematic Issues and Best Practices. The Palgrave Handbook of Research Design in Business and Management, pp. 239-261 (2015).

60. Medina-Díaz M., Verdejo-Carrión A.: Validity and reliability in student learning evaluation throughout active methodologies, Alteridad, 15, pp. 270–284 (2020).

61. Pozuelos F., García F., Conde S.: Evaluation Innovative Practices in University Education. Validation of Instrument, Educación XX1, 24, pp. 69–91 (2021)

62. Stockemer D.: Quantitative Methods for the Social Sciences, Springer (2019).

63. Sloan L., Quan-Haase A., Kitchin R., Beninger K.: The SAGE Social Media Research Methods, Cardiff, (2017).

64. Hancock G., An J.: A Closed-Form Alternative for Estimating ωReliability under Unidimensionality, Measurement: Interdisciplinary Research and Perspectives, 18, pp. 1–14 (2020).

65. Ledesma R., Ferrando P., Tosi J.: The Use of Exploratory Factor Analysis in RIDEP. Guidelines for Authors and Reviewers, RIDEP, 52 pp 173–180 (2019).

66. Rojas-Torres L.: Robustness of Confirmatory Factor Analysis Fit Indices to Outliers, Revista de Matemática: Teoría y Aplicaciones, 27, pp. 383–404 (2020).

67. Morata-Ramirez M., Holgado F., Barbero-García M., Mendez G.: Confirmatory factor analysis. Recommendations for unweighted least squares method related to Chi-Square and RMSEA, Acción Psicológica, 12, pp. 79–90 (2015).



back to Table of Contents