Developing Rubrics and Tasks for Measuring Coding Competency for Mathayomsuksa 3 Students
Keywords:
Rubric, Coding Competency, Board Games, Scratch OnlineAbstract
This research aimed to: 1) develop coding competency rubrics for Mathayomsuksa 3 students and 2) develop tasks for measuring coding competency for Mathayomsuksa 3 Students. Informants were 5 coding experts and 60 students selected through purposive sampling to represent a range of abilities. The research instruments were analytic rubrics and two types of tasks: board games and online Scratch programming. Statistics used in data analysis included mean, standard deviation, Aiken's V index and the intra-rater reliability coefficients. The results showed that 1) the rubrics for coding competency consisted of 5 dimensions: abstraction, decomposition, algorithmic thinking, evaluation, and generalization/ patterns. Scoring criteria met content validity (Aiken index value of 1.0) and the intra - rater reliability coefficients of .96 to .97. 2) the tasks measuring coding competency through using board games met content validity (Aiken index value of 1.00), with the discrimination indices ranging from .65 to .70 and the difficulty indices ranging from .54 to .57 ; and the tasks measuring coding competency thrush using online Scratch programming met content validity (Aiken index value of 1.00), with the discrimination indices ranging from .61 to .63 and the difficulty indices ranging from .53 to .60
References
ชนิสรา สงวนไว้ และศิริชัย กาญจนวาสี. (2559). การเปรียบเทียบความเที่ยงของแบบสอบวัดความสามารถในการแก้ปัญหาอย่างสร้างสรรค์ ทางคณิตศาสตร์: การประยุกต์ใช้ทฤษฎีการสรุปอ้างอิงความน่าเชื่อถือของผลการวัด. OJED, 11(4), 743–760.
สำนักงานเลขาธิการสภาการศึกษา. (2564). แนวทางการส่งเสริมการจัดการเรียนการสอนวิทยาการคำนวณ Coding เพื่อพัฒนาทักษะผู้เรียนในศตวรรษที่ 21. กรุงเทพฯ: 21 เซ็นจูรี่.
Balanskat, A., Engelhardt, K. (2015). Computing our Future: Computer Programming and Coding-Priorities, School Curricula and Initiatives across Europe, European Schoolnet. Retrieved on May 25, 2022 from https://www.researchgate.net/publication/284139559
Brackmann, C. P., Román-González, M., Robles, G., Moreno-León, J., Casali, A., & Barone, D. (2017). Development of Computational Thinking Skills Through Unplugged Activities in Primary School. In Proceedings of the 12th Workshop on Primary and Secondary Computing Education (p. 65-72). Netherlands: Nijmegen. Retrieved on May 9, 2022 from https://doi.org/10.1145/ 3137065.3137069
Brennan, K., & Resnick, M. (2012). New Frameworks for Studying and Assessing the Development of Computational Thinking. Retrieved on May 9, 2022 from https://scratched.gse.harvard.edu/ct/files/AERA2012.pdf
Csizmadia, A., Curzon, P., Dorling, M., Humphreys, S., Ng, T., Selby, C., & Woollard, J. (2015). Computational thinking: A guide for teachers (Computing at School). Retrieved on May 9, 2022 from https://eprints.soton.ac.uk/424545/1/150818_Computational_Thinking_1_.pdf
Djambong, T. (2016). Computational Thinking in Connection With the Acquisition of Key Skills for the 21st Century: Reflection from Literature Review. In Proceedings of 8th International Conference on Education and New Learning Technologies (p.500-509). Spain: Barcelona. Retrieved on May 9, 2022 from https://competi.ca/wp-content/uploads/2014/04/publication-djambong-takam-edulearn16.pdf
Ebel, R.L., & Frisbie, D. A. (1986). Essentials of educational measurement (4th ed.). Englewood Cliffs, NJ: Prentice Hall.
Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144. Retrieved on May 20, 2022 from https://doi.org/10.1016/j.edurev.2007.05.002.
Koo, T. K., & Li, M. Y, (2016). A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of Chiropractic Medicine, 15(2), 155–163. Retrieved on May 9, 2022 from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4913118/pdf/main.pdf
Korkmaz, Ö. (2016). The Effect of Scratch-and Lego Mindstorms Ev3-Based Programming Activities on Academic Achievement, Problem-solving Skills and Logical-mathematical Thinking Skills of Students. Malaysian Online Journal of Educational Sciences, 4(3), 73-88. Retrieved on May 9, 2022 from https://eric.ed.gov/?id=EJ1106444
Mehrens, W. A., & Lehmann, I. J. (1991). Measurement and Evaluation in Education and Psychology (4th ed.). New York, NY: Houghton Mifflin Company.
National Research Council. (2010). Report of a Workshop on the Scope and Nature of Computational Thinking. Washington, D.C: National Academies Press. Retrieved on April 25, 2022 from https://www.nae.edu/24767/Report-of-a-Workshop-on-The-Scope-and-Nature-of-Computational-Thinking.
Sireci, Stephen G., & Faulkner-Bond, M. (2014). Validity Evidence Based on Test Content. Psicothema, 26(1), 100-107. Retrieved on May 10, 2022 from https://www.researchgate.net/publication/259825627_Validity_evidence_based_on_test_content.
Thorndike, R. M., Cunningham, G. K., Thorndike, R. L., & Hagen, E. P. (1991). Measurement and Evaluation in Psychology and Education (5th ed.). NY: Macmillan Publishing.
Tsarava, K., Moeller, K., Pinkwart, N., Butz, M., Trautwein, U. & Ninaus, M. (2017). Training Computational Thinking: Game-based Unplugged and Plugged-in Activities in Primary School. Retrieved on April 15, 2022 from https://www.researchgate.net/publication/320491120
Unahalekhaka, A., & Bers, M. U. (2022). Evaluating Young Children’s Creative Coding: Rubric Development and Testing for ScratchJr Projects. Education and Information Technologies, 27(5), 6577–6597. Retrieved on April 25, 2022 from https://doi.org/10.1007/s10639-021-10873-w
Wing, J. M. (2006). Computational Thinking. Communications of the ACM, 49(3), 33–36.
Wing, J. M. (2010). Computational Thinking: What and why?. Retrieved on April 28, 2022 from https://www.cs.cmu.edu/CompThink/resources/TheLinkWing.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Suan Dusit Graduate School Academic Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
