Informing Makerspace Outcomes Through a Linguistic Analysis of Written and Video-Recorded Project Assessments
International Journal of Science and Mathematics Education
A growing body of research focuses on what outcomes to assess in makerspaces, and appropriate formats for capturing those outcomes (e.g. reflections, surveys, and port-folios). Linguistic analysis as a data mining technique holds promise for revealing different dimensions of learning exhibited by students in makerspaces. In this study, student reflections on makerspace projects were gathered in 2 formats over 2 years: private written assessments captured in the 3D GameLab gamification platform, and semi-public video-recorded assessments posted in the more social FlipGrid platform. Transcripts of student assessments were analyzed using Linguistic Inquiry Word Count (LIWC) to generate 4 summary variables thought to inform makerspace outcomes of interest (i.e. analytical thinking, authenticity, clout, and emotional tone). Comparative findings indicate that written assessments may elicit more analytical thinking about maker projects compared with less analytical conversation in videos, while video assessments may elicit somewhat higher clout scores as evidence of social scaffolding along with a much more positive emotional tone. Recommendations are provided for layering assessment approaches to maximize the potential benefits of each format, including reflective writing for social spaces, in social groups, and about design processes and procedures.
Original Publication Citation
Oliver, K. M., Houchins, J. K., Moore, R. L., & Wang, C. (2021). Informing makerspace outcomes through a linguistic analysis of written and video-recorded project assessments. International Journal of Science and Mathematics Education 19, 333–354. https://doi.org/10.1007/s10763-020-10060-2
Oliver, Kevin M.; Houchins, Jennifer K.; Moore, Robert L.; and Wang, Chuang, "Informing Makerspace Outcomes Through a Linguistic Analysis of Written and Video-Recorded Project Assessments" (2021). STEMPS Faculty Publications. 112.
Educational Assessment, Evaluation, and Research Commons, Educational Technology Commons
This is a pre-print of an article published in International Journal of Science and Mathematics Education. The final authenticated version is available online at: https://doi.org/10.1007/s10763-020-10060-2.