Multimodal Storyboarding as a Pedagogical Tool for Enhancing Literary Comprehension
Keywords:
Multimodal storyboarding, Literary comprehension, Dual coding theory, Constructivist learningAbstract
This research investigates the educational possibilities of multimodal storyboarding as a tool to increase the comprehension of literary novels by undergraduate students. Drawing on multimodal literacy theory, dual coding theory, and constructivist pedagogy, the project explored the multimodal combination of visual, textual, and spatial semiotic modes toward a deeper engagement with challenging texts. With a convergent mixed-methods design, the intervention was delivered over six weeks with 46 Undergraduate ESL learners in a city college in Chennai. Participants created sequential visual panels, converting one full-length novel from text to visual panels and engaging with structured prompts and discursive reflections. Quantitative analysis of the pre- and post-intervention assessments indicated significant improvements in overall comprehension, with the most exemplified gains on thematic interpretation and inferencing for ESL students. Thematic analysis of focus group discussions demonstrated that the multimodal nature of the task contributed to student autonomy of interpretation, affective engagement, and meaning-making in collaboration with peers. The instructor's reflections further indicated enhanced participation, a more evenness of discourse during classroom discussion, and fewer evasion strategies to complete the task. Overall, this study implies that multimodal storyboarding engages more productive cognitive processing and provides equitable access to literary engagement, drawing on learning students’ varied learning and processing styles. The findings recommend the implementation of multimodal strategies, including storyboarding, into higher education teaching of literature to enhance understanding, critical analysis, and inductive pedagogical practice.
References
Bernstein, R., & Osman, R. (2019). Pedagogical practices in higher education: A narrative synthesis of the literature. Teaching in Higher Education, 24(3), 322–339. https://doi.org/10.1080/13562517.2018.1471451
Bezemer, J., & Jewitt, C. (2018). Multimodality, learning and communication: A social semiotic frame. Routledge. https://doi.org/10.4324/9781315687537
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational Psychology Review, 3(3), 149–210. https://doi.org/10.1007/BF01320076
Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE.
Giannakos, M. N. (2023). The role of visualizations in higher education: A systematic review and research agenda. Computers & Education, 194, 104670. https://doi.org/10.1016/j.compedu.2022.104670
Hughes, J. (2020). Re-thinking literature pedagogy in a digital age. Changing English, 27(3), 239–252. https://doi.org/10.1080/1358684X.2020.1773392
Jewitt, C. (2017). Introducing multimodality. Routledge. https://doi.org/10.4324/9781315638027
Kanellopoulou, C. (2019). Revisiting dual coding theory in the context of multimedia learning. Journal of Educational Multimedia and Hypermedia, 28(3), 239–257.
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge. https://doi.org/10.4324/9780203970034
Li, Q. (2022). Applying cognitive load theory in instructional design for complex learning. Educational Technology Research and Development, 70(5), 2231–2254. https://doi.org/10.1007/s11423-022-10162-5
Linder, C. (2024). Inclusive approaches to literature pedagogy in multilingual contexts. Language and Education, 38(1), 72–87. https://doi.org/10.1080/09500782.2023.2215439
Mayer, R. E. (2017). Using multimedia for e-learning. Journal of Computer Assisted Learning, 33(5), 403–423. https://doi.org/10.1111/jcal.12197
Mawaddah, S., & Heriyawati, D. F. (2022). Digital storytelling to enhance EFL learners’ literacy skills. Journal of Language Teaching and Research, 13(4), 834–842. https://doi.org/10.17507/jltr.1304.14
Navila, M., Rahman, A., & Akhter, S. (2023). Multimodal strategies in ESL classrooms: Impacts on learner engagement. Asian EFL Journal, 27(1), 140–160.
Paivio, A. (2007). Mind and its evolution: A dual coding theoretical approach. Psychology Press.
Serafini, F. (2014). Reading the visual: An introduction to teaching multimodal literacy. Teachers College Press.
Toister, A. (2020). Visual storytelling in education: From film storyboards to classroom practice. International Journal of Education and the Arts, 21(5), 1–21.