Hyppää sisältöön
    • Suomeksi
    • På svenska
    • In English
  • Suomeksi
  • In English
  • Kirjaudu
Näytä aineisto 
  •   Etusivu
  • LUTPub
  • Tieteelliset julkaisut
  • Näytä aineisto
  •   Etusivu
  • LUTPub
  • Tieteelliset julkaisut
  • Näytä aineisto
JavaScript is disabled for your browser. Some features of this site may not work without it.

Improving the quality of teaching by utilising written student feedback: A streamlined process

Hujala, Maija; Knutas, Antti; Hynninen, Timo; Arminen, Heli (2020-07-12)

Katso/Avaa
hujala_et_al_improving_the_quality_of_teaching_final_draft.pdf (926.2Kb)
Lataukset: 


Post-print / Final draft

Hujala, Maija
Knutas, Antti
Hynninen, Timo
Arminen, Heli
12.07.2020

Computers & Education

157

Elsevier

School of Business and Management

https://doi.org/10.1016/j.compedu.2020.103965
Näytä kaikki kuvailutiedot
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi-fe2020072847683

Tiivistelmä

Currently student feedback is mainly evaluated with quantitative methods since qualitative analysis has been highly effort intensive. In this article, we present a process for tapping into the resource of responses to open-ended feedback questions by using a topic-modelling approach that goes beyond listing modelling outcomes. The objective of this study is to present a streamlined, yet rigorous, process for analysing large amounts of written feedback that connects qualitative findings to existing literature, theories and quantitative feedback. The topic models are created using the Latent Dirichlet Allocation (LDA) method, after which qualitative and quantitative evaluation methods are used to validate the topic outcomes. The proposed process can help educators analyse teaching quality on programme- or institution-wide level, or on single courses with a very large number of students. The process systematizes and combines existing processes, is repeatable, and can serve as a basis for richer analysis for educators. In student evaluation of teaching (SET) research, it advances the state of the art in applied topic modelling by demonstrating how to validate the topics via thematic analysis and by connecting them to theoretical frameworks and quantitative data. Previous topic modelling studies in this field follow mainly descriptive approaches. We demonstrate the process with feedback data collected from 6087 student evaluations of university courses and confirm that quantitative feedback variables can be used to validate qualitative feedback topic-modelling outcomes and thematic analysis provides a more in-depth explanation of the topics. We additionally find that the proposed topic modelling approach discovers new constructs of SET that cannot be distinguished from quantitative SET measures. The main limitation of the study is that the proposed process is novel and requires further evaluation to establish its full validity.

Lähdeviite

Hujala, M., Knutas, A., Hynninen, T., & Arminen, H. (2020). Improving the quality of teaching by utilising written student feedback: A streamlined process. Computers & Education, 103965, DOI: 10.1016/j.compedu.2020.103965

Alkuperäinen verkko-osoite

https://www.sciencedirect.com/science/article/pii/S0360131520301639?via%3Dihub
Kokoelmat
  • Tieteelliset julkaisut [1560]
LUT-yliopisto
PL 20
53851 Lappeenranta
Ota yhteyttä | Tietosuoja | Saavutettavuusseloste
 

 

Tämä kokoelma

JulkaisuajatTekijätNimekkeetKoulutusohjelmaAvainsanatSyöttöajatYhteisöt ja kokoelmat

Omat tiedot

Kirjaudu sisäänRekisteröidy
LUT-yliopisto
PL 20
53851 Lappeenranta
Ota yhteyttä | Tietosuoja | Saavutettavuusseloste