Pre-Rate My Professor: Predicting Course Ratings And Response Rates From Lms Activity In College Courses

Loading...
Thumbnail Image

Degree type

Doctor of Philosophy (PhD)

Graduate group

Education

Discipline

Subject

College teaching
Course evaluation
Educational data mining
Higher education
Learning analytics
Learning management system
Higher Education Administration
Higher Education and Teaching

Funder

Grant number

License

Copyright date

2022-09-09T20:21:00-07:00

Distributor

Related resources

Contributor

Abstract

College teaching is primarily assessed through the use of course ratings, which are expected to act as both summative and formative feedback. Considering the significance of teaching in academia and the amount of time professors spend on teaching and related activities, it is particularly important that ratings are effective formative feedback. In this study, methods from learning analytics and data mining are used in an effort to predict course ratings and response rates on ratings surveys from students’ activity in the course learning management system, with the goal of making predicted ratings available to faculty early. Regression and classification methods used in this study included linear and logistic regression, random forests, and gradient boosting and features were chosen based on their inclusion in earlier studies predicting individual student success and motivation. However, none of the models created for this study were not able to accurately predict either course ratings or response rates on either the entire data sample or a subset of classes with higher LMS activity. This may have been caused by difficulties with aggregating features or outcome variables to the class level, which was necessary due to the confidentiality of the student ratings. It may also result from the complexity of good college teaching: unlike individual student grades or motivation, which have been successfully predicted, there are many successful and unsuccessful forms of teaching.

Date of degree

2021-01-01

Date Range for Data Collection (Start Date)

Date Range for Data Collection (End Date)

Digital Object Identifier

Series name and number

Volume number

Issue number

Publisher

Publisher DOI

relationships.isJournalIssueOf

Comments

Recommended citation