Evaluation,of,students’,satisfaction,with,three,teaching,modes,in,the,contact,lens,course,by,Students’,Evaluations,of,Educational,Quality,questionnaire

Hong-Mei Zhang, Yi Pang2, Rui-Hua Wei

Abstract

•KEYWORDS:Students’ Evaluations of Educational Quality questionnaire; contact lenses; offline teaching; online teaching; blended teaching

The use of technology in education has resulted in online learning becoming a common teaching method[1-7].Many schools have incorporated this into their teaching, including medical schools[1, 8-12].The COVID-19 pandemic accelerated this process.According to the United Nations Educational, Scientific, and Cultural Organization(UNESCO), the closure of schools and universities, including Tianjin Medical University, has had an impact on 1.2 billion students.Before the year 2020, the theoretical and experimental components of the contact lens course were taught using a conventional offline(face-to-face)teaching method.In the spring semester of 2020, due to the spread of COVID-19, schools at all levels across China held off opening their classes.Following the Ministry of Education’s “stop schools, non-stop learning” campaign during the pandemic, online courses were introduced.Medical education was also severely affected by the global crisis.Most countries adopted digital remote learning modes to ensure the stability and continuity of education[1, 10, 13-17].The faculty of Tianjin Medical University School of Optometry also shifted from offline to online to facilitate students’ education.The shift was an immense challenge for all the teachers.Besides reorganizing the content, and learning the software, they also had to learn to interact with students from the other side of the screen.

Although online teaching was only a temporary method to cope with the pandemic, it presented an opportunity to move China’s education forward.Even after the lifting of the travel restrictions, the number of students who use remote learning continues to grow.This has changed the learning habits of students and the teaching habits of faculty[18].We tried a blended(online for some theoretical parts, offline for the experimental parts)teaching mode for the contact lens course in fall 2020.

In 1.5 years, students experienced three teaching modes: offline, online, and blended teaching.However, it remains unknown which one is the most acceptable.

Some studies reported no significant differences between online and offline teaching modes among health sciences students[1].Others reported significant improvement in the online learning groups[3].Studies failed to reach consistent conclusions, resulting in complex decisions when selecting a teaching method for medical education[19].

Therefore, we used an internationally validated questionnaire to assess student satisfaction with the three teaching modes in the contact lens course, as well as suggest ways to improve the course.

StudyParticipantsThe survey was conducted in June 2021 at Tianjin Medical University, which has two campuses, Dagang and Qixiangtai.The study participants comprised three groups.The first group included 92 students enrolled in 2017 at Dagang campus who were taught by online teaching; The second group included 100 students enrolled in 2018 who were taught by blended teaching; The third group included 60 students enrolled in 2017 at Qixiangtai campus who were taught by offline teaching.A total of 252 students participated in this survey.This study was conducted under the approval of the authorities and ethics committee of Tianjin Medical University Eye Hospital and adhered to the tenets of the Declaration of Helsinki.Informed consent was obtained from the subjects after an explanation of the nature and possible consequences of the study.

Students’EvaluationsofEducationalQualityQuestionnaireStudents’ Evaluations of Educational Quality(SEEQ)is one of the most widely used evaluation scales for teaching effectiveness.The SEEQ questionnaire was compiled by the eminent Australian educator Marsh[20]in 1987.It has been used in universities in many countries and regions and has good reliability, validity, and applicability[21].After being revised by Meng and Liu[22]according to the cultural characteristics of China, the SEEQ questionnaire became widely used in China[23-24].

There are 32 questions in SEEQ, all of which use a 5-point Likert scoring method, from 1(strongly disagree)to 5(strongly agree).Hence, the higher the score is, the higher the evaluation.Participants were also asked to comment on their experience using an open-ended question.

We sent an invitation letterviaweblink to explain the purpose of the study, and asked the students to complete the survey within 2wk and rate the degree to which they agreed or disagreed with each item in the questionnaire.

StatisticalAnalysisData were collected using the WenJuanXing website and analyzed using SPSS 23.0(IBM Corporation, Armonk, NY, USA)to determine the mean and standard deviation of each item.One-way ANOVA was performed to compare the difference among the three teaching modes.The difference was considered statistically significant atP<0.05.

Questionnaires with incomplete answers were excluded(n=31).A total of 221 valid questionnaires were collected, with a response rate of 87.7%(221/252).Among the respondents, 87(39.4%)were males, and 134(60.6%)were females.

The total scores were 151.46(12.45), 148.71(13.14), and 147.97(14.56)for the offline, online, and blended teaching groups, respectively, with no significant difference(F=1.10,P=0.33).The differences between males and females were not significant among the three teaching modes(P=0.44, 0.27, and 0.22, respectively; Table 1).

Table 1 The differences in evaluation scores of the three teaching modes

To further analyze each item in the SEEQ, we compared the scores of each question among three teaching modes.The mean(SD)score of Q5 was 4.74(0.53), 4.51(0.70), and 4.40(0.86)in offline, online, and blended teaching, respectively.There was a significant difference among the three modes in terms of interaction time with the faculty during office or after class(F=3.48,P=0.03).The scores of the other items were also higher in offline teaching compared to the other two modes.However, no statistically significant differences were observed(allP>0.05).

The following items got the highest scores: Q22 in offline teaching, Q24 and Q21 in online teaching, and Q21 in blended teaching.The results indicate that faculty members were sincere and responsible in teaching.The theoretical knowledge, viewpoints, and background of the course were presented in detail.The reading materials handed out were valuable.The score of Q31 ranked the lowest in all three teaching methods.Students thought they were given excessive homework which added to their pressure(Table 2).

To explore whether their academic performance affected satisfaction, we classified the students into 3 groups according to their scores in the contact lens course.Students ranked in the top 30% of the class, 30%-60% of the class and the bottom 30% of the class gave an average score of 149.23(13.89), 148.59(13.91), and 149.75(11.84), respectively.There were no statistically significant differences among the three groups(F=0.09,P=0.91).

Offline teaching got the highest score both in the top 30% of students and students ranked 30%-60%, though the difference was not significant(P=0.60 and 0.25, respectively).For the bottom 30% of the students, the score for blended teaching was the highest but there were also no significant differences among the three modes(F=0.72,P=0.50; Table 3).

A word cloud analysis of the students’ comments(Table 4)showed that 18.1%(40/221)suggested increasing the experiment time, while 5.9%(13/221)suggested increasing communication and interaction time.Some students proposed adding high-quality teaching videos and images, and some hoped that their theoretical knowledge could be extended.

Table 2 Differences among three teaching modes in each item of Students’ Evaluation of Educational Quality

Table 3 Differences among three teaching modes classified by students’ academic performance

Table 4 Some of the students’ comments

Our study showed that students were satisfied with all three teaching modes.However, they had more interaction time with teachers in offline teaching compared with online and blended teaching.It provided us with insights into the strengths and weaknesses of different teaching modes.

There was a slight advantage for traditional offline teaching over online and blended teaching in both total and individual assessments.This means that the students were accustomed to accepting traditional face-to-face teaching.It was difficult for them to adapt to the rapid transition to a complete e-learning environment.The COVID-19 pandemic accelerated the transition[25].Some students complained about network crashes and the unavailability of electronic equipment, while some were unfamiliar with the software being used[26].

Despite online and blended teaching garnering lower grades, the students claimed that remote e-learning may partially replace the traditional method of disseminating theoretical material, but not with regard to clinical expertise.Our results were consistent with Goodwinetal.’s[27]research, which found that e-learning in blended learning environments does not appear to improve students’ grades in clinical skills teaching in optometry.The study emphasized that it is important to better understand the situations in which e-learning tools can be best utilized within the optometry curriculum.Meanwhile, Subramanianetal[28]showed that online learning was better than offline for medical students.More research is required to draw a firm conclusion on this subject.

In offline teaching, students and teachers interacted more, according to item 5’s results.A better level of learning efficiency is achieved through discussions between students and teachers during offline instruction.Surprisingly, convenient networks did not increase effective communication between teachers and students in online teaching.A study by Fatani[13]also showed that web video conferencing technology caused a barrier to interact with the instructor.

As a result, teachers sometimes give their students homework assignments after school to assess their understanding; nevertheless, as item 31 demonstrated, this added pressure on the students.O’Dohertyetal[29]thought online learning not only has significant advantages in terms of flexibility and rich learning resources but also exposes the faculty’s inadequacy in teaching design.

Blended learning has shown to be a successful strategy for advancing the “classroom revolution” in higher education by addressing the shortcomings of both offline and online learning.It avoids the drawbacks of both offline and online learning while absorbing their benefits.The Chinese Ministry of Education has vigorously advocated for the development of high-quality online and offline blended courses.In a systematic review and Meta-analysis[30], in 26 of the 41 studies, blended learning groups outperformed their comparable control groups in terms of learning outcomes.In our study, blended teaching did not show its expected advantage.The reasons could be as follows.First, the faculty did not fully adopt the new teaching mode, and some of them simply recorded a lecture and uploaded it on an online platform.Second, the faculty had not yet mastered internet resources like video conferencing and virtual classrooms in such a short period of time.Our study has the following limitations.First, our participants’ knowledge and learning capacity varied, which might have an impact on the outcomes and appraisal of the three different teaching approaches.Second, the answers were self-reported; therefore, the possibility of recall and reporting bias cannot be excluded.Third, online and blended teaching was performed for one year only.Hence, more time was needed to assess these three teaching modes.

In summary,students were satisfied with all three teaching modes in the contact lens course.They had more interaction time with teachers in offline teaching compared with online teaching and blended teaching.More time is needed to increase teachers’ online teaching ability.