The end of semester survey of students has become ubiquitous in tertiary education. The literature on its use goes back the 70s. That’s just the majority of the work too; there is some research into the use of surveys for teaching from the early 20th century. With 40 plus years of serious research effort it would be safe to assume that the system used to measure teaching quality and help improve it is well established and well developed the best spiritual movies. Therefore, if an academic knows how to use and respond to these surveys, then that academic can’t help but become a better teacher. The only gap then would be how to use the current survey system properly.
As i mentioned above, the research into teaching quality really took off in the 70s. This was before the quality revolution of the late 70s and early 80s where new quality principles developed in Japan flowed to the rest of the world. It was first in manufacturing and then it spread to services and other business areas. However, it seems that because research into teaching quality started before the quality revolution, the area developed without input from other areas that were developing quality systems. The end effect was that teaching quality took a very different path and because it was a much smaller community, did not benefit from the larger pool of ideas and research findings. The end effect is that when it comes to quality, teaching has been left decades behind the rest of the world.
The biggest flaw with quality control in teaching is the focus on time. Many assume that having a single survey at the end of the semester, when the students have had a chance to see the whole subject, is the best time to ask them their thoughts. However, establish quality control theory says that a quality outcome can only be achieved by tracking the state of the respective system all the time. If you wait until the end, then you have simply produced a bad outcome (probably) and let it go out into the world – it’s too late. Instead, you must ensure that each step taken to bring about the desired outcome is executed correctly to ensure that the entire process is working correctly. Then the desired outcome (in this case a well-educated student) can be expected.
The next biggest flaw is the idea that all data collected must be tabulated and recorded for distribution to all members of the organisation. Much modern quality control is within the system being controlled and the operator(s) of that system. This was not easily achieved. Many factory mangers dislike the idea of a problem eventuating, that problem being identified by the machine operator, then being fixed by the operator, and the factory manager never knowing. The system works well, but many fear ignorance. This seems to have carried over to academia. Academics are not given the chance to see that an issue is forming and a chance to correct it. Instead, the results of surveys are often withheld until assessment is completed with not chance to correct the issues.
The third flaw that i will talk about is the focus on what is measured. Teaching quality control efforts have noted correctly that it is the inputs to the system that need to be measured and controlled to ensure a good outcome. However, whereas in technical system the inputs and output are easy to identify and relate, in teaching they are not. The end effect is that the typical quality control tool in teaching is large and tries to measure anything that could affect teaching. Ideally, the quality control system would be adaptable, and able to find the issue that needs to be dealt with at the time. Not only do you realise that you might misunderstood your students, but you will also find out when your students misunderstood you.
You will at times find that the issue is not with the subject, the students’ ability, your teaching method or the anything like teaching material. Instead, it will sometimes be a perspective. Because the students can come to a subject with a certain perspective about what it is meant to offer, they will find the teaching incongruent with the subject matter. This perspective becomes very clear with comments left in the early stages of the subject. By correcting these earlier, you will find that students can adjust their position and learning style to suit sooner, and get more from the subject.
Leave a Reply