Educational Seduction, or the Dr. Fox Effect
In a well-known study, a professional actor was hired to deliver
a non-substantive and contradictory lecture, but in an
enthusiastic and authoritative style. The audience, consisting of
professional educators, had been told they would be listening to
Dr. Myron Fox, an expert on the application of mathematics to
human behavior. They were then asked to rate the lecture. Dr.
Fox received highly positive ratings, and no one saw through the
Student Evaluations: A Critical Review 4/22/21, 11:33 AM
https://spot.colorado.edu/~huemer/papers/sef.htm Page 5 of 14
hoax.(14) Later studies have obtained similar results,(15) showing
that audience ratings of a lecture are more strongly influenced by
superficial stylistic matters than by content.
Adding support to this conclusion was another study, in which
students were asked to rate instructors on a number of
personality traits (e.g., “confident,” “dominant,” “optimistic,”
etc.), on the basis of 30-second video clips, without audio, of the
instructors lecturing. These ratings were found to be very good
predictors of end-of-semester evaluations given by the
instructors’ actual students. A composite of the personality trait
ratings correlated .76 with end-of-term course evaluations;
ratings of instructors’ “optimism” showed an impressive .84
correlation with end-of-term course evaluations. Thus, in order
to predict with fair accuracy the ratings an instructor would get,
it was not necessary to know anything of what the instructor
said in class, the material the course covered, the readings, the
assignments, the tests, etc.(16)
Williams and Ceci conducted a related experiment. Professor
Ceci, a veteran teacher of the Developmental Psychology course
at Cornell, gave the course consecutively in both fall and spring
semesters one year. In between the two semesters, he visited a
media consultant for lessons on improving presentation style.
Specifically, Professor Ceci was trained to modulate his tone of
voice more and to use more hand gestures while speaking. He
then proceeded, in the spring semester, to give almost the
identical course (verified by checking recordings of his lectures
from the fall), with the sole significant difference being the
addition of hand gestures and variations in tone of voice
(grading policy, textbook, office hours, tests, and even the basic
demographic profile of the class remained the same). The result:
student ratings for the spring semester were far higher, usually
by more than one standard deviation, on all aspects of the course
and the instructor. Even the textbook was rated higher by almost
a full point on a scale from 1 to 5. Students in the spring semester
believed they had learned far more (this rating increased from
2.93 to 4.05), even though, according to Ceci, they had not in fact
learned any more, as measured by their test scores. Again, the
conclusion seems to be that student ratings are heavily
Student Evaluations: A Critical Review 4/22/21, 11:33 AM
https://spot.colorado.edu/~huemer/papers/sef.htm Page 6 of 14
influenced by cosmetic factors that have no effect on student
learning.
6. Academic Freedom
Some argue that SEF are a threat to academic freedom.(17) Not
only do SEF influence instructors’ grading policies, teaching
style, and course difficulty, but they may also restrict what a
professor says in class. Professors may feel inhibited from
discussing controversial ideas or challenging students’ beliefs,
for fear that some students will express their disagreement
through the course evaluation form. More than one author has
described SEF as “opinion polls,” with the suggestion that SEF
require professors to think like politicians, seeking to avoid
giving offense and putting style before substance.(18)
Alan Dershowitz reports that some of his students have “used
the power of their evaluations in an attempt to exact their
political revenge for my politically incorrect teaching.” One
student, who complained to Dershowitz about his (Dershowitz’)
teaching about rape from a civil liberties perspective, informed
Dershowitz that he should expect to be “savaged” on the student
evaluations at the end of the term. Several students subsequently
complained on their teaching evaluations about the content of
his lectures on the subject of rape, saying that they were
offensive, that he should not be allowed to teach at Harvard, and
so on. Alan Dershowitz, of course, need have little fear of losing
his job. The same is not true of less prominent, junior faculty at
institutions across the country.(19) I have personally received
evaluation forms complaining that the professor “teaches his
own views,” and I have as a result been influenced to remove
controversial material from my classes.
College students do not have a universal appreciation for the
ideals of free speech and academic freedom. An anthropology
professor I once had at Berkeley became locally (in)famous for
his criticisms of affirmative action and for his view that
minorities and women had lower average levels of intelligence
than the rest of the population. Subsequently, a group of
Student Evaluations: A Critical Review 4/22/21, 11:33 AM
https://spot.colorado.edu/~huemer/papers/sef.htm Page 7 of 14
students disrupted his class to protest against his allegedly
racist, sexist, and homophobic teachings. The students went on
to call for his dismissal from the university. Signs appeared on
campus saying, “No more racist bullshit in the name of academic
freedom.”(20) Berkeley, it seemed, had come a long way since the
days of the free speech movement. Fortunately for him, the
professor already had tenure. But what would have happened to
a junior faculty member in a similar position? Given the student
reaction in this case, it is not difficult to imagine that even much
less controversial statements might have elicited low end-ofterm
evaluations from those students who wished to see the
professor fired. Even a small percentage of such extremely
negative evaluations could have a significant impact on a
professor’s career.
Professors discussing unconventional or controversial ideas may
also receive a larger number of very positive student
evaluations, relative to other professors whose classes are more
bland and, perhaps, boring. In spite of this, there are two reasons
why the overall incentive created by SEF will be for the professor
to avoid controversy. First, the average rating professors receive
is 4 or above on a scale of 1 – 5; therefore, a very hostile student
can give a rating three points below the average, whereas a very
enthusiastic student can only give a rating one point above the
average. Thus, assuming the professor is average, the marginal
unusually hostile student has an impact up to three times greater
than the marginal unusually enthusiastic student. Second, there
is a saying in American politics to the effect that one doesn’t gain
votes, one only loses them–meaning that it is much easier to
earn a voter’s opposition through taking substantive stands on
issues than it is to gain support by doing so. If a politician says
three things that I agree with and one that I disagree with (all
concerning emotionally charged issues), I am more likely to vote
against him, provided the other candidate did not say anything I
disagreed with, even if this was because the latter said very little
at all. This explains why American politicians often avoid taking
non-trivial stands on issues. A similar principle applies to
professors, when their retention is decided in a similar manner:
any statement or question a teacher raises that anyone could take
offense at will run a risk of evoking hostile reactions from a few
Student Evaluations: A Critical Review 4/22/21, 11:33 AM
https://spot.colorado.edu/~huemer/papers/sef.htm Page 8 of 14
students who will regard the statement or question as grounds
for a negative evaluation, while there is little chance that even a
non-hostile student will take it as grounds for an especially
positive evaluation. Thus, it is reasonable to suppose that the
degree to which a professor is controversial would be a strong
depressive factor on his student evaluations, although this thesis
has not yet been subjected to systematic testing.
There exist simple and well-known ways for a professor to avoid
giving offense. One technique, when a class ostensibly focuses
on a controversial subject matter, is to focus one’s lectures on
what other people have said. For example, a professor may,
without raising any eyebrows, teach an entire course of lectures
on ethics without ever making an ethical statement, since he
confines himself to making reports of what other people have
said about ethics. This ensures that no one can take offense
towards him. During classroom discussions, he may simply nod
and make non-committal remarks such as “Interesting” and
“What do the rest of you think about that?”, regardless of what
the students say. (This provides the added “advantage” of
reducing the need both for preparation before class and for effort
during class, on the part of the professor.) Although pedagogic
goals may often require correcting students or challenging their
logic, SEF-based performance evaluations provide no incentive
to do so, while the risk of reducing student happiness provides a
strong incentive not to do so. Some students may take offense, or
merely experience negative feelings, upon being corrected,
whereas it is unlikely that students would experience such
negative feelings as a result of a professor’s failure to correct
them. Overall, SEF reward professors who tell their students
what they want to hear.
G. F. Schueler draws our attention to a related case:
Socrates, who is usually thought to have been one of the world’s
“Great Teachers,” nevertheless received rather low marks from his
“students” on his final teaching evaluation. At a time of life when
most of us would long since have retired, the Athenian jurors at
his trial met his request for a pension by voting to put him to
death…(21)
Student Evaluations: A Critical Review 4/22/21, 11:33 AM
https://spot.colorado.edu/~huemer/papers/sef.htm Page 9 of 14
As Schueler notes, there is no reason to believe that the majority
of Athenian citizens who were familiar with Socrates’ activities
would have evaluated his work as a philosopher much
differently. The death sentence, allegedly for corrupting the
youth and believing in gods of his own invention, was Socrates’
payment for his lifelong efforts at challenging the beliefs of his
fellow citizens. Though today’s students lack the power to put to
death professors with whom they disagree, the lesson that such
challenges are not always welcome is unlikely to be lost on those
professors who hold unconventional views.
7. Why Use SEF?
In the light of the preceding objections, why do most institutions
continue to use SEF? The main reasons are probably the
following: (a) SEF are easy and inexpensive to administer. (b)
SEF give an impression of objectivity, in comparison with more
“subjective” measures such as letters from observers, since SEF
produce definite numbers. (The impression seems to be an
illusion, however, since the numbers are merely measurements
of subjective impressions.) (c) There are few alternatives to SEF,
if one wants to assess teaching effectiveness. Steven Cahn argues
that teaching should be assessed by experts in the field, i.e., one’s
colleagues,(22) but as indicated in section 1, such measures
appear to be even less valid. Greenwald and Gillmore suggest
using student ratings but with statistical corrections for grading
leniency; this, however, would not address the concerns of
sections 4, 5, and 6 above.
8. Other Approaches
Institutions seeking to improve teaching quality may take one or
more of the following measures, which would not be subject, or
would be less subject, to the objections of sections 3-6:
1. Faculty members could be offered courses or workshops on
improving teaching effectiveness, receiving recognition on
performance reviews for having taken such courses.
Student Evaluations: A Critical Review 4/22/21, 11:33 AM
https://spot.colorado.edu/~huemer/papers/sef.htm Page 10 of 14
2. Student evaluation forms could be redesigned to emphasize
relatively objective matters, such as “Did the professor come to
class on time?”, “Did he read student work and return it within a
reasonable time frame?”, and so on, rather than subjective items
such as “How would you rate this instructor?” or “How fair was
the grading?” The former sort of questions would probably be
less subject to the effects of bias than the latter. In addition, they
have a better chance of inducing improvements in teaching
performance.
3. Written comments might be taken into account in weighting
student ratings. Evaluation forms on which low ratings are given
without explanation, or where the complaints are directed at the
professor’s beliefs, the harshness of the grading, the difficulty of
the course, or the professor’s personal characteristics (such as
physical appearance, clothing style, or personality) might be
discounted.
4. Teaching can be evaluated in part by examination of syllabi
and other course materials. These can be used to verify that a
course contains substantive content; but professors should not be
monitored for the “correctness” or moral or political value of that
content.
Are you busy and do not have time to handle your assignment? Are you scared that your paper will not make the grade? Do you have responsibilities that may hinder you from turning in your assignment on time? Are you tired and can barely handle your assignment? Are your grades inconsistent?
Whichever your reason is, it is valid! You can get professional academic help from our service at affordable rates. We have a team of professional academic writers who can handle all your assignments.
Students barely have time to read. We got you! Have your literature essay or book review written without having the hassle of reading the book. You can get your literature paper custom-written for you by our literature specialists.
Do you struggle with finance? No need to torture yourself if finance is not your cup of tea. You can order your finance paper from our academic writing service and get 100% original work from competent finance experts.
Computer science is a tough subject. Fortunately, our computer science experts are up to the match. No need to stress and have sleepless nights. Our academic writers will tackle all your computer science assignments and deliver them on time. Let us handle all your python, java, ruby, JavaScript, php , C+ assignments!
While psychology may be an interesting subject, you may lack sufficient time to handle your assignments. Don’t despair; by using our academic writing service, you can be assured of perfect grades. Moreover, your grades will be consistent.
Engineering is quite a demanding subject. Students face a lot of pressure and barely have enough time to do what they love to do. Our academic writing service got you covered! Our engineering specialists follow the paper instructions and ensure timely delivery of the paper.
In the nursing course, you may have difficulties with literature reviews, annotated bibliographies, critical essays, and other assignments. Our nursing assignment writers will offer you professional nursing paper help at low prices.
Truth be told, sociology papers can be quite exhausting. Our academic writing service relieves you of fatigue, pressure, and stress. You can relax and have peace of mind as our academic writers handle your sociology assignment.
We take pride in having some of the best business writers in the industry. Our business writers have a lot of experience in the field. They are reliable, and you can be assured of a high-grade paper. They are able to handle business papers of any subject, length, deadline, and difficulty!
We boast of having some of the most experienced statistics experts in the industry. Our statistics experts have diverse skills, expertise, and knowledge to handle any kind of assignment. They have access to all kinds of software to get your assignment done.
Writing a law essay may prove to be an insurmountable obstacle, especially when you need to know the peculiarities of the legislative framework. Take advantage of our top-notch law specialists and get superb grades and 100% satisfaction.
We have highlighted some of the most popular subjects we handle above. Those are just a tip of the iceberg. We deal in all academic disciplines since our writers are as diverse. They have been drawn from across all disciplines, and orders are assigned to those writers believed to be the best in the field. In a nutshell, there is no task we cannot handle; all you need to do is place your order with us. As long as your instructions are clear, just trust we shall deliver irrespective of the discipline.
Our essay writers are graduates with bachelor's, masters, Ph.D., and doctorate degrees in various subjects. The minimum requirement to be an essay writer with our essay writing service is to have a college degree. All our academic writers have a minimum of two years of academic writing. We have a stringent recruitment process to ensure that we get only the most competent essay writers in the industry. We also ensure that the writers are handsomely compensated for their value. The majority of our writers are native English speakers. As such, the fluency of language and grammar is impeccable.
There is a very low likelihood that you won’t like the paper.
Not at all. All papers are written from scratch. There is no way your tutor or instructor will realize that you did not write the paper yourself. In fact, we recommend using our assignment help services for consistent results.
We check all papers for plagiarism before we submit them. We use powerful plagiarism checking software such as SafeAssign, LopesWrite, and Turnitin. We also upload the plagiarism report so that you can review it. We understand that plagiarism is academic suicide. We would not take the risk of submitting plagiarized work and jeopardize your academic journey. Furthermore, we do not sell or use prewritten papers, and each paper is written from scratch.
You determine when you get the paper by setting the deadline when placing the order. All papers are delivered within the deadline. We are well aware that we operate in a time-sensitive industry. As such, we have laid out strategies to ensure that the client receives the paper on time and they never miss the deadline. We understand that papers that are submitted late have some points deducted. We do not want you to miss any points due to late submission. We work on beating deadlines by huge margins in order to ensure that you have ample time to review the paper before you submit it.
We have a privacy and confidentiality policy that guides our work. We NEVER share any customer information with third parties. Noone will ever know that you used our assignment help services. It’s only between you and us. We are bound by our policies to protect the customer’s identity and information. All your information, such as your names, phone number, email, order information, and so on, are protected. We have robust security systems that ensure that your data is protected. Hacking our systems is close to impossible, and it has never happened.
You fill all the paper instructions in the order form. Make sure you include all the helpful materials so that our academic writers can deliver the perfect paper. It will also help to eliminate unnecessary revisions.
Proceed to pay for the paper so that it can be assigned to one of our expert academic writers. The paper subject is matched with the writer’s area of specialization.
You communicate with the writer and know about the progress of the paper. The client can ask the writer for drafts of the paper. The client can upload extra material and include additional instructions from the lecturer. Receive a paper.
The paper is sent to your email and uploaded to your personal account. You also get a plagiarism report attached to your paper.
Delivering a high-quality product at a reasonable price is not enough anymore.
That’s why we have developed 5 beneficial guarantees that will make your experience with our service enjoyable, easy, and safe.
You have to be 100% sure of the quality of your product to give a money-back guarantee. This describes us perfectly. Make sure that this guarantee is totally transparent.
Read moreEach paper is composed from scratch, according to your instructions. It is then checked by our plagiarism-detection software. There is no gap where plagiarism could squeeze in.
Read moreThanks to our free revisions, there is no way for you to be unsatisfied. We will work on your paper until you are completely happy with the result.
Read moreYour email is safe, as we store it according to international data protection rules. Your bank details are secure, as we use only reliable payment systems.
Read moreBy sending us your money, you buy the service we provide. Check out our terms and conditions if you prefer business talks to be laid out in official language.
Read more