Guidelines for Evaluating Teaching

Just as there is no simple system for evaluating the quality of faculty research, there is no simple system for evaluating the quality of faculty teaching. However, by thinking carefully about the purposes of evaluation, and by crafting multiple methods of evaluation that suit those purposes, one can devise evaluation systems that are reliable, valid, and fair. Equally important, the process of discussing and crafting evaluation systems focuses attention on the practice of good teaching and helps to create a culture in which teaching is highly valued.

Some Principles of Teaching Evaluation

• Multiple methods.
  The most important consideration in teaching evaluation, both for improvement purposes and for personnel decisions, is the use of multiple methods of teaching evaluation involving multiple sources of data.
• Faculty, departmental and school responsibilities.
  To ensure that the evaluation system adopted is credible and acceptable, faculty members must have a strong hand in its development. Before departments and schools adopt teaching evaluation systems, the faculty members should determine their criteria for effective teaching. Departments and schools can then take responsibility for developing their own evaluation methods and evaluation criteria. Since different disciplines require different methods and settings for instruction, they require different methods and criteria for evaluation. This is also true for interdisciplinary instruction. Teaching evaluation systems can be flexible to accommodate diversity in instructional methods (e.g., lecture, discussion, lab, case study, small group interaction, practicum, studio, field work, clinical work, etc.). To promote compatibility within the university, standards should be reviewed, understood, and accepted by all groups involved in the promotion and tenure review process.
• Individualizing teaching evaluation.
  Effective teaching evaluation must be individualized. A uniform system discriminates against some individuals, so a plan sensitive to individual variation should be developed. A faculty member should provide information about his/her contributions and accomplishments as a teacher on a longitudinal basis over his/her teaching career. Consideration can then be given to changes in emphasis and interest that will naturally occur in an academic career.
• What may be assessed.
  Teaching evaluation has as its central element the assessment of the quality of classroom instruction. Since teaching includes activities broader than classroom instruction, evaluation of teaching must assess more than classroom performance. While departments and schools may identify additional items, among the teaching activities that may be assessed are the following:
  • quality, amount, and level of classroom instruction (including shared instruction)
  • development of curricula, new courses, and classroom materials;
  • supervision and mentoring of graduate students, including chairing of dissertations;
  • service on graduate examination and dissertation committees;
  • one-on-one consultation with students, including supervision of independent study and readings courses;
  • supervision of teaching assistants in undergraduate courses;
  • conduct and supervision of laboratory instruction;
  • supervision of undergraduate and graduate research;
  • advising students in the major;
  • supervision of field work; and
  • supervision of clinical and practicum experiences.

  Some Sources of Data for Evaluating Teaching: Students, Colleagues, and Self-Reflection

  Students: Multiple Sources

  • End-of-course rating forms and written comments. Generally, students are able to report on the extent to which a teacher appears prepared for class sessions, communicates clearly, stimulates interest, and demonstrates enthusiasm and respect for students; research shows that student responses on these dimensions are valid and reliable. Generally, students are less able to judge the knowledge of the instructor or scholarly content and currency of a course.
  • When using student ratings for personnel decisions and teaching improvement, institutions often include the following among their guidelines:
    • Questions about instructors and courses should be relevant. They should fit the instructors and courses being evaluated.
    • Multiple sets of ratings of faculty courses over time should be considered; personnel decisions should be influenced only by ratings from several courses over several terms.
    • Because global ratings of the teacher or course tend to correlate higher with student learning than do more specific items, personnel decisions should rely more on global items (e.g., "Overall, this is an excellent course." "Overall, the instructor is an excellent teacher.").
    • Comparative data (such as departmental, school, or institutional norms) should be provided so that individual evaluations can be interpreted within a meaningful context. For example, information about course characteristics (e.g., disciplinary field, class size, required/elective, lower division/upper division, etc.) should be considered when reviewing evaluation results.
    • When results from student evaluation forms are used in personnel decisions, it is essential that standardized procedures for administering the forms be followed. Procedures should indicate who will distribute, collect and return questionnaires; when the evaluations should take place; and when the evaluation results will be made available.
    • Student rating results should be considered in personnel decisions only when most of the students in a class have completed the surveys.
    • The use of optional items chosen by the instructor customizes and makes the forms more useful for teaching improvement purposes.
    • Rating forms should include open-ended questions so that students can write their own comments. Written comments are particularly helpful in improving classroom performance.
    • A knowledgeable colleague or teaching improvement consultant should be available to discuss evaluation results with individuals in order to help them interpret scores, provide encouragement, and suggest teaching improvement strategies.

    Colleagues: Peer Review

    • In most institutions, faculty and administrators have relied on student ratings of teaching effectiveness for teaching improvement purposes and for personnel decisions. Now, however, surveys about how teaching is evaluated on college and university campuses demonstrate an increase in use of faculty colleagues as raters of teaching effectiveness. Colleague review of teaching can play as significant a role as does peer evaluation of research.
    • Colleagues who have expertise in the discipline being taught and training in what to observe can provide important evaluative information through classroom visits and review of course materials and instructional contributions. For a faculty member engaged in interdisciplinary instruction, evaluation may involve colleagues with expertise in similar interdisciplinary instruction and/or with expertise in each of the individual disciplines represented by the faculty member.
      • Evaluation of classroom teaching -- Colleagues can provide important evaluative information through classroom visits. In particular, a colleague's observation of such aspects of teaching as appropriateness of materials and methods, breadth and depth of material covered, the relation of such material to the syllabus and goals of the course, and incorporation of recent developments in the discipline can offer a more informed appraisal of the instructor's mastery of content than can students' perceptions. There is consensus that peer observation has enjoyed more success as a strategy for teaching improvement than for personnel decisions. When used for personnel decisions, it is important to have explicit criteria by which colleagues make evaluations. A standardized observation form will yield systematic and comparable data, especially if participating faculty are trained in what and how to observe. The evaluation process is enhanced when, prior to classroom visits, colleagues review the syllabus and course-related materials and discuss course goals and class objectives with the instructor.
      • Evaluation of course materials -- Colleagues can evaluate course materials, such as syllabi, textbooks, handouts, assignments, graded exams, graded papers, etc. In the visual and performing arts, colleagues may evaluate faculty-directed art exhibits, theater and dance productions, musical ensembles, and individual performances when these activities are directly related to a faculty member's instructional activities. Examination by colleagues offers several advantages: It properly uses faculty expertise, can be done in a reasonable period of time, and can be done anonymously (just as is done with peer review of research). It is also appealing because it can be used for both personnel decisions and for teaching improvement purposes.
      • Evaluation of instructional contributions -- Colleagues may be in the most advantageous position to evaluate such teaching-related activities as curriculum development, supervision of student research, participation in colleagues' and teaching assistants' teaching development, articles on teaching in disciplinary journals and other publications, and authorship of textbooks and other instructional materials.

      Self-Reflection: Teaching Dossiers
      

      • The development of a teaching dossier (or portfolio) is a method that allows individuals to collect and display multiple sources of information regarding their teaching effectiveness for examination by others. It contributes both to sound personnel decisions and to the professional development of individual faculty members. A dossier is a "factual description of a professor's major strengths and teaching achievements. It describes documents and materials which collectively suggest the scope and quality of a professor's teaching performance" (Seldin, 1991, p. 3).
      • The purpose of the dossier will drive decisions about format and content. The purpose will also guide decisions about what materials will be reviewed and by whom. There is no single prescription for how a teaching dossier should be structured or what specific information it should contain. Each unit will need to decide what is important and relevant. Units might want to consider including information in the following three areas:
        • The background of the faculty member. The dossier may contain reflective statements by the faculty member on the development of and changes in his or her teaching philosophy, strategies, and objectives; efforts to evaluate and improve teaching and changes resulting from having done so; ways in which he or she has kept up with the professional field in areas related to teaching performance; and his or her future teaching goals.
        • The environment in which the faculty member works. For example, the faculty member may describe his or her current expectations regarding distribution of effort among teaching, research, and service activities; include a list of classes taught; discuss important details about these classes that may affect teaching, such as class size and the characteristics, abilities, and motivations of the students; and provide a list of other teaching-related responsibilities and accomplishments.
        • Elements regarding the faculty member's teaching process. The faculty member may provide the following:
          • samples of teaching materials, such as course syllabi, laboratory assignments, and videotapes of classroom teaching;
          • samples of student learning, such as exams, papers, projects, slides of student work, etc.; and
          • the faculty member's reflections about the samples of teaching and learning materials. For example, a faculty member may comment on the reasons for curricular revisions; innovations or experiments with teaching methods or course structure; how and why a particular course's syllabus has changed from one year to another; why specific exam questions were chosen or specific assignments suggested; and ways in which students are provided feedback on exams and assignments.

          Concluding Remarks

          Evaluation of teaching is not a science; there is still much to learn. However, as indicated in this brief set of guidelines, there is already a considerable body of knowledge about teaching evaluation. The academic community has a strong incentive to add to that knowledge since we will not be able to recognize and reward teaching adequately until we craft a better system for evaluating it.

          Selected Bibliography

          Benton, S. L., & Ryalls, K. R. (2016). Challenging misconceptions about student ratings of instruction. IDEA Paper No. 58. Manhattan, KS: The Idea Center. Retrieved from https://www.ideaedu.org/Portals/0/Uploads/Documents/IDEA%20Papers/IDEA%20Papers/PaperIDEA_58.pdf

          Braskamp, L. A., Brandenburg, D. C.; & Ory, J. C. (1984). Evaluating teaching effectiveness: A practical guide. Beverly Hills, CA: Sage.

          Centra, J. A. (1993). Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness. San Francisco: Jossey-Bass.

          Cross, K. P., & Angelo, T. A. (1993). Classroom assessment techniques: A handbook for college teachers (2nd ed.). San Francisco: Jossey-Bass.

          Linse, A. R. (2017). Interpreting and using student ratings data: Guidance for faculty serving as administrators and on evaluation committees. Studies in Educational Evaluation, 54, 94-106. Retrieved from https://www.sciencedirect.com/science/article/pii/S0191491X16300232

          Edgerton, R., Hutchings, P., & Quinlan, K. (1991). The teaching portfolio: Capturing the scholarship in teaching. Washington, DC: American Association for Higher Education.

          Seldin, P. & Associates. (1990). How administrators can improve teaching: Moving from talk to action. San Francisco: Jossey-Bass.

          Seldin, P. (1997). The teaching portfolio (2nd ed.). Bolton, MA: Anker Publishing Company, Inc.