Curriculum Evaluation Plan - Section II.

ANNUAL COURSE AND CLERKSHIP REPORT

Introduction

The annual report consists of three parts:

I. The course or clerkship syllabus given to the students
II. The written report prepared by the director with accompanying appendixes
III. Data supplied by the Office of Medical Education (OME)

In order to facilitate evaluation, course/clerkship directors should be sure to include all material requested in the exact form and organization requested. Each section of the syllabus and report should be clearly delineated and identified to correspond with these instructions.  

Each section of the syllabus and report are evaluated longitudinally by members of the subcommittee. Four parameters are used to assess quality of a course or clerkship syllabus and four parameters to assess the written report. A reviewer will assess the same section in all reports, i.e. like an NIH grant evaluation. Therefore, each section should “stand alone.” For example: if a deficiency is identified in the section on student evaluation of instruction and a strategy for improvement implemented, the improvement should appear in that section in addition to the separate section on plans for improvement. Do not refer a reviewer to another section.

 An example of an exemplary submission (course report/syllabus, clerkship report/syllabus) and the evaluation form used by the subcommittee is provided. It is strongly recommended that these documents be reviewed during preparation of materials.

I. COURSE/CLERKSHIP SYLLABUS

A. Overview

1. A brief description of the course/clerkship
2. The administrative structure

   a. Department chair with contact information
   b. Course/clerkship director with contact information
   c. Course/clerkship administrative assistant/secretary with contact information

3. An overview of the clerkship content

   a. Length, hours, units of study as appropriate
   b. Sites for instruction
   c. Schedule for a typical week

4. The educational philosophy

   a. Course/clerkship
   b. Department - if there is one

B. Learning Objectives

1. The competency categories to be addressed
2. The measurable learning objectives for each competency category
3. The learning/instructional activity used to achieve each learning objective
4. The evaluation methods used to assess student achievement of each learning objective.

C. Student Performance Criteria

1. Identify the internal and external measures used to assess student's knowledge and skills. Representative forms should be included.
2. Describe the system for giving formative feedback. Representative forms should included, but alone are not sufficient.
3. Describe the system for determining summative feedback. Representative forms should be included.

II. DIRECTOR'S WRITTEN REPORT

There are five sections to the directors' report.

Representative course and clerkship written report templates.

A. Identification of the Teaching Faculty for the Course or Clerkship

1. Director(s): Total FTE
2. Administrative support: Total FTE
3. Departmental Teaching Faculty: Total FTE
4. Non-departmental Teaching Faculty/Staff/Students: Total FTE

B. Specific Changes in the Course or Clerkship

1. Compare to last year and the rationale or basis for any changes.
2. Address remediation or areas of weakness or deficiency cited in the previous report.

C. Evaluation of Student Performance

1. Identify types of evaluations used to assess student levels of knowledge and/or skills. Comment on the appropriateness of them.
2. Describe how students performed on internal or external (e.g., NBME subject examinations) instruments relative to the course/clerkship learning objectives.
3. Based upon the data from the Office of Medical Education, comment on the distribution of competency scoring and final grade distribution of student performances. Do you believe that the course evaluation system identified students who were truly exceptional and those that may need additional assistance?

Number of student performances scored in the following competency and grade categories.

D. Feedback to Students

1. Identify the student rating to the on-line course question about formative mid-course feedback.
2. Describe your interpretation of such scoring in reference to what is written in your course syllabus about formative feedback, and what actually occurs.
Discuss the legitimacy of student ratings.

E. Student Evaluation of the Course/Clerkship and Director

1. Provide a synopsis/summary of student on-line evaluations of the course/clerkship. This should include analysis and comment by the Director of strengths and areas needing improvement. Numerical data alone is not sufficient. Discuss the legitimacy of the student ratings.
2. Provide a synopsis/summary of the student debriefings. This should include analysis and comment by the director of student concerns. Minutes alone are not sufficient. Discuss the legitimacy of the student ratings.
3. Provide a synopsis/summary of student evaluation of the Director, and administrative support, if applicable. Discuss the legitimacy of the student ratings.

F. Evaluation of Instruction

1. Provide a synopsis/summary of student evaluation (on-line and debriefings) of the overall instruction by faculty, residents and staff, as applicable.
2. Critique the overall teaching performance of faculty, residents, and staff from the Director's perspective. Identify and comment on strengths and areas needing improvement.
3. Identify any plans for faculty development.

G. Evaluation of Course/Clerkship

1. Discuss the timing and appropriateness of the course/clerkship to the curriculum's general professional education program including content and instructional methods.
2. Discuss the strengths and weaknesses of the course/clerkship and describe plans for improvement. Include a description of present and/or future innovative programs.
3. Discuss the long-term plans for continued development and new directions for the course/clerkship.
4. Describe the resources needed from the Office of Medical Education to improve the course/clerkship.

III. COURSE/CLERKSHIP AND STUDENT NUMERICAL DATA SUPPLIED BY THE OFFICE OF MEDICAL EDUCATION (OME)

1. NBME subject examinations
2. USMLE Steps 2 and Steps 2, if applicable.