The evaluation manager takes leadership in designing, developing and implementing ongoing evaluation of medical school curricula, faculty teaching skills, and medical student achievement in a learner-centered curriculum.
The evaluation manager will work collaboratively in a fast-paced multi-disciplinary environment with faculty and students in a variety of areas, such as Curricular Affairs, Foundations of Clinical Medicine, Student Affairs, Academic Computing, and research.
Responsibilities of the evaluation manager focus on the evaluation of the undergraduate medical education curriculum, including outcome assessment, evaluation of student performance, analysis of data, and preparation of reports. The incumbent will coordinate the design, development and implementation of the evaluation program for the medical school’s curriculum as well as for student and faculty evaluation processes. This will involve overall program evaluation for the curriculum as well as evaluation of its specific components (i.e., students, courses, and faculty).In addition, this position is responsible for providing operational support to the Committee on Medical Education (CME) and the CME Executive Committee.
Program Evaluation and Program Development
Work collaboratively with educational leaders and other faculty to develop and implement a program for evaluation of curriculum. Obtain IRB approval as appropriate, analyze results and report regularly to the curriculum committees.
Design a method for ongoing program evaluation and quality improvement, assist in the administration of instruments, analyze results, prepare reports, and work with faculty to develop action plans. This will include evaluation of 1) courses, 2) faculty and 3) student outcomes.
Develop summary evaluation data for the curriculum committees.
Assist in other program evaluation activities and assume tasks and activities as required by the vice dean for Education, associate dean for Curricular Affairs, director of Student Assessment and Program Evaluation, chair of the Committee on Medical Education, block leaders, and Clinical Curriculum Council.
Respond to requests, both within and outside of the school, for curricular information.
Program Evaluation and Outcomes Related to Student Performance
Collaborate with course directors (basic science and clinical) in designing, assessing, updating, and revising evaluation procedures in compliance with AAMC recommendations and LCME requirements.
Analyze performance data from student assessments and compare current and prior class performance as part of overall outcome assessment. Present reports to committees and councils as requested.
Analyze CWRU student performance on the USMLE Step 1 and correlate it with performance on the NBME Comprehensive Basic Science Examination, as well as with additional variables. Track CWRU student performance on the USMLE Step 2. Create reports on longitudinal performance for the university outcomes committee.
Program Evaluation related to the LCME and AAMC
Assist with the Liaison Committee on Medical Education (LCME) reaccreditation. The self-study year will require the completion of an extensive database and a report which responds to specific questions.
Responsible for the completion and review of the LCME annual medical school questionnaire.
Responsible for writing progress reports to the LCME when requested.
Analyze data and complete annual CWRU entry for the AAMC curriculum directory.
Institutional Research and Scholarship
Collaborate on and/or initiate educational research and evaluation projects and proposals.
Engage in educational scholarship and produce scholarly reports, publications, and presentations.
Committee on Medical Education
Coordinate the Committee on Medical Education and the CME Executive Committee monthly meetings, including reserving facilities and preparing relevant documentation to be distributed to CME members.
Coordinate all logistics, providing minutes of meetings and preparing reports.
Office of Curricular Affairs
Update the office of curricular affairs websites, such as the WR2 Curriculum site.
Proctor School of Medicine examinations on a regular basis.
Support the activities of Curricular Affairs when added help is needed.
Perform other duties as assigned.
Department: Contact with the vice dean for Education and Academic Affairs, associate dean for Curricular Affairs, senior associate dean for Student Affairs, society deans, director of student assessment and program evaluation, and executive director of Curricular Affairs.
University: Contact with educational leaders and executive dean of Cleveland Clinic Lerner College of Medicine, associate deans for schools of dental medicine, nursing, applied social sciences; and director of UCITE.
External: Contact with AAMC group on educational affairs and NBME associate directors of testing.
Students: Contact with students from years 1 through 4 enrolled in the School of Medicine.
No supervisory responsibility.
Experience: 3 to 5 years related work experience; experience in evaluation of medical education programs preferred.
Education/Licensing: Bachelor’s degree required; master’s degree preferred.
Excellent knowledge of data analysis tools such as SPSS, Stata, and Excel.
Familiarity with educational innovations and best practices for education program and student performance evaluation in other health professions at educational institutions.
Leadership skills and ability to work collaboratively and efficiently with others in various settings on a timely basis.
Professional and effective verbal and written communication skills.
Strong interpersonal skills; ability to work and communicate with various individuals from a broad spectrum of disciplines, technical and educational backgrounds within the department, School and University, and with individuals outside the University.
Strong organization skills; ability to multi-task, prioritize and meet deadlines. Must demonstrate attention to detail and accuracy, time management skills, and follow-through.
Excellent customer service skills; ability to maintain effective working relationships and address the potential and current needs of faculty and students.
Ability to work effectively independently and collaboratively within a team. (Must be highly motivated, responsible, dependable and a self-starter.)
Ability to work with sensitive information and maintain confidentiality.
Ability to maintain familiarity and demonstrate knowledge of curriculum priorities, leadership and programs.
Effective problem-solving skills; must demonstrate excellent analytical skills, sound judgment and good decision-making.
Must demonstrate flexibility and ability to work under pressure; must be able and willing to work in a fast-paced, changing environment, and conform to shifting priorities, demands and timeline.
Familiarity with policies and procedures of program evaluation.
Proficiency in Microsoft Office (ex: Word, Excel, PowerPoint), database applications, and with internet navigation.
Must demonstrate willingness to learn new techniques, procedures, processes, and computer programs as needed.
Will be required to work indoors. Occasional evenings and/or weekend work may be requested.
In employment, as in education, Case Western Reserve University is committed to Equal Opportunity and Diversity. Women, veterans, members of underrepresented minority groups, and individuals with disabilities are encouraged to apply.
Case Western Reserve University provides reasonable accommodations to applicants with disabilities. Applicants requiring a reasonable accommodation for any part of the application and hiring process should contact the Office of Inclusion, Diversity and Equal Opportunity at 216-368-8877 to request a reasonable accommodation. Determinations as to granting reasonable accommodations for any applicant will be made on a case-by-case basis.