Working under limited supervision, the program evaluation specialist (research assistant 3) is responsible for providing evaluation, research, and analysis support to the various projects taking place with the Center for Evidence Based Practices (CEBP). The work includes development and implementation of research and evaluation protocols, data collection and management, programming (SPSS or SAS), descriptive and statistical analyses, and preparation of research and evaluation reports. The program evaluation specialist will provide input and recommendations on overall project directions and address key data collection and substantive issues.
The CEBP assesses programs that provide mental health, substance abuse, employment, and/or other health-related services. Program evaluation involves the systematic assessment of implementation and delivery of behavioral health services. The evaluation gathers information about clinical, programmatic, policy, and systems functioning via direct interview of different stakeholders, observation, review of relevant documentation (including health records, meeting minutes, policies and procedures, and other relevant reports or documents), and collection and analysis of relevant quantitative data. Data are gathered through site visits, phone interviews, record reviews, and web-based surveys. Reports are generated for internal service improvement and public dissemination to demonstrate outcomes of CEBP customer services.
These customers receive evaluation, consultation, and training services from the Center for Evidence Based Practices (CEBP). The CEBP is a technical-assistance organization that promotes knowledge development and the implementation of evidence-based practices for the treatment and recovery of people with mental and substance use disorders. The center is a partnership between the Mandel School of Applied Social Sciences and the Department of Psychiatry at the Case School of Medicine and is the umbrella organization for the Ohio Substance Abuse and Mental Illness and the Supported Employment Coordinating Centers of Excellence and the Tobacco: Recovery across the Continuum Project. The CEBP does not conduct bench research or drug trials.
1. Working closely with the principal investigator, provide input and recommendations on overall project directions, addressing key data collection and substantive issues.
2. Coordinate the research activities of the center.
3. Evaluate adequacy of data approaches and design, develop, and implement new data approaches and collection for CEBP projects and within the center.
4. Carry out complex research analyses of a non-routine nature, including description statistics and the use of multivariate models when appropriate, and interpret statistical findings in SPSS, SAS, MS Excel and/or SQL.
5. Present statistical results in tabular and graphical forms.
6. Prepare summaries on the results and conclusions of the statistical analyses and contribute to the preparation of reports.
7. Manage the online evaluation database, including verifying quality of data and facilitating user access and data entry.
8. Merge multiple data sources.
9. Participate in evaluation activities, on-site, phone, and/or video.
10. Write evaluation reports and may co-author research papers.
11. Write and present results of program evaluation and other outcome projects.
12. Direct the work of students.
Perform other duties and responsibilities as assigned.
Department: Daily contact with department staff.
University: Daily contact with department staff within the university.
External: Weekly contact with representatives of local agencies.
Students: May have contact with students.
No direct supervisory responsibility; may direct the work of students.
Experience: 3 to 5 years of related experience required with at least 1 year of experience with data analysis, program evaluation, survey creation, database management, grant writing and report writing experience. Experience and familiarity with evidence-based practices in the behavioral health realm preferred.
Education/Licensing: Bachelor’s degree in a social work, psychology, nursing or other health-related field required; master’s degree strongly preferred.
1. Demonstrated evaluation and project management skills are required.
2. Highly organized with strong quantitative and qualitative skills including experience with data management, quality improvement tools and methods of data analysis and display.
3. Excellent written and oral communication skills.
4. Knowledge of behavioral healthcare systems and evidence-based practices for individuals with severe mental illness and substance use disorders.
5. Must be highly organized, self-directed, results-oriented, innovative and flexible.
6. Must be able to work with limited supervision and seek out effective solutions for complex data management problems.
7. Strong computer skills including Microsoft Office Suite and SPSS. Knowledge of MS SQL/My SQL, Adobe Connect and/or Scopia, and web-based data collection a plus.
Normal office working environment. Must be able to travel and have access to an operational vehicle.
In employment, as in education, Case Western Reserve University is committed to Equal Opportunity and Diversity. Women, veterans, members of underrepresented minority groups, and individuals with disabilities are encouraged to apply.
Case Western Reserve University provides reasonable accommodations to applicants with disabilities. Applicants requiring a reasonable accommodation for any part of the application and hiring process should contact the Office of Inclusion, Diversity and Equal Opportunity at 216-368-8877 to request a reasonable accommodation. Determinations as to granting reasonable accommodations for any applicant will be made on a case-by-case basis.