BASIC FUNCTIONS AND RESPONSIBILITIES
Corporate and/or division expert in testing and measurement, specifically in the development of assessment instruments. A thought leader in area of specialization. Stay abreast of developments in the field to maintain status. Practical measurement and test design knowledge. Act independently to provide leadership and perform test development work for complex testing programs and projects. Have full knowledge of and capacity to perform all phases of test creation process. Perform a lead external role, representing ETS to the public and media on issues related to test development. Serve as a mentor to Assessment Specialists I and II. May have duties instructing, directing and reviewing the work of other assessment professionals.
Write and review items; gather and resolve feedback from multiple sources on items; evaluate item acceptability after testing.
Participate and manage constructed-response scoring activities, including work with faculty consultants or state department staff.
Approve items for use on tests, evaluating both content and psychometric properties.
Devise strategies for improving outside item writer results, develop item writer training materials; plan and lead item writer training meetings, and monitor work with outside item writers.
Provide leadership in the design and development of new assessments and innovative products and services; negotiate with content groups and communicate on program issues; provide expertise for developing new blueprints and item types.
Write rules for Test Assembly System; assemble pre-tests, tests, and assist in preparation of Special Test Editions.
Review and make recommendations for security cases.
Work with client committees, including organizing meetings, recruiting and training committee members, recommending committee members, organizing review materials, developing training materials and agendas, explaining and summarizing analysis results, and advising on measurement issues.
Work directly with client content representatives to obtain signoff on items and tests.
May attend client launch meetings, planning meetings, and update meetings.
Plan and develop program publications and interpretive test preparation materials; participate in teacher training activities.
Plan and conduct reliability, validity or comparability studies.
Train others in application of item statistics to evaluation of items and assembly of tests; work with Statistical Analysis staff during test assembly process to obtain signoff on statistical parameters of forms.
Plan, manage and direct test development activities as a lead for one or more program teams, possibly as a member or leader of a test creation team.
Serve as resource on problem item scoring issues.
Serve as a resource on staff development, including mentoring of other assessment specialists.
Serve on policy and planning committees with increasing responsibility.
Serve as senior test development and measurement advisor and mentor to division and to the corporation.
Lead proposal development and complex and integrated research.
Act as liaison between ETS and advisory boards and committees.
Serve as ETS spokesperson with media representatives on matters of assessment and usage of assessments.
Direct projects, delegate work, and monitor progress; create, implement, and monitor item development plans; undertake and oversee major development projects.
May manage staff.
Monitor budget requirements for one or more projects.
May take a leadership role in interviewing and training staff.
A Master’s degree in field of specialty is required or an equivalent combination of education & experience from which comparable knowledge & abilities can be acquired.
Seven or more years of progressively responsible professional experience (including educational measurement, applied statistics, or teaching), five of which must be in test development, educational measurement or applied statistics, are required.
Mastery of field of specialty, plus extensive knowledge of testing and measurement, in order to provide expert advice to the corporation, to serve in a leadership capacity, and to represent ETS in professional organizations and in the educational community is also required.
Keyword: test development, assessment, education, teaching, english
From: Educational Testing Service
Educational Testing Service - 7 months ago
At ETS, we advance quality and equity in education for people worldwide by creating assessments based on rigorous research. ETS serves indiv...