Test Validation and Development Specialist Series

California State Personnel Board Specification

Series established March 16, 1978

Scope

This series specification describes two working levels in the specialized field of test validation and development. Entry into the series is typically from outside State service.

Definition of Series

Positions in this series provide professional staff work of a technical and statistical nature in the field of test validation and development. This work is typically associated with personnel selection and/or occupational/licensing programs. The work involves reviewing, analyzing and evaluating personnel selection and occupational licensing systems; developing personnel selection and licensing techniques and devices including written tests, performance tests, oral examinations, and background evaluations; conducting written item analysis; developing systems for collecting and analyzing quantitative data relevant to test research and development; performing statistical analyses related to test evaluation and development, interpreting test results, reviewing tests for conformance with the Federal Guidelines on Employee Selection Procedures; serving as a consultant to the staff on principles and techniques of test validation and development; preparing reports and making recommendations concerning personnel selection or occupational licensing programs.

Factors Affecting Position Allocation

Level, variety, and complexity of work; independence of action; supervision received, and responsibility for making decisions affecting the departmental validation program.

Definition of Levels

Test Validation and Development Specialist I

Positions at this level perform professional analytical and evaluative research associated with personnel selection and/or occupational licensing of average difficulty and assist in more difficult projects. They also contribute significantly to project planning, design, analysis and report preparation. This is considered to be the primary recruitment level.

Test Validation and Development Specialist II

This is the full journeyperson level. Positions at this level design and conduct varied and complex personnel selection and/or occupational licensing projects or portions of major projects. Incumbents use a wide range of analytical skills, experimental methods, statistical techniques, and psychometric principles. They provide assistance to lower level staff and give advice to staff engaged in the operation of ongoing test validation and development projects. Incumbents at this level may function in a lead capacity over a small group of analysts or employees engaged in similar work.

Minimum Qualifications

Test Validation and Development Specialist I

Experience: Two years of increasingly responsible research experience which shall have included performing research studies using statistical tests of significance; statistically analyzing research data using correlation, multiple regression or a form of multivariate analysis such as discriminant analysis, canonical correlation or factor analysis; and the preparation of written reports of such research. (Possession of a Master's Degree in Statistics or a behavioral science field may be substituted for one year of the required experience; possession of a doctoral degree with an emphasis in industrial psychology, organizational psychology or psychometrics may be substituted for the entire two years of the required experience.) and

Education: Equivalent to graduation from an accredited college or university. (Additional qualifying experience may be substituted for the required education on a year-for-year basis.)

Test Validation and Development Specialist II

Either I

One year of experience performing the duties of a Test Validation and Development Specialist I in the California state service. (Applicants who have completed six months of the experience, as specified above, will be admitted to the examination but they must satisfactorily complete one year of this experience before they can be eligible for appointment.)

Or II

Experience: Three years of increasingly responsible research experience which shall have included performing research studies using statistical tests of significance; statistically analyzing research data using correlation, multiple regression or a form of multivariate analysis such as discriminant analysis, canonical correlation or factor analysis; and the preparation of written reports of such research. At least one year of the required experience must have been involved in the development and evaluation of measures of human abilities or human performance. (Possession of a Master's Degree in Statistics or a behavioral science field may be substituted for one year of the general experience; possession of a doctoral degree with an emphasis in industrial psychology, organizational psychology or psychometrics may be substituted for two years of the general experience.) and

Education: Equivalent to graduation from an accredited college or university. (Additional qualifying experience may be substituted for the required education on a year-for-year basis.)

Additional Desirable Qualifications

Both Levels:

In appraising the relative qualifications of candidates, consideration will be given to the extent and type of pertinent training and expertise over and above that required under the "Minimum Qualifications". Preferred types of additional training and experience are:

1 A Master's Degree in Industrial Psychology or Psychometry.

2. Experience in the construction and validation of group administered aptitude, ability or achievement tests.

3 Research experience involving use of electronic data processing equipment.

4. Graduate level courses in statistics, research design, and multivariate analysis.

Knowledge and Abilities

Both Levels:

Knowledge of: Principles, procedures, and techniques used in test validation and development including research design and experimental methods; Federal Guidelines on Employee Selection Procedures; psychological principles concepts, and theory; various tests and measurements relating to personnel selection and occupational licensing, including the application of quantitative procedures to aptitude, achievement, and performance tests, in psychology and other social sciences; the ethnic and cultural factors involved in validating selection procedures; electronic data processing techniques related to social science research studies.

Ability to: Apply research principles and methods to research problems, test validation and development; prepare and evaluate research reports; apply professional knowledge in resolving complex selection and licensing problems; establish and maintain effective relationships with other staff members, public and private agencies, and organizations; teach research principles and methods to other staff members; carry out complex research projects; perform in an independent and creative manner; utilize and apply effectively the required technical knowledge; e.g., psychometric techniques, applicable rules and guidelines, technical standards, etc., maintain cooperative relationships with those contacted in the course of the work; speak and write effectively; and act as a team leader.

Class History