I would employ this mechanism by administering the same test on different occasions; I would then use those results to determine the extent to which the test is useful beyond the first administration to any specific group of subjects.
5. Example of Gender-Biased Symbolic Logic Test Question
"A football team scores a touchdown and now leads its opponent by four points. Should they attempt a single-point kick or a two-point conversion?"
6. Specific Nature of Bias and Proposed Solution Prior to Testing
This test question is an objective measure of quantified logical reasoning but would be biased toward males by virtue of differential familiarity with American football rules. The researcher could have identified this bias by administering the test to groups of gender-specific subjects and comparing their results to their respective results on other questions designed to test the same abilities in different contexts.
7. Disparate Impact without Bias
"Please read the following passage and then answer the corresponding reading comprehension questions that follow." Generally, the comparative socioeconomic level of adolescent learners corresponds to their reading comprehension levels....
Therefore, learners from higher socioeconomic circumstances would score higher on the same test item that is designed to measure reading comprehension. Nevertheless, it is not biased when used in conjunction with any application where reading comprehension is of specific relevance to that application.
8. Review Panel Form to Screen Prospective Test Items for Bias.
1. Is the test item potentially inherently biased against any specific group of test subjects? (Because test evaluators should be able to identify and highlight potential sources of bias in testing)
2. To what specific group of test subjects is the test item potentially inherently biased? (Because test evaluators should be able to identify and highlight potential victims of bias in testing)
3. Does the value or relevance of the contextual value of the item outweigh its degree of potential bias in connection with its intended application? (Because certain questions are sufficiently related to and relevant to the application of the test to outweigh the potential impact of bias)
4. Can you propose a comparable unbiased question? (Because some biased questions can be substituted with substantively comparable unbiased questions).
