Verified Document

Test Blueprint Validity And Reliability Research Paper

Related Topics:

Administering the tests developed and formulated for the nursing-based curriculum entails providing reliable test items. Reliability is important because it helps counteract human error both on the part of the student taking the test and the person grading the test. "Reliability is the quality of a test which produces scores that are not affected much by chance. Students sometimes randomly miss a question they really knew the answer to or sometimes get an answer correct just by guessing" (KU, 2016). By increasing the reliability of the test items, the quality remains consistent in the test and offers a superior level of testing that avoids the pitfalls of unavoidable human error. For instance, there are different ways to construct a test. With each different way, there are various measuring methods to help provide reliable outcomes. Essay questions and multiple-choice questions can contain qualitative or quantitative data that are measured differently. Multiple-choice questions are measured quantitatively and some ways to measure such data is the Kuder-Richardson, the alpha coefficient, or the split-half.

The Kuder and Richardson Formula 20 test allows the person to check for "internal consistency of measurements with dichotomous choices" (Real Statistics, 2016). It is equal to the aforementioned split half methodology in "all combinations of questions" (Real Statistics, 2016), remaining applicable whether the question is wrong or right. The value for a wrong answer/question is 0 and the value for a right answer/question is 1. With values ranging from 0 to 1 and reliability is indicated from a high value, an excess of .90 is a major indicator of a homogenous test.

The alpha coefficient goes by a different name. It is Cronbach's alpha and is a measure of how closely associated a set of items exist as a group (internal consistency). If there is a 'high' value for alpha this...

If there is a desire to offer evidence for a unidimensional scale, further analyses may be done. To check dimensionality, a common method is exploratory factor analysis. Although Cronbach's alpha is not actually a statistical test, is considered a coefficient of consistency/reliability.
Split-half reliability is another measure of consistency and is similar to the Kuder and Richardson Formula 20 test, except in this test, the scores are split into two parts that are then compared with one another. If the results remain consistent, the assumptions are it is highly likely measuring the same thing. This test does not measure validity. It just measures consistency/reliability. However, by recognizing the reliability of the test analyzed, it therefore sets the limit/ceiling of validity.

These methods for testing reliability allow the multiple-choice portion of an exam to be properly analyzed and create certainty over the consistency of the test items, forming the basis of a superior quality test. Essay questions have a different method of analysis since that data is qualitative. Qualitative data is generally analyzed using an analytic rubric.

Analytic rubrics are seen often in paper assignments where students receive a table featuring a vertical and horizontal list of categories. The scale is usually from 1-5 with a score at the end. This is for the horizontal categories with 1 being the worst and 5 being exemplary. The vertical aspect contains what is being graded such as presentation, grammar, and so forth. These categories relate to the instructions of an assignment and how well the student follows said instructions. It is a reliable measure to take because it provides a detailed explanation of why a student receives the score they do, avoiding any misconceptions. "It gives students a clearer picture of why they got…

Sources used in this document:
References

College Board,. (2016). Validity Evidence -- Research -- The College Board. Research.collegeboard.org. Retrieved 10 July 2016, from https://research.collegeboard.org/services/aces/validity/handbook/evidence

Gonzalez, J. (2014). Know Your Terms: Holistic, Analytic, and Single-Point Rubrics. Cult of Pedagogy. Retrieved 10 July 2016, from http://www.cultofpedagogy.com/holistic-analytic-single-point-rubrics/

KU,. (2016). Assessment/Quality Test Construction -- Special Connections. Specialconnections.ku.edu. Retrieved 10 July 2016, from http://www.specialconnections.ku.edu/?q=assessment/quality_test_construction

Real Statistics,. (2016). Kuder and Richardson Formula 20 -- Real Statistics Using Excel. Real-statistics.com. Retrieved 10 July 2016, from http://www.real-statistics.com/reliability/kuder-richardson-formula-20/
Cite this Document:
Copy Bibliography Citation

Related Documents

Reliability and Validity in Business Research
Words: 1663 Length: 5 Document Type: Research Paper

Concepts of Reliability and Validity in Business Research Introduction In business research, how evidence is obtained and how well the process can be duplicated to verify results are two important features that help scholars, professionals and stakeholders make progress in the field. Building on ideas and processes that can help business leaders, managers, owners, administrators and investors is part of what makes research so vital and important. However, not all research is

External Validity - Is the
Words: 382 Length: 1 Document Type: Thesis

b) Preexperimental design and quasi-experimental design- a Preexperimental design is a design that acts as a blueprint for the actual research and a quasi-experimental design is a design that resembles a quantitative or qualitative research design but lacks controls. c) history and maturation -- history refers to events that take place outside of the experiment that may affect participants' responses to the experiment and maturation refers to the change that occurs

Psychological Tests Are Pompous Procedures of Intellectual
Words: 684 Length: 2 Document Type: Essay

Psychological tests are pompous procedures of intellectual performance. A good number are objective as well as medical; nevertheless, definite projective tests might engross various height of prejudiced elucidation. The main aim of this paper is to clearly bring the meaning of the term test, describe the main classifications of tests and show the main or significant major uses as well as those who use the varied forms of tests, also

Deinstitutionalization Importance of a Historical Literature Review...
Words: 4057 Length: 14 Document Type: Research Paper

Evaluating theoretical framework also assists in determining whether the structure directs the research study. This process entails identification of constructs or concepts, assessment of definitions, relationships, variables, hypothesis, methodology and findings. Discussion Question Two: Will there always be a theoretical framework that aligns with your chosen topic of study? Why or why not? Theoretical framework entails the collection of combined concepts that are not essentially well established (Aparasu, 2011). Theoretical framework

Human Resource Management
Words: 1674 Length: 4 Document Type: Research Paper

Human Resource Management Job analysis Job Design and considerations Job design is the arrangement of work in organizations. The arrangement assist employees as well as the organization meet objectives. An effective job design satisfies employees in organizations since it prevents dissatisfaction arising from repetitive work. It also assists organizations by preventing employees from alienation. Additionally, job designs improve on the productivity of an organization. Job designs, however, need to consider the following aspects in

Proportion of Students Who Pass
Words: 580 Length: 2 Document Type: Term Paper

(HESI). This instrument will be chosen for this study because it was developed by nurse educators and clinicians using the model for writing critical-thinking test items which requires application of clinical nursing judgment to determine correct responses. The psychometric property of the HESI exit exam has an estimated reliability coefficient (KR-20) of 0.951. The HESI Predictability Model (HPM), a proprietary mathematical model, is used to calculate all HESI scores.

Sign Up for Unlimited Study Help

Our semester plans gives you unlimited, unrestricted access to our entire library of resources —writing tools, guides, example essays, tutorials, class notes, and more.

Get Started Now