Verified Document

Constructing An Item Analysis Research Paper

¶ … shorten tests while still providing reliable information about student performance. It can also be used to clarify or improve questions students will be tested on in the future as well as to eliminate questions which are not reflective of students' real abilities. An item analysis is conducted after-the-fact, i.e., after a test is given and allows the teacher to improve and redesign the test based upon the feedback received from student responses. With the rise in the use of test analysis technology, now teachers in classrooms as well as professional test designers can use the method to improve tests. A typical score report offers data such as the average or mean response as well as the standard deviation from that average ("Understanding item analysis reports," 2015). Item difficulty is also assessed as well as the test's ability to determine how well the students understood the material that was being tested. A test with a high level of internal consistency in this area will be both more reliable and valid than a test that is not. Ideally, the difficulty level of a specific item should be slightly greater than the midpoint to eliminate the chance of random guessing resulting in a correct response ("Understanding item analysis reports," 2015). A key concept behind item analysis is that of item discrimination: the extent to which a response to the item correlates with a high or low score on the test. For example, a difficult test question might have a high correlation of correct answers for students with high overall marks on the test and a correlation of incorrect answers for students with low marks. This would suggest an effective test question vs. A question with a relatively random series of answers (McDonald 2013: 231). Conversely, test questions which appeared to stump...

The least effective test takers would be problematic in terms of its efficacy in testing ability.
Arguments in favor of using item analysis

Testing time is finite and item analysis allows tests to be shorter and more carefully designed to reflect teacher's and district's needs. Teachers can also engage in classification of items to ensure a wide range of student needs and abilities are assessed, such as using Bloom's Taxonomy to rate various questions based upon the types of higher-level thinking required to answer the question ("Item analysis," 2015). Test answers which appeared to only be answered by the most sophisticated thinkers in the class might highlight potential skills deficits in the student population as a whole as well as problems with the test.

Teachers often use the same tests from year to year but testing can be -- and should always be -- a work in progress. Test items must constantly be screened for confusing wording which does not test the desired content area; for bias against a specific population (such as race or gender); and if the test answer is unclear (or too clear) in nudging the reader in the direction of a particular answer (Krishnan 2013: 7).

There are also a number of useful, peer-reviewed techniques to use to screen for potential biases and other problems with item analysis, including Classical Measurement Theory (CMT) or Classical Test Theory (CTT) versus Item Response Theory (IRT) otherwise known as Rasch. Theory (Krishnan 2013:2). CTT uses smaller sampling sizes and because it is sample-dependent, results are not generalizable; IRT estimates can be used to assess the overall accuracy for items for test-takers of different levels of ability. In other words, a test…

Sources used in this document:
References

About the GRE. (2014). ETS. Retrieved from:

https://www.ets.org/gre/revised_general/about

Krishnan, V. (2013). The Early Child Development Instrument. Early Child Development

Mapping Project. Retrieved from:
http://www.cup.ualberta.ca/wp-content/uploads/2013/04/ItemAnalysisCTTCUPWebsite_10April13.pdf
http://fcit.usf.edu/assessment/selected/responsec.html
Retrieved from: http://www.washington.edu/oea/services/scanning_scoring/scoring/item_analysis.html
Cite this Document:
Copy Bibliography Citation

Related Documents

Construct Development and Scale Creation:
Words: 1605 Length: 5 Document Type: Essay

This test is useful because it can bring to light certain aspects of anxiety that are manifested somatically, even if the student is unwilling to admit about worrying about test performance on the more overt questions. Then, if a strong correlation was shown between high levels of test anxiety amongst African-American students and a lower-than-expected performance on the SAT when compared with their white counterparts, more qualitative work could

Written Classroom Assessment Items
Words: 1362 Length: 5 Document Type: Essay

Writing Classroom Assessment ItemsThe assessment for this unit of study is for English Language Arts for Grade 7 class. This assessment focuses on examining students� literacy in the English language and their understanding of concepts learned in the classroom. In essence, this assessment is designed to examine students� comprehension and mastery of the English language. Therefore, the assessment includes writing in order to examine students� interactions with different pieces of

Construct of Social Persuasion
Words: 1938 Length: 5 Document Type: Essay

Measurement of Social Persuasion Social Persuasion Defined The term 'social persuasion' has been defined differently by various researchers and scholars in different fields of study. For purposes of this text, however, Kaptein's (2012) definition and scope will be adopted. Thus, social persuasion is defined as the symbolic ability "to convince other people to change their attitudes or behaviors regarding an issue, through the transmission of a message in an atmosphere of free

Analysis of Six Themes in Entrepreneurship
Words: 5055 Length: 17 Document Type: Essay

Entrepreneurship Introduction The company selected is Dar Almanthour for Fragrance. The company was established in the year 2000 by the owner, Mr. Therar AlTararwa. The key products retailed by the company comprise of Bakhour, perfumes, scents, perfume oil and designed boxes for formal events. It started off with his friend at work wanting to sell his own made up fragrance and offered Mr. Therar AlTararwa to sell these fragrances to his family

Operationalizing Constructs
Words: 970 Length: 3 Document Type: Essay

Operationalizing Constructs Business The subject of the paper is to evaluate the nature and quality of the processes used to develop conceptual definitions and measurable items in two articles that are examples of research. Each study has a specific model and method serving as framework within which to conduct the research and to analyze the data gathered. Conceptual definitions are not entirely spontaneous. The kernel of the idea upon which they are

Students Will Select a Construct of Interest
Words: 1703 Length: 6 Document Type: Article Critique

Students Will Select a Construct of Interest My construct of interest is whether there are any prejudice tests that can accurately measure prejudice to races other than Blacks. Do the currently available standardized tests on prejudice measure prejudice to individuals other than Black people? Conduct research on other assessments used to measure the same or similar construct, The Modern Racism Scale According to the SAGE Handbook of prejudice, Stereotyping and Discrimination (Dovidio, 2010), the scale

Sign Up for Unlimited Study Help

Our semester plans gives you unlimited, unrestricted access to our entire library of resources —writing tools, guides, example essays, tutorials, class notes, and more.

Get Started Now