Verified Document

Types Of Evaluation Designs And 2 Types Of Methodologies Essay

¶ … criminal procedure and the idiosyncrasies of criminal practice vary widely from jurisdiction to jurisdiction" (Jaros, 2010, p. 445). If what Jaros states is true, then it is probably true as well that evaluating the different circumstances surrounding the commission of crime is also widely diverse in its practice. There are a number of methodologies that are used in various research including studies relating to the study of criminal justice and different aspects of that arena; two of the more commonly used methodologies employ quantitative and qualitative methods of research. The quantitative methodology is used by researchers who are seeking to quantify certain areas of study or the results of such studies. Quantifying involves numbers, percentages and numerically evaluated data. One of the benefits that can be derived when using quantitative evaluation is that such a method provides numerical data for comparative studies. Comparative studies show specific numbers calculated from participant responses. Although many experts can argue concerning discussions and conclusions of quantitative results, very few of these experts will argue with the numerical aspects of those conclusions

However, not all experts agree that studies that use quantifying methodologies are effective in the area of criminal justice. A 2005 article by Max Travers suggested that a "provisional critique" of the criminal justice evaluation should include a footnote on the fact that evaluation research is "predicated on a misguided notion of objectivity" (Travers, 2005, p. 48). Quantitative evaluations are supposedly objective since numbers are not normally considered to be capable of lying.

Travers suggests that "most evaluation research is methodologically poor…when assessed by the standards employed in the academic peer-reviewed disciplines of criminology and sociology" (p. 48). Travers then continues by asserting that the lower standards required in quantitative methodology "does not offer the same intellectual interest or fulfillment as a traditional academic work" (p. 40). Travers would much rather use qualitative methods in criminology studies and seeks to overcome researcher bias by gathering data on the why's of crime rather than the numbers.

Qualitative studies are conducted in almost the exact opposite manner as quantitative studies. Qualitative studies are not looking to gather numerical data, instead, the focus of a qualitative study is on how the participants feel, think or perceive certain situations. One of the benefits of a qualitative study is that it provides researchers with a deeper understanding of the subject's motivational thinking regarding the subject of the study. Oftentimes a qualitative study will provide the researcher with the opportunity to examine the depth of feelings towards the subject. A qualitative study is the type of study that many researchers use to study behavior or phenomena in natural environments.

Many experts, however, disagree with Travers premise concerning the strength of qualitative vs. quantitative studies. Don Weatherbum answers Traver's assertions by stating that while "quite a few criminologists appear to share his (Traver's) skeptism about the possibility of disinterested and objective enquiry" (Weatherbum, 2005, p. 416) but that in reality experts "routinely reject large numbers of studies on the grounds of poor design, poor statistical analysis, low sample sizes, weak measures of key variables, inadequate controls and so on" (p. 416).

Weatherbum contends that methodologies are not the problem since most academic researchers understand that the "purpose of the evaluation is to see whether a program is achieving its stated aims and that it is not always necessary to interview anyone to find out whether it is" (p. 418). Weatherbum is talking about a summative evaluation of specific programs regarding criminal justice. According to Weatherbum, governments engage academia to answer a specific set of research questions when conducting criminal justice studies, and to accomplish that requires quantitative methodologies not the qualitative measures that assist a researcher to press his or her own agenda.

There are numerous examples of using both research methodologies in the same study to complement each other. One expert tells how a recent study using both was conducted by stating "the questionnaire was conducted through a face-to-face interview with the day-shift officer permanently assigned to the housing unit of each prisoner in the random sample" (Williams, Lindquist, Hill, Baillargeon, Mellow, Greifinger, Walter, 2009, p. 1287). These researchers used face-to-face interviews usually considered qualitative in nature, complemented by a questionnaire that is seen as quantitative in methodology and employed a random sample without a comparative group with is also seen as qualitative in style.

Oftentimes, the use of a certain methodology depends on what information is being sought by the researcher and whether the evaluation is considered formative or summative in...

It also depends on what the results of the study are going to be used for. One of the most common uses of evaluations in the criminal justice arena can concern the criminals themselves.
One expert writes "evaluations of competence to stand trial (CST) are the most common type of criminal forensic evaluation conducted" (Behavioral Sciences, 2006). The CST offers an evaluators the opportunity to examine the circumstances around the crime and the individual who committed the deed. One expert wrote "it is clear that competence evaluations can considerably impact criminal proceedings and a defendant's liberty" (Warren, Murrie, Steiskal, Colwell, Morris, Chauhan, Dietz, 2002).

Oftentimes evaluations can determine if the individual who committed the crime can be admitted to programs that are designed to help them. Programs such as the MERIT program help to "break the drug -- crime cycle by involving defendants in treatment and rehabilitation" (Merit, 2006). Of course, to get admitted to such programs, the individual must submit to an intense evaluation by a medical professional.

An irony not lost on this author is that the MERIT program was evaluated as to its effectiveness using a summative evaluation. The evaluation discovered that "of the 238 participants referred to MERIT, 72% were accepted, with half of those entering the program successfully completing it" (NSW, 2003).

Other evaluative measures taken in the criminal justice system assists the system in determining whether the defendant or prisoner is being rehabilitated. A recent study determined that "analyzing consequences of interventions, the impact of labels and the outcomes of treatment systems are essential" (Clancey, Howard, 2006, p. 380).

Some experts worry that there are too many evaluations taking place and that the courts may be abdicating their responsibilities when it comes to deciding whether individuals who have committed crimes are either being imprisoned or sent to a rehabilitation center on the advice of the evaluator.

One study reports that "in all but one of 328 Alabama cases the court accepted the mental health professional's opinion -- a 99.6% agreement rate between the court and evaluator" (Zapf, Hubbard, Galloway, Cox, Ronan, 2004, p.30). It may make more sense to accept the evaluator's findings, and it might be the easy route for overcrowded court systems, but that does bring into account the evaluator's veracity, and the reliability and validity of the methodologies the evaluator employs. One expert states "decision making…is effectively delegated to clinical evaluators making low-visibility and essentially unreviewed decisions pursuant to a vague, open-textured standard (Winick, 1995, p. 572).

Another area of stringent evaluation in the criminal justice industry is the pre-trial chamber. One expert recently espoused that "the pre-trial chamber has a main role in preparing the confirmation of charges. It has to ensure that a confirmation hearing takes place within a reasonable period and that the evidence is disclosed between the parties to the proceedings" (de Beco, 2007, p. 470).

Other studies can help determine exactly what type of individual commits crimes and how to deter them from doing so. As an example, one study showed that "drug users, especially heavy users, commit a disproportionate amount of crime" (Chaiken & Chaiken, 1982) and another study shows that "studies of restorative justice demonstrate the complexity of implementing and evaluating an alternative approach to traditional criminal justice processing" (Bonta, Wallace-Capretta, Rooney, McAnoy, 2002, p. 320).

This particular evaluation seeks to assist criminal justice officials in deciding whether those convicted of crimes should face jail time or be remanded to an alternative treatment center.

This study sought to determine whether "restorative justice can have a positive influence on the views of those who have been harmed; and regarding the impact on the recidivism of those who caused the harm" (p. 321). What is really interesting is that this particular study said that researchers must remain "mindful of the methodological limitations of many studies" (p. 321).

Each methodology does display certain limitations as to how to determine the effective use of criminal justice. Comparing the two methodologies is a straightforward exam. The qualitative researcher is armed with a method to explore by using open-ended questions, thoughts and conversations to determine the participant's thoughts and perceptions.

The evaluator often uses in-depth interviews, focus groups and one-on-one scenarios to assist in determining how the participant's thought process is working. The researcher can be armed with general questions and ideas based on the focus of the study, but the majority of time the hypothesis of the study will change based on the participant's beliefs, thoughts, observations and perceptions. The evaluator attempts to determine the positive or negative nature of the responses but…

Sources used in this document:
References

Behavioral Sciences and the Law (2006) online accessed at Wiley Inter-Science on November 11, 2010, at www.interscience.wiley.com

Bhola, H.S. (1990) Evaluating 'literacy for development' projects, programs and campaigns: Evaluation planning, design and implementation, and utilization of evaluation results. UNESCO Institute for Education, xii

Bonta, J.; Wallace-Capretta, S.; Rooney, J.; McAnoy, K.; (2002) An outcome evaluation of a restorative justice alternative to incarceration, Contemporary Justice Review, Vol. 5, Issue 4, pp. 319-338

Chaiken, J.M. & Chaiken, M.R.; (1982) Varieties of criminal behavior, Santa Monica: Rand Publishers
Merit, (2006) accessed on November 10, 2010 at: http://www.lawlink.nsw.gov.au/lawlink/cpd/merit.nsf/pages/merit_aboutus
Cite this Document:
Copy Bibliography Citation

Related Documents

Program Evaluation Design
Words: 3686 Length: 10 Document Type: Term Paper

Program Evaluation Design constructive, practical, principled and correct process in an organized manner is necessary towards ameliorating and contributing for an efficient program assessment. It has been planned to structure and systematize vital components of program assessment being a realistic and non-rigid instrument. For efficient program assessment, the outline encompasses actions and principles in program assessment. Abiding by the actions and principles of this structure will let an appreciation of

Design Science
Words: 636 Length: 2 Document Type: Essay

Peffers et al. (2008) describes an attempt to identify and define a design science research methodology for information systems. One of the main challenges in this regard is that information systems, or what the authors refer to as "IS," is an applied research discipline. In this regard, the authors explain that theory from other disciplines is often used to inform information systems and towards problem solution within information systems.

Interviewing As a Methodology the
Words: 6264 Length: 20 Document Type: Methodology Chapter

He began to speak less formally, weaving his previously formulated questions into something that resembled a conversation. This led his interviewees to speak more candidly and with more self-reflection, moving beyond their celebrity images. Chirban's interactive interviewing required more empathy and listening skills on his part, but the trust that it established enabled him to enter the interviewee's world. The new relationship also allowed interviewees to reflect on their

Program Evaluation Integrate Data Collection Methods Into
Words: 3086 Length: 10 Document Type: Essay

Program Evaluation Integrate data collection methods into the program evaluation plan. The data collection method is seeking to integrate qualitative and quantitative research together. It is developing a program that is effective in helping to support smoking cessation efforts. Qualitative research is used to provide background on the study and proven smoking cessation initiatives. For instance, this portion of the research revealed that any effective program will integrate therapy, support groups and

Program Proposal and Evaluation Plan
Words: 2874 Length: 10 Document Type: Essay

This in turn adds more pressures on the Australian social and economic structure, making diabetes the seventh most fatal disease in the country. The diagram below proves that fact. Diabetes deaths, 1984-2004 Objectives: The main objective of this research included: An increase in the consumption of fruits and vegetables amongst the sample within the six months allotted for the program. The percentage aimed at was at least 80% To record decrease in the overall

Program Evaluation Parts I And
Words: 6669 Length: 22 Document Type: Thesis

In order to accomplish this task, the net cost per student will be calculated and compared to the desired outcomes of the program. In order to be beneficial and worthwhile, the benefits of the program must not dramatically outweigh the costs of the program. Cost:benefit analysis will help to determine if the program is beneficial enough to continue. Resources The cost: benefit analysis will help to determine if the expenditures for

Sign Up for Unlimited Study Help

Our semester plans gives you unlimited, unrestricted access to our entire library of resources —writing tools, guides, example essays, tutorials, class notes, and more.

Get Started Now