Verified Document

Developing Best Employee Performance Assessment For Call Centers Case Study

¶ … Telephone Customer Service Representatives Employment Assessment - Telephone

How do you interpret the reliability results for the clerical test and work sample? Are they favorable enough for the company to consider using them for keeps in selecting job applicants?

A primary objective of evaluating two new methods of assessing candidates for positions as telephone customer service representatives for the Phonemin Company is to improve the caliber of the employment pool from which new hires are selected. The participation of customer service representatives in the telephone ordering system of the company is critical to this endeavor. Moreover, the company will be adding roughly 40 employees to the call center in order to meet the anticipated growth in phone order sales. From this, it is readily apparent that effective means of assessing candidates for the positions of telephone customer service representatives is needed. The reliability figures for the current employee candidate system, which is comprised of a clerical work test and two work samples, are as follows:

For the clerical test, reliability is indicated with a high alpha coefficient of 0.85 and 0.86. This is a reasonably high reliability score. And the test-retest reliability score is even higher, at a very solid 0.92.

The work sample (T) reliability scores show an inter-rater agreement at 88% and 79%, both of which are adequate scores for inter-rater reliability. Higher reliability scores would be preferable. The work sample (C ) inter-rater reliability scores are 81% and 77%. Again, these inter-rater agreement percentages are adequate, but lower than the percentage typically desirable for inter-rater reliability scores.

Overall, the company can be comfortable using these the work samples and the clerical work test as measures to assist with the selection of candidates for positions as telephone order sales customer service representatives. The company should, however, consider undertaking measures to improve the inter-rater reliability scores for the assessments. Typical ways of improving inter-rater agreement are to increase specificity in the rating protocol and to provide additional training and periodic recalibration of raters. This is so because a known weakness of inter-rater reliability is drift, a term used to indicate movement away from the standards set by the rating protocol by the raters over time,...

How do you interpret the validity results for the clerical test and work sample? Are they favorable enough for the company to consider using them for keeps in selecting new job applicants?
Validity is a pivotal metric with any assessment. Psychometrists take precautions to ensure that validity of the instruments they use is sufficiently robust to enable confidence in the measures. Validity figures are achieved through scientific measures that are designed to assess the particular type of validity under review. Scientists regularly utilize the following types of validity: Content validity (types are face validity, curricular validity), criterion-related validity (types are predictive validity, concurrent validity), construct validity (types are convergent validity, discriminant validity), and consequential validity ("Validity evidence," 2014). Content validity examines the match between the content (often a subject area) that is being assessed and the actual test questions ("Validity evidence," 2014). Curricular validity is an expression of the extent to which a test matches specific objectives of a curriculum that is part of the training or education processes ("Validity evidence," 2014). Criterion-related validity examines the relationship between test scores and some relevant outcome, which in the assessment of candidates for employment is actual job performance ("Validity evidence," 2014). Construct validity is the degree to which a testing instrument or particular measure serves to assess the underlying theoretical construct ("Validity evidence," 2014). Consequential validity, a construct that is familiar to human resources personnel and social scientists, is a term used to refer to the social consequences of using a certain test for a particular purpose ("Validity evidence," 2014).

Criterion-related validity is the type most commonly of interest in performance and other psychometric tests used to assess the suitability of candidates for employment ("Validity evidence," 2014). The relevant figures for the clerical test include the following: Work sample (T) and work sample (C ) correlations are low and are not significant. The criterion-related validity measures of the clerical test show significant correlations with a negative error rate and a positive speed. Correlation with complaints about telephone sales order…

Sources used in this document:
References

French, A., Macedo, M., Poulsen, J., Waterson, T., & Yu, A. (2008). Multivariate Analysis of Variance (MANOVA). San Francisco, CA: San Francisco State University. Retreived http://userwww.sfsu.edu/efc/classes/biol710/manova/MANOVAnewest.pdf

Shoukri, M.M. (2010) Measures of interobserver agreement and reliability (2nd ed). Boca Raton, FL: Chapman & Hall/CRC Press.

Validity evidence: Types of validity. (2014). New York, NY: The College Board. Retrieved http://research.collegeboard.org/services/aces/validity/handbook/evidence
Cite this Document:
Copy Bibliography Citation

Related Documents

Emotional Labor Implications on a Call Centre
Words: 3259 Length: 10 Document Type: Essay

Emotional Labor Implications on a Call Centre During the last two decades Contact or call centers have emerged as the answer to cost effectiveness for all sort of businesses that require back end customer services (Boreham et al., 2007). These call centers hailing from different countries are very similar with respect to markets, offered services, structure of the organization and type of workforce. This industry has flourished very quickly but usually these

Employees Performance Appraisals at the
Words: 4257 Length: 15 Document Type: Thesis

The initial recommendation comes from the employee's direct supervisor and is then discussed with the general director and the payroll manager. At the fourth stage, the performance review, the employee and his direct supervisor come once again face-to-face to discuss the outcome of the performance appraisal process. The employee is informed of the managerial decision regarding future remunerations, and a date for a new meeting is set. The new meeting

Improving Group Productivity the National Call Center
Words: 2831 Length: 9 Document Type: Essay

Improving Group Productivity The National Call Center for the Veteran's Administration (VA) Education Department employs over 700 people, which can be called upon to answer incoming calls from veterans. Within the four regional offices, there are employees of various positions, including Case Managers, Educational Liaison Representatives, application processors, and leaders who verify compliance, productivity, etc. With all employees being called upon to answer incoming calls, each employee needs to be aware

Organization Performance Assessment Organizational Performance Assessment...
Words: 2998 Length: 12 Document Type: Essay

Organization Performance Assessment Organizational performance assessment can be defined as a process of evaluating the performance of an organization against some well defined goals and targets. It lays much emphasis on the accomplishments of an organization in relation to its mission and the stated objectives. In the situation of a government department, the assessment would check the major mandates, ambitions, priority and the performance schedules and evaluates the advancements that have

Employee Satisfaction With a Company's Review Process
Words: 7400 Length: 27 Document Type: Term Paper

Employee Satisfaction with a Company's Review Process The following research examines the reason for a decline in employee satisfaction regarding the review process at XYZ, Inc. The results of the survey revealed that sample biases may have confounded the results and that the survey will have to be re-administered to reflect the true attitudes and results of the preliminary research leading up to the current survey. The result showed a high

Developing Human Potential
Words: 6427 Length: 20 Document Type: Essay

Human Potential Developing Human Potential When an organization makes the decision to take an individual on as a part of staff, effectively they are making a human capital investment in that individual (Lepak & Snell, 1999). Where the organization pays for the training of, insuring of, and salary to that individual they in turn are expected to perform the tasks within their job description efficiently and accurately thus allowing the organization to

Sign Up for Unlimited Study Help

Our semester plans gives you unlimited, unrestricted access to our entire library of resources —writing tools, guides, example essays, tutorials, class notes, and more.

Get Started Now