Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Training Evaluation

6-1
Explain why evaluation is important.
2. Identify and choose outcomes to
evaluate a training program.
3. Discuss the proces...
Choose the appropriate evaluation
design based on the characteristics of
the company and the importance and
purpose of the...


Walgreen Company wanted to determine if the
time, money, and effort devoted to training
technicians actually made a dif...







Training effectiveness refers to the benefits that
the company and the trainees receive from training.
Training...




Companies are investing millions of
dollars in training programs to help
gain a competitive advantage.
Training inve...
Because companies have made large dollar
investments in training and education and view
training as a strategy to be succe...


Formative evaluation – evaluation
conducted to improve the training
process.



Summative evaluation – evaluation
cond...






To identify the program’s strengths
and weaknesses.
To assess whether content,
organization, and administration o...








To gather data to assist in marketing
training programs.
To determine the financial benefits and
costs of the ...
Conduct a Needs Analysis

Develop Measurable Learning
Outcomes
Develop Outcome Measures

Choose an Evaluation Strategy

Pl...
6 - 12

Level Criteria

Focus

1

Reactions

Trainee satisfaction

2

Learning

Acquisition of knowledge, skills, attitude...
Cognitive Outcomes
Skill-Based Outcomes

Affective Outcomes

Results
Return on Investment

6 - 13




Cognitive Outcomes
 Determine the degree to which trainees are
familiar with the principles, facts,
techniques, pro...


Affective Outcomes
 Include attitudes and motivation.
 Trainees’



perceptions of the program
including the facilit...


Return on Investment (ROI)
 Comparing

the training’s monetary benefits
with the cost of the training.
 Direct costs
...
Good training outcomes need to be:
 Relevant
 Reliable
 Discriminate
 Practical

6 - 17






Criteria relevance – the extent to which training
programs are related to learned capabilities
emphasized in the ...
Outcomes
Measured in
Evaluation

Contamination

Outcomes
Identified by Needs
Assessment and
Included in
Training
Objective...






Reliability – degree to which outcomes
can be measured consistently over time.
Discrimination – degree to which
t...


Threats to validity refer to a factor that will
lead one to question either:
The believability of the study results (in...




Threats To Internal Validity
 Company
 Persons
 Outcome Measures
Threats To External Validity
 Reaction to prete...
Pre- and Posttests

Use of Comparison Groups

Random Assignment

6 - 23


Posttest – only



Time series



Pretest / posttest





Posttest – only with
Comparison group

Time series with
C...
6 - 25

Factor

How Factor Influences Type of Evaluation Design

Change potential

Can program be modified?

Importance

D...








To understand total expenditures for
training, including direct and indirect costs.
To compare costs of altern...
1.
2.
3.

4.

Identify outcome(s) (e.g., quality, accidents)
Place a value on the outcome(s)
Determine the change in perfo...
Determine training costs (direct costs + indirect
costs + development costs + overhead costs +
compensation for trainees)
...
6 - 29

Industry

Training Program

ROI

Bottling company

Workshops on managers’ roles

15:1

Large commercial bank

Sale...
Upcoming SlideShare
Loading in …5
×

of

Training evaluation   ppt 6 Slide 1 Training evaluation   ppt 6 Slide 2 Training evaluation   ppt 6 Slide 3 Training evaluation   ppt 6 Slide 4 Training evaluation   ppt 6 Slide 5 Training evaluation   ppt 6 Slide 6 Training evaluation   ppt 6 Slide 7 Training evaluation   ppt 6 Slide 8 Training evaluation   ppt 6 Slide 9 Training evaluation   ppt 6 Slide 10 Training evaluation   ppt 6 Slide 11 Training evaluation   ppt 6 Slide 12 Training evaluation   ppt 6 Slide 13 Training evaluation   ppt 6 Slide 14 Training evaluation   ppt 6 Slide 15 Training evaluation   ppt 6 Slide 16 Training evaluation   ppt 6 Slide 17 Training evaluation   ppt 6 Slide 18 Training evaluation   ppt 6 Slide 19 Training evaluation   ppt 6 Slide 20 Training evaluation   ppt 6 Slide 21 Training evaluation   ppt 6 Slide 22 Training evaluation   ppt 6 Slide 23 Training evaluation   ppt 6 Slide 24 Training evaluation   ppt 6 Slide 25 Training evaluation   ppt 6 Slide 26 Training evaluation   ppt 6 Slide 27 Training evaluation   ppt 6 Slide 28 Training evaluation   ppt 6 Slide 29
Upcoming SlideShare
Evaluation of training
Next
Download to read offline and view in fullscreen.

58 Likes

Share

Download to read offline

Training evaluation ppt 6

Download to read offline

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Training evaluation ppt 6

  1. 1. Training Evaluation 6-1
  2. 2. Explain why evaluation is important. 2. Identify and choose outcomes to evaluate a training program. 3. Discuss the process used to plan and implement a good training evaluation. 4. Discuss the strengths and weaknesses of different evaluation designs. 1. 6-2
  3. 3. Choose the appropriate evaluation design based on the characteristics of the company and the importance and purpose of the training. 6. Conduct a cost-benefit analysis for a training program. 5. 6-3
  4. 4.  Walgreen Company wanted to determine if the time, money, and effort devoted to training technicians actually made a difference.  It was interested in assessing the effectiveness of the training program. 6-4
  5. 5.     Training effectiveness refers to the benefits that the company and the trainees receive from training. Training outcomes or criteria refer to measures that the trainer and the company use to evaluate training programs. Training evaluation refers to the process of collecting the outcomes needed to determine if training is effective. Evaluation design refers to from whom, what, when, and how information needed for determining the effectiveness of the training program will be collected. 6-5
  6. 6.   Companies are investing millions of dollars in training programs to help gain a competitive advantage. Training investment is increasing because learning creates knowledge which differentiates between those companies and employees who are successful and those who are not. 6-6
  7. 7. Because companies have made large dollar investments in training and education and view training as a strategy to be successful, they expect the outcomes or benefits related to training to be measurable. 6-7
  8. 8.  Formative evaluation – evaluation conducted to improve the training process.  Summative evaluation – evaluation conducted to determine the extent to which trainees have changed as a result of participating in the training program. 6-8
  9. 9.    To identify the program’s strengths and weaknesses. To assess whether content, organization, and administration of the program contribute to learning and the use of training content on the job. To identify which trainees benefited most or least from the program. 6-9
  10. 10.     To gather data to assist in marketing training programs. To determine the financial benefits and costs of the programs. To compare the costs and benefits of training versus non-training investments. To compare the costs and benefits of different training programs to choose the best program. 6 - 10
  11. 11. Conduct a Needs Analysis Develop Measurable Learning Outcomes Develop Outcome Measures Choose an Evaluation Strategy Plan and Execute the Evaluation 6 - 11
  12. 12. 6 - 12 Level Criteria Focus 1 Reactions Trainee satisfaction 2 Learning Acquisition of knowledge, skills, attitudes, behavior 3 Behavior Improvement of behavior on the job 4 Results Business results achieved by trainees
  13. 13. Cognitive Outcomes Skill-Based Outcomes Affective Outcomes Results Return on Investment 6 - 13
  14. 14.   Cognitive Outcomes  Determine the degree to which trainees are familiar with the principles, facts, techniques, procedures, or processes emphasized in the training program.  Measure what knowledge trainees learned in the program. Skill-Based Outcomes  Assess the level of technical or motor skills.  Include acquisition or learning of skills and use of skills on the job. 6 - 14
  15. 15.  Affective Outcomes  Include attitudes and motivation.  Trainees’  perceptions of the program including the facilities, trainers, and content. Results  Determine the training program’s payoff for the company. 6 - 15
  16. 16.  Return on Investment (ROI)  Comparing the training’s monetary benefits with the cost of the training.  Direct costs  Indirect costs  Benefits 6 - 16
  17. 17. Good training outcomes need to be:  Relevant  Reliable  Discriminate  Practical 6 - 17
  18. 18.    Criteria relevance – the extent to which training programs are related to learned capabilities emphasized in the training program. Criterion contamination – extent that training outcomes measure inappropriate capabilities or are affected by extraneous conditions. Criterion deficiency – failure to measure training outcomes that were emphasized in the training objectives. 6 - 18
  19. 19. Outcomes Measured in Evaluation Contamination Outcomes Identified by Needs Assessment and Included in Training Objectives Relevance Deficiency Outcomes Related to Training Objectives 6 - 19
  20. 20.    Reliability – degree to which outcomes can be measured consistently over time. Discrimination – degree to which trainee’s performances on the outcome actually reflect true differences in performance. Practicality – refers to the ease with which the outcomes measures can be collected. 6 - 20
  21. 21.  Threats to validity refer to a factor that will lead one to question either: The believability of the study results (internal validity), or validity)  The extent to which the evaluation results are generalizable to other groups of trainees and situations (external validity)  6 - 21
  22. 22.   Threats To Internal Validity  Company  Persons  Outcome Measures Threats To External Validity  Reaction to pretest  Reaction to evaluation  Interaction of selection and training  Interaction of methods 6 - 22
  23. 23. Pre- and Posttests Use of Comparison Groups Random Assignment 6 - 23
  24. 24.  Posttest – only  Time series  Pretest / posttest   Posttest – only with Comparison group Time series with Comparison group and Reversal  Solomon Four – group  Pretest / posttest with Comparison group 6 - 24
  25. 25. 6 - 25 Factor How Factor Influences Type of Evaluation Design Change potential Can program be modified? Importance Does ineffective training affect customer service, product development, or relationships between employees? Scale How many trainees are involved? Purpose of training Is training conducted for learning, results, or both? Organization culture Is demonstrating results part of company norms and expectations? Expertise Can a complex study be analyzed? Cost Is evaluation too expensive? Time frame When do we need the information?
  26. 26.     To understand total expenditures for training, including direct and indirect costs. To compare costs of alternative training programs. To evaluate the proportion of money spent on training development, administration, and evaluation as well as to compare monies spent on training for different groups of employees. To control costs. 6 - 26
  27. 27. 1. 2. 3. 4. Identify outcome(s) (e.g., quality, accidents) Place a value on the outcome(s) Determine the change in performance after eliminating other potential influences on training results. Obtain an annual amount of benefits (operational results) from training by comparing results after training to results before training (in dollars) 6 - 27
  28. 28. Determine training costs (direct costs + indirect costs + development costs + overhead costs + compensation for trainees) 6. Calculate the total savings by subtracting the training costs from benefits (operational results) 7. Calculate the ROI by dividing benefits (operational results) by costs.  The ROI gives you an estimate of the dollar return expected from each dollar invested in training. 5. 6 - 28
  29. 29. 6 - 29 Industry Training Program ROI Bottling company Workshops on managers’ roles 15:1 Large commercial bank Sales training 21:1 Electric & gas utility Behavior modification Oil company Customer service Health maintenance organization Team training 5:1 4.8:1 13.7:1
  • kajalkakranian

    May. 5, 2021
  • LadyleeFlorendo

    Mar. 23, 2021
  • GhazalaMushir

    Aug. 13, 2020
  • kaminiaswal1

    May. 7, 2020
  • YogaLingam3

    Nov. 17, 2019
  • NishuJain31

    Nov. 15, 2019
  • NajjineeSharjah

    Nov. 7, 2019
  • MAAAAAAAM

    Nov. 4, 2019
  • KelumEranga

    Sep. 2, 2019
  • SohailAhmad235

    May. 13, 2019
  • UjjawalKumar52

    Apr. 21, 2019
  • RashmiGupta198

    Apr. 8, 2019
  • RahulSehrawat19

    Apr. 3, 2019
  • KiranjeetKaur58

    Jan. 28, 2019
  • HarshitaSai

    Dec. 27, 2018
  • ArafatNaeem

    Oct. 16, 2018
  • AbhishekPatil253

    Oct. 12, 2018
  • MohdBshr

    Sep. 19, 2018
  • manishkumar3244

    Jul. 25, 2018
  • DavidJaison1

    Jul. 24, 2018

Views

Total views

76,741

On Slideshare

0

From embeds

0

Number of embeds

52

Actions

Downloads

3,533

Shares

0

Comments

0

Likes

58

×