Think HR Think CHRM
Thursday - 22 Aug 2019

CHRMGlobal.com on LinkedIn
Username : Password: Forgot Password?
Updates
Updates
Training Effectiveness
Human Resources » Training & Education


Chrm Message From: vinaykumar07 Total Posts: 10 Join Date: 10/03/2006
Rank: Executive Post Date: 25/06/2006 06:30:38 Points: 55 Location: India
Training Effectiveness

The effectiveness of training is a measurement of learning. It is determined by comparing post-test scores with pre-test scores and then measuring the net change. There are several methods to measure this—on a per-student basis, on a per-“skill point” base or on a per-dollar basis. Let’s look at the skill-point base, which measures the cost of raising a student’s skill by one unit."

This is dangerously wrong! Let me explain!

The difference between a pre-test score and a post-test score can be for many reasons, several of which may actually apply together. Without any root cause analysis to identify the causal links between the different scores (pre-test and post-test) all you can truthfully say about this situation is that the pre-test scores were X and the post-test scores were Y - you cannot say WHY they are like this.

This does NOT mean there is no link, just that you haven't demonstrated one - and this is where evaluation practitioners get in to bother - yes, even if you follow Kirkpatrick or Phillips' approach - you have to have PROOF when the CFO and CEO ask for it - CORRELATION IS NOT CAUSATION!!!

A measurement of learning is not training effectiveness - it's a measure of learning! You can learn everything required, but fail to put it to required use and the required outcomes are not achieved. Training in organisations is ALMOST ALWAYS about achieving a better performance or capability than is currently available - it's about OUTCOMES that favour the customer and the shareholder - it's not about learning - that's a bonus (in my humble opinion!).

Generally effectiveness measures are defined in terms of the extent to which a set of objectives are met. It would be quite easy to have a large overlap here with efficiency measures.

(Training) efficiency is generally defined as the number of units output for the number of units input. Taking a similar theme I suggest training efficiency can be measured several ways - here are some examples:

Number of training courses achieving the required outcomes
----------------------------------------------------------------- ---- x 100%
Total number of training courses delivered


Or


100% x (Number of trainees behaving as requried/operating equipment to required standard) / (Total number of people trained)

Or

100% x Total benefits / Total costs


Coming back to the effectiveness focus again there is some help to be found from our old friend Kirkpatrick.

Effectiveness at Level 1 (Reactions of trainees) could be measured in terms of getting at least 4 out of 5 in each area being rated. If 100% of trainees rate all the aspects at least 4 out of 5, then at Level 1 we'd be 100% effective. But if these same trainees have line managers sho report that these trainees are only demonstrating new but required behaviours for 40% of the time, then arguably the training at Level 4 (Business Impact of training) is just 40% effective.

Going back to the article I quoted from above...

IF you can demonstrate causal links as I discussed earlier, then arguably the pre and post test scores CAN be seen as a measure of effectiveness.

Read carefully with definitions!!

Regards

Vinay Kumar
Chrm Message From: nethra_khushi Total Posts: 20 Join Date: 10/03/2006  
Rank: Executive Post Date: 17/04/2007 09:57:08 Points: 100 Location: India

Trng evaluation can be done at four levels - Reaction (of participants to the content and material of the T module); Learning (beyond the T session); Behaviour (to check the transfer of trng at workplace) and Result (impact on trng on performance)

Evaluation could be by session feedback/evaluation (to check the Level 1: Reactions); program feedback (Level 2: Learning) ; Job Improvement Plan / Feedback: Job Improvement plan can be prepared by participants after training to ensure application of the trng on the job and structured feedback session: After 2 to 3 months of training a
feedback session is held to know how the training is implemented, transfer of learning at the job (Level 3: Behaviour); (Level 4: Results) Professional agencies: At periodic intervals, evaluation of training effectiveness can be conducted by reputed outside professional agencies like Tata management Training Centre, Administrative Staff College of India, etc.

Regards

Nethra R

Chrm Message From: jigar Total Posts: 61 Join Date: 10/03/2006  
Rank: Manager Post Date: 19/11/2012 22:26:22 Points: 305 Location: India

Training effectiveness can be measured as:-

1. on the job observation
2. Interviewing with the paricipats
3. Taking the objective question test
4. Review or feedback by superior
5. Actual performance by participants

Jigar

 

Chrm Message From: paulthomas Total Posts: 43 Join Date: 10/03/2006  
Rank: Executive Post Date: 20/11/2012 00:22:37 Points: 215 Location: India

The following methods can be used for measuring Training Effectiveness at work :

1). Observation by his Team Leader during the defined period (One month to 3 months).
2). Feed back from his Team Leader & members.
3). Feed Back from all the concerned with whom he / she interacts professionally.
4). Monitor the performance in terms of Qulity and Productivity.
 

 
Events
 
Related Discussion
Training on Designing Acc
Training Tips for Trainer
Training Benefits
Effectiveness of Performa
Identification of Trainin
Parable of the Fisherman
project training
Training Aspirant
Movies that Make Good Tra
Training in Recruitment &
 
Related Articles
ROI - Perspective of Trai
Training Children to be S
Measuring Training Effect
Training ROI & Effectiven
Improving Effectiveness o
Skill Based Training
Understanding Training fr
Selecting a Training Cons
Why do most of the Traini
Hiring for Attitude, Trai