Linking learning and performance

1 Why it is so important to measure learning and performance?........................... 1 Program evaluation overview ................................. 2 Using summative evaluation data to investigate..... 5 Case studies of typical HRD programs ................... 7 References ............................................................. 7 2 How to develop objectives and plan for the evaluation?............................................... 8 Planning for the program evaluation ....................... 8 Defining program objectives ................................... 12 Case studies in progress - the beginning ............... 21 Summary ................................................................ 28 References ............................................................. 29 3 How to design learning measures............. 30 Constructing good tests .......................................... 31 Knowledge-based tests .......................................... 34 Performance-based tests........................................ 42 Alternative approaches to measure learning .......... 44 Case studies in progress ........................................ 47 Summary ................................................................ 53 References ............................................................. 58 4 How to test learning measures for reliability and validity .................................... 59 Testing measures for reliability ............................... 59 Testing measures for validity .................................. 61 Administering tests ................................................. 70 The test environment .............................................. 71 Case studies in progress ........................................ 72 Summary ................................................................ 74 References ............................................................. 75 5 How to analyze learning data..................... 77 Tabulating the data ................................................. 78 Examining the data ................................................. 80 Describing the data................................................. 81 Displaying the data ................................................. 89 Reporting groups of learning data .......................... 90 Case studies in progress ........................................ 92 Summary ................................................................ 101 References ............................................................. 102 6 How to ensure learning transfers to job performance ................................................... 104 The transfer problem .............................................. 104 The evaluator’s transfer role ................................... 107 Strategies for ensuring transfer .............................. 109 Take extreme measures to ensure transfer ............ 117 Case studies in progress ........................................ 118 Summary ................................................................ 120 References ............................................................. 121 7 How to design job performance measures ........................................................ 122 Planning for job performance data collection.......... 122 When to measure job performance ........................ 126 How to measure job performance........................... 129 Case studies in progress ........................................ 145 Summary ................................................................ 164 References ............................................................. 164 8 How to analyze job performance data ...... 166 Tabulating and organizing the data ........................ 166 Analyzing the data .................................................. 167 Sales program example.......................................... 167 Presenting results ................................................... 180 Case studies in progress ........................................ 181 Summary ................................................................ 193 References ............................................................. 194 9 How to link results to conclusions and recommendations .......................................... 195 Making recommendations....................................... 198 Sales example ........................................................ 200 Case studies in progress ........................................ 203 Summary ................................................................ 217 References ............................................................. 218 10 How to effectively present evaluation results ............................................................. 219 Determine who will receive report........................... 219 Determine what will be reported ............................. 221 Determine where the report will be presented ........ 221 Determine how the report will be presented ........... 222 Case studies in progress ........................................ 229 Summary ................................................................ 239 References ............................................................. 239 11 Now What? How to maximize evaluation results .......................................... 240 Post-program evaluator roles ................................. 241 Using evaluation results for organizational trending................................................................... 244 Using benchmarking data for continuous improvement ........................................................... 245 Case studies concluded.......................................... 245 Summary ................................................................ 247