I've just started looking into ROI and the 5 levels of evaluation. Keeping with one suggestion I found, I want to apply it only to those programs that are far-reaching and relatively more expensive. Therefore, our new hire orientation program and our monthly service recognition program looked like two good places to start.

Any thoughts on applying ROI to the above situations would be greatly appreciated.

My first question would by why? Why are you looking at these two programs (other than they are far-reaching and relatively expensive)? Who's asking for this information? Are these two programs even training?

Thanks DonS. I should have been more detailed. Orientation is filled with training, both cultural and OTJ. The orientation period last approximately three weeks and concludes with a test. The monthly service recognition program does not have training in it. No one is asking for the information. Orientation will soon be done completely different than it has been in the past, and I would like to have concrete data that shows it is beneficial to keep orientation in the new format.

Before embarking on any level of measurement or evaluation, I'd suggest taking a look at how your program is strategically aligned. What employee, shareholder (ROI is just one small component of this -- you could also measure impact on EPS), customer, and societal value will it generate? What corporate and business unit goals does it align with? What specific behaviors, KPIs, key results are expected? What knowledge, and skills will the new employees gain and apply as a result of the orientation? Then do a scaled comparison of the new program with the old -- here are the gaps the new program impacted!

I'm not suggesting that you shouldn't evaluate the programs, but if no one is asking for the information what will you do with the data you collect? Part of your evaluation planning should include who is your audience and what information do they want to see(they might not know)?

Do you have any evaluation data on the "old" orientation? How will you compare the "old" and the "new"?

I agree with what Erick T. says about making sure your orientation program is strategically aligned with your business objectives. Doing that ahead of time (along with other design implementation) will take care of ROI.

What do you have planned for measuring the monthly service recognition program? By the sounds of things, I'm not sure that this program would fall into that type of evaluation. JMHO.