Hello Everyone!

My name is Joshua Ailsworth. I am a graduate student at James Madison University in Harrisonburg, VA in the Adult Education/Human Resource Development program. I am currently enrolled in a course on Program Evaluation & Measurement. We are covering a number of topics related to evaluation and I have some general comments and questions in regard to modern evaluation practices that I would like some feedback on, if individuals could be so kind.

In studying current evaluation practices, Kirkpatrick’s (1998) model appears to stand the test of time, despite its inherent flaws and the difficulty in evaluating all four levels, particularly level three and level four. Numerous researchers have since attempted to counter the Kirkpatrick model by offering a new, improved model of evaluation. Kaufman & Keller (1994) attempted to go beyond training programs and beyond training participants to examine the value and worth of programs, creating a five-level model based in part off of Kirkpatrick’s (1998) model. Individuals such as Kearns (2005) have argued using the traditional four-level model, but also putting emphasis on using ROI to examine the value added to the organization prior to training. Individuals such as Holton (1996) have created completely new and ever more complex models of evaluation to be more precise and efficient in measuring outcomes. Despite the evidence that Kirkpatrick’s (1998) model is seriously flawed, there has yet to be a model agreed upon as the best and most correct one for evaluation besides Kirkpatrick’s model.

Given the amount of research and the development of new models of evaluation in recent years, are organizations beginning to move away from Kirkpatrick's traditional four-level model?

What approach(s) are your organizations currently taking to evaluate their programs?

What are the strengths and weaknesses of the model(s) your organizations are utilizing?

Do the model(s) your organizations are utilizing garner effective, meaningful results that inform future decisions?

Where trends do you see emerging in the evaluation and measurement field in the future?

Thank you for your time! I look forward to hearing your experiences and insights in this area of the field!


-Joshua Ailsworth-

I see that you posted this same question on Feb. 7. I agree with Nero - Are you asking us to help you with your Master's thesis?

I am not asking for anyone to help with a Master's thesis or research project. The assignment that I am working on is to solicit feedback from practitioners in the field of evaluation in an online Community of Practice (forum) on questions we generated in an area of the field that we are interested in. So any feedback anyone could provide to the questions I posted on the ROI or Kirkpatrick threads would be greatly appreciated. Thank you for your time.