Good afternoon.....I'm looking for some information/data on the response choices of a Likert scale when used for a Level 1 evaluation. The question I'm really struggling with is: "Is it more effective to have an odd number of options (1-5 type)with the middle option being neutral, or to have an even number of response choices, which forces a more clear decision." Is there any data out there that would suggest one is more than effective than another - outside of personal preference!! THANKS

Do you have to use a scale at all? Would you (have you) consider(ed) a different type of Level 1 eval?

That's an interesting question. We do plan on having several open ended questions as well, and will leave room following each of the questions for a free form field. The evaluation for this training is a joint effort with another peer, and their preference is the odd numbered approach. Just curious if/what research there may be out there to support one way or the other. THANKS for the question...

Every time I have ever seen anyone use a combination package (scaled questions followed by open-ended), the majority of learners will quickly circle the numbers (many just do one big loop around the next-to-best response), and leave the open-ended questions blank. Providing 4 or 5 concise open-ended questions alone (no scale) basically guarantees constructive responses to just about anything you want to know. Numbers are just numbers - rarely does anyone take the time to explain why they picked the number they picked. Providing a scale gives the learner an easy-out. (And, frankly, gives the facilitator an easy-out as well.)

If you really want reactions you can actually use to help you improve the learning, try:

1) What was the most important thing you learned and why?
2) How do you plan to apply what you've learned?
3) Describe the most memorable thing about your learning experience. Why was it the most memorable?
4) What is one thing you would most like to change and why?
5) Overall, how would you rate this learning experience (on a scale from 1 - 10 with 10 being the highest). Please explain.

eps,

When I build a web-based survey/assessment for client I encourage them to go for even number of selection options. For me there is little to be gained from that safe place in the middle....and would rather build in a No Opinion...NA...etc option.

The real design effort should be in the descriptions used for each point on the scale. Since numbers/letters mean zip...it is the descriptors (agree, strongly agree, etc) that hold the value.

Trust your instincts...that's all the data you need.