We are in the process of moving our paper based level 1 evaluation for instructor led courses onto the LMS. Any research out there anyone know of that can predict what will happen to things such as: response rate, validity of the responese; should you make the eval necessary in order for the course to register on your transcript? At what point should you give up on waiting for responses? If anyone has information on this, I would appreciate you sharing. Thank you!

Mandroid,

Someone else out there might want to tackle your questions about response rates, validity...etc.

From this one person's perspective I would only encourage you not to use a sledgehammer for this light duty task. Level one feedback is important but it's focus is narrow and shelf life short. It is best when delivered while the experience is fresh and not influenced by a lousy or great experience back in the workplace.

I like to have instructors/trainers facilitate their own L1 feedback session...using a well crafted survey (anonymous is fine) followed by an opportunity for participants to react-offer upgrades. So many of those who deliver also have an important role in the design as well so it helps make the connection between the lab and the workshop.

Regarding on-line surveys. Any program (software) worth its salt can administer the Level 1 survey by directing it to specific participant email addresses. If set up properly you can also track feedback over time. All feedback is protected and anonymous (again...with proper program).

If the culture supports and encourages (demands) feedback you are in luck. Try to continuously reinforce the notion that feedback is an integral part of any learning process. Otherwise you have a period of trust building ahead of you.

quote:

Originally posted by verite:


Level one feedback is important but it's focus is narrow and shelf life short. It is best when delivered while the experience is fresh and not influenced by a lousy or great experience back in the workplace.

I second that emotion!! Perhaps, for the context of this particular discussion, it would be helpful for us to understand why you want to put this evaluation online?

As a facilitator, I want/require that feedback right away. Level One measures learner reaction, and is best gathered immediately. It doesn't have much merit as historical data, except to, perhaps, see trends (are people liking this more with a different instructor, etc.). But ultimately, level one has value when its gathered immediately and from every participant. Level 1 should be voluntary -- but if you do it immediately after class, your odds of 100 percent participation are extremely good. Your your odds go down drastically if they don't have to do it until they get back to their jobs. Requiring people to complete them online as a prerequisite for getting credit defeats the purpose.