Every day, Thiagi tweets ready-to-use pieces of practical advice on performance-improvement topics such as coaching, creativity, customer service, feedback, leadership, listening skills, and management.
Here are some pieces of advice about evaluation that were re-tweeted frequently:
- Remember: All evaluations involve a combination of product, process, and person. They are all inter-related. Don't try to isolate them.
- Remember two purposes of evaluation: formative (to improve the intervention) and summative (to prove the value of the intervention).
- We fix a problem in one part of a system and produce negative consequences in another. That’s why we need goal-free evaluation.
- Remember, confirmation bias (you see what you expect to see) reduces objectivity of observation as a measurement tool.
- Remember, disconfirmation bias (you ignore what you don’t expect to see) reduces objectivity of observation as a measurement tool.
- Use scenario-based questions for testing. Search the Internet for Will Thalheimer’s report on “simulation-like questions”.