The importance of good evaluation design, and how the design stage can be used to prevent problems that are much harder to fix using statistical methods at the analysis stage;
Key problems with data collection that can arise when conducting an impact analysis. In particular, low survey response rate and social desirability bias;
Internal and external validity and the extent to which these are threatened by problems with data collection; AND
Statistical power: the consequences of having insufficient power, and the importance of estimating statistical power of evaluation design at the outset.
CASE
New York City’s Teen ACTION Program: an Evaluation Gone Awry
ASSIGNMENT: BASED ON WHAT YOU HAVE LEARNED OVER THE COURSE OF THE TERM,
PART 1: Provide a detailed and critical policy assessment of this evaluation gone awry, and what can be learned from this to be better analysts–Be specific about what you would do to do a better analysis. Make sure to draw on readings from previous units.
After you have completed PART 1, go to the web page for Teen Action, and …
AUDIO VIDEO ONLINE
New York City’s Teen ACTION Program: an Evaluation Gone Awry: The Teen ACTION Evaluation – Part 1
AUDIO VIDEO ONLINE
New York City’s Teen ACTION Program: an Evaluation Gone Awry: The Teen ACTION Evaluation – Part 2
PART 2
… based on the available information, write a policy memo detailing the type of analysis you would recommend to the mayor and why?
The post New York City’s Teen ACTION Program: an Evaluation Gone Awry first appeared on COMPLIANT PAPERS.