MY505      Half Unit
Research Design for Policy and Programme Evaluation

This information is for the 2023/24 session.

Teacher responsible

Dr Flora Cornish

Availability

This course is open to any Research level student.

This course is not controlled access. If you register for a place you are likely to be given a place.

Course content

This course teaches the fundamentals of contemporary evaluation research design, for students interested in pragmatic applications of evaluation methods in real-world settings. Students will be equipped with research design skills to be able to design and critically appraise evaluation research in applied fields such as international development, health, and public policy. Students are taught to develop a clear and coherent Theory of Change as a foundation for an evaluation. Taking a mixed methods approach, the course covers the major quantitative designs, including randomized experiments and observational (i.e. non-randomized) research designs such as instrumental variables, difference-in-differences, regression discontinuity design, matching, and synthetic control. It covers qualitative and participatory research designs and their contribution to formative research, process evaluation, realist evaluations, and theory-based evaluations. Examples from the fields of health, international development and public policy will be used throughout the lectures and seminars. Students learn to apply what they have learned, by working in groups on real research design tasks in seminars. The realities of designing evaluations for government and non-government organisations mean that resources are limited and ideal conditions are rarely met. The course therefore focuses on how to make pragmatic choices and deal with often sub-optimal tradeoffs in real-world contexts.

This course focuses primarily on the fundamental principles of evaluation design rather than the implementation of particular quantitative or qualitative methodologies, there are therefore no prerequisites required to register. It is complementary with most other quantitative and qualitative courses offered by the Department of Methodology. Given some overlaps in content on the quantitative side, it is usually advised not to take this course together with MY557 Causal Inference for Observational and Experimental Studies. Research degree students may work on their individual PhD topics for their formative and summative assignments.

Teaching

This course is delivered through a combination of seminars and lectures totalling a minimum of 25 hours across Winter Term. This course has a Reading Week in Week 6 of Winter Term.

Formative coursework

A Theory of Change in the Winter Term.

Indicative reading

Angrist, J. D. and Pischke, J-S. (2014) Mastering Metrics: The Path from Cause to Effect. Princeton University Press

Bell, S. & Aggleton, P. (2016). Monitoring and Evaluation in Health and Social Development: Interpretive and Ethnographic perspectives. London: Routledge.

Cartwright, N. & Hardie, J. (2012). Evidence-Based Policy: A practical guide to doing it better. Oxford, UK: Oxford University Press.

Glennerster, R. and Takaarasha, K. (2013) Running Randomized Evaluations: A Practical Guide, Princeton University Press.

Patton, M. Q. (2015). Qualitative Research and Evaluation Methods. (4th Edition). London: Sage.

Assessment

Research design (100%) in the ST.

Key facts

Department: Methodology

Total students 2022/23: 1

Average class size 2022/23: 1

Lecture capture used 2022/23: Yes (LT)

Value: Half Unit

Guidelines for interpreting course guide information

Course selection videos

Some departments have produced short videos to introduce their courses. Please refer to the course selection videos index page for further information.

Personal development skills

  • Self-management
  • Team working
  • Problem solving
  • Application of information skills
  • Communication
  • Specialist skills