Capstone Project

Assessment overview

The Capstone Project is an individual-level summative assessment prepared for the Health Economics specialisation of the Global Master of Public Health (Online), the `GMPH’. The Capstone is designed to capture the knowledge ÌìÃÀ´«Ã½ will have gained throughout the economic evaluation lessons in this specialisation. This project is comprised of a mix of practical and theoretical aspects, and requires ÌìÃÀ´«Ã½ to plan, undertake, interpret, and draw policy-relevant conclusions from economic evaluations. In layman terms, the Capstone is a mix of a quantitative exam, and case-study format questions, which require ÌìÃÀ´«Ã½ to infer the setting, and draw upon outside knowledge to place the question in context, in order to then answer the question using course materials.

Design decisions

Rationale for the assessment

The design of the Capstone was very much linked to the type of ÌìÃÀ´«Ã½ the GMPH included. The Capstone Project opens up 13 weeks before it is due. Time was allotted specifically to the ÌìÃÀ´«Ã½ (no new coursework online; no online live sessions) for weeks 8-13. When a cohort is largely comprised of online, professional learners, allowing for flexibility of timing and delivery is deemed an important factor.

The Capstone was a supplement to an online, timed MCQ, worth the additional 25% of the marks for the course, delivered at week 8 (the Capstone was due week 13).

Fit with other assessments and the programme/ module

Health Economics is a standalone elective module, so it is not driven how the Capstone fits in with the other programme assessments. However, as the online GMPH is a heavy course, typically enrolling senior health staff, globally, the programme team did look to make sure no other key programme assessments were due right around the same time as the Capstone.  The ÌìÃÀ´«Ã½ are taking (perhaps not at the same time, but within the Online GMPH) the core courses of Statistics for Public Health, Epidemiology for Public Health, Foundations of Public Health Practice, Health Protection, Health Systems Development, Population Health Improvement, and a Research Portfolio. The other key summative assessment in this module was an automatically marked 45-minute MCQ.

Practicalities

Preparing ÌìÃÀ´«Ã½ for assessment

The teaching staff presented a live session on the Capstone, trying to alert ÌìÃÀ´«Ã½ to subtleties that might be missed, e.g. needing to look up background material themselves, each question standing independently, etc. The goal of the teaching team is for everyone to learn, and succeed, and one of the difficulties in teaching such a large cohort online is reaching all of the ÌìÃÀ´«Ã½. Therefore, if anyone ever wants to discuss the Capstone in office hours, et cetera, that was always accepted and welcomed. No practice exams were given in advance, as there are limited case studies in countries with the same issues as the Capstone (Vietnam, for example, or something specific to the UK).

Marking arrangements

The Capstone was marked double-blind, by questions. The teaching team created a very detailed rubric, both for marking and for feedback. Thus, consistency in marking could be delivered, even with the open-ended questions. Quantitative problems had rubrics as well. X amount of points if this went wrong, but Y amount of points if they still maintained the right order of interventions, etc.

Feedback arrangements

Feedback comments were assigned for each point of the entire rubric. Additionally, markers were given notes as to how many comments should be made on each section of the Capstone, whether they were comments because a student had missed a significant amount of points, or positive comments because they had completed the section accurately. In this way, the teaching team ensured each student would receive a consistent level and quality of feedback, and this eased the burden on the outside markers.

Management of the process

The most important part of the Capstone of course is monitoring the ÌìÃÀ´«Ã½ seem to understand the content going in. This is always tricky, especially in an online course. The teaching team took close note of one particular section, for example, ÌìÃÀ´«Ã½ continued to ask about in office hours, or a large portion of the ÌìÃÀ´«Ã½ had missed on the MCQ. If that was the case, the teaching team would proactively again try to present the material in a different way, trying to assist the ÌìÃÀ´«Ã½ as much as possible to put them in a strong position for the Capstone.

Student experiences with the assessment

As the ÌìÃÀ´«Ã½ are generally senior, management-level professionals, often the course draws healthcare-industry executives expecting more of a `discussion’ style format, who can be surprised by the mathematics and technical rigour of a health economics course. Whilst this can make the first few weeks of the course difficult, generally expectations and understandings of the course settle in, and the level of engagement of the class is generally quite high. The `health’ side of the course is most easily understood and the `economics’ side of the course can be a bit misunderstood. There have been a few ÌìÃÀ´«Ã½ who have been overwhelmed by the quantitative aspects of the course. Due to the online `go at your own pace’ nature of the course, some ÌìÃÀ´«Ã½ can fall behind. In this instance, generally the programme team is approached, and then the Teaching Fellow / Graduate Teaching Assistant is approached, and streamlined advice tailored to that individual is dispensed.

Online adaptations

This is for an online course, so no adaptations needed. However, for an in-person course, this assessment would work as well. The assessment could be distributed to the class with a large window open for submission similar to a standard exam with a due date.

The assessment window could be adapted for ÌìÃÀ´«Ã½ who were in-person, full-time, not working professionals.

Hear what the Imperial Experts have to say...

Pros and cons of exams

Pros and cons of exams

Pros and cons of exams

Professor Martyn Kingsbury, Centre for Higher Education Research and Scholarship

What is the summative and formative assessment?

What is the summative and formative assessment?

Kate Ippolito, Centre for Higher Education Research and Scholarship

How to make exams useful for learning

How to make exams useful for learning

Professor Martyn Kingsbury

What are open book exams?

What are open book exams?

Professor Martyn Kingsbury

The value of open book exams

The value of open book exams

Professor Martyn Kingsbury, Centre for Higher Education Research and Scholarship

What to consider when designing open book exams

What to consider when designing open book exams

Professor Martyn Kingsbury, Centre for Higher Education Research and Scholarship

How to avoid over assessing ÌìÃÀ´«Ã½

How to avoid over assessing ÌìÃÀ´«Ã½

Judith Webster, Registry

How to help ÌìÃÀ´«Ã½ frame employability skills

How to help ÌìÃÀ´«Ã½ frame employability skills

Katie Dallison, Careers Services

Overview

Faculty: Medicine
Department: School of Public Health
Module name: Health Economics
Degree: Global Master of Public Health (Online)
Level: Postgraduate
Approximate number of ÌìÃÀ´«Ã½:  125
Weighting: 75%
ECTS: 5
Module type: Elective

More information

Interviewee: Hugo Turner

Second Interviewee: Natasha Croome

Third interviewee: Christa Hansen

Roles: Module Lecturers and GTA, respectively