History Bias, Study Design, and the Unfulfilled Promise of Pay-for-Performance Policies in Health Care
EDITOR'S CHOICE — Volume 13 — June 23, 2016
Figure 1. Mean percentage of patients achieving a selected quality indicator — a target total cholesterol level of ≤5 mmol/L— in a sample of family practices that participated in a study evaluating the effect of the United Kingdom’s pay-for-performance policy. Dashed line indicates when the pay-for-performance policy was implemented (April 2004). Figure is based on data extracted from Table 2 of Tahrani AA, McCarthy M, Godson J, Taylor S, Slater H, Capps N, et al. Diabetes care and the new GMS contract: the evidence for a whole county. Br J Gen Pract 2007;57(539):483–5 (19).
Month and Year | Percentage (Standard Deviation) of Patients Reaching Target Lipid Levels |
---|---|
April 2004 | 47 (9) |
March 2005 | 64 (8) |
March 2006 | 71 (6) |
Figure 2. Mean clinical quality scores for diabetes at 42 practices participating in a study evaluating the effect of the United Kingdom’s pay-for-performance policy. The scale for scores ranges from 0% (no quality indicator was met for any patient) to 100% (all quality indicators were met for all patients). Dashed line indicates when the pay-for-performance policy was implemented (April 2004). Figure is based on data extracted from Table 1 in Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M. Effects of pay for performance on the quality of primary care in England. N Engl J Med 2009;361(4):368–78 (21).
Year | Mean Clinical Quality Score | |
---|---|---|
Percentage | Standard Error | |
1998 | 61.6 | 1.8 |
1999 | No data | No data |
2000 | No data | No data |
2001 | No data | No data |
2002 | No data | No data |
2003 | 70.4 | 1.5 |
2004 | No data | No data |
2005 | 81.4 | 0.8 |
2006 | No data | No data |
2007 | 83.7 | 0.7 |
Figure 3. Percentage of study patients who began antihypertensive drug treatment from January 2001 through July 2006. Dashed line indicates when the United Kingdom’s pay-for-performance policy was implemented (April 2004). Figure is based on data extracted from bottom panel, Figure 3, in Serumaga B, Ross-Degnan D, Avery AJ, Elliott RA, Majumdar SR, Zhang F, et al. Effect of pay for performance on the management and outcomes of hypertension in the United Kingdom: interrupted time series study. BMJ 2011;342:d108 (22).
Month and Year | Percentage of Patients |
---|---|
Jan-01 | 8.03 |
Feb-01 | 7.97 |
Mar-01 | 7.50 |
Apr-01 | 8.29 |
May-01 | 7.48 |
Jun-01 | 7.98 |
Jul-01 | 8.67 |
Aug-01 | 7.94 |
Sep-01 | 7.67 |
Oct-01 | 8.18 |
Nov-01 | 8.42 |
Dec-01 | 7.63 |
Jan-02 | 8.94 |
Feb-02 | 7.69 |
Mar-02 | 8.74 |
Apr-02 | 7.91 |
May-02 | 8.18 |
Jun-02 | 8.91 |
Jul-02 | 8.42 |
Aug-02 | 8.43 |
Sep-02 | 8.05 |
Oct-02 | 9.63 |
Nov-02 | 8.49 |
Dec-02 | 8.42 |
Jan-03 | 8.27 |
Feb-03 | 9.28 |
Mar-03 | 9.81 |
Apr-03 | 8.57 |
May-03 | 8.94 |
Jun-03 | 9.60 |
Jul-03 | 8.38 |
Aug-03 | 9.92 |
Sep-03 | 9.31 |
Oct-03 | 9.37 |
Nov-03 | 9.98 |
Dec-03 | 9.44 |
Jan-04 | 8.79 |
Feb-04 | 10.54 |
Mar-04 | 9.02 |
Apr-04 | 9.52 |
May-04 | 9.80 |
Jun-04 | 10.24 |
Jul-04 | 9.66 |
Aug-04 | 9.72 |
Sep-04 | 8.90 |
Oct-04 | 9.71 |
Nov-04 | 10.37 |
Dec-04 | 9.56 |
Jan-05 | 9.24 |
Feb-05 | 10.29 |
Mar-05 | 9.87 |
Apr-05 | 10.92 |
May-05 | 11.37 |
Jun-05 | 10.57 |
Jul-05 | 9.86 |
Aug-05 | 10.88 |
Sep-05 | 9.37 |
Oct-05 | 10.31 |
Nov-05 | 10.95 |
Dec-05 | 10.14 |
Jan-06 | 9.72 |
Feb-06 | 10.83 |
Mar-06 | 10.02 |
Apr-06 | 10.67 |
May-06 | 9.96 |
Jun-06 | 11.12 |
Jul-06 | 10.79 |
Aug-06 | 11.56 |
Figure 4. Mortality at 30 days among all hospitals examined before (from first quarter 2002) and after (through fourth quarter 2009) implementation of a pay-for-performance intervention (Premier Hospital Quality Incentives Demonstration [HQID]), which targeted 4 conditions beginning in late 2003: acute myocardial infarction, congestive heart failure, and pneumonia, and patients who underwent coronary artery bypass grafting. Changes at hospitals participating in the pay-for-performance intervention (Premier) were similar to changes at hospitals not participating (non-Premier) for all 4 conditions. Figure is reproduced from Jha AK, Joynt KE, Orav EJ, Epstein AM. The long-term effect of premier pay for performance on patient outcomes. N Engl J Med 2012;366(17):1606–15 with permission from the New England Journal of Medicine (23).
Quarter (Q) and Year | 30-Day Mortality for All 4 Conditions Combined, Percentage | |
---|---|---|
Premier | Non-Premier | |
Q1 2002 | 13.7 | 13.7 |
Q2 2002 | 12.6 | 12.5 |
Q3 2002 | 12.6 | 12.9 |
Q4 2002 | 13.4 | 13.4 |
Q1 2003 | 13.3 | 13.0 |
Q2 2003 | 11.8 | 12.2 |
Q3 2003 | 12.5 | 12.6 |
Q4 2003 | 13.3 | 13.2 |
Q1 2004 | 12.7 | 12.7 |
Q2 2004 | 11.6 | 11.8 |
Q3 2004 | 11.9 | 12.0 |
Q4 2004 | 11.9 | 12.0 |
Q1 2005 | 12.7 | 12.8 |
Q2 2005 | 11.4 | 11.6 |
Q3 2005 | 11.7 | 11.7 |
Q4 2005 | 11.9 | 11.8 |
Q1 2006 | 11.9 | 11.7 |
Q2 2006 | 11.0 | 11.2 |
Q3 2006 | 11.7 | 11.5 |
Q4 2006 | 11.4 | 11.6 |
Q1 2007 | 11.7 | 11.9 |
Q2 2007 | 11.4 | 11.1 |
Q3 2007 | 11.4 | 11.4 |
Q4 2007 | 11.6 | 12.0 |
Q1 2008 | 12.1 | 12.4 |
Q2 2008 | 11.1 | 11.2 |
Q3 2008 | 11.2 | 11.8 |
Q4 2008 | 11.8 | 11.9 |
Q1 2009 | 11.8 | 12.3 |
Q2 2009 | 11.9 | 11.4 |
Q3 2009 | 11.7 | 11.8 |
Q4 2009 | 11.2 | 10.9 |
Figure 5. Mean low-density lipoprotein (LDL) cholesterol levels at baseline and 12-month follow-up in an intervention (pay-for-performance) group (in which incentives were provided to physicians) and a control group (no pay-for-performance). The intervention was conducted from 2011 to 2014 in 3 primary care practices in the northeastern United States. Patients in the control group achieved a mean reduction of 25.1 mg/dL in LDL cholesterol levels from a baseline of 161.5 mg/dL. Patients in the pay-for-performance group achieved a mean reduction of 27.9 mg/dL from a baseline of 159.9 mg/dL. The difference between the 2 groups was neither statistically significant nor clinically meaningful. Figure is based on data extracted from Asch DA, Troxel AB, Stewart WF, Sequist TD, Jones JB, Hirsch AG, et al. Effect of financial incentives to physicians, patients, or both on lipid levels: a randomized clinical trial. JAMA 2015;314(18):1926–35 (26).
Group | Low-Density Lipoprotein Cholesterol Level, mg/dL | |
---|---|---|
Baseline | Follow-up | |
No Pay for Performance (Control) | 161.5 | 136.4 |
Pay for Performance (Intervention) | 159.9 | 132.0 |
- Page last reviewed: June 23, 2016
- Page last updated: June 23, 2016
- Content source:
- Maintained By: