I thought I’d follow up on all the comments regarding Pay For Success in bullet point format.
- Regarding the difficulty of measuring impact: Pay For Success sets up a contract that specifies the population to be served, the outcomes to be achieved and the measurement methodology to be used. While the contract may be flawed, the process is agreed upon and so you avoid the second guessing of evaluation that happens in an research setting. If the contract is flawed, then both sides will learn and changes will be made to future contracts. But each contract once executed does not need to get mired in debates about the validity of the evaluation process.
- Regarding cost savings to tax payers not being the same thing as philanthropic impact: I think this is correct. Government and philanthropy have different goals and how they measure success should be different. In the case of Pay for Success, the government is the payer and so their needs must be met. The government engages in public activity for the public good and has a natural interest in providing that good at the lowest possible cost. But low cost isn’t the only goal. For instance, a Pay For Success project that aimed to improve educational outcomes might be in the interest of the government even if the cost was higher. However, the current fiscal and political realities suggest that an initial focus on projects that will lower tax payer expenses makes the most sense. Longer term Pay For Success contracts could be crafted with philanthropic funders as the payer, in which case pure social impact, non-cost related goals might be sought.
- Regarding setting the correct outcomes: It is true that since the contract must set specific outcomes, if those outcomes are too narrow they might create a “teaching to the test” reaction from the intermediary. For instance, if a homelessness reduction project simply specified that a certain percentage of beneficiaries have a place to spend the night, the intermediary may be incentivized to place people into extremely low cost, unsafe housing that is actually detrimental to their longer term life outcomes. However, I believe that the risk of paying for outcomes is far less than the risk of paying for inputs (paying a nonprofit to serve the homeless without any discussion or tracking of outcomes).
- Regarding the time frames used in the contract: Short term incentives can be hugely destructive. One major contributing factor to the financial crisis was the short term incentives that mortgage lenders pursued. Luckily the Pay For Success program breaks away from the traditional one to two year appropriation cycle and allows the contracts to support long term outcome measurement. That being said, there will always be some tension around time frame and working to reward short, medium and long term success will be important.
Pay For Success is an experiment. However, it represents a rare opportunity to shift government spending from input based to outcome based. That shift, from funding activity to funding results, is one of the key unifying elements of the effective philanthropy movement. I believe that those of us who care about results based philanthropy need to lend support to the Pay For Success concept, while not downplaying the challenges, of which philanthropy is well aware, of results based funding.