Methodological Guidelines
Benefits | Costs | Net Benefits | BCR | |
---|---|---|---|---|
Policy A | $300 | $100 | $200 | 3 |
Policy B | $240 | $60 | $180 | 4 |
Policy C | $200 | $40 | $160 | 5 |
Treatment of transfers
Interventions involving transfers are an area where consistent classification matters greatly. Transfers tend to fall under the field of social protection and include unconditional cash transfers, conditional cash transfers, food transfers and subsidized insurance. In this case, the transfer appears as both a cost and a benefit in the BCR equation. It should not be netted out. For example, consider an unconditional cash transfer of $100. Suppose the administrative costs of delivering the transfer are $5 while the transfer delivers consumption-smoothing benefits of $10 to recipients. In this case, the benefits are $110, while the costs are $105 for a BCR of 1.04. If one were to net out the transfer (incorrectly), the intervention would appear as benefit = $10 and cost = $5 for a BCR of 2. However, as above, the real resource cost of the intervention is $105, not $5, so 1.04 is, in our estimation, more accurate reflection of the social return.
Time frame of analysis
In terms of the appropriate time frame of analysis, there is one principle: the time frame should be long enough to capture the most important future flow-on effects (typically benefits, but sometimes also costs) from a given intervention. The exact length will vary by analysis. For example, since infrastructure lasts for decades, CBAs of roads, public transport, sewage networks and other major capital works should take at least a 20 year (or more) time horizon to capture all the benefits. In contrast, the costs and benefits of say, crop insurance can be modeled as a one year steady-state intervention, since typically insurance covers only that year’s crop, with next year’s insurance covering next year’s crop and so on. Importantly, as long as the time frame used captures all material flow-on effects, differences in time do not affect the comparability of interventions when using benefit-cost ratio as the metric of interest.
The analytical base year is 2018
For those economists not working from peer-reviewed publication and/or working on an entirely new intervention, the analytical base year for the Prioritizing the Best Buys for Development Across the African Continent project is 2018. This means that all costs and benefits should be reported in 2018 United States dollars. Costs sourced from earlier years should be inflated to the analytical base year using a GDP inflation index, though it is discouraged, when it can be avoided, to use data before 2016. Additionally, forecasts of costs and benefits only need to account for real growth and should ignore inflation. Additionally, all interventions should take the initial conditions of the year 2018 (or as recently as data allows) and assess the effects against this baseline.
Political considerations
All political costs regarding the decision to implement should be ignored, while political fall-out in actual implementation should be considered. In other words, all cost-benefit analyses should take as a starting point the hypothetical scenario where the decision is already made to implement the intervention. Costs associated with advocacy, campaigning, etc. to encourage implementation should be ignored. However, if the completed decision may make politicians decide to cheat or skim the process, this simply means a smaller benefit or a larger cost and should be included (along with all other risks, and challenges in implementation).
The concept of risk
BCR estimates should be revised downward to incorporate well-documented assessments of risk. For example, where it relates to microfinance, it is generally recognized that 2% of borrowers are at risk of default. This risk should be worked into the calculations; in this case, it is an additional cost to the lender.
Implementation failures
To the extent that the data allows, commissioned economists should account for implementation failures such as corruption and incompetence. The most straightforward way to account for this is to adopt parameter estimates from studies with high quality methods (e.g. randomized-controlled trial, difference-in-difference, regression discontinuity) which should theoretically embed all the vagaries of implementation into the effect size. However, recent literature around RCTs documents divergence between small-scale pilots and real-world implementation. In disciplines where these studies are not possible or uncommon, we suggest carefully considering to what extent the evidence represents ideal or non-realistic scenarios with respect to the actual local context and adjust accordingly.
Equity weights
As with most CBAs, as traditionally adopted, Copenhagen Consensus assigns an equal weighting to all costs and benefits regardless of who obtains or pays them. The one exception is for individuals who illegally obtained assets via corruption or theft, which we assign a weight of zero. So for example, in an intervention which reduces corruption, the loss of corrupted funds does not count as a cost in the societal cost-benefit calculation.
Jobs vs. output
Cost-benefit analysis, as is traditionally adopted, does not count the creation of jobs as a benefit. Instead the focus should be on the flow on effects of job creation – either output, income or consumption. The primary reason the value of jobs differs depending on the state of the labor market in question, and this is better determined by examining flow-on effects (the increase in output or the increase in incomes) rather than the monetary value of the number of jobs created.
If the intervention under analysis specifically targets job creation – such as a workfare program like India’s rural guarantee scheme – economists need to examine the broader general equilibrium effects to understand the impact in a cost-benefit framework.
Important common assumptions and approaches for Prioritizing the Best Buys for Development Across the African Continent project
Wages and wage forecasts
Wages and wage forecasts are required for estimating productivity and education benefits as well as time costs / benefits. The Center encourages the use of GNI per capita forecasts where:
Wages = GNI per capita * labor force participation * labor share of income
GNI per capita and GNI per capita growth for all Sub-Saharan African countries were distributed to experts.
Discount rates
We acknowledge there is considerable debate around the appropriate discount rate to use in economics, as well as the fact that discount rates differ with country context. Considering that we are analyzing countries at various stages of development, we would like experts to report BCRs at 5%.
Valuing mortality and morbidity
Valuations of mortality and morbidity follow recent guidelines developed under the Harvard led Guidelines for Conducting Benefit-Cost Analysis project (Robinson et al. 2019). These guidelines suggest a range of approaches. Given time constraints, we adopt one of these approaches for this project. Copenhagen Consensus’ preferred approach is to convert each death avoided into years of life lost (YLL) avoided, using the relevant life tables, and to value each YLL at 1.3x GNI per capita. YLLs should not be discounted.
This preferred approach was derived by taking a VSL value of $9.4m USD (2015 dollars) – representing approximately 160 times income as measured by income per capita PPP - transferred to the continent using an income elasticity of 1.5. In 2017, GNI per capita PPP for sub-Saharan Africa was Int$3700 while the corresponding value for the US was Int$61,120 (World Bank, 2019). Using these figures and applying the approach documented in Robinson et al. (2019) suggests a VSL to GNI per capita multiplier of approximately 39x for the continent.
Life years are valued using a constant value of statistical life year (VSLY). A VSLY is typically derived by dividing the VSL by the average life expectancy of an adult of average age, proxied by half the life expectancy at birth. In sub-Saharan Africa, life expectancy at birth is 61 (World Bank, 2019), implying 30.5-year life expectancy for an adult of average age. The value of a YLL therefore, as a function of GNI per capita is 39 / 30.5 = 1.3.
In terms of morbidity avoided, the Guidelines recommend adopting a cost-of-illness approach. However, this approach can be very data intensive. For parsimony, we suggest here estimating the Years of Life Lost to Disability (YLDs) avoided from morbidity benefits, and applying the same multiplier for YLLs i.e. 1.3xGNI per capita.
In summary all DALYs (whether YLLs or YLDs) should be valued at 1.3xGNI per capita and not discounted.
Value of time
Following Whittington and Cook (2019), we assess the value of time which can be put to use for productive purposes at 100% of wages, while time that cannot be applied to productive purposes is valued at 50% wages for the population in question. Analysts should be careful to include the cost of time required to access the services provided by interventions, particularly for health programs.
In some instances, economists will have to value time of children. While there appears to be no agreed consensus on appropriate valuation, it seems reasonable that i) the value should be lower than productive adult’s time and ii) very young children probably have a zero or even negative value of time (e.g. if children are not at school, adult caregivers are required). So we suggest applying a value of zero for the time of children less than 10 years old. This is consistent with the returns to education literature (e.g. Psacharopolous and Patrinos, 2018), which does not apply an opportunity cost of attending primary school before grade 5. For children aged 11 to 15, a value somewhere between children’s and adult’s time should be applied depending on the context, and potentially reflecting the value that children might contribute to agricultural activities or factory work. Individuals aged 16 and above should be considered adults.
Value of carbon emissions avoided
The value of carbon emissions avoided is drawn from a recent review of the social cost of carbon literature (Tol, 2018). According to this review, the marginal value of a ton of CO2-eq avoided varies by discount rate. For a 3% discount rate the value is USD 25.30 / ton while for a 5% discount rate it is USD 7.60 / ton. Both figures are denominated in 2010 USD. For much higher discount rates, the effective value of carbon emissions avoided at USD 0 / ton.
To estimate the value of carbon emissions reduction also requires a growth factor in the social cost of carbon emissions, since the social cost grows over time as more CO2-eq is released into the atmosphere. The growth factor should be set at 2% as per year (Tol, 2018). The equation for calculating the benefit of avoided carbon emissions is therefore:
where t=0 represents the year 2015, SCC is the social cost of carbon above in 2010 USD (note in Tol (2018) the emissions year and the currency year are different), g = 2%, r = discount rate.
Treatment of costs of raising funds
In some CBAs, analysts explicitly include the cost of raising funds or the cost of taxation. This is usually assessed as a fixed cost per dollar of investment. We recommend ignoring this in CBA since it affects all analyses approximately equally. The inclusion of this cost would add complexity without improving precision or our ability to identify outliers.
Download the full methodological appendix including references here.