Skip to content

Human Development Index Debate Round 2: UNDP, you’re still wrong

by Martin Ravallion, Director of the Development Research Group at the World Bank

Francisco Rodriguez has defended the HDI against recent criticisms by Bill Easterly and Laura Freschi, who drew in part on my new paper, “Troubling Tradeoffs in the Human Development Index.”

Francisco would make a good lawyer, since he defends his case vigorously on multiple fronts. But this leaves a puzzle about his true position. On the one hand he claims that tradeoffs—including the implied monetary valuations of extra longevity and schooling—are not relevant to the HDI, and that it is even “incorrect” to calculate them. But (on the other hand) he agrees that the old HDI was deficient because it assumed constant tradeoffs (perfect substitution). If he does not care about the HDI’s tradeoffs then why does he care about how much substitution is built into the index, which is all about its tradeoffs?

The tradeoff built into any composite index is just the ratio of the (marginal) weight on one of its underlying variables (such as longevity in the HDI) to another (such as income). There is nothing “incorrect” in wanting to know the HDI’s weights and implied tradeoffs. These are key properties for understanding and assessing any composite index.

And the implicit weights and tradeoffs in the new HDI are questionable. I find that the HDI’s valuations of longevity in the new HDI vary from an astonishingly low $0.51 for one extra year of life expectancy in Zimbabwe to $8,800 in Qatar. The valuations are lower than for the old HDI, especially in poor countries.

And this striking devaluation of longevity is not just due to the fact that the HDI puts declining marginal weight on income, as Francisco suggests. As my paper shows, the weight on longevity itself has declined due to the change in methodology, and substantially so in poor countries.

Francisco defends the new HDI on the grounds that it allows imperfect substitution between its components. This is a non sequitur. One can introduce imperfect substitution without the questionable features of the new index. Indeed, I showed in my paper that if the HDI had used instead the Chakravarty index—a simple generalization of the old HDI, with a number of appealing properties—it could have relaxed perfect substitution in a less objectionable and more transparent way.

I agree with Francisco that perfect substitutability was a dubious feature of the old HDI, and (as he points out) the index was criticized from the outset for this feature. It is a shame that it took 20 years for the Human Development Report to fix the problem. And it is an even bigger shame that the proposed solution brought with it new concerns.

One such concern is the substantial downward revision to the HDI for many countries in Sub-Saharan Africa (SSA), which Easterly and Freschi pointed out. Francisco questions their claim, but the data are not on his side. The graph shows the pure effect of the change in the HDI’s aggregation method. (I have held everything else constant, at the same data used by the 2010 HDI.) Switching to the geometric mean involves a sizeable downward revision for countries with low HDIs, and these are disproportionately found in SSA.

This is not to deny that much of SSA is lagging in key dimensions of development, as Francisco notes. The point here is to separate the role played by the questionable new methodology used by the HDI.

Maybe it is time to go back to the drawing board with the HDI. Deeper consideration of what properties the index should have—especially its tradeoffs—would be a good way to start.

Related posts:
The First Law of Development Stats: Whatever our Bizarre Methodology, We make Africa look Worse
What the New HDI tells us about Africa
Human Development Index Debate Round 2: UNDP, you’re still wrong

Be Sociable, Share!
This entry was posted in Academic research, Data and statistics and tagged . Bookmark the permalink. Follow any comments here with the RSS feed for this post. Both comments and trackbacks are currently closed.

3 Comments

  1. Sam Gardner wrote:

    I am more concerned by the idea that a composite index actually tells anything at all. “Development” is like every “holistic” concept in essence undefined. It means everything, and thus nothing. Development is reached by solving the problems that are each on their own the main development issue at the moment you tackle them. Insecurity is one of the basic needs. And nearly never covered by any index, and not at all in the MDGs. Prioritizing should be a local political process, and should not be a global technocratic game, where academics discuss how many child deaths goes into an extra year of education. This is why I consider the state of the worlds’ children report or the corruption perception index more interesting than any composite index.

    Posted December 13, 2010 at 4:23 pm | Permalink
  2. Russell Silva wrote:

    Whoa — Dr. Easterly, what’s the story behind the striking Zimbabwe outlier data point?

    Posted December 14, 2010 at 11:15 am | Permalink
  3. Russell, the “HDI crash” for Zimbabwe stems from the new methodology of the HDI, using the geometric mean. Multiplying Zimbabwe’s (actually quite fair) attainments in life expectancy and (especially) schooling by its very low “income index” gives you this super low HDI. Notice that Zimbabwe does quite a lot better using the arithmetic mean. And using the Chakravarty index, as I proposed in my paper, Zimbabwe’s HDI would have risen by over 300%, from the lowest (by far) to the 12th lowest. While such sensitivities are common in “mashup indices,” the Chakravarty index has better properties, so I think it gives a more credible number for Zimbabwe, and other countries. Martin

    Posted December 14, 2010 at 3:39 pm | Permalink

2 Trackbacks

  1. […] more here: Human Development Index Debate Round 2: UNDP, you’re still wrong AKPC_IDS += "7300,";Popularity: 50% […]

  2. […] side of the debate have their say as much as they want. So here is UNDP’s new response to Martin Ravallion’s response to UNDP’s previous response to our original blog criticizing the new Human Development Index, […]

  • About Aid Watch

    The Aid Watch blog is a project of New York University's Development Research Institute (DRI). This blog is principally written by William Easterly, author of "The Elusive Quest for Growth: Economists' Adventures and Misadventures in the Tropics" and "The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good," and Professor of Economics at NYU. It is co-written by Laura Freschi and by occasional guest bloggers. Our work is based on the idea that more aid will reach the poor the more people are watching aid.

    "Conscience is the inner voice that warns us somebody may be looking." - H.L. Mencken

  • Recent Comments

  • Archives