How to know if we're winning in Afghanistan

Fri, 08/07/2009 - 9:17am

By Peter Feaver

There is a revealing story in today's New York Times on the Obama administration's efforts to identify meaningful metrics in the Afghan war. It has a quote from your humble blogging servant on how difficult it was to identify useful metrics in the Iraq war. The quote is accurate and in context (David Sanger is a pro), but it may be useful to provide even more context. The challenge is finding metrics that are valid and reliable and accurate.

Valid metrics correspond to the true situation on the ground and the true prospects for the war; when those numbers are trending up, the war is really trending up, and vice-versa. An "invalid" metric in this sense might be U.S. combat deaths. That figure could be trending up because you are losing the war (as was happening in 2006), or it could be trending up because you are finally taking costly steps to reverse the trajectory (as was happening in 2007).

Reliable metrics are ones that cannot be artificially raised (or lowered) by our actions or enemy actions. An unreliable metric might be enemy suicide bombing attacks. If that is your primary gauge of how things are going in the war then you can be misled in the short run because the enemy could launch a desperate flurry and lead you to draw the wrong inferences about the situation on the ground. The classic example of this was the Tet offensive in Vietnam, which convinced the recently deceased Walter Cronkite that the Viet Cong could never be defeated when, in fact, Tet marked the end of the VC.

Accurate metrics are truthful. Even valid and reliable metrics are no good if they are inaccurate -- that is, if the reporting is bogus. During the Vietnam War, the Pentagon inflated enemy body counts so that they became more a metric of Pentagon mismanagement of the war than a metric of progress on the battlefield.

But even that may not be enough. In the story, I mention that we thought the "rat rate," the number of good tips we got from Iraqis reporting on Al Qaeda or insurgent activity in their neighborhoods, was a valid, reliable, and accurate metric. I still think it is a good metric because it tapped into the heart of the pre-surge strategy: were Iraqis "standing up" in the fight so we could begin "standing down." But, by itself, it was obviously insufficient because it did trend positively in 2006 just as the war was trending negatively.

One final word: as I have argued before, establishing good metrics is only a part of a successful strategy. It must be accompanied by a good political-military strategy on the ground in Afghanistan, of course. And it must be accompanied by a sustained commitment of presidential political capital and political persuasion, engaging in the elite debate on the topic and explaining to the American people the president's side of the case. We are seeing that expenditure of capital and persuasion on health care -- in truth, an extraordinary commitment of Chicago-style campaign efforts -- but nothing even remotely comparable on the war front. In coming months, I expect the administration will have to ramp up its efforts to explain its war policies. When it does so, I hope it has valid, reliable, and accurate metrics to offer.
( filed under: )


Advertisement

 

So, What is Success?

What is success in Afghanistan? I appreciate the need for metrics (or benchmarks, or whatever) by which we can judge progress, but toward what necessary end is that progress meant to lead?

President Obama has defined success in terms of al Qaeda and its threat to the United States. The resources employed in Afghanistan, and the way they are being employed, suggest another goal, that of building an enduring central government in Kabul strong enough -- and with internal enemies weak enough -- to survive once NATO forces leave. Is attainment of that second goal required to attain the first? Is it achievable at all?

I don't know the answers to these questions, but it does concern me when commentators jump right over them and go on to discussion of metrics and perceptions. Recognizing that substantial damage must have been done to the cause of creating a sustainable Afghan state during the years in which the Bush administration treated Afghanistan as a sideshow to the main event in Iraq, should we not attempt to ascertain whether an effort to do in Afghanistan now what we chose not to do beginning in 2002 is likely to achieve its objective?

Metrics

It would seem to me, just as a matter of logic, that "the number of good tips [on] insurgent activity" might be an indicator of the level of insurgent activity, and thus that a large number might not be a good sign.

Also, would you care to spell out what you mean by "Chicago-style campaign efforts," Dr. Feaver? It appears to me, at first blush, to be an attempt to insert a derogatory reference without having to provide substantiation.

I mention that we thought the

I mention that we thought the "rat rate," the number of good tips we got from Iraqis reporting on Al Qaeda or insurgent activity in their neighborhoods, was a valid, reliable, and accurate metric. I still think it is a good metric because it tapped into the heart of the pre-surge strategy: were Iraqis "standing up" in the fight so we could begin "standing down."

Doesn't that depend on how carefully we determined which tips were good?

In witch-hunt scotland, anybody who had a personal enemy had to judge whether that enemy might report them as a witch. If that looked too likely then the safest thing was to report them first, and then they would be tortured into confessing,,,,

So an increasing number of tips was a measure of social breakdown, not of success against the witches.

Unless you are very careful at deciding which tips are good, this could be an extremely bad measure.

Where are your metrics?

Revealingly, you didn't offer any metrics of your own. So you have no idea what to do and how to measure success.

Admit it, we got into Afghanistan because some terrorists there killed thousands of our own. But now we have no idea what to do there.

We're trapped in a landlocked wasteland with no Osama in sight. Nativist and ungrateful Afghans have punished outsiders, irrespective of whether they come with bags of wheat or not.

We have plans for "community policing" in Afghanistan, but we can't even do the same in black areas in southeast DC!

The classic example of this

The classic example of this was the Tet offensive in Vietnam, which convinced the recently deceased Walter Cronkite that the Viet Cong could never be defeated when, in fact, Tet marked the end of the VC.

Why do you repeat this today?

It made sense to make this false claim after Tet. They staged a great big coordinated attack and we didn't find out about it until after it already started. It showed the world how much support the south vietnamese government didn't have. We desperately needed to find a way to spin it that made it look like Tet wasn't such a big loss.

But why are you still claiming it today? We lost vietnam more than 30 years ago. Why keep repeating the same old disinformation when the value is long, long gone?

Afghanis-Nam? Viet-Stan?

I think we will never know if we are winning this conflict. We will surely know, though, when we have lost it.

This is not the kind of situation where the math of MacArthur's island hopping, or of Eisenhower's planning for D-Day is applicable.

Our obsession with machine forecast must give way to judgment forecast.

Can we see light at the end of the Salang Tunnel?