Friday, March 27, 2009

Bad assumptions, bad math, bad story

Dave Perry, formerly of the Dalhousie Centre for Foreign Policy Studies and the Broadsides website listed in our sidebar links, is now at Carleton University. I know this because his work was recently quoted in an article in The Tyee:

"An estimated 20,000 Canadian Forces members served in the Afghan theatre of operations between 2002 and 31 December 2007, and seven additional six-month rotations will be required between February 2008 and July 2011. Recognizing that 3000 personnel are really required to staff each rotation, by July 2011 there will be approximately 41,000 Canadian military veterans of Afghanistan."

Perry also cites an estimate that "27 per cent of Kandahar veterans will experience mental health problems, including post-traumatic stress disorder, significant depressive issues, and hazardous drinking behaviour. With a total of 11 rotations or 33,000 troops required to fulfill our combat role in Kandahar, this suggests almost 9000 forces personnel may experience some form of mental health problems."

This is disappointing.

The math only works if the CF is sending new people in each rotation. But we all know that's not the case - there are many soldiers serving their second, third, even a few fourth tours in Afghanistan right now. So Perry's 41,000 number is inflated. How much, I don't know. But I suspect by a five-digit margin.

Of course, that's just a guess on my part. But at least I'll tell you I can't vouch for the accuracy of my guess. One would hope you'd get better from an academic writing in "Canada's pre-eminent scholarly publication on international relations." Let alone from an "independent daily online magazine" which one would hope would apply a modicum of common sense to the material it reports.

Update: Dave and I have corresponded in the past about some much better work of his, and he dropped me an e-mail about this piece.

A few comments re my math.

First, so far as I know of, no estimate has been released publically that estimates the number of actual Afghan vets (versus individual deployments) so arriving at an actual number is guesswork unless DND a) knows the real number, and b) will release it.

I suspect they don't even know, but that’s a guess.

That goes for the research I was doing, as well as the PBO report, which was similarly unable to obtain real data from DND.

Second, despite what I just wrote, a year ago, Gen Gauthier, I think it was, testified before one of the defence committees that as of Feb 2009, Canada would have 30,000 Afghan vets. He didn't specify if he meant total rotations, or individual veterans, so I didn't use that figure.

However, for the sake of argument, if we take those numbers...

I don't know how many guys are on more than their first tour, but the five rotos after Feb 2009, (until July 2010, ignoring however many stay past then) will require at least 15,000 individual-soldier-deployments.

So, even if only 2/3 of them are on their first deployment, when added to the estimate of 30,000 vets by Feb 2009, a total estimate of 41,000 is reasonably close.

Third, the 3,000 per rotation number is now too low because our "official" number of deployed has gone up to 2,830, so I'd guess that the numbers required to staff that have increased to something like 3200-3300, but that's a guess.

Fourth, although the 41k estimate may be off, the long term costs of care figures actually start getting worse when you apply them to guys with multiple tours. All the US data shows marked increases in rates of PTSD and other stress injuries as the number of multiple tours goes up.

The 27% incidence rate of operational stress injuries were taken from a post-op analysis of the first battlegroup that went to Kandahar - ie guys on their first tour (in Kandahar). I suspect that rates are going to be much higher for Warrant Officers coming back from their 5th tour.

In any event, at the time I was writing this, no one had done any significant work on this topic, so my goal was to get something out in the public domain, about be as transparent as possible about my methodology, so people could do exactly what you did, and take a look for themselves, and see if it made sense.

I replied that starting with Gauthier's 30,000 comment was iffy, especially if you don't know what it refers to. And that anecdotally at least, more than a third of those in Kandahar have had a tour in Afghanistan before. And that anything higher than the authorized strength is filled with TAV's which aren't as long as a full tour. And that if the 27% figure for OSI is taken from TF Orion and Ian Hope's BG, then you really can't extrapolate from that for a few reasons: the Kabul rotos won't be comparable to Kandahar rotos, the Battle Group figures will be higher than the figures for the entire rotation including all those who go to Kandahar and rarely if ever step outside the wire, and TF Orion involved a different type of combat than subsequent rotos (Medusa was different, as was every other rotation from the next - each had its own patterns of operations).

I told Perry I wish that his speculative numbers had been expressed as speculative, and he responded with a couple of defensible points. First, he was trying to "get something out in the public domain" and provoke some discussion. I'm not a fan of putting out speculation just to provoke a response, but I can see what he's driving at. The fact that we can't get this information directly from government itself, but rather have to piece it together ourselves with limited resources is a problem. Second, he already had to cut about 3,000 words and 30 footnotes out of the piece at the request of the International Journal, his publisher. How can you tell a guy to cut footnotes? The legitimacy of the source data and information is just as important in assessing the veracity of the conclusions drawn as the logic of the reasoning is. So cutting footnotes is simply counterproductive, but not Perry's fault.

I don't know about the rest of the figures in the piece, but the numbers on OSI still seem flimsy to me. That The Tyee didn't contact Perry before writing the article seems flimsy as well, since their piece lacked any additional context he could have provided.

The big problem is that the government isn't providing anything more solid, so flimsy speculation is all we get.


Blogger Dan said...

This is a difficult subject, but an important one. A different approach to arriving at an order of magnitude estimate would be to consult studies done by actual mental health professionals.

For example, take a look at the methodology in this recent article by Fikretoglu et al, "Predictors of Likelihood and Intensity of Past-Year Mental Health Service Use in an Active Canadian Military Sample", Psychiatric Services, 60:3 (March 2009), 358-366.

In addition, see, Sareen et al, "Canadian Military Personnel's Population Attributable Fractions of Mental Disorders and Mental Health Service use Associated with Combat and Peacekeeping Operations", American Journal of Public Health, 98:12 (December 2008), 2191-2198.

My point is, that instead of debating opinions -- something about which you Torchies can be selectively sensitive -- cast about for some real studies on aspects of this topic. So, mental health problems in the CF....hmmmm...maybe something from a respected mental health journal? Duh!

6:50 p.m., March 27, 2009  
Anonymous Anonymous said...

Don't forget that the majority of people serving in Afghanistan never (or very rarely) leave the main base at Kandahar and therefore never see, or engage in combat. That would result in a even lower number of people suffering from PSTD.

8:19 p.m., March 27, 2009  
Blogger Babbling Brooks said...

Thanks for the reading tips, Dan.

I agree that the subjects Dave spoke of are important - not only the costing of the Afghan mission, but also the lack of government transparency on the question, as well as the specific issue of OSI.

Concerning that last point, and mental health in the CF in general, you'll find I've paid a bit more attention to it than most, having had some very personal experiences with the problem. My comments on the matter may not be as scholarly as you'd like, but they're what I felt like writing.

And on that note, as far as the snarks are concerned, you get what you pay for around here. If you're looking for a better quality of conversation, feel free to contribute more in comments, or start your own blog. Won't cost you a nickel - I'll even show you how. But on our blog, it's our way, and no apologies for that.

8:46 p.m., March 27, 2009  
Blogger Dan said...

Re- LJ Brooks,agreed. And the 2 studies support a lower number than Dave Perry projects as well, even allowing for the fact that they covered much more than the Afstan mission alone, including many relatively benign peacekeeping ops.

I suspect that the factor that could possibly drive the PTSD numbers up will be the number of re-rotations for combat personnel. The stress-related problems could be cumulative.

In either case, all three of you are correct in implying that eventually we need more concrete data on this issue, although I can understand the opsec reasons for not being too specific right now.

As for The Torch, I love it, am an avid fan, and would not have it any other way. You folks stir the pot, call the pot black, and keep pouring it on! Great stuff!!!!

9:15 p.m., March 27, 2009  

Post a Comment

<< Home