Proceed with caution when mining VAERS

In the comments to my interview with DarkSyde, another parent and I discussed "alternative" medicine and some of the autism literature. Today over on Respectful Insolence, Orac has an excellent post on how using data from the VAERS database isn't the best way to accurately gauge adverse effects.

A bit of background on VAERS: this is the Vaccine Adverse Event Reporting System. If you or your child has a bad reaction to a vaccine--a serious illness after receiving it, an unexpected side effect, etc.--they're the folks you contact to report it. These adverse effects are then analyzed to see if they're being reported more frequently than would be expected due to chance alone. (For example, it's simply a fact of life that some people will become ill, or even die, within a few days of receiving a vaccine--especially if it's a vaccine in wide use. VAERS and other data can be used to investigate whether these reactions are likely due to the shot itself, or are simply a chance event). However, VAERS is subject to a lot of biases in design. First, it's designed to allow self-reports, and it will accept pretty much anything the reporter submits as an "adverse event." Orac links to a story where a woman reported to VAERS that a vaccine had turned her into the Incredible Hulk--and it could have stayed in the database if she'd not given them permission to remove it. This is good in a way--it's better to be broad and overly-inclusive than to dismiss reported side effects. But any type of self-reporting brings a bias to the study. For example, those who are more wary of vaccines may be more likely to report side effects than those who have more confidence in them. And, as Orac points out, potential lawsuits appear to be driving up the number of side effects reported to VAERS--a reason to be skeptical of evidence used from that database to support a connection between vaccination and thimerosal.

, ,

More like this

Things are crazy now for me, both at home and at work. I mean really, really crazy. So crazy that even I, one of the most verbose bloggers out there, am forced to take two or three days off from my little addiction--I mean habit. Consequently, having foreseen that this time would come around these…
I sensed a disturbance in the antivaccine (i.e, the dark) side of the Force yesterday. No matter where I wandered online and on social media, I kept running into a new article, an article by Neil Z. Miller about vaccines. For example, the merry band of antivaccine propagandists over at Age of…
In the eyes, of anti-vaccine advocates, vaccines bear the brunt of blame for a variety of conditions, including autism, asthma, neurodevelopmental disorders, autoimmune disorders and a wide variety others. Often this link is based on retrospective data, in which parents or patients recall and self-…
I've lamented time and time again how much woo has managed to infiltrate academic medicine, even to the point where prestigious medical schools such as Harvard and Yale have fallen under its sway. I've even gone so far as to lament that resistance is futile when it comes to the rising tide of woo…

There's also an issue in that as far as I (and the doctors I've talked to) know, doctors can't report to VAERS. And if they can, they're not aware of it.

I developed Complex Regional Pain Syndrome (type II) after a hepatitis vaccination. I wasn't aware of VAERS; my mother, a doctor, wasn't aware of VAERS; and the 4 neurologists I've seen since haven't mentioned it.

CRPS is known to affect adolescents disproportionately and its, well, not very fun. However even though every doctor i've seen guessed immediately that not only a vaccine, but a HEPATITIS vaccine, caused it (wihtout me telling them), it's still not acknowledged openly.

Actually now I think of it Tara, you'd really get a kick out of the fact here in New Zealand, we're having the most aggressive vaccine follow up done pretty much anywhere. CARM (Center for Adverse Reactions Monitoring) has been following the Meningococcal B vaccine rollout over the whole country. In general they've found what everyone pretty much expected, that severe reactions to the vaccine are highly uncommon and most side effects are minor.

It's worth noting that this is regulated by health professionals, so that means GPs and the like and not self reporting. They still report just about everything however, but they properly ascribe symptoms to the vaccine or something else usually. The full data set will probably be assembled and released after the MeNZB campaign has finished, but tidbits are available (though I can't find anything up to date at the moment).

Interesting. There's a form right on the VAERS homepage addressed to health care providers, so AFAIK, they should be able to report. I wonder how much mention this kind of thing gets in med school.