Categorizing Scientific Studies: From Practice-Changing to Meaningless MOOPs

The skeptical cardiologist typically spends many hours a week scanning scientific publications, looking at past research, and analyzing relevant cardiovascular information.

Within a few minutes of looking at a study, I have a pretty good idea of which of three categories to put them in.

Practice-Changing Studies

The most exciting category is “Studies Which Will Change My Clinical Practice and Impact My Patients.” Unfortunately, these are few and far between.

When these have come along in the last 10 years in the cardiovascular arena I have generally written about them in detail on this site. 

Examples of this include the SPRINT study in hypertension, the emergence of TAVR for the treatment of aortic stenosis, the PREDIMED study in nutrition, and the ISCHEMIA trial in coronary artery disease.

Of note, all of the above-mentioned studies were high-quality randomized controlled trials (RCTs) and therefore represent science’s best method of knowing the truth.

Confirmation of My Current Practice

Many studies fall into the category of “Studies which confirm my current clinical practice”, meaning they confirm what I had concluded based on the previous scientific information on a clinically relevant topic.

If such a study is of note because it differs from guidelines or mainstream thinking I typically have written an update of my prior articles. This happens quite frequently in the nutrition field where the scientific literature has evolved and now is in conflict with seemingly ossified mainstream dogma and guidelines.

An example of this in the field of preventive cardiology was published this week in one of the JACC journals and is entitled “When Does a Calcium Score Equate to Secondary Prevention?: Insights From the Multinational CONFIRM Registry.”

My liberal clinical use of and strident advocacy for utilizing scans coronary artery calcium scans to better characterize individual risk for atherosclerotic cardiovascular disease has been consistently ahead of guidelines and this study supports my clinical approach. However, because this study adds little or nothing to the field or changes my clinical practice I wouldn’t write about it.

Of course, being a good scientist means looking out for studies that don’t confirm my current perspective on cardiovascular disease and avoiding “confirmation bias.”

Meaningless and/or Overblown Observational Studies

The vast majority of scientific publications these days fall into the category I will term “Meaningless and/or Overblown Observational Publications” (MOOPs) and these, as many have noted, tend to create media headlines and social media buzz.

These studies are easy to do and a profusion of low-quality scientific journals, eager for content snap, them up. Likewise, online and print journalists, eager for content, clicks, and readers, create click-bait headlines and articles that frequently overstate the significance of the MOOP.

Academic scientists are frequently complicit in promoting the significance of these very insignificant papers because their careers and advancement are dependent on publication and recognition.

This process in the last 10 years has substantially contributed to a public that has lost confidence in science as a guide to their health.

The field of nutritional epidemiology, the area that transformed me into a skeptical cardiologist, is particularly susceptible to the MOOP but we’ve also seen it most recently and prominently in COVID-19-related publications on long COVID, Paxlovid therapy, masking and vaccine effectiveness.

It is very tempting (and disappointingly common in those scientists/doctors who are biased) to endorse a MOOP if it supports your viewpoint and savagely critique MOOPs that don’t.

I try hard to approach all MOOPs with the same “unbiased” critical approach.

For example, although I advocate that my sedentary patients increase their weekly minutes of moderate to vigorous exercise (and I have written tons on the importance of maintaining cardiofitness as we age), I have to admit the data supporting this (with rare exceptions) comes almost exclusively from observational studies.

A recent study (also published in JACC) on this topic was summarized by a Dutch media outlet as follows:

A new study by researchers at Radboud University Medical Center has found you don’t need to take 10,000 steps a day to reduce your chances of premature death. The magic number is 7,126.

The paper was not a “new” study it was a meta-analysis, a lumping together, of 12 previously performed MOOPs involving over 110,000 people. 

I’m happy to see the 10000-step myth debunked. I’m good with the idea supported by this paper that those who are really sedentary should start moving around more but to be consistent I have to point out these data are observational and therefore, fairly meaningless.

Here is the “Central Illustration*” from the paper. Look at the nice graphs which show a dramatic reduction in mortality as one proceeds from 2,000 steps to around 6000 steps.

Those graphs and these analyses, however, are only showing associations, the cause of which is unclear. Proponents of more steps would like you to believe that increasing your step count from 2000 to 6000 will result in a 50% reduction in your chances of dying over a 5-year period. However, if we are honest and consistent we have to state clearly that they don’t prove that.

Those individuals who choose to or can only walk the remarkably low amount of 2000 steps per day are radically different from those who choose to or are capable of walking 7126 steps per day. While some of these differences can be accounted for (age, sex, hypertension, etc.), many can’t. These are unmeasured and, therefore confounding variables.

Thus, we cannot state that this paper proves that increasing your step count reduces your chances of premature death. To prove this statement we would have to take two groups of very similar individuals and randomly assign one group to increase their step count and then assess death rates after a period of time. This experiment, a randomized controlled trial (RCT), would be a very strong indicator of causality.

It turns out an RCT on this topic was published in 2020 but no longevity experts mention it because it was negative. The authors of “The effect of exercise training for five years on all-cause mortality in older adults—the Generation 100 study: randomised controlled trial” found no difference in its primary end-point of overall mortality over 5 years in 1600 patients receiving active exercise training versus those told to follow the national guidelines of 150 minutes of moderate exercise weekly.

The Other Categories

There are a few other categories that medical publications fall into.

One that I find particularly irritating is “The Worthless Cardiac Imaging Study.”

Having spent a decade in academia doing research and writing papers primarily in the area of cardiovascular imaging I am very aware of the limitations and the limited value of single-center studies on new imaging techniques/processes/measurements. 

These studies are very easy to do, can easily find a low-rent medical journal that will publish them and add little to nothing to our clinical knowledge and practice. I won’t dwell on this category because the vast majority are not publicized widely and are of little interest to doctors and patients.

Another category is “Studies That Only I am Likely to be Interested in.” “Longitudinal Changes in Left Ventricular Diastolic Function in Late Life: The ARIC Study” is unlikely to be heavily tweeted (or Xed?) and an overblown headline related to it won’t be noted in the NY Times.

However, I am fascinated by age-related changes in diastolic function because a lot of the research I performed in my early career focused on Doppler-echocardiographic assessment of how the left ventricle relaxes and fills with blood.

I have previously written on the vagaries of the clinical diagnosis of diastolic function. Part of the difficulty cardiologists have in making sense of diastolic function is due to the longitudinal changes we see late in life. The speed at which the left ventricle relaxes declines progressively with aging and I theorize that this is the major cause of the age-related decline in cardio-fitness with aging.

Moopingly Yours,

ACP

Twitter
LinkedIn
Facebook

11 thoughts on “Categorizing Scientific Studies: From Practice-Changing to Meaningless MOOPs”

  1. I too enjoyed your acronym MOOP, although the extra added humor to your acronym was that it reminded me of GOOP, from the esteemed celebrity of quakery dissemination Ms Paltrow. I thought it was ironic the similarity of names and and how well they correlated.

    I enjoyed this posting as well, I think you laid out an interesting perspective of your assimilation and processing of studies into your own practice. I myself have learned a tremendous amount from your blog about cardiology and being more critical in evaluating information. I consider you and your blog to be a great resource . I did have a question though, you had mentioned that with “Studies Which Will Change My Clinical Practice and Impact My Patients.” that you generally write about them in detail on this site. I had not seen anything written about the SGLT2I trials (EMPEROR, DAPA and DELIVER) and there seemingly very positive results for HF patients. I was curious if the trial data had impacted your clinical practice for your HF patients and if you utilize these medications?

    Reply
    • Christian,
      Thank you. The GOOP connection did cross my mind.
      Also, the fact that I haven’t written on SGLT2i crossed my mind.(I suspect I have mentioned these somewhere on the website at the time initial studies came out.) I am utilizing these agents in HFrEF and I wasn’t 5 years ago so it has changed my practice.
      I feel like the Pharma industry does a great job of notifying everyone from doctors to patients of the benefits of new drugs and they were rapidly incorporated into guidelines so that I wasn’t highly motivated to add my assessment.
      Dr. P

      Reply
  2. Regarding the Generation 100 study, the study was done on patients 70-79 years old. Isn’t that rather late in life to be hoping for the benefit of such an intervention?

    There are lots of different lines of thought in the longevity field but I believe the goal of aggressive exercise recommendations was to prevent a precipitous dropoff of strength (and other related stuff, like bone density) that’s very hard to reverse later on.

    Reply
    • Michael,
      Proponents of the value of increased cardio exercise (like myself) believe it works for all age groups. The authors of this study were cardio proponents and selected this age group for intervention thinking that it would show improved longevity.
      In the longevity field there is a spectrum but I think all of us are proponents of regular resistance/strength training to forestall age-related sarcopenia ( muscle-loss). This wasn’t tested in the Generation 100 study.
      Dr. P

      Reply
  3. Dr. M. – I represent a small subset of patients who have very high calcium scores (1500 – 2500) but remain event free. What we have in common is we have all been heavy duty exercisers/athletes for years. (At the age of 80, I have swum a 10+ MET mile three times a week for 53 years.) There have been a number or articles about us (“Hearts of Stone” in Circulation was memorable) but awareness of our condition has not trickled down to Maine so we are pretty much in the dark. Can you offer any helpful comments or pointers to germane research? Thanks for your enlightening work.

    Reply
  4. I intermittently give your analysis to my own cardiologist because I like (and he appreciates) the viewpoint that you offer and gives his own interpretation of yours ideas mixed in with his knowledge of my age and condition. Everyone is not the same. I am guessing that he uses your ideas, mixed with his own ideas, sifts thru and comes up with a protocol that either changes SLIGHTLY his knowledge and my cardio care. He is of course intensely interested in how what I show him, along with my own protocol, and how this may relate to his other patients as well. Each patient is unique in some manner. I am due for another evaluation in about 10 days and will see how your latest range of discussion can influence his decisions as relates to me, and his total practice. I like the idea of many observations that can be tailored to each patient. They were elated when my EF went from 52 to 60…and I want to see if that has changed, OR I would like it to stay in acceptable range so that I’m either good and improving, or need to do more in certain areas. ( I know that an EF of 100 or 15 is certain death) I have lost two friends to failing fractions. And, I get good sleep, and not always time for cardio exercises but I am active and have no mobility problems except I am not the gazelle I was in my 60’s. I’m 82.

    Reply
  5. You can learn how to “adjust for confounding variables” by studying statistics. However, it is very difficult to find volunteers, especially volunteers that are representative of the population, for randomized controlled trials, especially ones that take years. While one must be wary of generalizing from animals to humans, we do share a lot with other animals. But lab rats live in similar environments, have similar diets, and share a host of other differences from humans. So observational studies of humans are often all that is available in efforts to answer important questions. In general, prospective studies are more reliable than retrospective ones. In all observational studies the issues of likely confounding variables should be addressed. With large data sets of medical records potentially available (the Chinese certainly have them), AI is likely to be a wonderful source of, say, identifying individuals who are ‘medically identical’ at say, age 40, and, together with scientists, following that group for a number of years as data is collected on variables of interest such as, perhaps, physical environment, diet, known stressors, exercise, etc. I think the emerging science of epigenetics will have far reaching implications in coming years.

    Reply
  6. With all the respect, but playing the Don Quixote will not help that much. AHA will continue to make hundreds of millions selling the ACLS all over the world without questioning that adrenadine is an arrhythmogenic drug and should be used carefully when CPR has a shockable rhythm.

    Reply
  7. Great article, Anthony! I love your term, MOOP! I might also suggest ACB – Academic Click Bait! I find a highly efficient discriminator (especially amongst current studies) is COVID-19, equity, or diversity in the title! If those terms are spotted, it’s likely a MOOP! These days, that quick excludes large number of papers from wasting my time!

    John

    Reply
  8. I love the term “MOOPs”–sounds about like what it is. Also, I wonder if you can go to school to learn how to “adjust for confounding variables”.

    Reply

Please leave your comments. The skeptical cardiologist loves feedback. He reads all and replies to all that warrant a reply.