The scientific method: in normal times you don’t give a fuck about it

“The statistics are flawed”, “the numbers don’t convince me” are some of the more common things I hear and read these days in view of the ongoing pandemic of coronavirus disease 2019 (COVID-19).

One cannot disagree with that. I cannot disagree with you when you say that. In fact, I can very much relate to that. I feel you. And I’d love to work together with you to discuss the numbers, just as much as I like to do that for and with myself.

Every single person who says that “the numbers are not correct” is correct. Do you want to be one of them? I can understand that.

All the skeptical people are right. Really. You are absolutely right when you don’t quite trust the current statistics and numbers.

But some of you are also have a perspective that is rather fundamentally wrong and also destructive:

  • When you think and propagate that it isn’t all as bad as “they” are trying to tell us.
  • When you use that argument to morally justify not following guidelines.
  • When you try to convince your peers of your “insight”.

That disappoints me so much. What I hear and read these days is a reminder for how deeply we as a humanity have to worry about our own ignorance. It’s our collective ignorance that we suffer from the most (Einstein also mentioned “stupidity”, and he wasn’t wrong).

You may think that you contribute a thought of value when you say “the numbers are not correct”. I am pretty sure: it’s not a productive contribution. You need to care a little more, and try a little harder (please read on).

Gladly, smart people have already thought deeply (and still think, every day) about the uncertainty of disease-related data for us. They know that they base their decisions on potentially thin ice. They work with the fact that all models are wrong, some are useful (cheers to Mia). Finding more of the latter is hard work.

 

There is an important difference between them and you.

Most of “them” are trying to help. For example, by leaning on the side of caution. Some of “them” are making decisions that matter. Because they are asked to do so. And at least in Germany, I am quite grateful for the average decision-making that happened to date in the context of COVID-19. I am especially grateful that it’s often not the ignorant type of person who gets to making decisions that matter.

And here we are: the big difference between “them” and you is that you don’t need to make decisions that matter. You just use this opportunity to express how little you trust the people around you to do the right thing, how little you trust their desire to actually protect you from severe illness. I would love to see a shift in perspective: how would you think if you had to make difficult COVID-19-related decisions that affect a large number of people? I hope I can invite you to think about it, please.

 

You are Captain Obvious.

For undeniable, credible, bulletproof statistics we need dense sampling. We need exhaustive spatial and temporal coverage.

That requires a large amount of time, and many countries being affected (by definition). It will take months and years to quantitatively and with great confidence answer all these questions that we seek answers for right now.

However, we needed to make decisions in the meantime. And we still need to make decisions right now, and we are going to have to make decisions every minute from now. All in view of uncertainty.

There is a fundamental conflict here that implies that we’re in a shitty situation.

 

You don’t get kudos for finding out that we’re in fact in a shitty situation.

Working with the uncertainty at hand is exactly what every single scientist working in the field of epidemiology tried their best to be prepared for. Dealing with uncertainty is the biggest challenge of every single politician who needs to make decisions right now.

What do you think are most of these discussions about in meeting rooms and phone conferences? I would assume: uncertainty.

Now after we’ve made some decisions (in view of uncertainty) you come in, Captain Obvious.

Glad we have you. Genius. You’ve come up with some incredible findings.

For example, you have found that some test methods might be affected by false positives and false negatives. You have found that the time evolution of the case count numbers in region X is not conclusive because we don’t quite know how the time evolution of the corresponding testing effort looked like. You have heard that some COVID-19-attributed deaths might actually have been misclassified. No! Why didn’t we think of THAT?

 

Thanks, Genius. You’re right.

Genius! Fortunately you had a look at the website of the European mortality monitoring institution and found that it doesn’t quite show anything unusual for Europe in March 2020. Thanks for looking. I mean, really! We almost missed looking at their website. Now we know that it probably isn’t even unusual that all these people die. Probably just a local outlier!

In view of that: you are of course right! It’s very likely that whatever is happening in Italy, Spain, France is completely anecdotal. Of course! They’re probably just in bad luck over there, don’t have their shit together, or are just plain stupid. I mean, right, of course! There must be some plausible explanation for what’s happening there other than “this is dangerous”. And even if we don’t find a plausible explanation: we cannot yet conclude that “this is dangerous” because all the data we have so far are so damn inconclusive! We don’t really know anything! How can we act not knowing? You are right, the best course of action is to eat some crackers and every now and then refresh the website of the European mortality monitoring institution. Really cool plots they have.

You’re right. We should amend our conclusions: it’s unlikely that anything bad is going to happen to us because we don’t have bulletproof statistics yet about Italy, Spain, France. China’s numbers? Made up. And about the U.S…. I mean, their president simply fucks it all up, right (yes, he does)?

 

Denial of observation

In view of “anecdotal evidence” is where some of you even flip into conspiracy land. You happily ignore or trivialize the qualitative in the absence of the quantitative. (thanks, Gustav).

I really wish you would try to understand what I just tried to say here.

Example: you do not actually show genuine, deep interest for the situation in Italian hospitals (and refuse to analyze how we got there) until someone presents bulletproof evidence on a silver plate convincing YOU that .. oh, fuck, there were indeed unusually many people “dying”.

 

Did I just say “dying”? Hah.

In your view it seems to be only about dying or surviving. You seem to pick your battle with a potential number of deaths, from specific disease.

I would love to remind us that the spectrum of suffering includes more than just people dying. Do you know what it’s like to be intubated? I don’t. And I don’t want to find out. Seriously. Did you already hear that when you “survive” (which is likely, yes) that you might do so with some long-term lung tissue damage?

I don’t want to create fear. But at a higher level I would like you to consider what it means to fight a disease that we barely understand yet. There is a spectrum between “dying” and “surviving” that very much defines how we experience this disease. Please, differentiate.

From your arguments I infer that you all seem to understand what COVID-19 really is, how straight-forward it is to treat. You seem to know your enemy very well. Cool.

I can tell you that our measures of precaution are fortunately not one-dimensionally based on the potential number of people dying. Yes, it’s what most of us talk about. Because of our stupidity, and inability to talk more than one-dimensional through mainstream media.

But in the meeting rooms and in the phone conferences “they” talk about details. Details that matter.

You may want to consider for yourself that you know NOTHING about all that, compared to all the things that one can know about this disease, and how it spreads through populations.

 

Stop telling your peers that the lockdown measures are too much, that things are “not as bad as they are trying to tell us”.

Shut up. Until you know. You should pause here for a moment. And fucking think about the word “know”.

Also think about the following: given your limited efforts it is unlikely that you understand more about this than those people who try really really hard. Try harder, and then we can talk (see below).

My most important point really is: don’t influence the people around you with your personal risk assessment.

Yes, that assessment that you pulled out of your ass. Based on how severe this sickness was for you and your friends. OH WAIT, don’t have personal experiences yet? Maybe wait for things to happen. This. has. just. begun.

Free of irony: the timescale of the observation period that you base your intuition on is likely to be vastly different from the timescale that this pandemic will change things for you and us. Maybe account for the possibility that your intuition can mislead you.

Please, do not assume that the majority of the people providing guidance towards decision-making do not know what they are doing.  Stop believing that you are a productive member of society by finding simple flaws in the “statistics” (call it whatever you’d like) underlying the political decisions of the past weeks. I mean it’s cool that you care! But you should realize that (tens of) thousands of people working in scientific fields are actually doing their job here pretty well and you suggesting otherwise is not helpful. It creates damage.

Have you ever thought about how hard it is to have an in-depth expert-level discussion AND at the same time communicate the subtle findings to the public so that we would be able to “understand”? It’s close to impossible. What you see through the media is (sadly, yes!) a very very very very tiny fragment of what actually matters.

Statements will be refined and revised. Measures will be extended and relaxed. That’s all part of the process. Personally, as of the risk implied by the unknown, I quite like when this process starts erring on the side of caution, and then relaxes over time. Yes, you will find many statements that appear to be “wrong”. Especially in hindsight. That does not indicate that we are taking a bad path through this crisis.

 

Invitation to contribute

I want to say that if you really believe that you can contribute anything substantial to the discussion about models, statistics, numbers: you can. You’re even invited to. All you need to do is take some time and choose the right words. The scientific community is more open and accessible than ever.

Please, join the discussion. Be productive. This discussion leads to iteration. That iteration results in a refined understanding of the current situation. We derive knowledge.

This is called the scientific method.

In normal times you don’t give a fuck about it.

More knowledge leads to better decision-making. This is how this world works, on average.

I am calming myself down and genuinely ask you to please please have some faith, please assume good intentions. At the very least when you think about the science behind all that.

Leave a Reply

Your email address will not be published. Required fields are marked *

Human? Please fill this out: * Time limit is exhausted. Please reload CAPTCHA.

  1. Sreekar Guddeti Avatar
    Sreekar Guddeti

    The European Mortality Monitoring Institution has really impressive data. Nice article except for the expletives…

    1. Jan-Philip Gehrcke Avatar

      Thank you :-) Yeah. A little moody.

  2. Jefferson Avatar
    Jefferson

    Garbage.

  3. Jan-Philip Gehrcke Avatar

    One detail I’d like to elaborate on: if you are still trapped disputing “mortality rate” (however you want to define it) then I can guarantee you that decision-makers are lightyears ahead of you. Even in a best-case scenario with below-Influenza mortality rate COVID-19 enters the world IN ADDITION to all other illnesses (including Influenza) and still has potential to overwhelm health care systems: the likelihood for people to require hospitalization in combination with the average duration of their hospitalization are the dominating effects here.

    If you don’t understand that then please trust other people to understand that for you.