Using Probabilities to Estimate How Much to Believe a Claim

3/3/2021

One trick you can use to estimate how much belief you should put into a claim is to ask yourself what things if true would make you believe the claim. In other words, what evidence, presented together, would be convincing to you?

Once you have your list of “convincing evidence”, estimate a probability for each item. This is just your current best guess. You can and should change these estimates based on new information. If you’re particularly uncertain about an item, you could even do this overall exercise for that item (i.e. look at the sub-evidence that would required for it, estimate those probabilities, etc.).

Once you have the probabilities, multiply them together to estimate a probability for the overall claim.

Example

Let’s use the claim “COVID-19 is a Chinese bioweapon that escaped (or was released) from a Wuhan lab” as an example. This sounds like a conspiracy theory, so my initial reaction is one of disbelief, but I have no rigorous basis for belief. My gut reaction could be wrong. So, let’s do the analysis and see.

My “Convincing Evidence” with Probability Estimates:

  1. There is a lab in Wuhan where bioweapon(s) could be made in theory = 90% (seems likely to me)
  2. It’s currently possible to make a coronavirus like COVID-19 in a lab = 50% (it doesn’t seem impossible, but I really have no idea)
  3. If (2) it’s currently possible to make a coronavirus like COVID-19 in a lab, China would try to do so = 50% (I could see either side being true)
  4. If (2) it’s currently possible to make a coronavirus like COVID-19 in a lab AND (3) China was trying to do so, China would eventually succeed = 99% (this feel almost certain to me)
  5. If (4) China succeeded and had manufactured COVID-19, it escaped OR was purposely released in Wuhan = 10% (both, while possible, seem pretty unlikely to me)

Final calculation:

\[90\% \times 50\% \times 50\% \times 99\% \times 10\% \approx 2.2\%\]

My final estimate would thus be 2.2% (pretty unlikely but not impossible).


Like This?

for More in the Future

with Comments / Questions / Suggestions