Probability Audit (free Excel tool)

Contents

  • The motivation
  • The model
  • The mathematics
  • Link to the tool

Motivation

  • I am a credit risk manager. At the start of the year, I have assessed the probabilities of my debtors defaulting in the course of the year (which I am rather naively assuming to be independent). At the end of the year, I have a list of those who have defaulted and those who have not and I would like to evaluate how good my probability assessments were, on average.
  • I am a portfolio manager in an oil and gas exploration company. At the start of the year, my subsurface teams have assessed the probabilities that the exploration wells I drill during the year will discover oil. At the end of the year, I have a list of those that discovered oil and those that did not and I would like to evaluate how good my probability assessments were, on average.
  • I am testing myself at assessing probabilities, so I have taken a calibration test where I have answered a list of questions and provided a probability that my answer to that question is correct. I would like to see whether, on average, I over- or under-estimate probability

The model

  1. You can hit it with a Monte Carlo sledge hammer
  2. You can calculate the probabilities directly
  3. You can use the Central limit theorem and approximate the distribution with a Normal distribution.

Direct calculation

Central limit theorem

The math

The tool

--

--

--

Mathematical modelling for business and the business of mathematical modelling. See stochastic.dk/articles for a categorized list of all my articles on medium.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Supra-Rationality

Prims And Kruskal Algorithm

The Mythos of the Warp Drive

Randomness, Chaos Theory, and the Return to the Dark Ages

Three Solutions for the Simple Harmonic Oscillator

Winning at Casinos w/ Mathematics

Laws of Large numbers (detailed explanation)

Week 4: Different Minds

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Graeme Keith

Graeme Keith

Mathematical modelling for business and the business of mathematical modelling. See stochastic.dk/articles for a categorized list of all my articles on medium.

More from Medium

How to convert between Seurat/SingleCellExperiment object and Scanpy object/AnnData using basic…

How to use GeoPandas to visualise every Wind turbine in Germany

Turnout, in Oranges and Apples

MODELLER usage for Homology Modelling: Result Analysis and choosing the best model — Part 3