Interactive tools for building intuition about Shannon entropy and surprisal.
This repository contains three independent applications. See the README of each.
new-distribution-with-each-event/ — Interactive entropy simulator
A desktop GUI (matplotlib/TkAgg).
Stack: Python, numpy, scipy, matplotlib
Web version.
chained-surprisal-distributions/ — Entropy & surprisal explorer
A browser-based Bokeh server app for building probability distributions from scratch. Generate events, bin them however you like by adding bin edges, and watch Shannon entropy update in the chart title with each change. Outermost bins extend to infinity; empty bins receive Laplace smoothing so the distribution is always well-defined.
Stack: Python, numpy, scipy, Bokeh (browser UI); Playwright (optional tests)