Climbing Celeste

A few months back, I wrote about one of the mental models I use called The Mountain. If you haven’t read it yet, I highly recommend you check it out first! It sets up the…

Entropy (Information Theory)

Initially written as a Tweet, but to-be-expounded on this blog post. When the data source produces a low-probability value (i.e., when a low-probability event occurs), the event carries more “information” than when the data source…