Iterated Mark and Recapture An example of Bayesian estimation of population size using mark and recapture. Jan 2, 2020
Cool Softplus Function Properties The y-intercept of the tangent of a softplus function is the entropy of a Bernoulli distribution with probability equal to its slope Mar 22, 2019
Distributed Joint Training of Large Ensembles with Low Communication Overhead How to train an ensemble of neural networks cooperateively in a distributed setting. Feb 25, 2019
Who Needs Loss Functions? Mixing Manual and Automatic Differentiation Exploring mixing manual and automatic differentiation May 24, 2018
Distributed Multinomial Sampling A distributed algorithm for sampling from a multinomial distribution in O(log d) time, where d is the number of outcomes. Jan 30, 2018
Cross Entropy and Log Likelihood Ironing out some confusion I had about the relationship between cross entropy and negative log-likelihood. May 18, 2017