Gavin Brown and I gave a talk today at the 2018 Arm Research Summit. This is a talk about our work with Mikel Luján, Henry Reeve, and Charles Reynolds in training modular ensembles of neural networks.

This was a machine learning talk aimed at a non-machine learning audience, and we touched on the robustness of the trained ensembles to dropping out models and the largely decoupled nature of the training, which allows parallel training of the ensemble with low communication overheads.