Putting Your Ensemble on a Diet