To prune, or not to prune?