Learning to Let Go and Grow Together