Take the Loss and Move On!