That's true. That's generally a problem with transformer networks (the type of neural network used in GPT3) =)