That's an interesting kind of problem. I once read that the configuration of the human speech apparatus occurred in the first stages of life and that it was common for the vocal cords, breathing, and the positions of the tongue and lips to become fixed as a kind of 'muscle memory' in people. All of this made it quite difficult to learn to speak another language as an adult without having a certain accent that would give us away as foreign speakers.
In this case that you mention, the particular sounds of the language you want to learn may be very different from those that your body learned in childhood, and that adds an additional difficulty to the matter.
Anyway, it's a hypothetical speculation, but it might make sense.
A hug for Gigi.
RE: Still living, adjusting, and adapting the flavor of life - My life update