I don't envy you for this. It's going to be a difficult year or two (I don't know how long it takes to properly build it, respecting standards) and as you say, you can kiss privacy goodbye and maybe light too as the building may cover some of the light.

The good thing is, it's not your flat, you can move when you want.