The tree looks much better with the smaller, more proportionate leaves. I have been wanting to defoliate my citrus tree for some time now but I didn't know when would be best and like you said, doing it improperly could kill it. I didn't know whether to do in the winter when it's indoors and gets less light or in the summer when I move it outdoors.
RE: Ficus defoliation progress