Hey, no, absolutely not! I think you have it a little backwards! Truly, if you are able to abstain all week and control your portions on Friday, then YOU are the one in better control! I hope to build up the kind of strength that you have in order to enjoy the occasional drink.
Thankfully, I didn't have much trouble cutting out the processed sugars, though. My mom was never a fan, and I took after her. Both of my parents are vegan and I grew an affinity toward natural sugars from fruits and veggies from the time I was very young. I've been this way all my life, so I actually DETEST the flavor of candies- too sweet. Not gonna lie, I do love cookies, though. ;)