Here's the sticking point. You live in a society with a government that you don't want. The catch is that most people living with that government want it. We've decided that the government provides things that its easiest or practical or logical for government to provide. Like police, public schools, etc.
I understand you think there's a better way of providing those things. What you fail to understand is that without the state as a check, there is nothing stopping me from creating my own army to build my own power base. All this shit sounds great in theory, but that's where it ends.