"Why aren't there more X libertarians?" has always been an easy question to answer, and I don't think the philosophy itself is doing a great deal of the work there.
I do think the philosophy is doing some of the work, I'll say. Just because communities that have historically been the victim of coordinated private or local government terrorism and then were protected by the federal government seem less likely to adopt the same sceptical view of the feds vis a vis local/private control that libertarians advocate.
It's incumbent on us to allay their fears, and we absolutely cannot do that while a bunch of "us" run around shouting Nazi slogans, waving confederate flags, and insisting that even the recognition of crimes against certain forcibly collectivised people is unacceptable.
The same people who openly cater to white nationalists fly into a rage at the suggestion of even modifying our language to convey our principles to anyone they perceive to be left of them.
If you're a white nationalist, someone from Auburn will be along shortly to explain to you patiently why actually we both want the same thing, why we recognise "blood and soil" too, and why we hear you about all that political correctness and forced integration. And hey, here's "The Politically Incorrect Guide to American History," (it was a bestseller, you know) and Hoppe's foreword to "Right, White, and Libertarian." See? We're cool.
If you're a BLM activist who calls herself anti-capitalist and anti-imperialist, but all you really mean by that is that we should dismantle the military empire and abolish cronyist corruption, then I'm not even allowed to talk to you. All I'm meant to do is screech "capitalism is the way and the light" and "taxation is theft" in your face until you feel threatened enough to walk away.
As long as that faction is given any legitimacy at all in our movement, we should just stop asking why X community doesn't seem interested in hearing our pitch.