Unfortunately many think like that and this is why these communities fail to grow. 2 active users can become 3 and then 4 and those who are joining can easily find the niche community they are interested in and make it stronger. Otherwise general communities will grow and look like a big mix of everything, where you can't find what you want but you can find everything else that you're not interested in.