Indeed. This makes most debates really frustrating. Its a good thing to poit-out fallacies but that does not mean that a fact is incorrect because someone is commiting a fallacy.