People will understand your meaning anyway. Even if they don't believe in the same God you do they will simply just think to their own deity and make thoughts about it there.
... True. I don't think anybody ever really thinks of it that way. We DO sorta just group it all up together becasue the terms are all thrown around too much. Isn't the correct term for those who are against it Anti-theist? So yes. I think that a lot of us are ignorant sometimes >___<