Absolutely.

Physical reality is not changed by human thought or language (how obvious is that?)

Words and ideas are better when they are more closely aligned with physical reality (sex) rather than notional ideas (gender).

Hence Man and Woman should refer to biological sex. Those who want to discuss notional ideas such as gender need to make up their own precise language to refer to them, not try to appropriate already well defined terms.

Its certainly true that someone who does not start their thinking from a physical basis cannot be a good scientist.