Speaking from experience, they will put you in really difficult positions where you will perhaps have strong views on things i.e. I don't think it is right to abuse the mentally ill. So you find yourself in a position where you are talking about the "normal" ones you know. They don't know that your underlying belief may be motivated by something else entirely and you will look at very obvious fetishists with disgust. They don't consider that you don't subscribe to all their beliefs but most people simply have no desire to get into hours if not days of discussion with these people where they will just call you a TERF cunt anyway.
Most people just do not have a tunnel vision which is what it all descends into. I also think cancel culture and the complete inability to have a normal conversation with people contributes to this; it is very much like that shitty meme about if you say you like peaches, you will be bombarded with a million different takes on why you are wrong, and probably are responsible for some kind of genocide. I could say live your life how you want, but to someone else they want to assume and read that I believe we should let them into rape crisis shelters, prisons or take part in female sports. I don't, I just really don't care if wearing a dress and going by she/her gets you through life. If you asked me, I'd tell you that I don't want to even be in a changing room with someone like that. The internet in particular allows people to jump to their own conclusions and they have already decided the answer before you give it. Even the point about cancel culture is what I mean about not having a tunnel vision - we are in a period of time where people regulate their speech entirely and it still will never be good enough. If you like a tweet or post by someone that is 'bad' you are a co-signatory on everything they believe when in reality you just might have liked this individual thing that they said. If you subscribe to something, it may be because you wish to see an alternate viewpoint to your own; but unless you self-flagellate and justify your exact thinking process at the time you hit follow or subscribe, it does not matter. None of that is really psychologically healthy.
Pushing people to take extreme strongholds does nothing for any kind of conversation even outside this topic. So I could say "no, kick out the T" but it doesn't matter if I wish to talk about any other topic or have any other interest. I am fixed in time by this one belief out of many - others I may be far more driven by. It is a reflection of how we are as a society and it is shit. I realize it looks like I am talking around the original point (and I am to some degree) but a lot of it does come down to free speech. Once you tear away all of the nonsense, people may only find this one topic irritating out of plenty of others. And it does not matter what they do or say because you will always be stuck.