Exactly. Not only does it take a lot of energy, but getting it wrong and reading subtext where there is none causes unpleasant and confusing situations. Missing subtext, at worst, causes mild frustration.
Maybe some people do this, but I get a malingering vibe from this perspective. I think it's more likely that people are just about "If you get what I mean, we can connect and feel closer". And if you don't wanna connect with them, that's fine!
Another thing that adds to the fun: the meaning of words to different people.
A more extreme example is a story I vaguely remember where one person thought of "it tastes good" as somewhat negative, while the other actually meant "really good"/quite positive. Or something along those lines