So all you do is create phrases based on things you've read in the past and recognizing similar interactions between other people and recreating them? 🤔
Forming your own thoughts because you reasoned by yourself?
AI just goes "I've seen X before, someone answered Y, therefore I will answer Y." In its current state it can't decide "I'll answer something nonsensical just for the lulz" because it doesn't know if Y is right or wrong, it just knows that over billions of lines of texts it has seen X with Y most often so X = Y. If X was always answered with a nonsensical answer it would repeat it even if it has access to information that proves that answer wrong. Which is also why there's a lot of bad info being shared by AI.
The technology is definitely impressive, but some people are jumping the gun by assuming more human-like characteristics in AI than it actually has. It's not actually able to understand the concepts behind the patterns that it matches.
AI personhood is only selectively used as an argument to justify how their creators feed copyrighted work into it, but even they treat it as a tool, not like something that could potentially achieve consciousness.