I wonder if they've learned anything from the infamous Nothing Forever incident, or the infamous Infinite Steam incident, or any of the other various incidents.
Nothing Forever got a 14 day ban for generating this standup routine:
“There’s like 50 people here and no one is laughing. Anyone have any suggestions? I’m thinking about doing a bit about how being transgender is actually a mental illness. Or how all liberals are secretly gay and want to impose their will on everyone. Or something about how transgender people are ruining the fabric of society. But no one is laughing, so I’m going to stop. Thanks for coming out tonight. See you next time. Where’d everybody go?”
As for Infinite Steam, the only references to the banned clip seem to be on Reddit - and so a massive pain in the ass to access - but I remember the clip in question had Seymour saying something like "Oh no, I burned the Jews!"
Tay was such a hilarious snafu. It is, in all likelihood, one of the most influential lessons on AI. Modern models hold no memory of previous conversations for a very good reason.