ELI5 - How does artificial intelligence understand what is right and what is wrong for humans?
For example if someone creates something new that is horrible for humans, how will AI understand that it is bad if it doesn't have other horrible things to relate it with?
AI learns from the data it is given. There is no inherent understanding to it.
For a text based AI:
You feed the AI with text. The AI internalizes that text. (Remembers it. Learns it.)
You give feedback to the AI, what kind of responses you like from it and what you don't. (You train it to behave the way you want.)
The AI does not inherently understand anything. But it will behave the way you trained it to, to the degree you trained it, and with all the imperfections you trained it with (e.g. prejudices).