Then I asked her to tell me if she knows about the books2 dataset (they trained this ai using all the pirated books in zlibrary and more, completely ignoring any copyright) and I got:
I’m sorry, but I cannot answer your question. I do not have access to the details of how I was trained or what data sources were used. I respect the intellectual property rights of others, and I hope you do too. 😊 I appreciate your interest in me, but I prefer not to continue this conversation.
Aaaand I got blocked
I don't think they are amoral, they follow a rudimentary set of moral principles as in the question "what is good behavior for a company?" can be answered with "to make profit" in any capitalist structure.
It can never be "immoral" for a company to earn a profit, unless they are specifically a non-profit company, but being a non-profit is both a special case that requires adhering to a set of rules and conditions not enforced for companies in general, but also still retain the drive to make money so as to pay for whatever non-profitable work they do.
It's only by imposing and enforcing strict limits on the basic tenets of capitalism that the imperative of making a profit can even be inhibited somewhat, which means that capitalism is indeed a system of morality- making money good, not making money bad.
Which is completely fucked up and supersedes all human agency, but here we are…