@PixelJones so it should come as no surprise that those systems, once deployed, very often end up displaying (among others) racist biases. This has been shown over and over and over again, including with ChatGPT, as much as OpenAI is trying to paint over it.
https://qz.com/1427621/companies-are-on-the-hook-if-their-hiring-algorithms-are-biased
https://www.insider.com/chatgpt-is-like-many-other-ai-models-rife-with-bias-2023-1
And that, combined with the power of capital that is thrown behind these systems today, is genuinely dangerous. Whole "are they intelligent" thing is just smoke and mirrors, a distraction.