Conversation

Notices

1. Baldur Bjarnason (baldur@toot.cafe)'s status on Friday, 17-Mar-2023 10:18:08 JST Baldur Bjarnason

   JFC, it’s like the past few years’ discussions on bias in training data and issues with shortcut learning in AI models just didn’t happen at all?

   Like, our industry didn’t take in any of it, did it?

   • Baldur Bjarnason (baldur@toot.cafe)'s status on Friday, 17-Mar-2023 10:18:07 JST Baldur Bjarnason

     in reply to

     And the AI companies are behaving like cults:

     * Withhold information on their work to prevent the singularity
     * Theatrical "threat" testing to demonstrate the imminent arrival of a mechanical Yaldabaoth—a demiurge of a new world threatening humanity
     * Rules for disseminating knowledge about the models that aren't even remotely scientific. It's just insinuations and secrecy
     * Claims about the imminent arrival of the end times if we don't follow their rules and ideology

     This is all so fucked up

   • Baldur Bjarnason (baldur@toot.cafe)'s status on Friday, 17-Mar-2023 10:18:08 JST Baldur Bjarnason

     in reply to

     I thought we'd spent the past few years digging into issues and looking for ways to use these systems on problems they can handle, like data and media conversion and modification.

     But, no, we're going straight for the dystopian nightmare stuff:

     * Knowledgebases that straight up lie.
     * Creating an underclass that's only served by mediocre AIs instead of actual lawyers or doctors
     * Summarisers that hallucinate _in their summaries_
     * Decision-making systems rife with shortcuts and biases

     Adrian Cochrane repeated this.