Conversation

Notices

1. Aral Balkan (aral@mastodon.ar.al)'s status on Wednesday, 11-Jan-2023 04:56:17 JST Aral Balkan

   in reply to

   • Carl T. Bergstrom

   @ct_bergstrom Hint: they don’t want to.

   • Carl T. Bergstrom (ct_bergstrom@fediscience.org)'s status on Wednesday, 11-Jan-2023 04:56:19 JST Carl T. Bergstrom

     in reply to

     What makes this different than your average tech-company-does-very-shitty-thing-using-AI-without-informed-consent story is that the co-founder was so oblivious to any notion of research ethics, consent, mental health ethics, etc., that he wrote a long thread describing this experiment and was caught completely off guard when people reacted with shock.

     I think this example tells us a lot about whether we can trust tech to act ethically: looks like they don't know how, even when they want to.

   • Carl T. Bergstrom (ct_bergstrom@fediscience.org)'s status on Wednesday, 11-Jan-2023 04:56:20 JST Carl T. Bergstrom

     in reply to

     Morris later tried to walk back his original claims and suggested that he had informed consent from all participants.

     But it appears from his own claims that only the "peer supporters" were informed.

     According to Business Insider, `Koko users were not initially informed the responses were developed by a bot, and "once people learned the messages were co-created by a machine, it didn't work," Morris wrote on Friday.'

   • Carl T. Bergstrom (ct_bergstrom@fediscience.org)'s status on Wednesday, 11-Jan-2023 04:56:21 JST Carl T. Bergstrom

     in reply to

     Co-founder Rob Morris tweeted a description of the trial in this thread, in which he explicitly describes the activity as an experiment.

     https://twitter.com/RobertRMorris/status/1611450197707464706?s=20&t=ndcUoODJItgoTH8mlf8a9Q

   • Carl T. Bergstrom (ct_bergstrom@fediscience.org)'s status on Wednesday, 11-Jan-2023 04:56:22 JST Carl T. Bergstrom

     I don't even know where to start with this one. Apparently the mental health service kokocares.org ran a multi-day trial on 4000 users without their informed consent, in which koko's "peer supporters" used ChatGPT to craft their responses to the people they were providing with mental health support.

     https://www.businessinsider.com/company-using-chatgpt-mental-health-support-ethical-issues-2023-1