Conversation

Notices

1. Emily M. Bender (she/her) (emilymbender@dair-community.social)'s status on Thursday, 16-Mar-2023 04:57:39 JST Emily M. Bender (she/her)

   Okay, taking a few moments to reat (some of) the #gpt4 paper. It's laughable the extent to which the authors are writing from deep down inside their xrisk/longtermist/"AI safety" rabbit hole.

   Things they aren't telling us:
   1) What data it's trained on
   2) What the carbon footprint was
   3) Architecture
   4) Training method

   >>

   • Adrian Cochrane repeated this.
   • Emily M. Bender (she/her) (emilymbender@dair-community.social)'s status on Thursday, 16-Mar-2023 04:57:35 JST Emily M. Bender (she/her)

     in reply to

     Also LOL-worthy, against the backdrop of utter lack of transparency was "We believe that accurately predicting future capabilities is important for safety. Going forward we plan to refine these methods and register performance predictions across various capabilities before large model training begins, and we hope this becomes a common goal in the field."

     Trying to position themselves as champions of the science here & failing.

     >>

     Adrian Cochrane repeated this.
   • Emily M. Bender (she/her) (emilymbender@dair-community.social)'s status on Thursday, 16-Mar-2023 04:57:36 JST Emily M. Bender (she/her)

     in reply to

     I also lol'ed at "GPT-4 was evaluated on a variety of exams originally designed for humans": They seem to think this is a point of pride, but it's actually a scientific failure. No one has established the construct validity of these "exams" vis a vis language models.

     For more on missing construct validity and how it undermines claims of 'general' 'AI' capabilities, see:

     https://datasets-benchmarks-proceedings.neurips.cc/paper/2021/hash/084b6fbb10729ed4da8c3d3f5a3ae7c9-Abstract-round2.html

     >>

     Adrian Cochrane repeated this.
   • Emily M. Bender (she/her) (emilymbender@dair-community.social)'s status on Thursday, 16-Mar-2023 04:57:38 JST Emily M. Bender (she/her)

     in reply to

     But they do make sure to spend a page and half talking about how they vewwy carefuwwy tested to make sure that it doesn't have "emergent properties" that would let is "create and act on long-term plans" (sec 2.9).

     >>

     Adrian Cochrane repeated this.
   • Emily M. Bender (she/her) (emilymbender@dair-community.social)'s status on Thursday, 16-Mar-2023 04:59:10 JST Emily M. Bender (she/her)

     in reply to

     A cynical take is that they realize that without info abt data, model architecture & training set up, we aren't positioned to reason about how the model produces the results that it does…and thus more likely to believe claims of `AGI' and thus buy what they're selling.

     But given all the xrisk rhetorical (and Altman's blogpost from Feb) it may also be possible that at least some of the authors on this thing actually believe their own hype and really think they are making choices about "safety".