Conversation

Notices

1. nixCraft 🐧 (nixcraft@mastodon.social)'s status on Wednesday, 20-Mar-2024 19:43:35 JST nixCraft 🐧

   This one rack is 120kW of Nvidia AI compute. Google, Meta, Apple, OpenAI AND others are buying these like candy. In fact, there is a waiting list to get your hands on it. Each compute is super expensive too. All liquid cooled. Crazy tech. Crazy energy requirements too 🔥🤬all such massive energy requirements so that AI companies can sell LLM from stolen content from many humans and put everyone else out of the job while heating our planet.

   • nixCraft 🐧 (nixcraft@mastodon.social)'s status on Wednesday, 20-Mar-2024 19:54:52 JST nixCraft 🐧

     in reply to

     • Matt Knight

     @matt @nixCraft thank you for putting EL5 Version. I appreciate it very much.

   • Matt Knight (matt@mastodon.knight.fyi)'s status on Wednesday, 20-Mar-2024 19:54:53 JST Matt Knight

     in reply to

     @nixCraft to add some context for people on what 120kW means…

     An average US home uses 10,500kWh per year, or an average of 29kWh per day. This averages out at 1.2kW.

     In other words, if that server rack runs its PSU at 100%, it’s using as much power as 100 homes. In about 6sqft of floor space. Not including power used to cool it.

   • nixCraft 🐧 (nixcraft@mastodon.social)'s status on Wednesday, 20-Mar-2024 20:32:14 JST nixCraft 🐧

     in reply to

     • Gondor

     @grootinside That might happen sooner rather than later, given the way things are headed.

   • Gondor (grootinside@troet.cafe)'s status on Wednesday, 20-Mar-2024 20:32:15 JST Gondor

     in reply to

     @nixCraft The moment the guy in that scene starts to look more like an ...ah option than a villain. 🤔 😬

   • Troed Sångberg (troed@ioc.exchange)'s status on Wednesday, 20-Mar-2024 20:36:52 JST Troed Sångberg

     in reply to

     @nixCraft Agree. Who needs the Internet when we have fax machines!!!1

     I'm sorry, but this is just a horrible take. No content is stolen, we're putting people out of a job as much as refridgerators changed the ice-selling business and these datacenters have a small carbon footprint compared to the big stuff we can (and are) going after.

     New technology is usually good for humanity. Look at the smog filled skies of LA from the 70's. LLMs will either find a good usecase or they will not.

     Humanity decides.

   • nixCraft 🐧 (nixcraft@mastodon.social)'s status on Wednesday, 20-Mar-2024 20:36:52 JST nixCraft 🐧

     in reply to

     • Troed Sångberg

     @troed No content stolen? Have you seen how many lawsuits have been filed against OpenAI? They themselves admitted that without stolen content, AI could not be trained. OpenAI admits it's impossible to train generative AI without copyrighted materials https://www.engadget.com/openai-admits-its-impossible-to-train-generative-ai-without-copyrighted-materials-103311496.html

   • canleaf08 ⌘ ✅ (canleaf@mastodon.social)'s status on Wednesday, 20-Mar-2024 21:04:12 JST canleaf08 ⌘ ✅

     in reply to

     @nixCraft Where is the girl with the hammer? AI must be broken.

   • Chris Shaddock (chrisshaddock@mastodon.social)'s status on Wednesday, 20-Mar-2024 22:20:42 JST Chris Shaddock

     in reply to

     @nixCraft and still I can’t get Siri to turn on my lights.

   • Elric (elricofmelnibone@mastodon.social)'s status on Wednesday, 20-Mar-2024 23:50:32 JST Elric

     in reply to

     @nixCraft Hopefully they're at least using the waste heat to do something useful. That way having a nice, hot shower can be a happy side effect of plagiarism.

   • enoch_exe_inc (enoch_exe_inc@mastodon.social)'s status on Thursday, 21-Mar-2024 07:39:10 JST enoch_exe_inc

     in reply to

     @nixCraft 120 kW is roughly the power output of a small automobile, which is to say, a fuсking lot of power given the still-relatively primitive state of artificial intelligence. And that’s just for a single rack. Whatever purposes they are being used for likely uses hundreds or thousands of these.

     We badly need alternative computing substrates that consume a fraction of the energy of digital computers if we want this to scale up without also destroying the planet.

   • powaking (powaking@mastodon.social)'s status on Thursday, 21-Mar-2024 09:52:47 JST powaking

     in reply to

     @nixCraft Holy crap. Thats a lot of energy. I just charged my 2018 Tesla Model S 75D the other day at home (220v/40amp) and according to TeslaFi I went from 6%-90% in 6.5 hours and pulled 60kW from the wall. The amount this needs is jaw dropping.