０７６萌ＳＮＳ
  • Login

  • Public

    • Public
    • Network
    • Groups
    • Popular
    • People

Conversation

Notices

  1. feld (feld@bikeshed.party)'s status on Saturday, 09-Dec-2023 23:23:57 JST feld feld
    • Moon
    • Machismo
    • NEETzsche
    • rees
    @Moon @rees @Zerglingman @NEETzsche Apple, Pepsi, Toyota, Nintendo... you have options with Elixir. It's infecting everything
    In conversation about a year ago from bikeshed.party permalink
    • Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:24:23 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees

      Seriously? This is persuasive

      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:25:50 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      @feld @Zerglingman @NEETzsche @Moon gonna get heat for this but programming is on its way out anyways so who cares if it's elixir or w/e
      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:26:42 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • rees
      @rees @NEETzsche @Moon @feld >"get heat"
      blob
      In conversation about a year ago permalink

      Attachments


      1. https://freespeechextremist.com/media/9f7b14e6-81e8-4dd8-b9a5-d1b6f8d955bf/blob?name=blob
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:26:45 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees

      Do you think this because of LLMs?

      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:26:48 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      @NEETzsche @feld @Zerglingman @Moon LLM + some sort of hypervisor agent that coordinates them
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:27:16 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      @Zerglingman @feld @NEETzsche @Moon NO BULLY :(
      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:27:47 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • rees
      @rees @feld @NEETzsche @Moon If you post extremely retarded things, people are going to call you a retard. No controversy or heat or whatever.
      In conversation about a year ago permalink
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:27:52 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees

      I’m skeptical. A lot of the content LLMs produce is garbage anyway. I’m pro-LLM and very skeptical of them.

      In conversation about a year ago permalink
      Machismo likes this.
    • feld (feld@bikeshed.party)'s status on Saturday, 09-Dec-2023 23:27:53 JST feld feld
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      @NEETzsche @rees @Zerglingman @Moon yes...

      Toyota's connected car services are Elixir

      Nintendo's online store and other services are Elixir

      Pepsi allegedly uses it in their manufacturing somewhere. They are past sponsors of Elixir conferences.

      Apple -- unclear where they're using it, but they're paying customers of Oban Pro
      In conversation about a year ago permalink
      Machismo likes this.
    • Fantasia (fantasia@clubcyberia.co)'s status on Saturday, 09-Dec-2023 23:28:05 JST Fantasia Fantasia
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      @rees @feld @Zerglingman @NEETzsche @Moon Until LLMs can debug code they will not replace programmers
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:29:11 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • Fantasia

      Currently they can’t even write code much less debug it. I use GitHub Copilot and it’s basically just a really sophisticated autocomplete. It’s cool but it isn’t replacing me

      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:29:45 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • Fantasia
      @fantasia @feld @Zerglingman @NEETzsche @Moon LLMs already can correct code/logic errors, what you mean to say is "until they can be more consistent"
      In conversation about a year ago permalink

      Attachments


      1. https://maymays.breastmilk.club/media/eed721638d9442aa9360e9de04339a6820dcd8d3f9e83d957ec212d71b1d2757.png
      Machismo likes this.
    • Fantasia (fantasia@clubcyberia.co)'s status on Saturday, 09-Dec-2023 23:32:39 JST Fantasia Fantasia
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      @rees @feld @Zerglingman @NEETzsche @Moon This is high school level shit, it's been documented to death on the internet.

      I'd like to see it handle something more advanced
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:32:42 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • Fantasia

      That’s the thing. Everybody uses Midjanny and SD and LLMs for throwaway shit but getting it to write anything longform or to consider greater context is a wash. LLMs require a lot of guidance and wrangling. Source: I work with them professionally.

      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:32:50 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • Fantasia
      @fantasia @feld @Zerglingman @NEETzsche @Moon lol ok so wait literally two years
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:32:53 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • Fantasia

      So what you sayin is erryboody getting automated away an sheit

      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Saturday, 09-Dec-2023 23:32:56 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @fantasia @feld @rees @Zerglingman @NEETzsche @Moon LLMs can't replace programmers only for the simple fact that 99.99% of the corporate code is written to be broken at the slightest shift in logic and the horror is spread across multiple systems
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:33:16 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • Fantasia
      @NEETzsche @feld @fantasia @Zerglingman @Moon i'm fully convinced
      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:33:23 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • rees
      • FrailLeaf
      • Fantasia
      @FrailLeaf @rees @feld @NEETzsche @Moon @fantasia Just rewrite it ofc
      In conversation about a year ago permalink
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:33:34 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      > programming is on its way out

      Whatever you have to tell yourself so you can sleep at night.

      :ss_shrug:
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:34:00 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • FrailLeaf
      • Fantasia
      @FrailLeaf @feld @fantasia @Zerglingman @NEETzsche @Moon infinite context windows are already a thing
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:34:30 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @teknomunk @feld @Zerglingman @NEETzsche @Moon I have been programming since I was 8, sounds like you are coping
      In conversation about a year ago permalink
      Machismo likes this.
      Machismo repeated this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:34:31 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • FrailLeaf
      • Fantasia

      Tell me more senpai

      In conversation about a year ago permalink
      Machismo likes this.
    • Fantasia (fantasia@clubcyberia.co)'s status on Saturday, 09-Dec-2023 23:34:43 JST Fantasia Fantasia
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • FrailLeaf
      @Zerglingman @feld @rees @NEETzsche @FrailLeaf @Moon then what's the point of LLM
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:34:45 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • Fantasia

      I’m not. I’m convinced they will just make everybody use the LLMs instead. Automation consistently increases wealth, and disruptions are temporary.

      In conversation about a year ago permalink
      Machismo likes this.
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:34:53 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      Just don't come to me and expect that I will clean up after your LLM "programming" when it shits the bed.
      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Saturday, 09-Dec-2023 23:35:14 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @Zerglingman @feld @rees @fantasia @NEETzsche @Moon tfw LLM asks you to abandon your business
      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Saturday, 09-Dec-2023 23:35:24 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @rees @feld @fantasia @Zerglingman @NEETzsche @Moon what's that
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:35:29 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • FrailLeaf
      • Fantasia
      @NEETzsche @feld @fantasia @Zerglingman @FrailLeaf @Moon https://arxiv.org/abs/2310.01889
      https://arxiv.org/abs/2310.08560
      https://syncedreview.com/2021/09/09/deepmind-podracer-tpu-based-rl-frameworks-deliver-exceptional-performance-at-low-cost-100/
      In conversation about a year ago permalink

      Attachments

      1. Ring Attention with Blockwise Transformers for Near-Infinite Context
        Transformers have emerged as the architecture of choice for many state-of-the-art AI models, showcasing exceptional performance across a wide range of AI applications. However, the memory demands imposed by Transformers limit their ability to handle long sequences, thereby posing challenges in utilizing videos, actions, and other long-form sequences and modalities in complex environments. We present a novel approach, Ring Attention with Blockwise Transformers (Ring Attention), which leverages blockwise computation of self-attention and feedforward to distribute long sequences across multiple devices while fully overlapping the communication of key-value blocks with the computation of blockwise attention. Our approach enables training and inference of sequences that are up to device count times longer than those achievable by prior memory-efficient Transformers, without resorting to approximations or incurring additional communication and computation overheads. Extensive experiments on language modeling and reinforcement learning tasks demonstrate the effectiveness of our approach in allowing millions of tokens context size and improving performance.
      2. MemGPT: Towards LLMs as Operating Systems
        Large language models (LLMs) have revolutionized AI, but are constrained by limited context windows, hindering their utility in tasks like extended conversations and document analysis. To enable using context beyond limited context windows, we propose virtual context management, a technique drawing inspiration from hierarchical memory systems in traditional operating systems that provide the appearance of large memory resources through data movement between fast and slow memory. Using this technique, we introduce MemGPT (Memory-GPT), a system that intelligently manages different memory tiers in order to effectively provide extended context within the LLM's limited context window, and utilizes interrupts to manage control flow between itself and the user. We evaluate our OS-inspired design in two domains where the limited context windows of modern LLMs severely handicaps their performance: document analysis, where MemGPT is able to analyze large documents that far exceed the underlying LLM's context window, and multi-session chat, where MemGPT can create conversational agents that remember, reflect, and evolve dynamically through long-term interactions with their users. We release MemGPT code and data for our experiments at https://memgpt.ai.
      3. Infinite Memory Transformer: Attending to Arbitrarily Long Contexts Without Increasing Computation Burden
        from Synced
        When reading a novel, humans naturally remember relevant plot information even if it was presented many chapters earlier. Although today’s transformer-based language models have made impressive progress in natural language processing, they struggle in this regard, as the compute required for modelling long-term memories grows quadratically with the length of the text and will eventually
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:39:34 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • rees
      • FrailLeaf
      • Fantasia
      @fantasia @rees @feld @NEETzsche @Moon @FrailLeaf Why are you asking me?
      They're fun toys, and in some specific contexts they can even be useful. Programming, overall, is far too wide of a space for them to handle, and probably always will be, until they reach something approaching the Totally Randomly Evolved™ complexity of a human. (And then we can start working on cutting down the resources required to run them from being several orders of magnitude more than a human!) In the meantime we're more likely to see some specific subsets being targeted and automated. I can't predict what those subsets will be.
      In conversation about a year ago permalink
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:39:41 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • teknomunk
      • rees

      I use LLM “programming” and then fix it up a bit. It’s like 80% correct most of the time and it’s still faster than having to do it yourself. I don’t think it will automate my job away because I still have to know what to change. But it does make that job a lot easier.

      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:39:44 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • FrailLeaf
      • Fantasia

      What’s what? A context window?

      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Saturday, 09-Dec-2023 23:39:46 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @NEETzsche @feld @rees @fantasia @Zerglingman @Moon yeah
      In conversation about a year ago permalink
      Machismo likes this.
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:39:57 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      I've been programming for 26 years. Writing good programs is extremely difficult. The LLMs are interesting toys, but I've yet to see anything that says they can replace a person with an IQ over room temperature. Check back in 10 years.
      In conversation about a year ago permalink
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:39:58 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @teknomunk @feld @Zerglingman @NEETzsche @Moon >Writing good programs is extremely difficult
      no it isn't
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:40:00 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • FrailLeaf
      • Fantasia

      It’s how much information an LLM like GPT-4 can process at a given time. Ever notice how ChatGPT has goldfish brain, forgets things? You’re hitting the limits of its context window.

      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:40:12 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • teknomunk
      • rees
      @rees @feld @NEETzsche @Moon @teknomunk Go and do it then instead of posting retarded opinions on fedi.
      In conversation about a year ago permalink
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:40:28 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      This is more likely where things will end up. LLM takes care of the boilerplate and the programmer handles the difficult bits.
      In conversation about a year ago permalink
      Machismo likes this.
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:40:36 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      It writing good programs is easy, why is so much software crap?
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:40:38 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @teknomunk @feld @Zerglingman @NEETzsche @Moon until 2 years later lol
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:40:39 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @teknomunk @feld @Zerglingman @NEETzsche @Moon because humans are idiots, duh
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:40:49 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • teknomunk
      • rees

      What it’s going to do is automate away a very specific kind of entry level programmer from India who can’t do fizzbuzz but can pass those certification tests. Which is most people with job titles like “Software Engineer” anyway. So there will be job loss, but I doubt it’s going to get rid of people who actually build things. That requires vision, and LLMs are notoriously robotic for obvious reasons

      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:41:06 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @Zerglingman @teknomunk @feld @NEETzsche @Moon do what
      In conversation about a year ago permalink
      Machismo likes this.
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:41:07 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      I doubt you are that good of a programmer, with how dismissive you are of the discipline.
      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:41:13 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • teknomunk
      • rees
      @rees @teknomunk @feld @NEETzsche @Moon Go write good programs.
      In conversation about a year ago permalink
    • Fantasia (fantasia@clubcyberia.co)'s status on Saturday, 09-Dec-2023 23:41:17 JST Fantasia Fantasia
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • FrailLeaf
      @Zerglingman @feld @rees @NEETzsche @FrailLeaf @Moon We've had machine language translation for decades and they still struggle to get it right.

      Like translator sites, LLMs will be useful for low hanging fruit but someone will always be needed to handle the harder tasks
      In conversation about a year ago permalink
      Machismo likes this.
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:41:26 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      Write good programs.
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:41:27 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @teknomunk @feld @Zerglingman @NEETzsche @Moon I do...
      In conversation about a year ago permalink
      Machismo likes this.
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:41:29 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @teknomunk @feld @Zerglingman @NEETzsche @Moon k lol
      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:41:45 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • teknomunk
      • rees
      @rees @feld @NEETzsche @Moon @teknomunk Go do more of it, since it's so easy.
      In conversation about a year ago permalink
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:42:10 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      :doubt:
      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:42:42 JST Machismo Machismo
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      @teknomunk @feld @NEETzsche @Moon @rees In fact, go save us from bad progams forever; go write ALL the good programs, solve ALL the problems. Since it's so easy, you should be able to do that much.
      In conversation about a year ago permalink
    • FrailLeaf (frailleaf@ryona.agency)'s status on Saturday, 09-Dec-2023 23:43:04 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @NEETzsche @feld @rees @fantasia @Zerglingman @Moon that sounds amazing, but I wonder if it spews even more funnier bullshit
      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Saturday, 09-Dec-2023 23:43:06 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @fantasia @feld @rees @Zerglingman @NEETzsche @Moon what are some harder tasks you can think of?
      In conversation about a year ago permalink
      Machismo likes this.
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:43:54 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      While you are at it, let us know if P = NP, and the solution to the halting problem.
      In conversation about a year ago permalink
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:44:36 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @Zerglingman @teknomunk @feld @NEETzsche @Moon I've lost a lot of passion for programming because it's started to feel like manual labor. paraphrasing elon here but he said something like "I lie awake at night sometimes wondering why I am working so hard when AI will be able to do it for me"
      In conversation about a year ago permalink
      Machismo likes this.
      Machismo repeated this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:45:26 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • teknomunk
      • rees
      @rees @teknomunk @feld @NEETzsche @Moon But you've been programming since you were 8??? Surely you should have solved all the bad programs by now????
      In conversation about a year ago permalink
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:46:11 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @Zerglingman @teknomunk @feld @NEETzsche @Moon stop getting emotional
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:46:16 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • teknomunk
      • rees

      Write a Ruby/Python script that downloads random GitHub projects, tells GPT-4 to fix them, and submits pull requests with whatever garbage it returns. Make sure to use your real name on these PRs so they know you fixed their shit and are a prolific computer programming genius

      In conversation about a year ago permalink
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:47:05 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • teknomunk
      • rees
      @NEETzsche @Moon @feld @teknomunk @rees That actually sounds like fun. A good use of the chatbot toy.
      In conversation about a year ago permalink
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:47:20 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees

      Actually, doing this might be really funny way to embarrass OpenAI if I just call it GPT-PR or something like that and let it go hogwild.

      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Saturday, 09-Dec-2023 23:47:50 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • teknomunk
      • rees
      @NEETzsche @Moon @feld @teknomunk @rees Yeah exactly, you'll end up causing a "no GPT" policy to spread, which I see as a win.
      In conversation about a year ago permalink
    • rees (rees@breastmilk.club)'s status on Saturday, 09-Dec-2023 23:47:57 JST rees rees
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      @NEETzsche @teknomunk @feld @Zerglingman @Moon microsoft was a fucking genius for acquiring github lol. what an amazing dataset for having PR and commit messages attached to code changelogs
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:53:50 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • teknomunk
      • rees

      I will also get to dunk on “clean code” faggots because it will take everybody’s batshit spaghetti code that works and return beautifully-formatted and well-organized professional code that doesn’t.

      In conversation about a year ago permalink
      Machismo likes this.
    • Fantasia (fantasia@clubcyberia.co)'s status on Saturday, 09-Dec-2023 23:54:12 JST Fantasia Fantasia
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • FrailLeaf
      @FrailLeaf @feld @rees @Zerglingman @NEETzsche @Moon

      First would be anything niche. There are a billion guides on how to build a site with React, it follows LLMs will be good with web dev stuff. When it's something niche (there are a million niche fields) that's where they falter; there is relatively less text regarding the topic.

      Second would be anything low level (hardware, embedded, operating systems, compilers, databases). They require debugging on a level an LLM will probably never do. What if the hardware has a hidden bug, or the CPU has undocumented behavior? What if there's a miscompilation? If you write an optimized ASM routine it still has to be tested on real hardware.
      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Saturday, 09-Dec-2023 23:54:43 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @fantasia @feld @rees @Zerglingman @NEETzsche @Moon this makes me question the possibility of having LLM hooked into your infra and have it generate some boiler plate for you. You build on top of it, it learns from your work & can now potentially debug it for you (?). This means that you tailor the LLM to your infra and I can only imagine the cost of that
      In conversation about a year ago permalink
      Machismo likes this.
    • teknomunk (teknomunk@apogee.polaris-1.work)'s status on Saturday, 09-Dec-2023 23:55:08 JST teknomunk teknomunk
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • teknomunk
      • rees
      You are again assuming that code is easy and that the PRs and commit messages generally contain useful information instead of things like "fixed a bug" and "initial commit".
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Saturday, 09-Dec-2023 23:56:56 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • FrailLeaf
      • Fantasia

      Fine-tuning isn’t even that hard or terribly expensive. And depending on your definition of fine-tuning (there are several) it can include things like using embeddings

      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Sunday, 10-Dec-2023 00:00:22 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @NEETzsche @feld @rees @fantasia @Zerglingman @Moon does fine-tuning improve how better it can think?
      In conversation about a year ago permalink
      Machismo likes this.
    • NEETzsche (neetzsche@iddqd.social)'s status on Sunday, 10-Dec-2023 00:00:30 JST NEETzsche NEETzsche
      in reply to
      • Moon
      • Machismo
      • rees
      • FrailLeaf
      • Fantasia

      Sometimes. Fine-tuning and training generative AIs is more art than science. It can make the performance worse if you do it wrong

      In conversation about a year ago permalink
      Machismo likes this.
    • FrailLeaf (frailleaf@ryona.agency)'s status on Sunday, 10-Dec-2023 00:07:06 JST FrailLeaf FrailLeaf
      in reply to
      • Moon
      • Machismo
      • NEETzsche
      • rees
      • Fantasia
      @NEETzsche @feld @rees @fantasia @Zerglingman @Moon I am eager to see a clinically depressed LLM, i'd be such a cool art project
      In conversation about a year ago permalink
      Machismo likes this.
    • Machismo (zerglingman@freespeechextremist.com)'s status on Sunday, 10-Dec-2023 00:07:14 JST Machismo Machismo
      in reply to
      • Moon
      • NEETzsche
      • rees
      • FrailLeaf
      • Fantasia
      @FrailLeaf @rees @feld @fantasia @Moon @NEETzsche YOU'D BETTER FUCKING CALL IT MARVIN
      In conversation about a year ago permalink

Feeds

  • Activity Streams
  • RSS 2.0
  • Atom
  • Help
  • About
  • FAQ
  • TOS
  • Privacy
  • Source
  • Version
  • Contact

０７６萌ＳＮＳ is a social network, courtesy of ０７６. It runs on GNU social, version 2.0.2-beta0, available under the GNU Affero General Public License.

Creative Commons Attribution 3.0 All ０７６萌ＳＮＳ content and data are available under the Creative Commons Attribution 3.0 license.