• unexposedhazard@discuss.tchncs.de
    link
    fedilink
    arrow-up
    18
    arrow-down
    1
    ·
    13 hours ago

    LLMs have a more mystical pull than other previous hypes, but look at what happened with crypto and blockchain. Every fucking government and company was saying that its the future and now nobody gives a shit about those anymore. It might be later than you and i would like, but eventually it will pass.

    • Pennomi@lemmy.world
      link
      fedilink
      English
      arrow-up
      18
      arrow-down
      4
      ·
      13 hours ago

      Or it will become foundational tech like the Internet. People said that was a fad too.

      It all depends on whether or not it becomes reliable and cheap.

      • unexposedhazard@discuss.tchncs.de
        link
        fedilink
        arrow-up
        15
        arrow-down
        3
        ·
        edit-2
        13 hours ago

        Idk why you are being downvoted. It is a real possiblity, but i just dont think its likely.

        reliable and cheap

        Because it simply wont ever be those things. LLMs become more expensive the better you try to make them, exponentially so. We will likely never see LLMs that are significantly better than what we have today. Basically all written human texts on the internet have been used for LLM training. Any further gains can only come from optimizing training algorithms and there hasnt been any real progress there for years now.

        • Pennomi@lemmy.world
          link
          fedilink
          English
          arrow-up
          6
          ·
          edit-2
          12 hours ago

          Yes, it will take a substantial change in LLM architecture to make them viable for general use. Like you said, a couple orders of magnitude improvement in training would be the biggest help. Though I’m not sure that’s even possible.

        • snooggums@lemmy.world
          link
          fedilink
          English
          arrow-up
          6
          ·
          13 hours ago

          The internet was successful because it was predictable and reliable and filled a previously unserved purpose. LLMs could possibly serve a purpose creating text that doesn’t need to be correct or accurate, but it won’t replace anything that requires any level of accuracy or accountability because the design is inherently flawed due to being a prediction algorithm.

          There are uses for pattern matching AI that will continue to be tools used by humans to help focus efforts in massively complex work, but they won’t ever be foundational replacements.

        • Pennomi@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          12 hours ago

          How is what I said AI apologism? I clearly expressed concern that the technology isn’t reliable or cheap.

    • greenskye@lemmy.zip
      link
      fedilink
      arrow-up
      5
      ·
      11 hours ago

      Cloud everything, saas, and offshore workers are all still things that have been negatively affecting people for years and never really went away even if the hype died down.

      • unexposedhazard@discuss.tchncs.de
        link
        fedilink
        arrow-up
        2
        ·
        5 hours ago

        Cloud computing is slowly crumbling too. At least in germany more and more companies are going back to on prem, because there are just a bunch of studies showing that cloud stuff is more expensive, less flexible and often actually has more downtime. But unlike other stupid projects you cant just reverse the move to cloud in a few months, it will take years to unfuck everything.