• codydodd@lemmy.ca
    link
    fedilink
    arrow-up
    17
    ·
    14 days ago

    Anyone who invested in data centres on the last year is already seeing their stock in trouble. The dot Com bubble pop wasnt due to mom and pop internet sites going under. It came from the massive oversupply in fiberoptic that companies like Cisco poured money into, and all related funds that followed them.

    There is a massive glut in data center projects relative to the shrinking demand for LLMs etc. The bubble is popping.

    • Nik282000@lemmy.ca
      link
      fedilink
      arrow-up
      16
      ·
      14 days ago

      I can’t wait get my hands on some cheap-ass server hardware. Having an in-home, offline, Hal 9000 is gonna be a lot more fun than having my boss slop out mass emails every 30 min.

      • tempest@lemmy.ca
        link
        fedilink
        arrow-up
        7
        ·
        14 days ago

        I just hope we actually see it in the used market. I would not be surprised to see these billionaire fucks destroy it all rather than allow the plebes to have access to decent hardware.

        • Nik282000@lemmy.ca
          link
          fedilink
          arrow-up
          5
          ·
          14 days ago

          I’m pretty sure that it will be used to fill the consumer hardware vacuum by pushing desktops as a service. Every device you own gets a unified desktop streamed to you from the remains of the AI industry.

          • tempest@lemmy.ca
            link
            fedilink
            arrow-up
            2
            ·
            12 days ago

            At least in my case I’ll be running my own shit until it all dies, unless they come to my physically, there’s no way for them to take anything but websites from me at this point.

            Full linux across every computer in my home, dumb TV’s and my own systems for media. I rely on no one but Linux devs, and even if I had to dump the internet, my own shit would continue to work just fine.

    • BlameThePeacock@lemmy.ca
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      2
      ·
      14 days ago

      Shrinking demand for LLMs? What planet are you living on?

      If you look at OpenRouter’s history back a year you can see the massive explosion in inference tokens consumed. https://openrouter.ai/rankings?view=month#top-models Obviously that’s not a perfect representation of the entire market given that the major companies also provide their own inference, but it’s the largest public view of usage and is likely extremely representative of what’s going on behind the scenes.

      The only thing holding more organizations back from using even more inference is cost, so any sort of “pop” is just going to immediately be eaten up by increased usage at slightly lower prices.

      Will a bunch of investors lose their shirts? Absolutely, but there is no lack of demand for datacenters right now.

          • codydodd@lemmy.ca
            link
            fedilink
            arrow-up
            3
            arrow-down
            1
            ·
            13 days ago

            Ceos are turning sour as ability measure ROI has proven elusive. Also, the above implies a slow increase to prices which is already happening.

      • Nocklusamigos@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        12 days ago

        Lets see how that plays out with increasing prices of electricity, cooling systems, fresh water.

        Next year will be full of surprises:

        1. Insanely hot heat waves
        2. Grid system failures as a result
        3. shortage of fresh water
        4. difficulty of cooling those data centers (there will be more of them)

        AI efficiency has to double at least to be viable at that point

        • Nocklusamigos@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          12 days ago

          And keep in mind. Grids need cooling, people need more ac, data centers need more ac, fresh water needs electricity. It is just going to snowball

        • BlameThePeacock@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          12 days ago

          AI currently (as of a month ago) only uses about 0.5% of total global energy. It’s not as big of a threat to the environment as you seem to think it is.

          Not to mention that the 2, 3, and 4 are failures by your government. My local government doesn’t have those issues because they properly regulated datacenters already.

          New datacenters here have to bid for specific limited available power blocks yearly when the utility determines how much will be available to their use, they also can’t be built with evaporative cooling anymore, and… 4 doesn’t apply because we don’t use evaporative cooling anymore.

          It’s fucking hilarious that the US is allowing datacenters to be build with evaporative water cooling in the middle of fucking deserts and/or drought regions. Stop being idiots.

          • Nocklusamigos@lemmy.world
            link
            fedilink
            arrow-up
            1
            arrow-down
            1
            ·
            12 days ago

            I dont know why you have to lie. It is 1.5% officially but my guess is 3% at least. Which is huge. 2,3,4 already a problem in some parts of USA and you I wrote about future problems. Maybe your gov is able to offload 2, 3, 4 to the nature but it is not your gov beinf smart, it is harming my home, my life and for what for useless pet projects and useless media

            • BlameThePeacock@lemmy.ca
              link
              fedilink
              English
              arrow-up
              1
              ·
              12 days ago

              Nope, it’s not. You’re counting “electricity usage” not energy usage.

              Those are not the same thing.

  • ryper@lemmy.ca
    link
    fedilink
    English
    arrow-up
    16
    ·
    14 days ago

    Just as an example: On Friday a data centre was announced in Nova Scotia, with the premier and a couple of MPs in attendance, and later in the day the client for the data centre was announced as Anthropic. Almost like the officials in attendance at the data centre announcement didn’t want to have to answer questions about what good a local data centre with an American Big Tech client does us.