This is really what blows my mind the most. With all this talk about how much power LLMs and diffusion models use companies are still constantly cramming it into places where it’s just running all the time passively doing things no one asked for.
Overall power use by these things would probably be cut down by an order of magnitude by just limiting it to directed, intentional use only.
if that happened then usage number would drop, and that would undermine the narrative that these tools have mass appeal that can be monetized for huge revenue. That would then raise some uncomfortable questions about the absurd amounts of money being spent on developing them, building data centers to run them, and buying the glorified graphics cards needed for all that.
Like, all the people making money selling the shovels for the gold rush would have to explain why no one is finding any gold.
This is really what blows my mind the most. With all this talk about how much power LLMs and diffusion models use companies are still constantly cramming it into places where it’s just running all the time passively doing things no one asked for.
Overall power use by these things would probably be cut down by an order of magnitude by just limiting it to directed, intentional use only.
if that happened then usage number would drop, and that would undermine the narrative that these tools have mass appeal that can be monetized for huge revenue. That would then raise some uncomfortable questions about the absurd amounts of money being spent on developing them, building data centers to run them, and buying the glorified graphics cards needed for all that.
Like, all the people making money selling the shovels for the gold rush would have to explain why no one is finding any gold.