

I think most of the time with these kind of problems we are comparing apples and oranges. Sure we are both using LLMs to make fruit, but what kind of fruit? I’ve found models are best at what they are most trained for but as soon as you want Kiwi and they aren’t as popular as apples you need to be on your A game. I think people who say LLMs are really good are doing trivial stuff or the most stock standard thing you can think of, like making a new portal web app with the most ubiquitous technologies that have been around forever.






I was lucky to upgrade my GPU before the price increases, but the open weight models are quite alright for the moderate stuff, and electricity is much cheaper than the cloud token costs at the moment. So, unless HW prices will be forever high and that bleeds into the 2nd hand market too, I don’t think there will be at least some economical viability.