Models that you can run locally on reasonably priced consumer grade hardware are always going to be crap, you really need the beefy models that destroy the environment for it to be somewhat useful.
Oh yeah this whole thing is very very much convenient to Nvidia and data center companies lmao.
I still think they’re incentivized to make the models more efficient as they could then squeeze out even more profit, it’s just that it’s a property of the technology itself that it doesn’t really work well until you have bajillions of parameters.
Models that you can run locally on reasonably priced consumer grade hardware are always going to be crap, you really need the beefy models that destroy the environment for it to be somewhat useful.
No shade to you personally, just that it’s really convenient that things work out this way.
Oh yeah this whole thing is very very much convenient to Nvidia and data center companies lmao.
I still think they’re incentivized to make the models more efficient as they could then squeeze out even more profit, it’s just that it’s a property of the technology itself that it doesn’t really work well until you have bajillions of parameters.