• Pennomi@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    12 hours ago

    Yes, it will take a substantial change in LLM architecture to make them viable for general use. Like you said, a couple orders of magnitude improvement in training would be the biggest help. Though I’m not sure that’s even possible.