As always with Zitron, grab a beverage before settling in.

  • HakFoo@lemmy.sdf.org
    link
    fedilink
    arrow-up
    5
    ·
    3 days ago

    I have to think that most people won’t want to do local training.

    It’s like Gentoo Linux. Yeah, you can compile everything with the exact optimal set of options for your kit, but at huge inefficiency when most use cases might be mostly served by two or three pre built options.

    If you’re just running pre-made models, plenty of them will run on a 6900XT or whatever.

    • Powderhorn@beehaw.orgOP
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 days ago

      I don’t expect anyone other than … I don’t even know what the current term is … geeks? batshit billionaires? to be doing training.

      I’m very much of the belief that our next big leap in LLMs is local processing. Once my interactions stay on my device, I’ll jump in.