• VonReposti@feddit.dk
      link
      fedilink
      English
      arrow-up
      0
      ·
      14 days ago

      Already is, take a look at devstral, qwen3.6, deepseek coder. All can be run on a hugh end GPU and if you’re a developer you likely have one.

      • makeshift0546@lemmy.today
        link
        fedilink
        English
        arrow-up
        0
        arrow-down
        1
        ·
        14 days ago

        The vast majority of users ain’t running anything but 27b max, more likely 14b, and that shit just ain’t nearly as good as older saas models much less dominant like opus. Maybe for small shit but complex talks just ain’t fitting on home hardware.