• blackbeans@lemmy.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      19 days ago

      Personally, I find myself using the Chinese alternatives more and more as they are just way cheaper.

      • abbadon420@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        19 days ago

        The good thing is that a deepseek can be run locally relatively well with consumer hardware. I trust chinese companies as much as i trust american companies with my data and my prompts.

        • Vlyn@lemmy.zip
          link
          fedilink
          English
          arrow-up
          0
          ·
          18 days ago

          You have 170+ GB VRAM at home? (:

          I mainly use DeepSeek v4 Flash now, it’s the cheapest around and the quality is high enough for coding. At work we’re throwing tons of money at Claude, but even there I usually stick to Sonnet (as Opus is burning money).

          • De Lancre@lemmy.worlddeleted by creator
            link
            fedilink
            English
            arrow-up
            0
            arrow-down
            1
            ·
            edit-2
            18 days ago

            You don’t need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don’t get me wrong, but it still somewhat useable.

            Upd.Once again, for those who use AI because struggles to read: it is slow, but it is usable. Which is, by definition, means that you don’t need 170+ GB of VRAM to run this model. Period. It runs from ssd. That is a fact.

            • placebo@lemmy.zip
              link
              fedilink
              English
              arrow-up
              0
              arrow-down
              1
              ·
              18 days ago

              “Somewhat” is doing a lot of heavy lifting there 😂 How much time does it take to process your average request?