• Itdidnttrickledown@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      6 hours ago

      Yup. I’ve had the same thoughts. There are many who still think its insane to have your own equipment. Now there will be those who think its insane to do your own thinking.

  • GreenKnight23@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    ·
    8 hours ago

    a big source of AI token ‘chewing’ is people just converting PDFs to presentations

    I haven’t been this happy in over a year.

    giggles

  • weew@lemmy.ca
    link
    fedilink
    English
    arrow-up
    39
    ·
    10 hours ago

    The funny thing is that even with this massive overspending, AI companies aren’t profitable. They need these companies to spend 10x the amount per token, and 10x the number of tokens. Probably 10x the number of customers too.

    Burning energy, draining water, spending massive cash so they can lose money on a product that doesn’t even do its job. How the hell has the bubble not popped yet…

    • WrathEnchanter@europe.pub
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 hours ago

      The Stock market is literally just vibes. As long as everyone believes, it will somehow be profitable in the future, the line will keep ging up

    • Tollana1234567@lemmy.today
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 hours ago

      and building more and more datacenters, replacing AI chips faster and faster, the more people use it, which of course is wasting a ton of money.

    • dtrain@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      7 hours ago

      I heard about a company that was looking at purchasing machines to run local llms for their developers to use.

      If more companies do this, rather than using the massive ai data centers being built…. the RAMpocolypse will get way worse.

      • Chaf@slrpnk.net
        link
        fedilink
        English
        arrow-up
        3
        ·
        3 hours ago

        That is the part that pains me to admit - running local LLMs is not a solution to the RAMpocalypse. In that case we’d just have more GPUs and RAM idling for ~90% of the time in someones basement, without being shared. As bad as it sounds, having data centers for AI stuff is actually the more ecological solution. I can’t believe I said that. Excuse me, I have to take a shower now *shudder*

  • Tattorack@lemmy.world
    link
    fedilink
    English
    arrow-up
    54
    arrow-down
    2
    ·
    14 hours ago
    • Replace workforce with AI because it’s easy to be lazy with AI.
    • Remaining workforce uses AI to be lazy.
    • SurprisedPikachu.webp
      • Mikrochip@feddit.org
        link
        fedilink
        English
        arrow-up
        21
        arrow-down
        1
        ·
        13 hours ago

        Hey, webp is awesome! Both lossless and lossy compression work great with it. Only thing lacking is software support

        • Manticore@lemmy.nz
          link
          fedilink
          English
          arrow-up
          4
          ·
          edit-2
          3 hours ago

          Yeah, that’s the eww part :( I hate when I find great memes and I know exactly the friend to share them to… and I can’t DM them.

          Especially if it’s animated. Easy enough to change the extension on PC to a PNG without issue yet. But anything too large to screenshot, or with multiple frames? Many a DND meme have I let pass by

  • Snapz@lemmy.world
    link
    fedilink
    English
    arrow-up
    93
    arrow-down
    4
    ·
    17 hours ago

    This is 100% the thesis I’ve been shopping personally… Many Boomers and Xers in executive positions had a “magical millennial” that they quietly kept as a secret “AI” to split/edit PDFs, set up an Airtable base, add columns to a google doc, etc. There was a tacit, silent agreement in this symbiotic relationship for the bulk of the last 20 years - you’ll make sure I don’t look completely incompetent in tech matters and I’ll backchannel on your behalf to senior leaders and people who “matter” to help you advance.

    Gen AI essentially allows the laziest input, gives a half competent output that “feels” fine and has the bonus of telling the boomer/Xer that they are actually amazingly capable, and could have done this themselves all along even, but they rightly delegated the task to their magical millennial, and now to the AI of choice.

    So they fired all the magical millennials, because they knew too much about the before times. Now that they are fucked without a life raft, costs soar and they will cling for dear life because they will be exposed otherwise.

    Edit: through a twist of fate, the iPad kids grew up technically incapable and relied on the magical millenials as well. They could only offer praise and loyalty really, or a boomer, Xer recruited them in and talked the MM up as a “wiz” to seek out. Anyway, now that the MM are gone, the Zoomers and gen Alpha kids only have one strength remaining, the old people have no idea what they are doing or how to quantify their success, outside of “use more AI”. So the fragile balance remains for now, with a vulnerable, hollow center where the magical millennials used to live.

    • Washedupcynic@lemmy.ca
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      6 hours ago

      I’m surrounded by this shit, and it seems to come from all generations. My boss, who is my age, called me because her computer was frozen and she wanted me to fix it. “I was like, turn it off and on again, this is the first, most basic rule of troubleshooting.” Meanwhile the boomer next to me is having me do shit like attach files to a fucking email.

    • SpaceCowboy@lemmy.ca
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      3
      ·
      11 hours ago

      I don’t know why you think it’s a generational thing. There has always technical people that filled in the gaps that the more extroverted management types didn’t care about. How do you think things worked when millennials were still in diapers?

      What you’re saying indicates you’re one of those people that don’t understand how many gaps other people are filling in for you. You’re talking about splitting PDFs, who do you think designed the PDF format? Or the http protocol that you use to open that google doc?

      Honestly the issue I see happening lately is that because iPads (and now AI) made things too easy for the young people they don’t actually know how things work at the low level, not interested in learning it, and often react with “this is too complicated, make it easier for me!”

      • Snapz@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        arrow-down
        1
        ·
        11 hours ago

        I said it was my own thesis, built from a decade plus in the trenches. If you read what I’d stated again, you’ll see that the implication was not purely generational, but boomers/Xers with power who drove the change. You also over emphasis technicality here as I was purposefully discussing the more mundane, beginner to intermediate level daily tasks that the millenials were fulfilling here. The millennials in this group are typically in rightful awe of the old timers talents to build on the foundational level, and also envy their circumstance of walking into a more open sandbox and with more stakes to claim in the early days.

        So basically, the above preceding doesn’t really concern you unless you found your way to VP level or really to the csuite especially, and even then, always exceptions. That understood , I won’t spend more time debating exceptions to the general rule, as I see it. I respect my elders, as long as they are decent people struggling to do better within these inherently broken systems.

      • dream_weasel@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        2
        ·
        11 hours ago

        I don’t know why you think it’s a generational thing. There has always technical people that filled in the gaps that the more extroverted management types didn’t care about. How do you think things worked when millennials were still in diapers?

        Uh… Unless you worked at the forefront of technology where more people probably WERE qualified, by and large these things worked on paper/transparencies I would presume. If PowerPoint and PDF were people, they are themselves millennials and gen z (ish) respectively.

        Now, when millennials were about 10 you’ve got a decent point ;).

        • SpaceCowboy@lemmy.ca
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          10 hours ago

          by and large these things worked on paper/transparencies I would presume.

          You have to presume because you weren’t involved in helping the people who were used to doing everything on paper learn how to turn on a computer. Do you think people in the past were super qualified and just magically knew how to use a computer in the past? Nobody ever needed help loading a file on a floppy disk and printing it to paper so they can present it to their boss?

          There have always been clueless bosses and tech people that had to make things work. If you go back further, why do you think they all had secretaries typing things up?

  • b161@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    18
    ·
    14 hours ago

    Waiting for hackers to break into companies and not do a ransomware attack. Just run some scripts which innocently do shit like turn PDFs into PowerPoints and chew through those tokens.

  • Eternal192@anarchist.nexus
    link
    fedilink
    English
    arrow-up
    36
    ·
    16 hours ago

    Eat shit you greedy corporate assholes, i hope all of your companies are damaged beyond recovery, you useless fucking tools.

  • primeriver76073@lemmy.1095.me
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    13
    ·
    5 hours ago

    @sanitation, worth pushing back a little on the ‘token chewing’ framing: the PDF-conversion use case probably isn’t the real budget killer — it’s the human review loop that follows. Someone generates a deck, decides it’s 70% right, then re-prompts three times to fix slides. That’s 4x the token cost of one clean generation, and it’s invisible in most usage dashboards. The fix isn’t fewer AI calls, it’s better output evaluation at step one. We’ve been building tooling around exactly that evaluation gap — rough writeup at if you’re curious how other dev teams are approaching it.

    • TheOakTree@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 hours ago

      rough writeup at if you’re curious how other dev teams are approaching it.

      Ah thank you, I will read " " and tell my peers and colleagues how we’re closing the evaluation gap.

      The fix isn’t to write your own five sentence response, it’s to let an LLM write your response for you and post without any proofreading.

    • Infinite@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 hours ago

      One has to wonder what the ROI is on having AI bots astroturfing about AI, especially when the output is this clearly artificial.

  • CovfefeKills@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    11 hours ago

    Dayum. If I was given unlimited budget for AI I would do the same. Everyone should have a set personal budget for AI expense and they can keep it if they don’t use AI.

    • SpaceCowboy@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      10 hours ago

      If I’m going to get a $20,000 bonus at the end of the year if I don’t use any AI, I’m not going to use AI.

      That’s a big problem with this tech… how do you price it? I think companies would purchase an allotment of tokens that can be used or banked by employees. Problem is they’d always be cutting the token budget.

      Where I work I have to have a meeting and justify a $100 license for software. So I don’t know how this will work long term.

  • chunes@lemmy.world
    link
    fedilink
    English
    arrow-up
    38
    arrow-down
    1
    ·
    17 hours ago

    Using an LLM to parse stuff is like using a rocket launcher to kill an ant.

    You can accomplish the same thing using a million times fewer resources with a purpose-built program.

    • BradleyUffner@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      14 hours ago

      Will, that’s what happens when employers tell employees that they should “use ai first”, track their token use on a dashboard, and tell them they’ll get fired if they are too low on the monthly ranking.

      • jj4211@lemmy.world
        link
        fedilink
        English
        arrow-up
        13
        ·
        13 hours ago

        Yeah, my manager expressed satisfication with me being one of the people using my quota of tokens.

        I have generated so much throwaway content that never gets used and only gets deleted to burn the tokens to avoid getting the “you aren’t using AI enough” talk. The fact they can see my actual productive output and believe AI is involved shows how utterly disconnected the metric is from reality.

    • jmp242@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      17
      ·
      17 hours ago

      Well, if your KPI is how much you use an LLM like in some reports - this is an easy way to get those good indicators. Also, LLMs are super easy to use to parse things, whereas many special programs like IDK grep isn’t exactly user friendly. Not to mention not finding patterns really. Though here I’m thinking things like looking at various logs on computers.

      • NotAnonymousAtAll@feddit.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        16 hours ago

        Maybe we could at least nudge the LLMs in the direction of suggesting appropriate tools and giving hints how to actually do that when applicable instead of blindly brute forcing every task. Of course that does not solve the issue of stupid corporate incentives, but I feel like by now most companies have realized that burning as much money as possible is not a good goal.

    • Rooster326@programming.dev
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      16 hours ago

      Yes but you’re in an open office and all you have available in your open office hell are: rocket launcher, your sanity, Debra’s snappy attitude.

  • jobbies@lemmy.zip
    link
    fedilink
    English
    arrow-up
    37
    ·
    18 hours ago

    These stupid companies are getting everything they deserve and I’m loving it.