Amazon has shut down an internal company leaderboard which ranked employees based on how much they used AI tools at work.
How come people with MBA studies are too dumb to see that easily cheated metrics, are easily cheated? What do they actually teach in those studies? Have 5 mission statements that are the exact opposite of how we actually act, and fire people do line go brrr? That’s it?
I don’t understand how they don’t know that as soon as you make a metric, people will try as hard as they can to game it, making the metric useless.
Whole concept of “how much AI you used”, is so flipping stupid of a metric I can’t even wrap my head around. I mean even if we assume it’s their own AI they are using… that’s their power etc… That’s like a leaderboard for most gas used up, or miles driven by your truck drivers.
It’s the old lines of code metric style of thinking.
The people in charge only know line go up means better and bigger number is better.
Its only when things go wrong and someone ELI5 for them that they listen. And even then it’ll wear off in a week and they’ll be on to their next make the number bigger obsession.
I’ve had to explain this to more executives than I wish to remember. Computer code is a recipe, not a cake. When you see a recipe that’s super long, and requires two kitchens worth of bakeware and tools, you probably think it’s a bad recipe. Short, elegant, easy to follow recipes with a little note in the margin from your grandmother about what to do when the dough is too sticky are the best recipes.
Unfortunately, one learned the exact wrong lesson from this, and started measuring lower lines of code produced as better… Which worked for a while, but lead to a lot of weirdness around new features for no particular reason.
I love this metaphor. totes stealing it. 😊