By training an algorithm that will have an impact on said statistics. Not only the algorithm can cheat (see Goodhart’s law), but it can repeat biases that led to these statistics (like those law enforcement algorithms that became racists)
My favorite was the one they were training to detect cancer in imaging scans but they forgot to edit out the info stamp in the corner so it just started flagging all the scans from the cancer center!
You are describing Google Ads right now. Algorithms are better and better in reaching to poeple that are already on the purchase patch. It’s like giving a restaurant flayers to people that are waiting for a weiter to show them a table.
Aren’t our ads amazing? Look, almost everyone who saw them made the purchase!
Analytics that ignores Goodharts law ruin everything. Movies, HR, Marketing (not much to ruin left, but you get the point), performancet review, recommendations…
By training an algorithm that will have an impact on said statistics. Not only the algorithm can cheat (see Goodhart’s law), but it can repeat biases that led to these statistics (like those law enforcement algorithms that became racists)
My favorite was the one they were training to detect cancer in imaging scans but they forgot to edit out the info stamp in the corner so it just started flagging all the scans from the cancer center!
You are describing Google Ads right now. Algorithms are better and better in reaching to poeple that are already on the purchase patch. It’s like giving a restaurant flayers to people that are waiting for a weiter to show them a table.
Aren’t our ads amazing? Look, almost everyone who saw them made the purchase!
Analytics that ignores Goodharts law ruin everything. Movies, HR, Marketing (not much to ruin left, but you get the point), performancet review, recommendations…