Here’s one very good reason why certain algorithms cannot be 100% trusted – because gorillas.
So here’s the thing: Google has a new Photos app, Google Photos, which allows users’ photos to be tagged and arranged automatically based on the objects in the photos. It’s really pretty nifty because, for instance, pictures of airplanes will all be arranged in an album labeled, “airplanes” without you having to do it.
It’s smart, it’s quick, it’s epic image recognition technology..that can go horribly wrong.
Just this week, Google came under fire when the Photos app decided to categorise photos in one of the most racist ways ever. On 28th June, computer programmer Jacky Alciné took to Twitter to post proof of the Google Photos error, along with the caption,“What kind of sample image data you collected that would result in this son?”
And also, a slew of other tweets:
What kind of sample image data you collected that would result in this son?
— diri noir avec banan (@jackyalcine) June 29, 2015
Like I understand HOW this happens; the problem is moreso on the WHY. This is how you determine someone’s target market. — diri noir avec banan (@jackyalcine) June 29, 2015
Fuck, the only thing under this tag is my friend and I being tagged as a gorilla. What the fuck? -__
— diri noir avec banan (@jackyalcine) June 29, 2015
And it’s only photos I have with her it’s doing this with (results truncated b/c personal): pic.twitter.com/h7MTXd3wgo — diri noir avec banan (@jackyalcine) June 29, 2015
Google Photos, y’all fucked up. My friend’s not a gorilla. pic.twitter.com/SMkMCsNVX4
— diri noir avec banan (@jackyalcine) June 29, 2015
Google’s chief social architect Yonatan Zunger responded quickly, apologising for the feature’s error.
He admitted for the flawed feature and said, “Sheesh. High on my list of bugs you *never* want to see happen. Shudder”.
https://twitter.com/yonatanzunger/status/615355996114804737
https://twitter.com/yonatanzunger/status/615383011819794432
According to The Verge, Zunger says that Google has had similar issues with facial recognition due to inadequate analysis of skin tones and lighting. “We used to have a problem with people (of all races) being tagged as dogs,” Zunger revealed.
A Google spokeswoman told the BBC, “We’re appalled and genuinely sorry that this happened. We are taking immediate action to prevent this type of result from appearing.” Zunger also noted that the company is working on longer-term fixes that revolve around which labels could be problematic and better recognition of dark-skinned faces.
Google has since removed the “gorilla” tag from its new Photos app, after attempting to fix the algorithm.
https://www.youtube.com/watch?v=ydBjsZnHrwM
Sources: The Verge, Telegraph UK, ABC.
