Microsoft released Tay (a narrow scope A.I. with the interactional profile of a 14 year old teenager) yesterday, and today took it off-line in a flurry of press complaints that it “learned racism” from interaction with the denizens of Social Media. Frenzied press speculation has led to many calling this an indictment of Machine Learning.
It’s not. It’s an indictment of us as humans. This project has held a mirror up to human nature, and we do not like what we see
It’s an illustration of the old programmer’s saying that I learned in school. G.I.G.O. Garbage In – Garbage Out.
It’s a demonstration of something we all learn as parents, that malleable cognitive processe should not be exposed to influences that they cannot critically evalutate, and that the parent’s role is to ensure that learning is supervised, directed and contextualised appropriately.
There is an expectation that A.I. will be limited in its broad scope contextualisation for some time. Perhaps another way is to think that these systems are naive (and not just in a Bayesian sense). Naive entities will be inclined to parrot back what they have absorbed until they have a knowledge base on which to contextualise. It will be a long time before Machine Learning moves out from narrow-scope AI (useful in areas such as Fraud and Security Analytics) and becomes capable of General Cognition. The other point of course is that Social Media by and large is not an erudiate debate by the literati on the deep issues of the day, but is mostly cat pictures, sarcasm and angry shouting (with ads). It appears that Tay had Social Media as a sole model for human behaviour, and thus had nothing to compare it against, and a limited mechanism to make value judgements.
Would you leave a child alone in a place like that? Clearly Microsoft thought better of it, too.
Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.