Gartner Blog Network


Microsoft release Tay onto the world and…

by Jonathan Care  |  March 24, 2016  |  3 Comments

Microsoft released Tay (a narrow scope A.I. with the interactional profile of a 14 year old teenager) yesterday, and today took it off-line in a flurry of press complaints that it “learned racism” from interaction with the denizens of Social Media. Frenzied press speculation has led to many calling this an indictment of Machine Learning.

It’s not. It’s an indictment of us as humans. This project has held a mirror up to human nature, and we do not like what we see

It’s an illustration of the old programmer’s saying that I learned in school. G.I.G.O. Garbage In – Garbage Out.

It’s a demonstration of something we all learn as parents, that malleable cognitive processe should not be exposed to influences that they cannot critically evalutate, and that the parent’s role is to ensure that learning is supervised, directed and contextualised appropriately.

There is an expectation that A.I. will be limited in its broad scope contextualisation for some time. Perhaps another way is to think that these systems are naive (and not just in a Bayesian sense). Naive entities will be inclined to parrot back what they have absorbed until they have a knowledge base on which to contextualise. It will be a long time before Machine Learning moves out from narrow-scope AI (useful in areas such as Fraud and Security Analytics) and becomes capable of General Cognition. The other point of course is that Social Media by and large is not an erudiate debate by the literati on the deep issues of the day, but is mostly cat pictures, sarcasm and angry shouting (with ads). It appears that Tay had Social Media as a sole model for human behaviour, and thus had nothing to compare it against, and a limited mechanism to make value judgements.

Would you leave a child alone in a place like that? Clearly Microsoft thought better of it, too.

Category: machine-learning  social-media  

Tags: machine-learning  social-media  

Jonathan Care
Research Director
1 years at Gartner
22 years IT Industry

Jonathan Care expertise includes payment systems, cybersecurity, fraud detection and prevention applications, authentication, identity proofing, identity theft, and insider threats. He also covers the PCI compliance program, tokenization and the security aspects of payment systems. Read Full Bio


Thoughts on Microsoft release Tay onto the world and…


  1. […] Jonathan Care Microsoft released Tay (a narrow scope A.I. with the interactional profile of a 14 year old […]

  2. Merv Adrian says:

    For goodness’ sake, don’t let Tay watch the presidential campaign, either.

  3. Ekim Kaya says:

    Good point, Jonathan. We also agree that “repeat after me” feature was a bad idea. Here’s our take as a 9 year old bot company:

    https://medium.com/@botego/why-microsoft-s-chatbot-tay-failed-and-what-does-it-mean-for-artificial-intelligence-studies-fb71d22e8359#.wc3nalgzx



Leave a Reply

Your email address will not be published. Required fields are marked *

Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.