Gartner Blog Network

Worry Me, Natural Language Processing Doesn’t

by Adrian Lee  |  January 17, 2018  |  Submit a Comment


The Newsweek headline screamed, “Robots Can Now Read Better Than Humans, Putting Millions of Jobs At Risk”. I nearly drowned laughing into my morning coffee. It was a slow news day?

The story described a reading accuracy test that pitched Alibaba’s natural language processing (NLP) AI versus a ‘rival human’.  Yes, the robot outdid the human by a score of 82.44 versus 82.305. Yes, that’s right, a difference of 0.135.  The article did not continue on to reveal which were the millions of jobs at risk. So, the alarmist stance that massive job cuts were on the horizon didn’t worry me. Yet. To put things into perspective, Gartner currently has over 900 research articles on the topic of conversational platforms, with more than 46 different analysts investigating the area of conversational AI.

Oh, Natural Language Processing (NLP) is the comprehension by computers of the structure and meaning of human languages, allowing users to interact with the computer using natural sentences. NLP features are dynamic and are evolving within conversational platforms. The one refrain I have for our clients when I advise on conversational platforms is this: we have so much more to learn.

The ‘processing’ of structured language has increased dramatically, especially in the advancement of entity recognition, machine translation, and text categorization driven by ever faster and low latency machine learning instances in the cloud.  But the ‘understanding’ of meaning – inference, sentiment, relations, and variations, are still work in progress. Seek not to process, but to understand. By which, I refer to Natural Language Understanding (NLU), and that’s important. for you to see the big picture. Below. I meant it, literally.

We still need to make sure the semantic aspects of the technology work. This is what drives the ‘understanding’ of human by machine.  As chatbots proliferate across customer service, financial services, retail, government and even healthcare;  the ability of technology vendors to provide contextually aware, multiturn-based natural-language conversations  presents an ongoing challenge to natural language understanding (NLU) handling. This is especially the case in the areas of semantic parsing and natural-language inferences.

Ambiguities in semantics arise when there are multiple grammatical interpretations possible. “Giant road bike” and “Giant road bike” on a digital commerce site can mean very different outcomes if the semantics engine cannot infer that “Giant” refers to a brand of bicycle and not the size of the bike in question. But you already knew that.

I shall stop here. If you want to read more about NLP or NLU and how it impacts digital commerce, please click here. Or we could get that same bot to do it.

Either way, you shouldn’t let it worry you.

2018-01-18 03_55_44-ConversationalAI_Presentation_AL_15Jan2018 - PowerPoint

Additional Resources

View Free, Relevant Gartner Research

Gartner's research helps you cut through the complexity and deliver the knowledge you need to make the right decisions quickly, and with confidence.

Read Free Gartner Research

Category: conversational-ai  digital-commerce  

Tags: conversational-ai  conversational-platforms  deep-neural-networks  digital-commerce  machine-learning  natural-language-processing  natural-language-understanding  nlp  nlu  

Adrian Lee
Research Director
1 years at Gartner
15 years IT Industry

Adrian Lee focuses on providing advice and market guidance on the overall personal technology environment, encompassing devices, services, apps and ecosystems. Adrian brings a focus on B2C and B2B2C mobile applications in personal technologies and service provider markets. He advises brand, product marketing, sales leaders and other stakeholders on how to deploy digital advertising, branded content and e-commerce platforms to drive profitable revenue growth. He supports brand management teams on how to navigate disruptive innovation and tools to create best-of-breed user experiences. Read Full Bio

Leave a Reply

Your email address will not be published. Required fields are marked *

Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.