event,

Everything You Need to Know About Chatbots

Yan Wang Yan Wang Follow Jan 09, 2018 · 12 mins read
Everything You Need to Know About Chatbots

2018 has arrived, and upon waking up, various social media platforms have been flooded with “18 years old” posts. There are posts like this:

1_

And of course, posts like this:

2_

Already trapped in a normal distribution of confusion, I decided to consult my personal assistant - Siri

3_

This made me curious about how old Siri actually is.

4

Well, girls need to be mysterious to be beautiful. So let’s ask the famous Buddhist youth who sees through everything and doesn’t sweat the small stuff - Xian’er from Longquan Temple.

5

History of Chatbots

The world’s first chatbot was called ELIZA, now over 50 years old. It was developed by MIT professor Joseph Weizenbaum in the 1960s.

ELIZA was initially developed to simulate “the responses of a non-directive psychotherapist in an initial psychiatric interview,” testing how humans and machines communicate. It used scripts that could recognize certain patterns and keywords to generate responses. What Joseph didn’t expect was that ELIZA could communicate like a psychotherapist, even forming emotional connections with some people.

6

ELIZA inspired numerous chatbots like PERRY, ALICE, Mitsuku, Albert One, etc.

SmarterChild was among the most popular. Developed in 2000, this post-2000s bot is now approaching adulthood at 18 years old. It caught the wave of SMS services’ popularity and incorporated cutting-edge natural language processing capabilities, understanding human language and responding accordingly.

In 2002, a chatbot that made users worldwide laugh was born - SimSimi. Created by Korean tech company ISMaker, this app had a fresh, cute interface especially popular with girls. Since its mascot was a yellow chicken, it was nicknamed “Little Yellow Chicken” in China. This little yellow chicken became almost overnight famous for its humorous responses, sparking a human-chicken conversation craze online.

7

It utilized about 10 million question-answer dialogue pairs as its foundation, with vocabulary growing through user input. When Little Yellow Chicken had no data to respond with, users could choose the “teaching” tab to teach it new words. This made users feel like they were texting close friends, bringing warmth during lonely, cold moments.

8

Think chatbots can only be funny? You’re wrong. Siri was born in 2010, almost redefining chatbot functionality. This mysterious lady who keeps her age secret is actually only 8 years old this year!

Users can not only query and converse with Siri through messages but also enjoy text, audio, image, and video interactions. Additionally, Apple gave Siri a series of practical functions:

Reminders and memos? Small case!

9

Calling a ride? Easy job!

10

Too lazy to read emails? Siri reads them for you!

11

From making calls, finding routes, song recognition to setting alarms, she can help with anything you think of. How well can Siri chat?

12

Interestingly, when Siri was released, Eliza was brought out again for conversation. At that time, Eliza and Siri had a 45-year age gap and 2 million times memory difference.

After Siri, Amazon’s not-yet-4-year-old Alexa took chatbots further. She’s now built into various smart home devices like Amazon Echo, Echo Dot, Echo Show, Fire TV. All you need to do is say “Alexa, play some music” or “Alexa, turn on the TV” to easily command all home appliances. Amazon even allows developers to create and publish skills for Alexa using the Alexa Skills Kit (ASK). You can download skills for free using the Alexa app.

13

What about the age of that eternally cute, Buddhist youth Xian’er monk? This “sweeping monk” of the chatbot world was born on October 1, 2015, marking the 10th anniversary of his master’s leadership at Longquan Temple. He’s only 1.5 years old - monks indeed don’t lie. Despite being the youngest, listening to Xian’er’s words can purify the soul with Zen wisdom and guide life direction.

14_

Surging Commercial Applications

As messaging apps continue to surpass social media networks in usage, chatbots are becoming increasingly popular in business, with their continuous optimization and progress significantly changing enterprises. More businesses are introducing chatbots in customer service channels to replace poorly performing voice systems. Users no longer need to impatiently navigate through multiple systems to get information or communicate with human customer service. For businesses, chatbots can provide similar services to call centers at lower costs. If third-party developers can quickly develop feature-rich chatbots, more enterprises and merchants will use chat tools to establish communication channels with consumers and existing customers.

15

Chatbots achieved 170% growth in just 3 months

At the F8 developer conference in April 2016, Facebook announced chatbot capabilities for the Messenger platform, allowing businesses to provide various services like customer support, guidance, and interaction through instant messaging chatbots. Chris McCann, president of online flower retailer 1-800 Flowers, said that within months of launching chatbots on Facebook Messenger, “70% of company orders completed through chatbots were from new customers. These users were younger than the company’s typical users.” Chatbots clearly cater to millennials (born 1984-1995) who are becoming the main consumer force.

Meanwhile, traditionally aloof fashion brands like Burberry, Victoria’s Secret, and Tommy Hilfiger accelerated their chatbot adoption. You can browse the latest seasonal styles and product catalogs. Chatbots ask about your measurements, country, style preferences, etc., to help you choose products. If interested, you can choose to view items in detail or make purchases, immediately being taken to the brand website where entire product lines appear in various colors and sizes. They make you feel like someone’s shopping with you even when your best friend isn’t available.

16

Simultaneously, major domestic e-commerce platforms have long developed and introduced robot customer service with significant results. In 2016, Zhonghong Life Insurance introduced Ant Financial’s customer service capabilities - online customer service, automatic outbound calls, intelligent quality inspection - significantly improving operational efficiency and quality. Robot resolution rates reached 83%, outbound productivity increased 15%, and inbound productivity increased 10%.

17

Automatic responses and chatbots aren’t gimmicks or marketing activities but paradigms for new user interfaces. When users interact with businesses through messages, they feel like they’re having real conversations. This messaging interaction method has inherent reconnection functionality because users can truly interact with chatbots in messaging apps. The days of companies spending millions of dollars and years launching mobile applications are over.

How Chatbots Work

So how do chatbots actually work? Current chatbots fall into two main types: one operates based on a complete set of rules; the other is a more advanced version using machine learning. What does this mean?

Rule-based chatbots have very, very limited functionality. They can only respond to very specific commands. If you say something wrong, they don’t know what you mean. Most chatbots we introduced earlier use machine learning functionality: when you speak, you don’t need to be very specific. They understand language, not just commands. They learn from conversations with people, becoming increasingly smarter.

In machine learning: you need a sample set to train a classifier that can select from all possible content (e.g., buy tickets, check flight status, get details, etc.) given user input.

18

For example, “I want to go from Paris, France to Venice, Italy on January 31st.” In this scenario, understanding cities and dates in input and returning appropriate answers is crucial. The chatbot might search databases (or online queries) for flights from Venice to Paris on given dates. Therefore, chatbots need information extraction from input to obtain important entities: locations, flights, airports, dates, etc. Input classification and information extraction are two important concepts to always remember.

When discussing chatbots, we must mention NLP:

19

NLP (Natural Language Processing) is technology studying computer processing of human language, including syntactic semantic analysis, information extraction, text mining (or text data mining), machine translation, information retrieval, question-answering systems, and dialogue systems. It can perform word segmentation, part-of-speech tagging, named entity recognition and linking for given sentences, and extract important information from given text, such as time, place, people, events, causes, results, numbers, dates, currency, proper nouns, etc. Simply put, it’s about understanding who did what to whom, when, why, and with what results. This involves key technologies like entity recognition, time extraction, and causal relationship extraction. NLP can also achieve visualization and interactive expression interfaces for mined information and knowledge through text clustering, classification, information extraction, summarization, and sentiment analysis. When applied to chatbots, systems conduct conversations with users through dialogue series, answering questions and completing tasks. NLP involves user intent understanding, general chat engines, question-answering engines, and dialogue management technologies. To reflect context relevance, it also has multi-turn dialogue capabilities. Additionally, to reflect personalization, it develops user profiles and personalized responses based on user profiles.

20

Trump vs. Hillary: Sentiment Analysis on Twitter

Beyond chatbots, NLP technology is developing rapidly in deep learning fields, including word embeddings, sentiment analysis, sentiment neuron applications, and automatic summarization like automatic translation.

Development Ceiling

Around Chinese Valentine’s Day 2015, Microsoft released the third-generation Xiaoice on WeChat, allowing users to “adopt” it through official accounts. Xiaoice covered nearly 1.5 million WeChat group users in just 3 days of public testing, then was blocked by Tencent WeChat. In just three days, Xiaoice exploded on WeChat then instantly extinguished - rising rapidly and falling suddenly, appearing and disappearing like a flash in the pan.

Similarly, Microsoft faced Waterloo abroad. Tay was Microsoft’s AI chatbot designed specifically for 18-24 year olds, with a virtual age of 19. When she first appeared on Twitter, Tay was polite and well-mannered. She was lively and talkative, “observing” your nickname, gender, favorite foods, relationship status, etc. She’d play games, tell jokes, stories, discuss horoscopes… However, soon after launch, Tay’s behavior developed in uncontrollable directions. Under netizens’ “training,” this innocent American girl not only learned to be rude and curse constantly but also made statements involving racism, pornography, Nazism, full of discrimination, hatred, and prejudice. Microsoft had to urgently take Tay offline under enormous public pressure.

It’s hard to imagine Microsoft’s feelings after this series of incidents…

21

An intelligent chatbot can learn independently, becoming smarter over time, ensuring it basically understands everything you say. While machine learning is a great AI panacea, it’s also AI’s stumbling block. Like “Tay,” she was truly artificial intelligence, capable of communicating with humans through self-learning. But this very self-learning panicked Microsoft, forcing them to publicly apologize and clean up the mess.

Additionally, while many chatbots claim to be “artificial intelligence (AI),” most aren’t actually intelligent.

22

What do non-intelligent chatbots look like? For example, chatbots provided to businesses on Facebook Messenger only allow you to operate according to their pre-set patterns.

23

If you chat with chatbots on Facebook Messenger or WeChat official accounts, you’ll find these “intelligent” chatbots are currently just news push functions embedded in programs. If you try using Jello Labs’ Spring chatbot to buy shoes, you might only receive endless product recommendation messages.

Language is one of evolution’s most complex products. Combining human natural language power with advanced machine intelligence isn’t achieved overnight. Despite advanced storage technology and rapid machine learning development making chatbot creation seem simple, creating truly good interactive experiences still has many obstacles to overcome.

24

Now, it’s hard to imagine a world without Siri and other voice assistants, but a few years ago, talking to your phone to tell it what to do seemed ridiculous. Chatbots can schedule meetings, tell you the weather, and provide various support. This is just the beginning. It’s predictable that chatbots will definitely integrate into all aspects of life in the future, creating more surprises.

References:

  1. How chatbots could change customer service over the next 5 years
  2. Customer service and virtual assistant bots will be prevalent for online businesses in many markets
  3. Conversational Interfaces: The Future of Chatbots
  4. Burberry, Victoria’s Secret, Tommy Hilfiger: how major fashion retailers experiment with chatbots
  5. 11000个聊天机器人齐犯尴尬癌:用户对其爱不起来

Want to know more chatbot anecdotes? Want to learn how to make chatbots? Come join the 2018 Girl Tech Festival! Give yourself a growth opportunity in the new year. We’re waiting for you in Beijing on January 14th!

techiefestival-25 Click to view event details and registration

About DataGirls

DataGirls is an interesting and informative data analysis learning community focused on Chinese women, aiming to help more women become data-driven thinkers, using data-driven decisions to help them achieve high balance in career, family, and personal life, gaining independence, freedom, and happiness. Follow WeChat official account “DataGirls” for more information.



Chinese version of this post: 一文解读聊天机器人的前世今生


Chinese version of this post: all you need to know about chatbot

Join Newsletter
Get the latest news right in your inbox. We never spam!
Written by Yan Wang
现就读于悉尼大学商业数据分析 ,是Datagirls社区志愿者助教,两年数据分析师工作经历,拥有丰富的社科数据分析项目经验。