Tim Walpole Using big data to unlock the delivery of personalized, - - PowerPoint PPT Presentation

tim walpole
SMART_READER_LITE
LIVE PREVIEW

Tim Walpole Using big data to unlock the delivery of personalized, - - PowerPoint PPT Presentation

Tim Walpole Using big data to unlock the delivery of personalized, multi-lingual real-time chat services for global financial service organizations Cognitive Architect About the Speaker Head of Mobile Cognitive Architect Passionate about


slide-1
SLIDE 1

Tim Walpole

Cognitive Architect

Using big data to unlock the delivery of personalized, multi-lingual real-time chat services for global financial service organizations

slide-2
SLIDE 2

Tim Walpole

About the Speaker

Head of Mobile Cognitive Architect 30 years working as a IT consultant Passionate about designing and delivering complex IT solutions

slide-3
SLIDE 3

About BJSS

TH THE UK’S ’S LARGEST T PRIV IVATE TELY-OWNED OWNED I. I.T.

  • T. & BUSIN

INESS CONSULTA TANCY

>1000 staff in the UK and USA Culture of service and quality

slide-4
SLIDE 4

Todays Deck - Who, What and Why ?

Cognitive architects Chatbot developers Conversational designers

Who

Cloud Native, vendor agnostic, global chatbot architectures

What

Conversational design concepts

And now A vision of what's possible..

How to deliver personalized, real time content

slide-5
SLIDE 5

5

slide-6
SLIDE 6

Consumers are demanding

§ Increased Personalisation § Real-Time Insight-Based Decisions § Multi Channel Access (Including Voice)

Businesses need to

§ Become more Efficient & Reduce Costs § Improve Customer Engagement and Loyalty to Drive Revenue § Decrease the risk of Incidents / Compliance Violation

§ By using the power of Machine Learning

Why should I invest today?

slide-7
SLIDE 7

Chatbot Headlines 2018

Gartner

“By 2020, 85% of customer interactions will be managed without a human”

“By 2020, over 50% of medium to large enterprises will have deployed production chatbots” “By 2019, more than 10% of IT hires in customer service will be writing scripts for conversational bots” Bots will take over By 2021, more than 50% of enterprises will spend more per annum on bots and chatbot creation than traditional mobile app development. IT Hires Production chatbots

slide-8
SLIDE 8

Chatbot Headlines 2018

BJSS

Simple FAQ BOT

Personalized Conversational BOT’s Complex FAQ BOT’s

Time

Personalized BOT’s BOT Networks

Cost to Serve Increased Revenue & Loyalty Why

slide-9
SLIDE 9

Why Chatbots - Summary

Deliver 24/7 customer service Reduce the cost to serve Enable personalization Improve customer satisfaction and retention Lead to revenue growth 4 5 3 2 1

slide-10
SLIDE 10
  • Mizuho Bank uses Big Data

and Machine Learning to process consumer loan applications in 30 minutes.

  • Conversational robot workers

such as Pepper are being introduced to to to free up human stuff. Mizuho Bank

and HSBC, Pizza Hut …

slide-11
SLIDE 11

“What will my balance be at the end of the month?”

Understand the question

Invoke predictive algorithms

Find relevant data Present back in meaningful forms. Process data and produce result

AI & NLP Machine Learning Big Data Example of a User Story

slide-12
SLIDE 12

Chatbot Framework Components

slide-13
SLIDE 13

Why should I use an extensible framework?

Business Requirements

Vendor Agnostic Tooling Built in Approval & Signoff Processes Role based Security Automated CI / CD & Assurance Testable Locally Blue / Green Deployments A / B Testing Rich Analytics & Visualisation Tools Linked to Change control process for content Data Security / Compliance GDPR / Personal Data Requirements

It’ It’s rapidly changing market Sm Small provider ers are e ei either er bei being bo bought

  • u
  • ut, pivot
  • t or
  • r stop
  • p trading

g ! Te Technologies are evolving rapidly

AI Maturity

The There is a need to

  • evol

volve ve as AI AI ser ervices es matur ure. e.

Mo Most do some things well, bu but not ev ever erything wel ell. No No one provider does it all perfectly

Use an extensible framework

slide-14
SLIDE 14

BJSS has developed

An enterprise grade

Reference architecture + Conversational CMS + Accelerator Platform

Key Features

  • Low cost Cloud Native architecture
  • Available on AWS with Azure to follow
  • Infrastructure as Code deployment
  • Using best of breed AI / ML Services
  • Extensible and future proofed

BJSS Chatbot Accelerator

To be open sourced later this year

slide-15
SLIDE 15

Example Implementations

A A Vi Virtual As Assistant for a large fi financial provider A A USA A Educational As Assistant to he help students

§ Fi

Find the most appropriate college & course

§ St

Start, and compet ete e thei eir chosen en course

§ Pl

Place them in an appropriate Job.

§ Un

Unauthenticated FAQ’s

§ Au

Authenticated Ac Account Ac Access

§ Pl

Planning for Worldwide Deployment

slide-16
SLIDE 16

Reference Architecture (AWS)

Orchestration Step Functions

slide-17
SLIDE 17

Orchestration Step Functions

slide-18
SLIDE 18

Orchestration Step Functions

slide-19
SLIDE 19

Orchestration Step Functions

slide-20
SLIDE 20

Orchestration Step Functions Regional AI Services Regional AI Services

slide-21
SLIDE 21

Session Context Storage Orchestration Step Functions Regional AI Services

slide-22
SLIDE 22

Session Context Storage Orchestration Step Functions Regional AI Services

slide-23
SLIDE 23

Data Persistence (Encrypted) Session Context Storage Orchestration Step Functions Regional AI Services

slide-24
SLIDE 24

Client Connection- iOT Orchestration Step Functions Data Persistence (Encrypted) Session Context Storage Regional AI Services

slide-25
SLIDE 25

Orchestration Step Functions Client Connection- iOT Data Persistence (Encrypted) Session Context Storage Regional AI Services

slide-26
SLIDE 26

Orchestration Step Functions Client Connection- iOT Data Persistence (Encrypted) Session Context Storage Regional AI Services

slide-27
SLIDE 27

Orchestration Step Functions Client Connection- iOT Data Persistence (Encrypted) Session Context Storage Regional AI Services

slide-28
SLIDE 28

Lightweight Message Transport Protocol Low power & Low Bandwidth Bi-Directional Machine 2 Machine Communication Guaranteed Delivery (QOS) Standard protocol for Internet of Things Transport

Why iOT and MQTT

MQ Telemetry Transport

Available at very low cost on most cloud providers

slide-29
SLIDE 29

The hardest part of implementing a good Chatbot is the conversation design

Conversation Design

Our toolchain provides A Conversation Design Methodology A vendor agnostic Conversation Design tool To help you design and document complex chatbot conversations

Tone of Voice Smalltalk FAQ’s Fulfilment Personalization Conversation Flows Multi Language Quick Replies Handling Failure Delegation

slide-30
SLIDE 30

The Conversation Design Process

Elicit Intent Elicit Slots Confirm Intent Delegate Finish

I want a Pizza What type of Crust What toppings To confirm, you want a thin pizza with tomato and cheese Delegate to Billing Intent Eventually… Thanks for ordering, your pizza is on its way Conversation Lifecycle

slide-31
SLIDE 31

Intent Fulfilment (Personalization)

Detect Intent(s) Intent Resolution

Personalized Response

Personalize Response

Question

User & Session Context Conversation CMS

  • Dialogflow
  • Snips.ai
  • AWS LEX
  • Microsoft Luis

Live Agent Handoff

Sentiment Analytics

slide-32
SLIDE 32

Which NLP Engine?

Cost Language Detection

Chatbot Accelerator NLP Minimum Requirements

Intent Detection & Slot Filling Programmatic API’s for Intent selection Slot filling

Privacy

Dialogflow Snips.ai AWS LEX Microsoft Luis . . .

slide-33
SLIDE 33

Machine learning is helping computers spot arguments online before they happen

Personalization Big Data can be used to provide personalized, real time responses Conversations Gone Awry

Sentiment Analysis can be used to detect early Signs of

Conversational Failure Intent Fulfilment

How does Big Data Help?

Cornell, Google, and Wikimedia researchers train AI to predict when we’ll get angry on the internet:

Implement a ’toxicity’ filter

slide-34
SLIDE 34

Example - A ’toxicity’ filter https://www.perspectiveapi.com

slide-35
SLIDE 35
  • Focus on a low risk part of your

business to understand what works and what doesn’t.

  • AI is immature and still developing;

the best way to make progress is to rapidly prototype.

  • Start with a slim, but full stack

solution: UI, NLP, Machine Learning & Big Data running on public cloud.

  • Take an Agile approach to

deliver new products and services: Prototype, Alpha and then Beta.

What do I do next..

slide-36
SLIDE 36

Final thoughts

Script-Writing is one on the Biggest Challenges

Make sure you consider the ethics

  • f running your chatbot
slide-37
SLIDE 37

To be open sourced later this year Available now - Contact BJSS for further details The BJSS Chatbot Accelerator Rapidly delivering AI enabled, enterprise scale, strategic chatbots.

Tim Walpole

Cognitive Architect

Any questions

Tim.Walpole@bjss.com