Agustinus Nalwan Head of AI Carsales.com.au Carsales Car Buying - - PowerPoint PPT Presentation

▶
agustinus nalwan
SMART_READER_LITE
LIVE PREVIEW

Agustinus Nalwan Head of AI Carsales.com.au Carsales Car Buying - - PowerPoint PPT Presentation

Mar 11, 2024 519 likes •1.36k views

MYSTIQUE THE FIGHT AGAINST REGO PLATE CLONER Agustinus Nalwan Head of AI Carsales.com.au Carsales Car Buying & Selling Private and Dealer +230k cars 5000 new cars /day Bikes, boats, trucks, A LITTLE BIT ABOUT

slide-1
SLIDE 1

MYSTIQUE
 THE FIGHT AGAINST REGO PLATE CLONER

Agustinus Nalwan

Head of AI

Carsales.com.au

slide-2
SLIDE 2

Carsales

  • Car Buying & Selling
  • Private and Dealer
  • +230k cars
  • 5000 new cars /day
  • Bikes, boats, trucks, …
slide-3
SLIDE 3

AI

4 YEARS

A LITTLE BIT ABOUT MYSELF

slide-4
SLIDE 4

WEEKENDS PROJECT

slide-5
SLIDE 5

WIFE’S QUESTION

slide-6
SLIDE 6

WHAT SHOULD I WEAR TODAY?

slide-7
SLIDE 7

WHAT SHOULD I WEAR TODAY?

slide-8
SLIDE 8

WHAT SHOULD I WEAR TODAY?

slide-9
SLIDE 9

MVP CLOTHES DAIRY MOBILE APP

slide-10
SLIDE 10

FIRST STEP AUTOMATIC OUTFIT CAPTURE

slide-11
SLIDE 11
slide-12
SLIDE 12
slide-13
SLIDE 13

CHALLENGES

Mother In Law Problem

slide-14
SLIDE 14
slide-15
SLIDE 15

SEVERAL WEEKENDS LATER Mother In Law Avoidance Subroutine

slide-16
SLIDE 16
slide-17
SLIDE 17

MYSTIQUE
 THE FIGHT AGAINST REGO PLATE

CLONER

slide-18
SLIDE 18

AI PRIVACY

slide-19
SLIDE 19

MYSTIQUE PROTECT PRIVACY

slide-20
SLIDE 20

WHAT IS REGO CLONNING?

slide-21
SLIDE 21

GREG

slide-22
SLIDE 22

GREG’S CAR

COAD133

slide-23
SLIDE 23

HIS CAR

COAD133

slide-24
SLIDE 24

CRIMINAL ACTIVITIES

slide-25
SLIDE 25

HAPPENED TO MANY OTHERS

PRIVATE AND DEALER

slide-26
SLIDE 26

“In 2017, a single dealer received more than $16,000 in fines as a result of a cloning incident”

slide-27
SLIDE 27

VICTORIA $20 million fuel theft / year

slide-28
SLIDE 28

SOLUTION

slide-29
SLIDE 29

MYSTIQUE DETECT AND BLUR REGO PLATES

slide-30
SLIDE 30
slide-31
SLIDE 31

HOW DOES IT WORK

slide-32
SLIDE 32

HOW DO WE BUILD IT

slide-33
SLIDE 33
slide-34
SLIDE 34

REGO DETECTION TECH

slide-35
SLIDE 35

AMAZON SAGEMAKER

OBJECT DETECTION ALGORITHM

slide-36
SLIDE 36

AMAZON SAGEMAKER

  • 1,500 images
  • 2 weeks dev

time

  • 1.5 weeks data

preparation

slide-37
SLIDE 37

BLURRING API

"bboxArea": { "x1": 497, "y1": 247, "x2": 536, "y2": 273 } AND

slide-38
SLIDE 38

ONE WEEK AFTER THE PILOT...

slide-39
SLIDE 39
slide-40
SLIDE 40

FALSE POSITIVE

slide-41
SLIDE 41

FALSE POSITIVE

slide-42
SLIDE 42

BIAS TRAINING SET

slide-43
SLIDE 43

TRAINING SET

slide-44
SLIDE 44

Positive Sample

slide-45
SLIDE 45

Positive Sample Negative Sample

slide-46
SLIDE 46

AMAZON SAGEMAKER TRAINING

slide-47
SLIDE 47

MANDARIN COME TO THE RESCUE

slide-48
SLIDE 48

AMAZON SAGEMAKER

Rego Plate (x1, y1, x2, y2)

slide-49
SLIDE 49

GENERATING NEGATIVE SAMPLES

slide-50
SLIDE 50

AMAZON SAGEMAKER

Rego Plate (x1, y1, x2, y2) Mandarin (x1, y1, x2, y2)

slide-51
SLIDE 51

COMPARISON

False Positive Rate

19%

Old Model

0.5%

New Model

slide-52
SLIDE 52

IMAGES

slide-53
SLIDE 53
slide-54
SLIDE 54
slide-55
SLIDE 55
slide-56
SLIDE 56

IMAGE METADATA

  • Orientation
  • Color Profile
slide-57
SLIDE 57

OTHERS

Formats (HEIC, PNG, GIF)

slide-58
SLIDE 58

GO LIVE!

slide-59
SLIDE 59

STATS

  • 150,000 Photos / Day
  • 8 Sec Response Time
  • 3.0 % Miss Blurring
  • 0.5 % False Positive
slide-60
SLIDE 60

MONITORING

  • SumoLogic
  • Prometheus
  • Customer Service

Feedback

slide-61
SLIDE 61

SUMOLOGIC MONITORING

slide-62
SLIDE 62

PROMETHEUS

slide-63
SLIDE 63

CPU RAM Cost

slide-64
SLIDE 64

CUSTOMER SERVICE FEEDBACK

slide-65
SLIDE 65

“One of our plates were cloned online and racked up several red light tolls. Wasted 2 months and a lot of money on this. Now, at least I have a sense of security with Mystique”

  • Dealer M

POSITIVE FEEDBACK

slide-66
SLIDE 66

“Hi Team. My number plate has been cloned as confirmed by VIC police. Kindly blur my number plates for the car

  • please. Thanks”
  • Seller A

UNEXPECTED FEEDBACK

slide-67
SLIDE 67

NEGATIVE FEEDBACK

  • Some people do not want blurring
slide-68
SLIDE 68

NEGATIVE FEEDBACK

  • Photos were wrongly blurred
slide-69
SLIDE 69

EXISTING FEEDBACK SYSTEM

SLACK CHANNEL

slide-70
SLIDE 70

IMPROVEMENT

slide-71
SLIDE 71
slide-72
SLIDE 72

NEW FEEDBACK SYSTEM

MYSTIQUE

Wrongly Blurred Image Draw Bounding Box Reported Feedback and Fix Update & Retrain

slide-73
SLIDE 73

NEW FEEDBACK SYSTEM

slide-74
SLIDE 74

FUTURE CAN WE DO BETTER?

slide-75
SLIDE 75

GENERATIVE ADVERSARIAL NETWORK

slide-76
SLIDE 76
slide-77
SLIDE 77

PLATE REMOVAL

slide-78
SLIDE 78
slide-79
SLIDE 79
slide-80
SLIDE 80

TAKEOUT

  • AI vs Privacy
  • Monitoring Tools
  • Self Reporting
slide-81
SLIDE 81

THANK YOU

slide-82
SLIDE 82

QUESTION?