MYSTIQUE THE FIGHT AGAINST REGO PLATE CLONER Agustinus Nalwan Head of AI Carsales.com.au
Carsales • Car Buying & Selling • Private and Dealer • +230k cars • 5000 new cars /day • Bikes, boats, trucks, …
A LITTLE BIT ABOUT MYSELF AI 4 YEARS
WEEKENDS PROJECT
WIFE’S QUESTION
WHAT SHOULD I WEAR TODAY?
WHAT SHOULD I WEAR TODAY?
WHAT SHOULD I WEAR TODAY?
MVP CLOTHES DAIRY MOBILE APP
FIRST STEP AUTOMATIC OUTFIT CAPTURE
CHALLENGES Mother In Law Problem
Mother In Law Avoidance Subroutine SEVERAL WEEKENDS LATER
MYSTIQUE THE FIGHT AGAINST REGO PLATE CLONER
AI PRIVACY
MYSTIQUE PROTECT PRIVACY
WHAT IS REGO CLONNING?
GREG
GREG’S CAR COAD133
HIS CAR COAD133
CRIMINAL ACTIVITIES
HAPPENED TO MANY OTHERS PRIVATE AND DEALER
“In 2017, a single dealer received more than $16,000 in fines as a result of a cloning incident”
VICTORIA $20 million fuel theft / year
SOLUTION
MYSTIQUE DETECT AND BLUR REGO PLATES
HOW DOES IT WORK
HOW DO WE BUILD IT
REGO DETECTION TECH
AMAZON SAGEMAKER OBJECT DETECTION ALGORITHM
AMAZON SAGEMAKER 1,500 images • 2 weeks dev • time 1.5 weeks data • preparation
BLURRING API "bboxArea": { "x1": 497, "y1": 247, AND "x2": 536, "y2": 273 }
ONE WEEK AFTER THE PILOT...
FALSE POSITIVE
FALSE POSITIVE
BIAS TRAINING SET
TRAINING SET
Positive Sample
Positive Sample Negative Sample
AMAZON SAGEMAKER TRAINING
MANDARIN COME TO THE RESCUE
AMAZON SAGEMAKER Rego Plate (x1, y1, x2, y2)
GENERATING NEGATIVE SAMPLES
AMAZON SAGEMAKER Rego Plate (x1, y1, x2, y2) Mandarin (x1, y1, x2, y2)
COMPARISON False Positive Rate 19% 0.5% Old Model New Model
IMAGES
IMAGE METADATA ● Orientation ● Color Profile
OTHERS Formats (HEIC, PNG, GIF)
GO LIVE!
STATS ● 150,000 Photos / Day ● 8 Sec Response Time ● 0.5 % False Positive ● 3.0 % Miss Blurring
MONITORING ● SumoLogic ● Prometheus ● Customer Service Feedback
SUMOLOGIC MONITORING
PROMETHEUS
Cost CPU RAM
CUSTOMER SERVICE FEEDBACK
POSITIVE FEEDBACK “One of our plates were cloned online and racked up several red light tolls. Wasted 2 months and a lot of money on this. Now, at least I have a sense of security with Mystique ” - Dealer M
UNEXPECTED FEEDBACK “Hi Team. My number plate has been cloned as confirmed by VIC police. Kindly blur my number plates for the car please. Thanks” - Seller A
NEGATIVE FEEDBACK ● Some people do not want blurring
NEGATIVE FEEDBACK ● Photos were wrongly blurred
EXISTING FEEDBACK SYSTEM SLACK CHANNEL
IMPROVEMENT
NEW FEEDBACK SYSTEM Update & Retrain Reported Feedback and Fix MYSTIQUE Draw Bounding Box Wrongly Blurred Image
NEW FEEDBACK SYSTEM
FUTURE CAN WE DO BETTER?
GENERATIVE ADVERSARIAL NETWORK
PLATE REMOVAL
TAKEOUT • AI vs Privacy • Monitoring Tools • Self Reporting
THANK YOU
QUESTION?
Recommend
More recommend
