SLIDE 1
Team
Ricardo Henriquez
Electrical
Jonathan Azevedo
Computer Systems
2
Ryan Lagasse
Computer Systems
Zipcart Team 26: Ryan Lagasse, Ricardo Henriquez, Jonathan Azevedo - - PowerPoint PPT Presentation
Zipcart Team 26: Ryan Lagasse, Ricardo Henriquez, Jonathan Azevedo - - PowerPoint PPT Presentation
Zipcart Team 26: Ryan Lagasse, Ricardo Henriquez, Jonathan Azevedo Team Ryan Lagasse Ricardo Henriquez Jonathan Azevedo Computer Systems Electrical Computer Systems 2 Motivation 3 Universal Product Codes (UPCs) Unique, twelve-digit
SLIDE 2
SLIDE 3
Motivation
3
SLIDE 4
Universal Product Codes (UPCs)
- Unique, twelve-digit numbers that identify items
- Barcodes are machine-readable
4
Digits Code 1 – 6 Manufacturer ID 7 – 11 Item ID 12 Check Digit
SLIDE 5
Reading UPCs with Computer Vision
5
SLIDE 6
Challenges
- Read moving barcodes at unpredictable angles
- Operate at the embedded scale
- Done in a way that comes natural to shoppers
6
SLIDE 7
Requirements
- 1. Recognize barcode as item is placed in cart
- 2. Detect when item is removed from cart
- 3. Display item list and current balance
- 4. Detect an unscanned item to prevent theft
- 5. Sustain power for a full business day
7
SLIDE 8
Specifications
- 1. 18 hours of continuous operation
- 2. One item entered/removed per two-second interval
- 3. Barcode surface must be reasonably flat
- 4. Maximum system latency: four seconds
8
SLIDE 9
Competitors
9
SLIDE 10
Design Alternatives
- Barcode Scanner
- Multiple Cameras
- Dedicated Display Terminal
10
SLIDE 11
- Single camera mounted to cart
- Mirrors used see around product
- Cloud services
- Intermediary between system and application
- Android smartphone application
- Display item list and current balance
11
Our Approach
Mirror Mirror Mirror
SLIDE 12
Block Diagram
12
Smartphone
Application Payment
Feedback System
LED Strip
Power Supply
Li-ion Battery Regulator DC Motor
UPC UPC Info
Optics System
Mirror Camera
Feed
Cloud Endpoint Cloud Database
- Product DB/Cache
- Item Register
Detection System
Microprocessor
VDD
SLIDE 13
Block Diagram
13
Smartphone
Application Payment
Feedback System
LED Strip
Power Supply
Li-ion Battery Regulator DC Motor
UPC UPC Info
Optics System
Mirror Camera
Feed
Cloud Endpoint Cloud Database
- Product DB/Cache
- Item Register
Detection System
Microprocessor
VDD
SLIDE 14
Optics System
14
Cart, Top-Down Perspective Front Front Left Right Back
Mirror Mirror Mirror
SLIDE 15
Smartphone
Application Payment
Feedback System
LED Strip
Call Data
- Product DB/Cache
- Item Register
Optics System
Mirror Camera
Detection System
15
Power Supply
Li-ion Battery Regulator DC Motor
Cloud Endpoint Cloud Database
- Product DB/Cache
- Item Register
Image UPC
Detection System
Microprocessor
VDD
SLIDE 16
Detection System
- Computer Vision algorithm
- Read UPCs from barcodes
- Network interface
- Send UPC, action to cloud
- Small, embedded platform
16
POST /cloud/order/3214 HTTP/1.1 Barcode: 07314916939 POST /cloud/order/3214 HTTP/1.1 Barcode: 07314916939 DELETE /cloud/order/3214 HTTP/1.1 Barcode: 07314916939
SLIDE 17
Smartphone
Application Payment
Feedback System
LED Strip
Call Data
Optics System
Mirror Camera
Feedback System
17
Power Supply
Li-ion Battery Regulator Circuit DC Motor
Cloud Endpoint Cloud Database
- Product DB/Cache
- Item Register
Feed UPC
Detection System
Microprocessor
VDD
SLIDE 18
Feedback System
18
- Intent is to differentiate a good scan from a bad one
- LED strip along inner edge of cart
- Green = good scan
- Red = bad scan
SLIDE 19
Smartphone
Application Payment
Feedback System
LED Strip
Call Data
Optics System
Mirror Camera
Image
Power Supply
19
Power Supply
Li-ion Battery Regulator Circuit DC Motor
Cloud Endpoint Cloud Database
- Product DB/Cache
- Item Register
UPC
Detection System
Microprocessor
VDD
SLIDE 20
- Self-sufficient to avoid charging
- DC Motor to generate power mechanically
- Brushed DC Motors typically 75-80% efficient
- Regulator circuit to produce constant and stabilized voltage
20
Power Supply
SLIDE 21
Smartphone
Application Payment
Cloud Database
Feedback System
LED Strip
Power Supply
Li-ion Battery Regulator Circuit DC Motor
Call Data
- Product DB/Cache
- Item Register
Optics System
Mirror Camera
Feed
Cloud Platform
21
UPC
Detection System
Microprocessor
VDD
SLIDE 22
Cloud Platform
- Track orders with database
- Manage product information
- Request from UPC API
- Cache results in local database
22
SLIDE 23
23
GET api.barcodelookup.com/{…} HTTP/1.1 Response: UPC: 073149169396 Product: Sterilite File Crate Price: 5.97 USD
SLIDE 24
Smartphone
Application Payment
Feedback System
LED Strip
Call Data
- Product DB/Cache
- Item Register
Optics System
Mirror Camera
Feed
User Interface
24
Power Supply
Li-ion Battery Regulator Circuit DC Motor
Cloud Endpoint Cloud Database
- Product DB/Cache
- Item Register
UPC
Detection System
Microprocessor
VDD
SLIDE 25
User Interface
- Display item register, balance
- Enables a path to payment implementation
- i.e. Samsung Pay, Venmo
25
SLIDE 26
Schedule of Work
26
10/1 10/8 10/15 10/22 10/29 11/5 11/12 11/19 11/26 12/3 12/10 12/17 12/24 Benchside #1 Detection Install OpenCV Barcode Detection(Still Photo) Barcode Detection(Video Feed) UPC Recognition UPC Lookup Add Items to Cart Balance Remove Items from Cart Balance Detect Missed Items Power Planning DC Motor Regulator Circuit Booster Circuit Battery Protection Circuit Li-ion Battery PDR Benchside #2 MDR Thanksgiving Break Feedback System Integration Order Tracking Theft Detection App Interface, Android Website Shopping Cart Install LEDs Mount Camera Install Mirrors Calibration
SLIDE 27
Bill of Materials
27
Raspberry Pi Camera Intel Movidius Visual Compute Stick Android Phone Shopping Cart Mirrors DC Motor(s) VRUZEND Battery Kit Li-ion Battery Cells PCB RGB LED Strip
SLIDE 28
MDR Deliverables
28
- Detect barcode around 180° of camera perspective
- Successful integration of feedback system
- Update cloud database with product information
- Show power generation using DC Motor
SLIDE 29