Better Business Butler P19591 Kollin Brakefield, Jed Katz, Marissa - - PowerPoint PPT Presentation

▶

Dec 08, 2023 29 likes •271 views

Phase IV Gate Review Better Business Butler P19591 Kollin Brakefield, Jed Katz, Marissa McCarthy, Rory McHenry, Tom Papish, Joel Yuhas Agenda Use Cases List of Software System Block Diagram Benchmarking Functional

SLIDE 1

Phase IV Gate Review Better Business Butler P19591

Kollin Brakefield, Jed Katz, Marissa McCarthy, Rory McHenry, Tom Papish, Joel Yuhas

SLIDE 2

Agenda

Use Cases
System Block Diagram
Functional Decomposition
Team Breakdown by Subsystem
Web & Database Structure
Back End Structure
List of Software
Benchmarking
Test Plans
Human Subject Testing Update
MSD II Preview
Henry’s Demo Questions

SLIDE 3

Use Cases

SLIDE 4

FOV: 62.2° H x 48.8° V

Podium with Camera Wall Mounted Interface

SLIDE 5

SLIDE 6

“Hello Mr. Destler. Please follow me to your table…”

SLIDE 7

Kitchen Interface

It appears as if Bill Destler and Dave Munson are here

SLIDE 8

System Block Diagram

SLIDE 9

Functional Decomposition

SLIDE 10

Team Breakdown By Subsystem

SLIDE 11

Web Front End Structure

SLIDE 12

Database Structure

Member data will be stored in a datatable to go from the face detection backend to the web front end.

SLIDE 13

Back End Structure

SLIDE 14

List of Software

SOFTWARE Functionality Software Webserver Node .Js Flask Facial Recognition FaceNet Microsoft API Data Storage Python SQL Pandas Detection/Image Resize OpenCV Connection TCP Interface JavaScript HARDWARE Functionality Hardware Camera Preprocessing Raspberry Pi 3b Picture Taking Camera System Control and Facial Recognition Server PC Displaying Information Interface Ipad Phone PC SOFTWARE MODULES Title Description RP Detection Sender Sending detections form images captured at the Raspberry Pi camera Embedding Relay Server Receive a detection and send out Face ID Interface Client Side Fetches and Displays recent profiles Main Server Manage data transmission and system logic

SLIDE 15

Benchmarking - Camera

Name Resolution [px X px] FOV [Degrees] FPS Price [USD] Dericam 1080p 1920x1080 75 30 $24.99 Logitech HP Pro C920 1920x1080 78 30 $44.99 Dericam 720p 1080x720 55 30 $19.99 EIVOTOR 720p Webcam 1280x720 ?? 30 $21.99 Logitech C270 1280x720 ?? ?? $19.99 Foscam Home Security Cam 1280x720 75 30 $39.99 ELP USB Camera 1920x1080 ~80 30 $45.99 ELP 2.1mm USB Camera 2592x1944 (maximum) ~60 8 (30 FPS Max) $43.00 ELP USB Camera for Machine Vision 2592x1944 (maximum) ~60 15 (30 FPS Max) $48.99

SLIDE 16

Benchmarking - Face Recognition

Facenet will be the primary facial recognition software

Long term benefits to independent and offline FR
Low opportunity cost to switch from Facenet to Microsoft API in the event

Facenet doesn't workout

Name Response Time (1 Face) Max Faces in Photo Programing Languages Image Size Max Calls Internet Connection Required Microsoft API 2s - 6s (depends on internet and attributes) 64 Any 4MB (max) 20 per min Yes Facenet 1s - 2s Variable Python 200KB Infinite No

SLIDE 17

Benchmarking - Server Hardware

Graphics Card/ GPU Name Core Memory PSU Req' Ram Req' Card Bus Port Type List Price Product Link Clock Speed Count Bandwidth Clock Speed Size Bus Width NVIDIA Tesla K10 745 MHz 3072 320 GB/s 5000 MHz 8 GB 512 bits 300W 16GB PCI-E x16 3.0 $178.44 Link NVIDIA Tesla K20X 732 MHz 2688 250 GB/s 5200 MHz 6 GB 384 bits 300W 16GB PCI-E x16 2.0 $99.99 Link ASUS ROG Strix RX 560 1285 MHz 1024 112 GB/s 7000 MHz 4 GB 128 bits 300W 8 GB PCI-E x8 3.0 $139.99 Link Intel NCSM2450.DK1 Movidius 600 MHz 12 400 GB/s 1066 MHz 2 MB 32 bits 7.5W 1GB USB $79.00 Link Pre-built Desktop Name CPU Speed Cores RAM Storage PSU Price Link Best-Fit GPU HP Elite 8200 High Performance SFF Business Desktop i3-2100 3.1 GHz 2 16 GB 2 TB HDD 240W $185.00 Link nVidia Tesla K10 HP Compaq Pro 6300 SFF Desktop i3-3220 3.3 GHz 2 16 GB 2 TB HDD 240W $210.00 Link nVidia Tesla K10 HP Elite 6300 Pro High Performance SFF Business Desktop i3-2100 3.1 GHz 2 8 GB 1 TB HDD 240W $146.03 Link ASUS ROG Strix RX 560 HP Elite 8300 SFF Desktop i5-3470 3.2 GHz 4 8 GB 500 GB HDD 240W $166.50 Link ASUS ROG Strix RX 560 500W Power Supply Upgrade List Price Link Comments Apevia ATX-RP500W Raptor $23.99 Link For the nVidia & Asus processors

SLIDE 18

Test Plans

SLIDE 19

S1 & S3 Test Plan

Test Goal:

Ensure the time from when a face is detected to when embedding

and compression of image is complete is less than 5 seconds

Test system's ability to ignore noise by testing with “null” subjects

with a false-positive rate of 5% at worst

Testing Parameters

Sample Size = 134 6 Human Subjects - Each subject will each complete runs Neutral Facial Expression (x3) Happy Facial Expression (x3) Angry Facial Expression (x3) Hat (x3) Coat (x3) Glasses (x3) Hat, Glasses & Coat (x3) 8 Null Subjects with Plain White Paper (x2) Plain Black Paper (x2) White Paper with Multicolor Drawings of faces (x2) White Paper with Multicolor Scribbles to Represent Noise (x2)

SLIDE 20

Human Subject Research Office

Heather Foti confirmed on November 26th that our project “does not fit the

federal definition of research with human subjects”

Team will move forward with caution when testing with humans
All subjects will still sign a photo release form prior to submitting to testing

Takeaway: There is no longer an ethical risk associated with testing with human subjects

SLIDE 21

MSD II - High Level Activities

Activity Importance Henry’s Walk-through To collect key measurements and answer questions for our system design Purchase Parts Begin system build and integration Execute Tests To verify our system is designed to meet engineering requirements Henry’s Proof-of-Concept Run To test our system in the target environment and to collect data relevant to the handoff to the next MSD Team

SLIDE 22

Henry’s Demo Questions

Can we assume that all subjects will enter the floor through the main elevator?
Where is an appropriate place to put the server?
Can we mount a television near the POS System?
When can we access Henry’s to record information regarding set-up?

SLIDE 23

Questions?

SLIDE 24