Beta Presentation Image Recognition, Annotation and Validation - - PowerPoint PPT Presentation

From Students… …to Professionals

The Capstone Experience

Beta Presentation Image Recognition, Annotation and Validation Mobile Application

Department of Computer Science and Engineering Michigan State University Fall 2018

Team Whirlpool

Shruti Avutapalli Jessica Clappison Jackie Li Savanna Pinkoski Jack Turak

Project Overview

Problem:

• Lack of realistic training photos to achieve high
• bject recognition accuracy.

Project Objective:

• Improve Yummly’s image recognition data model.
• Collect annotated photos from Whirlpool

employees.

• Evaluate correctness of annotations through

validation interface.

The Capstone Experience Team Whirlpool Beta Presentation 2

System Architecture

The Capstone Experience Team Whirlpool Beta Presentation 6

Android iOS Firebase TensorFlow Lite Storage Authentication User Creation/Sign-In Image Storage Cloud Functions Backend API Admin Dashboard

Image Capture Interface

The Capstone Experience Team Whirlpool Beta Presentation 7

Annotation Interface

The Capstone Experience Team Whirlpool Beta Presentation 8

Annotation Interface: Completed

The Capstone Experience Team Whirlpool Beta Presentation 9

Validation Interface

The Capstone Experience Team Whirlpool Beta Presentation 10

Admin Dashboard

The Capstone Experience Team Whirlpool Beta Presentation 10

Admin Dashboard

The Capstone Experience Team Whirlpool Beta Presentation 10

What’s left to do?

• Testing
• User feedback
• Bug fixes
• Edge cases
• UI Design Finalization
• Documentation

The Capstone Experience Team Whirlpool Beta Presentation 10

Questions?

The Capstone Experience Team Whirlpool Beta Presentation 11

? ? ? ? ? ? ? ? ?