ERP Air Force: Conservation Threat Detection The Capstone - - PowerPoint PPT Presentation

erp air force conservation threat
SMART_READER_LITE
LIVE PREVIEW

ERP Air Force: Conservation Threat Detection The Capstone - - PowerPoint PPT Presentation

Project Plan ERP Air Force: Conservation Threat Detection The Capstone Experience Team Evolutio Maddie Jones Jason Kirsch Qingyang Li Logan McDonald Drew Schnieller Department of Computer Science and Engineering Michigan State University


slide-1
SLIDE 1

From Students… …to Professionals

The Capstone Experience

Project Plan ERP Air Force: Conservation Threat Detection

Team Evolutio

Maddie Jones Jason Kirsch Qingyang Li Logan McDonald Drew Schnieller Department of Computer Science and Engineering Michigan State University Spring 2020

slide-2
SLIDE 2

Functional Specifications

  • Protect wildlife in Southern Africa
  • Identify and classify threats using drones
  • Monitor sudden changes in landscape
  • Clearly communicate threats through visual

interface

  • Silently convey information to Ranger without

use of visual display

  • All as close to real-time as possible

The Capstone Experience Team Evolutio Project Plan Presentation 2

slide-3
SLIDE 3

Design Specifications

  • User interface organizes relevant information

about threats and allows the user to interact with the system

  • Displays location of perceived threats in

relation to ranger

  • Small vibration motors in the shoulders and

back of the vest can alert rangers of direction and distance of nearby threats

The Capstone Experience Team Evolutio Project Plan Presentation 3

slide-4
SLIDE 4

Screen Mockup: Raspberry Pi Screen

The Capstone Experience Team Evolutio Project Plan Presentation 4

Main Screen/Map

slide-5
SLIDE 5

Screen Mockup: Raspberry Pi Screen

The Capstone Experience Team Evolutio Project Plan Presentation 5

LIST

slide-6
SLIDE 6

Screen Mockup: Raspberry Pi Screen

The Capstone Experience Team Evolutio Project Plan Presentation 6

New Threat

slide-7
SLIDE 7

Screen Mockup: Raspberry Pi Screen

The Capstone Experience Team Evolutio Project Plan Presentation 7

Responded Threat

slide-8
SLIDE 8

Screen Mockup: Raspberry Pi Screen

The Capstone Experience Team Evolutio Project Plan Presentation 8

Direction/Respond

slide-9
SLIDE 9

Technical Specifications

The Capstone Experience Team Evolutio Project Plan Presentation 9

  • Perception
  • Object Detection
  • Semantic Segmentation
  • Mapping
  • Detection Tracking
  • Threat classification
  • Logging
  • Action
  • Threat Response
  • Vibration Vest Alert
  • HMI Alert
slide-10
SLIDE 10

System Architecture

The Capstone Experience Team Evolutio Project Plan Presentation 10

Drone NVIDIA Jetson

Object Detection

Sensor Data

Semantic Segmentation

Ranger

Detection Tracking Threat Classification Threat Response Data Logging

Ranger Data Threat Data

Vibration Controller Vibration Motor GPS User Interface

slide-11
SLIDE 11

System Components

  • Hardware Platforms

▪ Drone ▪ NVIDIA Jetson ▪ Raspberry Pi ▪ Grove Vibration Motor

  • Software Platforms / Technologies

▪ Ardupilot ▪ Darknet / YOLO ▪ Tensorflow ▪ Tkinter

The Capstone Experience Team Evolutio Project Plan Presentation 11

slide-12
SLIDE 12

Risks

  • Detect Changes in Environment

▪ Identifying sudden changes in landscape; ie fires, floods ▪ Mitigation: Semantic Segmentation

  • Wearable technology for threat directions

▪ Alert rangers to the location of the threat without them having to look at a device ▪ Mitigation: Device with vibration sensors on vest

  • Ranger/drone/sensor connection

▪ Rural environment with unreliable internet service ▪ Mitigation: Use a wi-fi enabled device for the UI

  • Amount of available training data

▪ Most of the footage is of elephants, limited footage of vehicles and people ▪ Mitigation: Finding images and footage online that will satisfy our training needs

The Capstone Experience Team Evolutio Project Plan Presentation 12

slide-13
SLIDE 13

Questions?

The Capstone Experience Team Evolutio Project Plan Presentation 13

? ? ? ? ? ? ? ? ?