American Sign Group E Language Assistant Isabel Atanacio - EE - PowerPoint PPT Presentation

American Sign Group E Language Assistant Isabel Atanacio - EE Colin Fox - EE (ASLA) Charlie Munoz - EE Daniel Sarmiento - CpE

Motivation Group Background: ● Allows for Extensive Software work as well as Hardware implementation. ○ Develop something that truly helps society and those with disabilities. ● Desire to learn about: ● Microcontrollers, Sensors, Wireless Communication, Data Management, Machine Learning. ○ Improve previous projects. ●

Goals and Objectives Implement 3 basic American Sign Language Parameters: ● Hand Shape, Orientation, Location ○ Develop one Glove to translate hand gestures. ● Letters ○ Translate from gestures to text and speech ● Wireless Communication between gloves and computer ● Open for addition of new gestures to library ●

Project Specifications ● Flexible → Easy hand gestures. ● Weight = 2 lbs or less. ● Small PCB within a 2”x2” square. ● Bluetooth data transfer to interface. ● Implement all 26 letters. ● Text → Speech.

Hardware

Hardware Subsystems Sensors ● Wireless Communication ● Microcontroller ● Power ●

Hardware Block Diagram

Hardware Parts

Sensors - Flex Sensors 4.5’’ and 2.2’’ Flex sensors ● Power rating : 0.50 W continuous ● Linear Potentiometer ● Life Cycle > 1 million Flexes ● Manufacturer: Spectra Symbol ● Cost: $7.95-$12.95 ●

Sensors - IMU LSM6DS3: 6D orientation ● Gyroscope and Accelerometer ■ Dimensions: 2.5 x 3 x 0.83 mm ● Supply voltage: 1.71 V to 3.6 V ● Operates at 3.3V 1.25mA ● Manufacturer: ST Microelectronics ● Cost: $3.54 ●

Sensors - Contact Sensors Homemade Copper Tape Contact Sensors ● Switch functionality ● Functionality: ● Helps Differentiate similar signs ○

Wireless Communication Bluetooth vs WiFi ? ● Bluetooth uses 97% less power ○ Bluetooth ● RN 41: 100m range, 2400-115200 bps ○ Voltage supply: 3.3V-6V ● Power Consumption: ○ 25mA ● Manufacturer: Roving Networks ● Clost: $21.70 ●

Microcontroller - ATmega328P Controls the flow of data from the sensors to the computer. Dimensions: 7 x 7 x 1.2 mm ● Operating Voltage: 1.8 - 5.5 V ● Large Online Community ● 7mA draw ● Manufacturer: Atmel ● Cost: $6.95 ●

Power - Battery Lithium Polymer Battery 1200mAh ● Chosen based on ● estimated power consumption Estimated 4 hours of ● runtime

Power - Charger and Voltage Regulator Powercell Board Microchip MCP73831/2 ● Miniature Single-Cell Charge Controller ○ Control chip for battery charging ○ Price: $0.56 ○ Texas Instruments TPS61200 ● Low Voltage Boost Converter ○ Voltage regulator ○ Operating Voltage : 0.3 - 5.5 V ○ 300 mA at 3.3 V, 600 mA at 5 V ■ Price: $4.49 ○

Power - LiPo Voltage Monitor Maxim MAX17043G+U Operating Voltage: 2.5 - 4.5 V ● ±30 mV Accuracy up to 10 V ● Typical Current Draw: 50 � A ● I2C Interface to MCU ● Manufacturer: Maxim Integrated ● Cost: $3.28 ●

MCU

BLUETOOTH

VOLTAGE REGULATOR

BATTERY CHARGER

LiPo VOLTAGE MONITOR

IMU

FLEX SENSORS AND CONTACT SENSORS

Software

Software Block Diagram

Embedded Software Block Diagram

Updating Glove Angles Using Accelerometer and Gyroscope data ● Θ accel =atan(accel Z /accel X ) Θ new = α ( Θ old + Θ gyro *dT)+(1- α )( Θ accel )

Learning Block Diagram

Translating Block Diagram

Machine Learning Support Vector Machines ● Supervised classification learning ○ Very good with high dimensional ○ data Commonly used for gesture ○ recognition

Support Vector Machines Separates different classes ● of data with minimum error margin SVM are able to create ● non-linear fittings

Support Vector Machines With more training sets the ● fitting gets tighter and more irregular

Python vs C++ Python C++ + Easy, straightforward syntax + Creates an executable + No memory management + Faster at runtime + High-level native data types - Memory management - Requires python and - More code needed for libraries implementation - Slower than C++

Project Budget Item Quantity Cost/Unit Total 6 DoF IMU 1 $3.54 $3.54 Battery Voltage Monitor 1 $3.28 $3.28 Flex 4.5” 4 $12.95 $51.80 Flex 2.2” 1 $7.95 $7.95 Bluetooth 1 $21.70 $21.70 Dev Board 1 $6.00 $6.00 LiPo Battery 1 $12.95 $0.00 PCB and parts 1 $157.37 $251.64

Team Distribution Embedded Computer Sensors Bluetooth Microcontroller Software Software Isabel P S Colin S P S Charlie P S Daniel P P

Questions?