QualityDeepSense: Quality-Aware Deep Learning Framework for Internet - PowerPoint PPT Presentation

QualityDeepSense: Quality-Aware Deep Learning Framework for Internet of Things Applications with Sensor-Temporal Attention Shuochao Yao, Yiran Zhao, Shaohan Hu, Tarek Abdelzaher

DeepSense vs QualityDeepSense ● DeepSense ○ Unified neural network framework ○ Proved to be very good for mobile sensing and computing tasks ○ Does not consider noise/heterogenous qualily of the sensor data Solution!! ● QualityDeepSense ○ Modification of DeepSense to consider noise in the data ○ Uses sensor-temporal self-attention mechanism ○ Identify the qualities of input by calculating dependencies of their internal representation in DNN

Noise ● Low cost sensors ○ Insufficient accuracy, calibration & granularity ● Heavy multitasking & I/O workload ● May be due to other components of the system ● Noise do not determine the complex dependency between sensing inputs

Network Architecture

Data Flow ● Raw sensor data is divided across time for width t and a fourier transform is applied to each interval--Input of the network ● 3 Individual conv layers for extracting relations within a sensor ● Sensor Attention ● 3 Merge layers to extract relations between sensors ● RNN to extract temporal dependencies ● Temporal attention module ● Output (softmax)

Self -Attention ● Estimate sensing quality ○ Calculate internal dependencies ● Two steps ○ Calculate attention vector a ○ Weighted sum over rows using a ● To determine the dependencies among k-vectors

Evaluation ● Nexus-5 ○ 2.3GHz, 2GB memory, manually set to 1 .1 GHz ● TensorFlow-for-mobile ○ For DNN methods ○ Weka for SVM ● Dataset ○ 2-motion sensors-Accelerometer and gyroscope ○ 9 users with 6 activities (un-ordered) ○ Noise-augmented using white gaussian noise on either of time or frequency domain.

Accuracy Improvements

Effectiveness ● Attention ○ Multiplication of two attention modules ● Correlation b/w noise and Attention ○ Non-linear ○ Difference in sensing measurement ● Attention is small for strong noise

Execution time & Energy consumption

Overall ● QualityDeepSense performs better than DeepSense and is able to solve the heterogeneous quality sensing problem ● It shows lower performance degradation but with the expense of some execution time and energy consumption overhead ● There is no optimization done. Hyperparameter tuning & more network optimization can be done to reduce the overhead.

QualityDeepSense: Quality-Aware Deep Learning Framework for Internet - PowerPoint PPT Presentation

QualityDeepSense: Quality-Aware Deep Learning Framework for Internet of Things Applications with Sensor-Temporal Attention Shuochao Yao, Yiran Zhao, Shaohan Hu, Tarek Abdelzaher DeepSense vs QualityDeepSense DeepSense Unified neural

Deep Learning With Differential Privacy Presenter: Xiaojun Xu Deep Learning Framework

A Software Architecture Framework for Quality-Aware DevOps D. A. Tamburri , E. Di Nitto, M.

DEEP LEARNING FRAMEWORK FOR CYBER-ENABLED MANUFACTURING ADI DITY TYA A BALU SA SAMBIT IT

Hardness-Aware Deep Metric Learning Wenzhao Zheng , Zhaodong Chen, Jiwen Lu and Jie Zhou IEEE CVPR

Geometry-Aware Deep Visual Learning Katerina Fragkiadaki zebras How this talk fits the workshop

Uncertainty-Aware Food Recognition by Deep Learning Petia Radeva, Collaboration with: Eduardo

A Powerful, Flexible, and Intui5ve Deep Learning Framework Shohei Hido Chief Research Officer

Pluto A Distributed Heterogeneous Deep Learning Framework Jun Yang, Yan Chen Large Scale

RACC: Resource Aware Container Consolidation using a Deep Learning Approach Saurav Nanda,

DeClarE Debunking Fake News and False Claims using Evidence-Aware Deep Learning Kashyap

Imbalance Aware Lithography Hotspot Detection: A Deep Learning Approach Haoyu Yang 1 , Luyang Luo

Indigenous Knowledge Aware Drought Monitoring, Forecasting and Prediction using Deep Learning

MorphNet Elad Eban Faster Neural Nets with Hardware-Aware Architecture Learning Where Do

Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning Yu-An Chung 1 Hsuan-Tien Lin 1

3D Deep Clustering a clustering framework for unsupervised learning of 3D object feature

DEEP LEARNING FRAMEWORK FOR DIAGNOSTICS AND PATIENT-SPECIFIC DESIGN OF BIOPROSTHETIC HEART

c i f i c a DIgSILENT Pacific P Power system engineering and software T N Emerging

Motion Coordination and Other Distributed Control Problems for Large Networks of Agents Prabir

Disturbance Propagation in Leader- Follower Systems FOCUS Paolo Minero joint work with Yingbo

Distinguishing Causes from Effects using Nonlinear Acyclic Causal Models Kun Zhang 1 and Aapo

From Neural Networks to Music Technology for Healthcare: An Overview of Recent Research from IHPC

The Problem of the Divided Majority Preference Aggregation and Uncertainty ura-Georg Grani

Californias Previously Uninsured Residents Under the Affordable Care Act Wave 3 of the Kaiser

CICM2018: First Experiments with Neural Translation of Informal to Formal Mathematics