Team 2013 Weekly Presentation #2 10/6/2019 - 10/12/2019 Progress - - PowerPoint PPT Presentation

Team 2013 Weekly Presentation #2

10/6/2019 - 10/12/2019

Progress

• Submitted Problem Statement on September 30th
• Beginning research on IoT testing/verification (in general terms)
• Meeting with sponsor to answer questions from last week
• Research on specific IoT testing methods

The Problem

• Many IoT devices - need one way to test

them

• Focus on HVAC
• System composed of

○ Machine - sensors push data to cloud through a gateway ○ Cloud - stores/analyzes data ○ Interface - usually mobile/web app to monitor data and/or control machine (actuators)

• Our focus: end-to-end communication

between gateway and interface

Carrier Wi-Fi thermostat

Simple IoT Architecture

Types of HVAC Systems

• Heat Pump
• Rooftop Unit
• Water Source Heat Pump
• Packaged HVAC
• Split System HVAC
• Ductless System

Heat Pump

Technologies Used in IoT

• RFID - uses radio frequency
• NFC - mostly used in mobile devices
• Bluetooth - close range wireless comm
• Z-Wave - low power RF tech. Mainly used for

home automation (lamp controlling, etc.)

• Wi-Fi - most common in IoT
• 2G/3G/4G/5G
• Others

RFID

Goals of IoT Verification/Testing

• Performance - speed of data transfer
• Scalability/Reliability - how scalable and reliable is the system
• Cost/time reduction
• Automation - testing process should do most of the work
• Compatibility - process should apply to many different devices

Types of IoT Testing

• Usability: How useful is the device? Can it provide the necessary data?
• Compatibility: Many devices, different hardware/software
• Reliability and scalability: Simulations to ensure reliability and scalability of
• device. Can we add more devices to the system?
• Data integrity: Lots of data, needs to be verified
• Security: Many users accessing lots of data, need authentication (passwords,

encryption, etc.)

• Performance: Speed of acquiring/transferring data

Gray Box Testing

• Probably used in this project
• Develop test cases for a system that is only partially understood

○ Might know how the systems interact with each other, but not sure how each system works ○ Info, documentation, source code are limited

Challenges to Consider

• Complexity of hardware-network-software mesh
• Device interaction in real time

○ security, backward compatibility, upgrade issues

• Real-time data testing
• Many different UIs
• Network availability/strength/etc

Sponsor Tasks so Far...

• Research and/or develop various IoT testing/verification methods and

reference IoT architectures

○ In practice (used by companies) ○ Theoretical (method exists, but no practical application) ○ Created by us

• Focus on gateway-cloud-application interaction
• Verification goals: Performance analysis and data integrity

○ E.g. Changing temperature on app - How long until this change takes effect on the thermostat? How long until this is reflected on app? ○ Need a way to automatically verify data in system ■ To accomplish these, need access to data on both gateway and interface/app ○ Start with simple system (1 app, 1 device), then move to more complex

• Deliverables

○ As defined in Carrier project statement

Possible Testing Methods/Tools

• Check network latency (e.g. ping command in cmd)
• Wireshark

○ Free and open-source software for analyzing packets sent over the internet (data integrity and transfer speeds)

• Build small IoT systems and run simulations (IoTIFY)

IoTIFY process

Example of IoT Testing Architecture

• In this system the main testing features were

○ Interoperability ○ Conformance ○ Semantics Validation

What to Do Next...

• Figure out:

○ Technologies that Carrier uses for IoT ○ How these systems interact with each other ○ What tools can be used

• Ask for a model
• Find out which verification goals we should focus on
• Define a reference IoT architecture (focus on HVAC)
• Get answers to questions in problem statement

References

1. https://www.guru99.com/iot-testing-challenges-tools.html 2. https://www.softwaretestinghelp.com/internet-of-things-iot-testing/ 3. https://www.buildings.com/news/industry-news/articleid/21020/title/drive-hvac- efficiency-with-internet-of-things-functionality 4. https://www.propmodo.com/how-iot-is-taking-over-the-hvac-industry/ 5. http://twentyonecelsius.com.au/blog/everything-you-need-to-know-about-hvac- systems/ 6. https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8281514