Challenges in the use of indoor navigation and augmented reality in - PowerPoint PPT Presentation

Challenges in the use of indoor navigation and augmented reality in complex space Zaharije Radivojević, Miloš Cvetanović, Saša Stojanović School of Electrical Engineering, Belgrade University Workshop “Cooperation at Academic Informatics Education across Balkan Countries and Beyond” Primošten, Croatia 2-8 September 2018

Agenda • Background • Indoor navigation • Augmented reality • Results • Conclusions DAAD CAIE BCB 2018 2/28

Mobile device programming course • Type: Elective course • Starts: 8 semester (of 8 semesters for bachelor studies) • Class hours: 2+2+1 Mobile deice programming not Mobile phone programming • Format: – Midterms 20 (10+10) – Laboratory 10 – Project 50 – Final 20 • Topics: – Android programming in Java – Sensors – GUI Patterns DAAD CAIE BCB 2018 3/28

Mobile device • GPS • Gyroscope/Accelerometer Input • Magnetometer/Compass • Camera • Microphone • Electromagnetic receivers (Wi-Fi, NFC, Bluetooth) • Speakers • Screen Output • Vibrations DAAD CAIE BCB 2018 4/28

Indoor positioning DAAD CAIE BCB 2018 5/28

Outdoor Positioning DAAD CAIE BCB 2018 6/28

Outdoor Positioning – indoor problems DAAD CAIE BCB 2018 7/28

Can other sensors be used for navigation? • Gyroscope/Accelerometer • Magnetometer/Compass • Camera • Microphone • Electromagnetic receivers (Wi-Fi, NFC, Bluetooth) DAAD CAIE BCB 2018 8/28

Indoor Positioning – solutions • Inertial navigation • Image processing • Beacon usage • Combining multiple sensors • Information regarding space • ... DAAD CAIE BCB 2018 9/28

Indoor Positioning – Inertial navigation DAAD CAIE BCB 2018 10/28

Indoor Positioning – Inertial navigation ~ results DAAD CAIE BCB 2018 11/28

Indoor Positioning – Inertial navigation DAAD CAIE BCB 2018 12/28

Indoor Positioning – Inertial navigation Good results DAAD CAIE BCB 2018 13/28

Indoor Positioning – Inertial navigation Excellent results DAAD CAIE BCB 2018 14/28

Indoor Positioning – Inertial navigation+ DAAD CAIE BCB 2018 15/28

Indoor Positioning – Image processing Space recognition Content recognition DAAD CAIE BCB 2018 16/28

Indoor Positioning – Electromagnetism Wi-Fi NFC Bluetooth DAAD CAIE BCB 2018 17/28

Indoor Positioning – Electromagnetism Trilateration DAAD CAIE BCB 2018 18/28

Augmenting reality • Speakers • Screen • Vibration DAAD CAIE BCB 2018 19/28

Augmenting reality 1 DAAD CAIE BCB 2018 20/28

Augmenting reality 2 DAAD CAIE BCB 2018 21/28

Augmenting reality 2 DAAD CAIE BCB 2018 22/28

Augmenting reality 2 DAAD CAIE BCB 2018 23/28

Augmenting reality 3 DAAD CAIE BCB 2018 24/28

Augmenting reality 3 DAAD CAIE BCB 2018 25/28

Results Testing new technology 2017 – 4 bachelor thesis, 1 master thesis 2018 – 4 bachelor thesis, 1 master thesis – in progress DAAD CAIE BCB 2018 26/28

Conclusion • Combine multiple sensors for precise indoor location. • Beacons enable fine location, but require additional hardware. • Image processing and inertial navigation do not require additional equipment. • Augmented reality can be used in combination with location. DAAD CAIE BCB 2018 27/28

Thank you! Zaharije Radivojevic