Panagiotis Stalidis CERTH/ITI Goals of the project - PowerPoint PPT Presentation

Panagiotis Stalidis – CERTH/ITI

Goals of the project • Implementation of a bi-directional collaboration channel between citizens and LEAs. • Enhanced discovery of relevant and up to date information, speeds up the detection of risks. • Incident discovery, prediction, reporting and interaction 2 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

The project in a nutshell http://trillion-project.eng.it/ 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

System Architecture Mobile Apps and Web Apps and Mobile Apps Mobile Apps and serious games Dashboards for alerts and crisis serious games for citizen for alerts and crisis management for LEA training engagement management User Experience Framework Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Source Integration and Data Gathering Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Integration of data from mobile serious games Dashboards for alerts and crisis serious games for citizen for alerts and crisis management and web apps with data crawled for LEA training engagement management from social media like: ● Twitter User Experience Framework ● Flickr ● Instagram Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Information Extraction Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Extraction of information from serious games Dashboards for alerts and crisis serious games for citizen for alerts and crisis management multimodal content. for LEA training engagement management User Experience Framework Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Information Extraction Mobile Apps and Web Apps and Mobile Apps Mobile Apps and In order for the computer to serious games Dashboards for alerts and crisis serious games for citizen for alerts and crisis management understand natural language for LEA training engagement management text we apply NLP. ● Named Entity User Experience Framework Recognition ● Sentiment Analysis Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Information Extraction Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Using images from apps and serious games Dashboards for alerts and crisis serious games for citizen for alerts and crisis management social media we apply for LEA training engagement management techniques for: ● Object Detection User Experience Framework ● Image Segmentation ● Image Captioning Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Information Extraction Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Similar techniques as in Image serious games Dashboards for alerts and crisis serious games for citizen for alerts and crisis management Analysis by treating each frame for LEA training engagement management as an image. ● Video Captioning User Experience Framework Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Location, situation and context toolset Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Use of extracted information serious games Dashboards for alerts and crisis serious games from text, image and video for citizen for alerts and crisis management for LEA training analysis for location detection engagement management and event classification. User Experience Framework Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Location, situation and context toolset Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Filtering of relevant serious games Dashboards for alerts and crisis serious games information per event. for citizen for alerts and crisis management for LEA training engagement management ● Location Detection ● Image Classification User Experience Framework Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Location, situation and context toolset Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Merging of duplicate and/or serious games Dashboards for alerts and crisis serious games contextually related events. for citizen for alerts and crisis management for LEA training Enrichment of events with engagement management additional relevant User Experience Framework information. Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

System Architecture Mobile Apps and Web Apps and Mobile Apps Mobile Apps and Prediction of spatial and serious games Dashboards for alerts and crisis serious games temporal development of for citizen for alerts and crisis management for LEA training events. engagement management ● Hotspot Detection User Experience Framework Location, situation and context awareness toolset Citizens and LEAs profiles Information Information enrichment filtering and relationship Analytics classification enrichment Information extraction tools and services Text Image Video Audio Data Integration Analysis Analysis Analysis Analysis Gateway Source Integration and Data Gathering services 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Achievements • Detection of incidents in an efficient, context and content aware manner. • Locate on-site citizens and LEA representatives in crisis areas. • Request more information and assign specific actions to first responders of on-going incidents. 14 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017

Thank you for your attention For more information please contact stalidis@iti.gr or visit http://trillion-project.eng.it/ 30 Χρόνια Τ μ ή μ α Πληροφορικής ATEITH 2017, Thessaloniki, Greece, Sep 29-30, 2017