Digital Infrastructure Digital Utilities Clemens Vasters - - PowerPoint PPT Presentation
Digital Infrastructure Digital Utilities Clemens Vasters (@clemensv) clemensv@microsoft.com Architect, Microsoft Azure Microsoft Corporation Follow me on Twitter @clemensv Self Human Needs Actualization Esteem Recognition, Achievement,
Angelehnt an Abraham Maslow
Self Actualization Esteem Recognition, Achievement, Confidence Social Needs Friendship, Groups, Family, Love Safety and Security Security, Safety, Stability, Protection, Order, Law Physiological Needs Air, Shelter (Buildings, Heat, Energy), Water, Waste, Food, Sleep
Self Actualization Esteem Recognition, Achievement, Confidence Social Needs Friendship, Groups, Family, Love Safety and Security Security, Safety, Stability, Protection, Order, Law Physiological Needs Air, Shelter (Buildings, Heat, Energy), Water, Waste, Food, Sleep
Angelehnt an Abraham Maslow
Infrastructure Tools & Toys IoT++ IoT
Electricity Distribution Gas Distribution Patient Tracking Emergency Alert Mobile Care Safety Management Security Climate Control Lighting Energy Management Drinking Water Waste Water Pollution Control Fire Protection Medical Emergency Public Order Law Enforcement
Energy
Toll Collection Traffic Flow Air Traffic Control Bus/Tram/Train Traffic Alerts Street Quality Mobility
City
Health Buildings
Flood Control Solid Waste Air Quality Lifts and Escalators Signage Water Wind/Solar/Geothermal Fuel Distribution Power Plants Nuclear Waste Exploration Oil/Gas Production Coal Mining
Safety and Security Security, Safety, Stability, Protection, Order, Law Physiological Needs Air, Shelter (Buildings, Heat, Energy), Water, Waste, Food, Sleep
OR Equipment Vital Monitoring Implants Disability Aids Lab Equipment Radiology Equipment Rule Enforcement Ports Airports Taxi Diabetes
Electricity Distribution Gas Distribution Patient Tracking Emergency Alert Mobile Care Safety Management Security Climate Control Lighting Energy Management Drinking Water Waste Water Pollution Control Fire Protection Medical Emergency Public Order Law Enforcement
Energy
Toll Collection Traffic Flow Air Traffic Control Bus/Tram/Train Traffic Alerts Street Quality Mobility
City
Health Buildings
Flood Control Solid Waste Air Quality Lifts and Escalators Signage Water Wind/Solar/Geothermal Fuel Distribution Power Plants Nuclear Waste Exploration Oil/Gas Production Coal Mining OR Equipment Vital Monitoring Implants Disability Aids Lab Equipment Radiology Equipment Rule Enforcement Ports Airports Taxi Diabetes
Platform
http://research.microsoft.com/en-us/projects/citynoise/ The project aims to diagnose a city's noise pollution with crowdsensing and ubiquitous
noise situation throughout a city and analyzes the composition of noises in a particular location, by using 311 complaint data together with road network data, points of interests, and social media.
Monitoring
http://research.microsoft.com/en-us/projects/urbanair/ Using a diversity of big data to infer and predict fine-grained air quality throughout a city, and finally tackle air pollutions.
http://www.duesseldorf.de/vid/
http://onebusaway.org/ The OneBusAway project is a consortium of public sector transit agencies, commercial firms, nonprofits, academic researchers, and interested individuals delivering robust,
meet the needs of transit agencies and riders.
1 1 1 2 4 1 1 3 3 2 1 3 2 1 3 2 3
2 4 1 1 3 3 3 2 1 3 2 3
6 (+5) 4 (+2)
45km 7km
https://transparency.entsoe.eu/
Device OPC UA Server Address Space Capabilities “Message Writer” Published Items
Event Event Data (Query) Data (Query)
Encoding Msg Security Transport AMQP 1.0 Perimeter Boundary
AMQP Private and Public Cloud Infrastructures Azure Service Bus, Event Hubs, IoT Hub – IBM Bluemix MQLight Red Hat MRG – JBoss A-MQ – Apache Active MQ – Apache Qpid – SwiftMQ
PegelOnline is a service of the waterway information service of the German federal government, providing public Web Service APIs about waterway levels
time water stream flow data
drought maps
http://waterwatch.usgs.gov/
earthquake information
http://earthquake.usgs.gov/
Google Traffic works by analyzing the GPS- determined locations transmitted to them by a large number of cellphone users. By calculating the speed of users along a stretch of road, Google is able to generate a live traffic map.[2] Google processes the incoming raw data about cellphone device locations, and then excludes anomalies such as a postal vehicle which makes frequent stops. When a threshold of users in a particular area is noted, the overlay along roads and highways on the Google map changes color.[3]
http://en.wikipedia.org/wiki/Google_Traffic
system about lightning
about flight movements using ADS-B signals and public radar information
Movements for the Aviation Industry
system about ship movements using tracking signals
Elements
Sun, Rain, Snow, Temperature, Humidity, Barometric Pressurce, Lightning, Tides, Earthquakes, Water Flow etc.
Civilizatory Infrastructure
Water, Gas, Electricity, Waste, Roads, Rails, Airways, Ports, Airports, Healthcare, etc.
Digital Infrastructure
Historical Records Real-Time Information Prediction
Query Score Observe
Platform Solutions
Land-, Air-, Sea-Navigation, Smart Grid, Smart City, Public Transport Management, Logistics, etc.
Citizen/consumer apps, devices, and services Control
Control
does their own thing
federal and EU funding
scoped, slow moving data
elusive for a long time
*1648
public open data systems scale?
Commercial Services
Collect Collect
Collect Normalize Distribute Enrich
1,000,000s Peers
Time Series and State Storage Event Storage Real Time Analytics
Device Software Management Device Identity Management
x Millions x GByte/sec
Data Flow Connectivity
x PByte
Historic and Predictive Analytics
and management (direct-to-device and via gateway).
Policies, Procedures, Guidance
Cloud Field Gateways Devices Physical Global Network Identity and Access Control Application Data Physical Physical Local Network Local Network Edge Application Data Data Host Host Host Data Privacy Protection and Controls People and Device Identity Federation, Data Attestation Trustworthy Platform Hardware, Signed Firmware, Secure Boot/Load Secure Networks, Transport and Application Protocols, Segmentation Tamper/Intrusion Detection Physical Access Security
modeled after physical access security
Well-defined gates.
network/gateway level.
sufficient to access assets.
Device Device Device Device
Local Interaction
Local Gateway Local Portals and APIs Control System Analytics Data Management (CG)NAT Firewall Router Isolated Network Service Gateway Client Port Mapping is automatic, outbound Device does not actively listen for unsolicited traffic
No inbound ports
is minimized Public address, full and well defendable server platform
Q Q
Device Identity Registry/Directory
Connections are device- initiated and outbound Field Gateway
Access Control Policies
Device Device Device Device OPC UA Gateway
Cloud Systems Cloud Gateway Cloud Portals and APIs Control System Analytics Data Management
Local Gateway Local Portals and APIs Control System Analytics Data ManagementAMQP 1.0 Link Bi-Directional Secure Reliable Transfer Application Level No Inbound Ports
Solution Portal Provisioning API Identity & Registry Stores Stream Event Processor Analytics/ Machine Learning Data Visualization & Presentation Device State Store Gateway Storage IP capable devices Existing IoT devices Low power devices
Presentation Device and Event Processing Data Transport Devices and Data Sources
Cloud Gate- way Agent Libs Agent Libs Control System Worker Role Agent Libs
Field Gateway
Device Connectivity & Management Analytics & Operationalized Insights Presentation & Business Connectivity
Devices RTOS, Linux, Android, iOS, Windows
Protocol Adaptation Batch Analytics & Visualizations Azure HDInsight, AzureML, Power BI, Azure Data Factory Hot Path Analytics Azure Stream Analytics, Azure Storm Presentation & Business Connections Websites, Mobile Services Dynamics, BizTalk Services, Notification Hubs Hot Path Business Logic Service Fabric & Actor Framework Cloud Gateway Event Hub
Event Producers
> 1M Producers > 1GB/sec Aggregate Throughput
Up to 32 partitions via portal, more on request Partitions
Direct PartitionKey Hash
Throughput Units:
AMQP 1.0 Credit-based flow control Client-side cursors Offset by Id or Timestamp
Clemens Vasters @clemensv clemensv@microsoft.com http://www.azure.com
File:Middelgrunden_wind_farm_2009-07-01_edit_filtered.jpg?uselang=de
%C3%BCngen-026.jpg?uselang=de
Wizard_World_Anaheim_2011_-_Herbie_the_Love_Bug_ %285674405609%29.jpg
uselang=de
%C3%BCdvorstadt_Kreuzung_Eisner-Liebknecht.jpg?uselang=de
%C3%9Fnetz_Hamburg_03.jpg?uselang=de