SLIDE 1
- Organizational overview of German Federal Police
- Pain points (professional and technical requirements)
- Technical overview
- Benefits
- Q&A
Data Warehouse of German Federal Police From Raw Data to Flexible - - PowerPoint PPT Presentation
Data Warehouse of German Federal Police From Raw Data to Flexible - - PowerPoint PPT Presentation
Data Warehouse of German Federal Police From Raw Data to Flexible Analytics Data Warehouse German Federal Police Table of Contents Organizational overview of German Federal Police Pain points (professional and technical requirements)
SLIDE 2
SLIDE 3
- Replace the previous Excel-based reporting system
- Provide standardized quality-assured data for all cases
(parliamentary questions, FRONTEX, Federal Ministry of the Interior)
- Provide more flexibility in delivering analyses requested by
governmental and EU institutions in short notice
Data Warehouse German Federal Police Requirements
SLIDE 4
Data Warehouse German Federal Police Our Philosophy
Don’t try to boil the ocean!
- "The artist who aims at perfection achieves in nothing”
- The user doesn´t know the professional requirements -> agile
development Keep it short and simple but be prepared for the future
- More catalogs, little text needed
- more automation, little manual work needed
Stay independent
- Use open source whenever possible
SLIDE 5
- Flexibility
- Data quality assurance (“washing machine”)
- Ability to rearchitect the DWH at any time
- Reduced maintenance and development costs
- Automation and job control / monitoring
Data Warehouse German Federal Police Technical Requirements
SLIDE 6
Data Warehouse German Federal Police Overview
Data sources External sources
Extraction Transformation Loading Extraction Transformation Loading
PES Web (QS)
Central Database
Data Mart Data Mart
Meta database
Dashboards Data Mining Cubes
Data Warehouse Presentation layer (User)
Reports
PES Backup
Application / Backup Washing machine
SLIDE 7
Data Warehouse German Federal Police Data Management
PES (washing machine)
Data sources DWH dimension tables PES (washing machine) backup DWH validation DWH fact tables
SLIDE 8
Data Warehouse German Federal Police Data Management
PES Siko PES DWH DB LB DB DB
LB
App
DB DB
Washing machine Backup DWH
virtualized server Galera cluster 8 GB RAM ☺ dedicated server 256 GB RAM
App App
SLIDE 9
Slow Fast
Data Warehouse German Federal Police ETL – Manhunt (job)
SLIDE 10
Data Warehouse German Federal Police ETL – Manhunt (job)
SLIDE 11
Data Warehouse German Federal Police PES Web (washing machine)
SLIDE 12
Data Warehouse German Federal Police PES Web (washing machine)
SLIDE 13
Data Warehouse German Federal Police PES Web (washing machine)
SLIDE 14
Data Warehouse German Federal Police ETL – PES -> DWH (validation)
SLIDE 15
Data Warehouse German Federal Police ETL – fact tables
SLIDE 16
Data Warehouse German Federal Police Automation / Job control
SLIDE 17
Data Warehouse German Federal Police Automation / Job control
SLIDE 18
Data Warehouse German Federal Police Automation / Job control
SLIDE 19
Data Warehouse German Federal Police Presentation layer
SLIDE 20
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 21
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 22
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 23
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 24
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 25
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 26
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 27
Data Warehouse German Federal Police Presentation layer / BI server
SLIDE 28