Outline ABS 2017 Transformation Vision and Information - - PDF document

1

Information Infrastructure: Foundations for ABS Transformation

Stuart Girvan, Australian Bureau of Statistics MSIS Paris, April 2013

Outline

• ABS 2017 Transformation Vision and Information

Infrastructure

• Metadata Registry and Repository (MRR) & Statistical

Workflow Management system (SWM)

• Achievements so far
• What’s next?
• The journey

2

VISION FOR ABS 2017 TRANSFORMATION & THE ROLE OF INFORMATION INFRASTRUCTURE

Enablers Business Change Benefits Strategic Goals

Managed, consolidated & consistent business processes Re‐use processes Re‐engineered, Improved Business Processes Enterprise Architecture

Grow

Processes captured as Services, Workflow – SOA Metadata driven processes p

Survive and Thrive

Process Assembly and Automation

Reduce time and cost of b i business via new statistical products/ services

Statistical Workflow Management System (SWM) Existing/new applications integrate with MRR/EDW (Better) Tools and applications integrated with MRR Existing/new applications integrate with SWM/SOA Managed, consolidated & consistent applications & components Re‐use metadata Information Governance, Architecture & Management Managed, consolidated & consistent metadata Migrate corporate/foundation metadata to MRR

business

• perations

Metadata Registry and Repository (MRR) EDW

3

Business

Re‐use of common business processes Process assembly, configuration and automation

Information Application

Re‐use metadata Re‐use application components C t/ i bl

E n t e r p r i s e

Component/service assembly

Business Transformation The role of MRR and SWM

• MRR and SWM provide foundations for processes

and metadata to be: and metadata to be:

– Managed – Consistent – Discoverable – Governed – Executable – Ultimately, re‐usable, easily assembled, and in the case of processes, automatable

4

MRR AND SWM

What is MRR?

• The Metadata Registry and Repository consists

f t t

• f two parts:

– Repository – the centralised store for standards based metadata – Registry – the catalogue that tells you what’s in the repository

5

MRR – Registering & Retrieving Metadata

Repository

E.g. Register metadata

C l t t d t

Registry

Register key elements

• f metadata package

Complete metadata package resides in Repository

MRR – Registering & Retrieving Metadata

Repository

E.g. Metadata search

Search for metadata here

Registry ?

Pointer to Metadata in Repository

Returns list of relevant metadata held in the repository

6

MRR – Registering & Retrieving Metadata

Repository

E.g. Retrieve metadata from here based on search results

Registry

MRR & standards

Repository

E.g. DDI, SDMX,

Registry

Model of what we keep in a registration (ATMM‐ GSIM)

Mapping between the registration and the standard

This will be the metadata content in the most appropriate standard (DDI, SDMX, etc) , And ?

7

What is SWM?

• Statistical Workflow Management System
• ActiveVos (BPMS)

+ governance (e.g. Alignment of new processes to business architecture, Duplication of existing processes?) + processes for building workflow and orchestration + role and responsibilities

8

WHAT WE HAVE DONE SO FAR AND WHAT’S NEXT

9

What have we learnt?

• MRR works
• DDI/SDMX successfully used

– E‐forms generation – Table production for analysis M t d t i f d d t t – Metadata queries for end user data sets

What have we learnt?

• SWM good for

– doing things quickly – joining things up – coordinating and re‐using processes – handling long, asynchronous events

• Exposes and documents business process

10

What’s next?

Input Data Input Data Warehouse Warehouse and Tools and Tools Collection Collection /Data /Data Definition Definition Tools Tools Instrument Instrument Definition Definition Tools Tools Run Survey/ Run Survey/ Data Data Collection Collection Tools Tools Processing, Processing, Editing, Editing, Analysis Analysis Data Data Warehouse Warehouse and Tools and Tools Output Data Output Data Warehouse Warehouse and Tools and Tools Instrument Instrument Generation Generation Tools Tools Disseminate Disseminate Tools Tools

Corporate Classification Glossary Standard Question Data Topics Corporate Metadata Tools Classification Management Glossary Management Standard Question, Data Element (variable) Definition Topics Management Corporate Metadata Registry and Repository Corporate Business Process Tool and Repository SWM MRR

11

REACHING THE VISION

Vision for Re‐use: Existing Applications/Tools decomposed into re‐usable bits

User Interface Any given application consists of Business Rules and Processes SWM Common (largely), stable, reusable, automatable workflow Common, stable, reusable, modular services Services

Workflow & process

• rchestration

Code that takes metadata and data, and does something with it (e.g. imputation)

Data and Metadata MRR Common Statistical Metadata Common Statistical Data EDW

Statistical Data Information about Statistical Data

12

Vision for Re‐use for New Applications/Tools

User Interface New Application SWM Common (largely), stable, reusable, automatable workflow Common, stable, reusable, modular services Services

Application Specific Code

Business Rules and Processes

MRR Common Statistical Metadata Common Statistical Data EDW

Data and Metadata

SWM

Vision for re‐use and automation (& assembly)

User Interface User Interface User Interface User Interface

SWM

User Interface User Interface

SWM MRR EDW Services

Information Infrastructure Backbone

13

Information Infrastructure Backbone

The journey, and wins on the way

User Interface Business Rules and Processes Data and Metadata

• Configure and assemble processes

from components

• Business process greatly automated
• Code small number of things re
• Some re‐use of metadata and

process via integrated tools

• Some coding, some re‐use of code
• Tools begin to integrate

User Interface Business Rules and Processes Data and Metadata

SWM Services

• Code small number of things, re‐

using a lot others

User Interface Business Rules and Processes Data and Metadata

• Code most new applications
• Different tools don’t play well

together MRR EDW

Enablers Business Change Benefits Strategic Goals

Managed, consolidated & consistent business processes Re‐use processes Re‐engineered, Improved Business Processes Enterprise Architecture

Grow

Processes captured as Services, Workflow – SOA Metadata driven processes p

Survive and Thrive

Process Assembly and Automation

Reduce time and cost of b i business via new statistical products/ services

Statistical Workflow Management System (SWM) Metadata Registry and Repository (MRR) Existing/new applications integrate with MRR/EDW Existing/new applications integrate with SWM/SOA Managed, consolidated & consistent applications & components Re‐use metadata Information Governance, Architecture & Management Managed, consolidated & consistent metadata Migrate corporate/foundation metadata to MRR

business

• perations

EDW (Better) Tools and applications integrated with MRR

14

QUESTIONS?

Contributors: Chris Conran, Simon Wall, Gillian Nicoll