CORE: a concrete implementation of the CSPA architecture Mauro - PowerPoint PPT Presentation

CORE: a concrete implementation of the CSPA architecture Mauro Bruno ISTAT (Italian National Statistical Institute) Joint work with: Rolando Duma, Monica Scannapieco, Marco Silipo and Giulia Vaste 10 March 2015

Outline 1. A brief history 2. Why CORE? 3. CORE concepts 4. CORE at work 5. CORE architecture 6. CORE GUI 7. Concluding remarks CORE, Mauro Bruno – Bruxelles, 10 March 2015

A brief history CORE CSPA Common Reference Environment Common Statistical Production Architecture Environment for: Reference architecture based on: i) executing standard statistical processes i) existing standard models, such as GSBPM and GSIM, as shared vocabulary ii) defining processes in terms of abstract ii) the “ plug and play ” approach in designing, statistical services implementing and sharing statistical software iii) mapping services to specific IT tools solutions ESSNet CORA ESSNet CORE CORE in Istat 2009 2010 2011 2012 2013 2014 2015 CSPA CSPA CORE in Istat: specification implementation Platform for the execution of statistical processes according to CSPA principles CORE, Mauro Bruno – Bruxelles, 10 March 2015

Why CORE? Disseminate Collect Process Analyse Stovepipe scenario: • expensive Survey A • rigid • outdated • difficult to be Survey B managed • etc. code duplication heterogeneity no sharing no standards no reuse How can NSI move towards modernization and standardization ? How can NSI work in a more efficient and optimised way? CORE, Mauro Bruno – Bruxelles, 10 March 2015

Why CORE? Disseminate Collect Process Analyse Survey A CORE Survey B ? sharing standards reuse plug and play A SOA platform for integration and automation of statistical services and processes, re-engineered according to CSPA principles CORE, Mauro Bruno – Bruxelles, 10 March 2015

CORE concepts Service definition Pl/sql Definition of a service at a conceptual level in terms of GSBPM subprocess, of the business function, of GSIM input/output. Sas Tool Service implementation Definition of a service at a physical level . A service definition can have one or more … implementations Process Compose : compose a process with available service definitions Configure : bind each service with one of its available implementations Execute CORE, Mauro Bruno – Bruxelles, 10 March 2015

CORE at work 1. Define: - a service definition for each step in your process - a service implementation for each service definition, choosing a tool 2. Compose: conceptual design of a process , connecting service definitions 3. Configure: physical design of a process , starting from a conceptual process bind each service definition to an implementation 4. Prepare: specify input ( data file and configuration parameters ) for each service implementation 5. Execute: run your process! CORE, Mauro Bruno – Bruxelles, 10 March 2015

CORE architecture CORE engine CORE Pl/sql Sas R Java Shell tools CORE is a Java web application i) implements a workflow engine ii) stores process executions iii) allows editing tool scripts iv) displays runtime logs CORE, Mauro Bruno – Bruxelles, 10 March 2015

CORE engine Running service Interruptable service CORE, Mauro Bruno – Bruxelles, 10 March 2015

CORE tools CORE allows editing tool scripts (R, Sas, Pl/sql, shell) stored on the server, through an editing panel CORE, Mauro Bruno – Bruxelles, 10 March 2015

Concluding remarks CORE today i) CORE has been strongly re- engeenered, becoming an “easy to use” product for non technical users ii) different surveys (COE, Anvis, Frame) are moving towards a CORE-compliant design iii) CORE is becoming a key component in the process of modernization and automation of statistical surveys CORE tomorrow i) Implementation enhancements: web services support , more complex workflow (loop, switch), data mapping between heterogeneous services ii) Governance: policies, service and tool catalogue iii) CORE as a communication platform for CSPA services CORE, Mauro Bruno – Bruxelles, 10 March 2015