Aligning OAIS with the Enterprise Architecture 8 th European - - PowerPoint PPT Presentation
Aligning OAIS with the Enterprise Architecture 8 th European - - PowerPoint PPT Presentation
technology from seed Jos Barateiro* Gonalo Antunes Jos Borbinha Aligning OAIS with the Enterprise Architecture 8 th European Conference on Digital Archiving, 2010 Geneva, Switzerland Outline technology from seed Digital
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Outline
- Digital Preservation as a Problem
- Context
- The Enterprise Architecture Perspective
- Zachman Framework
- TOGAF
- Reference Architecture
- Shaman RA
- OAIS Reference Model
- Modelling OAIS
- Conclusions
Aligning OAIS with the Enterprise Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Digital Preservation as a Problem (1/2)
Generic and common requirements:
- Integrity: Effective preservation requires that the
informational content of objects remains unchanged through its lifetime.
- Reliability: A copy (or representation) of any preserved
- bject must survive over its system’s lifetime.
- Authenticity Assurance: A future consumer may require
the accessed information to be trustworthy.
Aligning OAIS with the Enterprise Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Digital Preservation as a Problem (2/2)
- Provenance: A future consumer may require information concerning
the origins of the object.
- Dealing with Obsolescence: Digital objects should be able to be
exploited independently of any technological context (ideally…).
- Scalability: Digital preservation systems might be required to face
technological evolution through the addition of new components.
- Heterogeneity: Digital preservation system’s components should be
heterogeneous due to technology disruption.
Aligning OAIS with the Enterprise Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Approaching Problems
Systems Engineering Enterprise Architecture Risk Management
Aligning OAIS with the Enterprise Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
(http://grito.intraneia.pt) – National project – Exclusive storage clusters (dedicated to digital preservation) – Extended storage clusters (using surplus resources of computing clusters) SHAMAN - Sustaining Heritage Access through Multivalent ArchiviNg (http://shaman-ip.eu/shaman) – European project – Three domains of focus: memory institutions, engineering and e-Science – Strong focus on authenticity and integrity – Definition of frameworks and architectures for digital preservation
Common ground: use of data grids (massive data sets, file management, user management, networking etc.)
Context
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
A reference architecture presents a way of recording a specific body of knowledge, with the purpose of making it available for further practical reuse. According to the ANSI/IEEE Std. 1471-2000: architecture is ”the fundamental organization of a system,
embodied in its components, their relationships to each
- ther and the environment, and the principles governing its
design and evolution”
Therefore, a reference architecture for digital preservation must provide a way to capture the knowledge in the domain, so that it can be instantiated in concrete architectures for real system implementations!
Reference Architecture – The concept
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Architecture «reference architecture» SHAMAN «framework» Viewpoints «architecture» Domains «architecture» M emory «architecture» Industrial «architecture» e-Science «system » Im plementations «system » M emory «system» Industrial «system» e-Science «references» Input + Motivation and Goals + Requirements «references» Related Work + Relevant Specifications + Relevant Standards + Relevant Technologies «reference model» OAIS considers constrained by constrained by constrained by use accounts for guided by depends derived accounts for
SHAMAN RA
Initial global view (1/2)
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Architecture «reference architecture» SHAMAN «framework» Viewpoints «architecture» Domains «architecture» Memory «architecture» Industrial «architecture» e-Science «system» Implementations «system» Mem ory «system» Industrial «system» e-Science «references» Input + Motivation and Goals + Requirements «references» Related Work + Relevant Specifications + Relevant Standards + Relevant T echnologies «reference model» OAIS considers constrained by constrained by constrained by use accounts for guided by depends derived accounts for
- The SHAMAN
DoW
- The initial work…
- …
- SOA…
- TRAC
criteria…
- …
Generic focus (a model based on generic requirements and assumptions…).
SHAMAN RA
Initial global view (22)
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
SHAMAN RA
Information Lifecycle (1/2)
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
The digital preservation system The interfaces
- f the digital
preservation system The context of the business
SHAMAN RA
Information Lifecycle (2/2)
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Vulnerabilities Process Software Faults Software Obsolescence Data Media Faults Media Obsolescence Infrastructure Hardware Faults Hardware Obsolescence Communication Faults Network Service Failures Threats Disasters Natural Disasters Human Operational Errors Attacks External Attacks Internal Attacks Management Organizational Failures Economic Failures Business Requirements Legal Requirements Stakeholders’ Requirements
From the lifecycle context
A taxonomy of vulnerabilities and threats to digital preservation (1/2)
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Vulnerabilities Process Software Faults Software Obsolescence T T . . . . Data Media Faults Media Obsolescence T T . . . . Infrastructure Hardware Faults Hardware Obsolescence Communication Faults Network Service Failures T T T T .
- .
- .
. c . Threats Disasters Natural Disasters Human Operational Errors . t . O C . Attacks External Attacks Internal Attacks t t
- O
C c Management Organizational Failures Economic Failures . . O O . c Business Requirements Legal Requirements Stakeholders’ Requirements . . .
- C
C
From the lifecycle context
A taxonomy of vulnerabilities and threats to digital preservation (2/2)
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Technology + Organization + Context = Enterprise Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Technology +Organization +Context =Enterprise Architecture
http://www.zachmaninternational.com/index.php/the-zachman- framework “The Zachman Framework is not a methodology for creating the implementation (an instantiation) of the object. The Zachman Framework is the ontology for describing the Enterprise. The Framework (ontology) is a STRUCTURE whereas a methodology is a PROCESS. “
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
TOGAF - The Open Group Framework
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
TOGAF overview
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
The SHAMAN Reference Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
he SHAMAN Reference Architecture Part 1 – Framework, which describes the architectural framework and respective viewpoints; he SHAMAN Reference Architecture Part 2 – Process, which describes the process for the development of preservation architectures derived from the Reference Architecture; he SHAMAN Reference Architecture Part 3 – Foundations, which describes the foundations of this work and provides references for the instantiation of concrete architectures; he SHAMAN Reference Architecture Part 4 – Glossary, which contains definitions for the main terms used in this Reference Architecture.
The SHAMAN Reference Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Viewpoint Framework
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Structural View
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Requirements and Conformance Preservation Strategic Planning Preservation principle Constraint Assum ption Requirement Gap Principle Business Governance Acting and Operation System Building and Support
System Building and Support Acting and Operation Business Governance Technology Applications Data Organization Unit Actor Role Function Preservation Process Preservation Driver Goal Objective Measure Event Service Quality Contract Preservation Service Data Entity Application Component Technology Component Platform Service Policy Strategy governs
- rchestrates
applies to applies to meets governs motivates creates adresses realises sets criteria performs
- rchestrates
tracked against generates, resolves assumed by resolves consumes, supplies processed by
- perates on
supplies, consumes implements implemented on implemented on implements governs is according to sets sets determines generated, resolved
Architectural Meta-model
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Requirements and Conformance Preservation Strategic Planning Preservation principle Constraint Assum ption Requirem ent Gap Principle Business Governance Acting and Operation System Building and Support
System Building and Support Acting and Operation Business Governance T echnology Applications Data Organization Unit Actor Role Function Preservation Process Preservation Driver Goal Objective M easure Event Service Quality Contract Preservation Service Data Entity Application Com ponent Technology Com ponent Platform Service Policy Strategy governs
- rchestrates
applies to applies to m eets governs m otivates creates adresses realises sets criteria perform s
- rchestrates
tracked against generates, resolves assum ed by resolves consum es, supplies processed by
- perates on
supplies, consum es im plem ents im plem ented on im plem ented on im plem ents governs is according to sets sets determines generated, resolved
…moving from an informal way of expressing (OAIS Reference Model Figure F-1: Composite of Functional Entities)… … to a more appropriately formal, traceable and
- bjectively represented
meta-model… Moving beyond
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
- 4. System Building and Support
- 1. Preservation
Strategic Planning Requirements and Conformance 4.2. Applications
- 5. Architecture
Realization
- 3. Acting and
Operation
- 2. Business
Governance 4.1. Data 4.3. Technology
The process
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Modelling examples (1/4)
UML
pkg oais OAIS Management Consumer Producer Administration Data Management Access Archival Storage Preservation Planning Ingest Media (from Archival Storage) Database (from Data Management) SIP «flow» Descriptive Inform ation «flow» DIP «flow» AIP «flow» AIP «flow» Descriptive Information «flow»
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Modelling examples (2/4)
BPMN
BPMN OAIS Core BP «BusinessProcess» Ingest «BusinessProcess» Ingest «BusinessProcess» Data management «BusinessProcess» Data management «BusinessProcess» Preservation Planning «BusinessProcess» Preservation Planning «BusinessProcess» Archival Storage «BusinessProcess» Archival Storage «BusinessProcess» Administration «BusinessProcess» Administration «BusinessProcess» Access «BusinessProcess» Access
AIP «flow» Descriptive Inform ation «flow» Descriptive Inform ation «flow» AIP «flow»
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Modelling examples (1/4)
UML
act Ingest Activity «structured» Coordinate updates «structured» Generate AIP Archival storage Data Management Administration Ingest Producer Submit SIP :SIP Receive submission check SIP Quality assurance :QA results Report to request? Report request Generate report :Report Request audit? Audit request Generate audit report Generate AIP :Audit report :AIP Generate descriptive info :Descriptive info Storage request Database update request Receive Data Receive descriptive info Database update confirmation Storage confirmation [true] [false] [true] Resubm it request [errors?] [true] [false]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Modelling examples (4/4)
BPMN
BPMN Ingest «Group» Co-ordinate updates «Group» Generate AIP «Pool» Archival storage «Pool» Ingest «Pool» Administration «Pool» Data management S IP Receive S IP from P rod ucer Che ck S IP e rro rs Re sub m it req u est Q uality a ssuran ce Q uality a ssu ra nce results Rep ort re que st? S e nd rep ort req ue st Re ceive re po rt re qu est Ge ne ra te rep ort S e nd re po rt Rece ive re p ort A ud it re qu est? Rep o rt rece ive d S end a udit re po rt re qu est Re ceive au d it rep ort re qu est Ge n era te a ud it re po rt S e nd a ud it rep ort A ud it rep o rt receive d Receive a ud it re port Ge ne ra te A IP G e nera te d escri ptive in fo S en d da ta base up da te re q ue st S en d sto rag e req ue st Rece ive da ta b ase up d ate req uest Up date d atab ase S e nd d a ta ba se u pd ate con firm ati on Data ba se u pda te co n firm a tio n rece ive d Receive sto ra ge re q uest S to re A IP S e nd sto ra ge confirm atio n S to ra ge con firm a tio n re ceived In ge st co nfirm a tio n Report A IP Descriptive in fo A u dit re po rt ye s n o ye s no ha s errors n o erro rs
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Deployment example
ESB Policy : Description
Process Modeling T
- ol
Process Execution Language Generator Service Orchestration Data Grid Database Legacy Digital Library System Service
wrapper SOAP/REST over HT TP Services Processes ex: iRODS, ... ex: Oracle, M ySQL, ... ex: DSPACE, Kopal, ... ex: Search & Browse Integration Service, ... ex: JBOSS jBPM, Apache ODE, ... ex: Enterprise Architect, Eclipse BPMN, XM L Editor, T ext Editor... Processes : Specification ex: BPM N, AGWL, UML Activity Diagram s, Petri net, DAG... Process Execution Language : Specification ex: BPEL, C-GWL, jPDL, ... ex: T ext, MS Word, PDF, XM L, ... «flow» «flow» «flow» «flow» «flow» «flow»
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed
Conclusions
- Digital preservation is a very complex problem!!!
Therefore:
- We surveyed the main requirements to digital preservation and
classified the threats and vulnerabilities that might endanger preservation using a taxonomy of threats and vulnerabilities.
- We propose the alignment of OAIS with the Enterprise
Architecture
- We propose a process “inspired” by TOGAF to develop create
preservation architectures.
Aligning OAIS with the Enterprise Architecture
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa
technology
from seed 16-05-09 Título da apresentação 31