Semantic Accountable Matchmaking for E-Science Resource Sharing - - PowerPoint PPT Presentation

Semantic Accountable Matchmaking for E-Science Resource Sharing

Zeqian Meng

Rizos Sakellariou

School of Computer Science, The University of Manchester

John Brooke JMB Associates Ltd. Manchester

Introduction | Motivation

e-Scientists resource sharing management for e- Scientists’ collaboration resource supplying infrastructures

Introduction | Motivation

Present isolated infrastructures Past technical twists partly via standards Future dynamic resource supply via open standards

• pen market for

The Science Cloud [1]

[1]: Amsaghrou, Rachida. Report On The Open Market Consultation And The Results. Geneva: CERN, 2016.

• Web. 29 June 2016.

Introduction | Motivation

e-Scientists resource sharing management for e- Scientists’ collaboration resource supplying infrastructures resource requesting

• rganisation

resource supplying

• rganisation

e"Scien'sts* e-Science infrastructures* centralized resource management and allocation*

2.*resource* request**

e"Scien'sts* e-Science infrastructures* resource management and allocation for a research group*

2* 1.*access* request* 1*

Introduction | Motivation

[2]

[2]: Solagna, Peter. "AAI In EGI Current Status". 2015. Presentation.

Introduction | Motivation

dynamic & customised resource supply fine-grained accountable resource sharing (per job) coarse-grained resource management

complex(( rela+onships(

VO(defines(complex(SLA(between( members(and(resources.(E.g.:(each(VO( member(gets(10k(cpuh/month(or(all( members(can(run(up(to(10(copies(of( licensed(siDware(simutaneously.( Distributed(management(very( hard(or(impossible(

dynamic( sta+c( minimal( rela+onships(

VO(does(not(offer(sophis+cated( SLAs,(etc.(VO(membership(is( used(mostly(to(grant(access(to( some(resources((which(are( subject(to(change)(( Distributed(management( possible( UVOS%% distributed%mgmt% gLite/VOMS%% No%distributed% mgmt%

Introduction | Motivation

Classification of Virtual Organizations [3]

[3]: Benedyczak, K. and Bała, P., 2012. The next generation of Virtual Organisations in UNICORE. Unicore Summit.

e"Scien'sts* e-Science infrastructures* resource management and allocation for a research group*

1.*resource* request* 2.*access* request**

e"Scien'sts* e-Science infrastructures* centralized resource management and allocation*

2.*resource* request**

e"Scien'sts* e-Science infrastructures* resource management and allocation for a research group*

2* 1.*access* request* 1*

Introduction | Main question

How to realise fine-grained accountable resource sharing?

• A standard-based information model

for fine-grained resource management

• An implementation of the

information model (independent

• rganizations, new lifecycle)

Contributions

Methodology

• Extension upon GLUE 2.0

(Glue Laboratory Uniform Environment 2.0)

• Semantic modeling & reasoning
• Implementation upon Amazon Web Sevices

hasMappingPolicy Share hasAppEnvironment hasUserDomain hasProviderDomain hasService hasAdminDomain needLib hasExeEnvironment hasApp hasAppEnvironment hasExeEnvironment hasPaymentMethod hasQueue hasMiddleware hasOSFamily hasResource mem physicalCpus cpuTime hasEndpoint hasOSFamily hasCpuModel clockSpeed hasResource hasCpuModel clockSpeed measurement

Results | Semantic model

OWL 2 (Web Ontology Language 2)

! !

hasMappingPolicy hasUserDomain belongToShare belongToUserDomain hasMember hasAppEnvironment hasApp IndividualCPUTime PhysicalCPUs hasExeEnvironment hasOSFamily hasResource hasCPUModel ClockSpeed Access verified hasService Share services search Services in Share cannot meet demands TotalCPUTime CPUTime (balance) User request UserName AppName GroupName hasExeEnvironment PhysicalCPUs hasService hasExeEnvironment hasOSFamily hasResource hasCPUModel ClockSpeed CPUTime

Results | Semantic reasoning

Pellet: open source, Java-based

!

e#Scien(st!A! Group

Mapping Policy.owl ! Base.owl! Collaborated Provider AWS! Share.owl Provider A! Service.owl Provider B! Service.owl

UserB, group! app! resource details!

e#Scien(st!B! e#Scien(st!C!

! !

Management!

Results | Implementation

Implementation design

Results | Evaluation

✔ Functionalities:

• - application- & resource-oriented matchmaking
• - balance updates
• - no resources returned with un-sufficient balance
• - members’ privileges for matchmaking

Results | Evaluation

✔ Performance: pure reasoning duration

• - a group with 15 members
• - 2 instances for application-oriented

matchmaking

• - 4 instances for resource-oriented matchmaking

Results | Evaluation

✔ Performance: pure reasoning duration

Scenario 1 2 3 5 Mean (ms) 267.10 279.33 272.93 280.83 Devea5on (ms) 74.45 74.37 72.54 59.11

• - application- & resource-oriented matchmaking

(S1&S2)

• - balance updates (S1)
• - no resources returned with un-sufficient balance

(S3)

• - members’ privileges for matchmaking (S5)

Conclusion

• A semantic model extended from GLUE 2.0
• Reasoning programs upon the model
• Evaluation over Amazon Web Sevices
• Testbed: negotiable and accountable

resource sharing

Hypotheses

• To form and dissolve resource supply

in a dynamic & independent manner

• Fine-grained accountable resource

sharing

• To allow analysis of algorithms for

performance

References

[1] Amsaghrou, Rachida. Report On The Open Market

Consultation And The Results. Geneva: CERN, 2016.

• Web. 29 June 2016.

[2] Solagna, Peter. "AAI In EGI Current Status". 2015. Presentation. [3] Benedyczak, K. and Bała, P., 2012. The next generation of Virtual Organisations in UNICORE. Unicore Summit.

Contact: Zeqian Meng zeqian.meng@manchester.ac.uk