Workflow Integrated Network Resource Orchestration Phil Wang, Inder - - PowerPoint PPT Presentation

▶
workflow integrated network resource orchestration
SMART_READER_LITE
LIVE PREVIEW

Workflow Integrated Network Resource Orchestration Phil Wang, Inder - - PowerPoint PPT Presentation

Jun 11, 2023 378 likes •572 views

Workflow Integrated Network Resource Orchestration Phil Wang, Inder Monga, Satish Raghunath, Franco Travostino, Tal Lavian {pywang, imonga, satishra, travos, tlavian}@nortelnetworks.com Nortel Networks Labs Presented by Franco Travostino Boston,

slide-1
SLIDE 1

Workflow Integrated Network Resource Orchestration

Phil Wang, Inder Monga, Satish Raghunath, Franco Travostino, Tal Lavian

{pywang, imonga, satishra, travos, tlavian}@nortelnetworks.com

Nortel Networks Labs Presented by Franco Travostino Boston, 02/09/2005

slide-2
SLIDE 2

WINNER - 2 GlobusWorld 2005 Nortel Networks Labs

Agenda

> WS Workflows and Challenges > WINNER > Featured Solutions > Related Work > Summary

slide-3
SLIDE 3

WINNER - 3 GlobusWorld 2005 Nortel Networks Labs

Propel Network Resources into the Grid Universe

> 1st Generation: Network Resources Mgmt for Grids

  • Demo-ed at GW04

> 2nd Generation: Secure Multi-Domain Brokering

  • Demo-ed at Supercomputing 2004

> 3rd Generation: Intercept the WS Workflow Curve (Today)

Branded as “DRAC” www.nortel.com/DRAC

slide-4
SLIDE 4

WINNER - 4 GlobusWorld 2005 Nortel Networks Labs

WS Workflows

> Web Services (WS) boost opportunities for business development > Workflow defines the automation of a business process

  • With new SOA solutions, for WS: BPEL4WS, for Grid: GSFL
  • Streamlines application jobs in terms of WS and Grids activities

> Workflow has a host of applications

  • eCommerce: B2B, financial brokerage, travel planning
  • Enterprise: concurrent design, data center, human resources
  • eScience: computing, data, visualization, sensor Grids
slide-5
SLIDE 5

WINNER - 5 GlobusWorld 2005 Nortel Networks Labs

Challenges

> WS Workflows bring new challenges

  • Business workflows streamline to network-wide collaboration
  • Grids/WS services and resources become workflow-aware

> Challenges on Network resources  our target

  • Pervasive resources sharing
  • Supply of services and resources may vary on conditions
  • Each workflow may demand a different level of resources
  • Resource requirements change as the workflow goes

Start Data Distribution Computing Data Collection Visualization End

Workflow Engine

Service Service Service Service Storage+Network

Process Activity WS/GS Resource

Cluster+Network Storage+Network Display+Network

App

Grid/WS Workflow

slide-6
SLIDE 6

WINNER - 6 GlobusWorld 2005 Nortel Networks Labs

WINNER

> Orchestrates network resources in harmonization with workflows

  • Enhances business processes with resource extensions
  • Employs network services to perform resource operations

Workflow INtegrated NEtwork Resource orchestration

Applications WINNER Grid Custom DRAC Networks

UNI GMPLS SNMP TL1 End users Network services w/ Service gateways Network protocols Resources

Globus Custom

User environments

BPEL

slide-7
SLIDE 7

WINNER - 7 GlobusWorld 2005 Nortel Networks Labs

DRAC: Dynamic Resource Allocation Controller

> Resource discovery

  • Available physical resources in network domains
  • Available network services in network domains
  • Resource properties, status and updates

> Resource Utilization

  • Resource collection and abstraction
  • Resource reservation and scheduling
  • Job status and feedback

> Resource management

  • Resource allocation and release
  • Network configuration and control
  • Security and AAA

> Application-aware smarts on resources

  • Multiple service gateways: Grid, workflow, storage
  • Resource policy, SLA
  • Resource optimization
  • Resource monitor and performance

WINNER is the Workflow Arm of DRAC

Grid Workflow Storage Health WINNER

DRAC

slide-8
SLIDE 8

WINNER - 8 GlobusWorld 2005 Nortel Networks Labs

WINNER and Workflow Engine

> WINNER Process

  • Defines the workflow activities specific on network resources
  • Acts in either standalone or extension to a legacy process
  • Invocated from apps, and related business services

> WINNER Process services (PS)

  • Web services that provide the activities of the business process
  • Realize the resource operations of the WINNER process
  • Support the workflow processing of network resources

> WINNER Resource services (RS)

  • Web services that support PS by provisioning necessary resources

to conduct the process and its activities

  • Perform the allocation of network resources
  • Update the status of network resources
  • Work closely with DRAC

Application

Workflow Engine

Resources

WINNER Process

WINNER PS WINNER RS

slide-9
SLIDE 9

WINNER - 9 GlobusWorld 2005 Nortel Networks Labs

WINNER Process: activity samples

> Application registration

  • Unique identification of each application
  • Classification of resource workflows

> Resource Job

  • Resource specification
  • Resource allocation
  • Resource re-allocation
  • Resource release

> Query

  • Network resources
  • Resource workflows
  • Resource negotiation, when applicable

> Misc

  • Account billing
  • Authorization, and security enhancement
  • Exceptions, status check, and error handling

Interface to the Workflow Applications

slide-10
SLIDE 10

WINNER - 10 GlobusWorld 2005 Nortel Networks Labs

WINNER and Grids Workflows

> WINNER supports Grid infrastructures with a Grid workflow engine

  • WINNER enhances the Grid workflow processes with resource activities
  • WINNER Services interact with DRAC to perform network resource

allocations in the Grid domains Net 2 Net 1 Net … Net N

DRAC DRAC DRAC DRAC

WSRF WSRF WSRF WSRF

Grid app WINNER-enhanced Processes

Globus engine

WINNER Services

slide-11
SLIDE 11

WINNER - 11 GlobusWorld 2005 Nortel Networks Labs

WINNER, Grids and WS Workflows

> WS Workflow applications take advantages of Grids

  • WS engine provides the WINNER enhanced business processes to WS apps
  • Grids engine provides Grids services to WS apps through WINNER services

Net 2 Net 1 Net … Net N

DRAC DRAC DRAC DRAC

WSRF WSRF WSRF WSRF

WS app API

Globus engine

WINNER Services WINNER-enhanced Processes

WS engine

WINNER Services

slide-12
SLIDE 12

WINNER - 12 GlobusWorld 2005 Nortel Networks Labs

WINNER and Multiple Workflows

> Web Services are re-utilized across multiple types of workflows

  • Grid workflow
  • WS workflow: BPEL4WS
  • Others

> WINNER supports respective workflow engines

  • WINNER services widely shared

App WS Utility PS WINNER Network RS WS App Business PS Storage RS Compute RS

Process Workf l

  • w engine

Services Process Globus engine WINNER Process BPEL engine WINNER

WINNER PS Grid App

DRAC

PS = Process Service RS = Resource Service

slide-13
SLIDE 13

WINNER - 13 GlobusWorld 2005 Nortel Networks Labs

WINNER and Late-Binding

> Late binding resources with workflows happen when

  • Workflow services and/or resources supply change
  • Workflows compete or optimize for resources
  • Workflows have special or uncertain requirements for resources

> WINNER performs workflow-aware late-binding, through DRAC

  • Network resource selections or alternations according to

applications

  • Resource optimization among workflows
  • Service site selections or alternations, together with service

providers

slide-14
SLIDE 14

WINNER - 14 GlobusWorld 2005 Nortel Networks Labs

Use Case: Workflow Engaged Networks for Radiology in Metro Regions

> Workflows of radiology data transporting and medical processing

  • Application-aware network resource allocations
  • Dynamic adjustments of network resources and workflow priorities
  • Maximal utilization of network resources
  • Workflow classifications

App Entry

slide-15
SLIDE 15

WINNER - 15 GlobusWorld 2005 Nortel Networks Labs

Use Case: Disaster Recovery

> Workflows of data evacuation and restoration in a disaster area

  • Critical Live Data pointing to survivors and their whereabouts
  • Sensor data showing distress in architectural structures and environment

> Orchestrates network resources for orderly, max-yield workflows

  • Sensor-triggered workflow automation without any operator involvement
  • End-to-end, secure, across the agile network infrastructure
  • Policy-driving resource allocation and its preemptive usage
slide-16
SLIDE 16

WINNER - 16 GlobusWorld 2005 Nortel Networks Labs

Related Work

> WSBPEL or BPEL4WS: the OASIS effort

  • http://www.oasis-open.org

> GridFlow/SDRC Matrix: a peer-to- peer infrastructure for Grid

Workflow Management Systems

  • http://www.npaci.edu/dice/srb/matrix/

> GSFL and GridAnt: Globus workflow effort

  • http://www-unix.globus.org/cog/projects/workflow/

> Pegasus: mapping of complex scientific workflows onto the grid

  • http://pegasus.isi.edu/pegasus/main.htm

> GWFE: execute their workflow applications on Grids

  • http://www.gridbus.org/workflow/: Globus 2.4

> Taverna: a language and software tools for eScience

  • http://taverna.sourceforge.net/
slide-17
SLIDE 17

WINNER - 17 GlobusWorld 2005 Nortel Networks Labs

Summary

> WINNER integrates network resources with WS workflows

  • WINNER processes, process services and resource services
  • Workflow-aware network resource orchestration

> DRAC network services are leveraged for allocation and information in network resource orchestration > Late-binding gives the adaptability to orchestrate network resources in favor of workflows’ needs > WINNER fits with Grids, Web Services, and other workflow applications

  • Enhances business processes with resource extensions
  • WS workflows can take advantages of Grids

> Two use-cases show the workflow benefits in medical and disaster applications

slide-18
SLIDE 18

WINNER - 18 GlobusWorld 2005 Nortel Networks Labs

Questions and Comments ? Workflow Integrated Network Resource Orchestration