Gigi Karmous-Edwards gigi@mcnc.org May 14, 2006 TERENA Workshop - - PowerPoint PPT Presentation

Gigi Karmous-Edwards

gigi@mcnc.org

May 14, 2006

TERENA Workshop Catania

• Motivation
• Optical Control Plane
• EnLIGHTened Computing
• GLIF
• Conclusions

Outline

Motivation

• E-science: global, large scale scientific collaborations

enabled through distributed computational and communication infrastructure

• Combines scientific instruments and sensors, distributed data

archives, computing resources and visualization to solve complex scientific problems

• In physics, molecular biology, environmental, Health,

Entertainment, etc.

E-science and Grid Computing

• Grid computing: main enabler of E-science
• Grid is concerned with "coordinated resource sharing and

problem solving in dynamic, multi-institutional virtual

• rganizations." (Foster)
• E-science migrated to Grid for the reasons of affordability of

high-bandwidth communication infrastructure, affordability of resources and inter-disciplinary nature of the research

E-science and Grid Computing

Demands on Networks: Advanced Support of E-science Apps

Optical Network

Grid Cluster Grid Cluster Grid Cluster Grid Cluster Grid Cluster Grid Cluster

• 1000 channels per fiber….. Experimentation with 160G per

channel

• Dark Fiber every where ….
• Fiber is much cheaper…US Headlines: Google buys Fiber
• All-optical switches are getting faster and smaller (ns switch

reconfiguration)

• Control Plane protocols, SOA, continue to mature
• Layer one Optical switches relatively cheaper than other

technologies

• Electronic Dispersion Compensation
• Fiber, optical impairments control, and transceiver

technology continue to advance while reducing prices

Advances in Optical Technologies

• High bandwidth connectivity of supercomputers (teraflops+)
• Large file transfers, over long distances
• Advanced support of E-science applications
• Application-driven and automatic resource management
• Determinism (QoS), jitter and latency requirements
• Coordination of network with computational and non-

computational resources (CPU, databases, sensors, instruments

• Mechanisms for retrieving near-real-time information about

network resources and network states

• Mechanism for both advance and fast on-the-fly reservation and

set-up

• Policy and security enforcement in open scientific

environments

New Demands on Networks

• Applications/end-users/sensors/instruments requesting
• ptical networking resources host-to-host connections
• on demand
• Near-real-time feedback of network performance

measurements to the applications and middleware

• Exchange data with sensors via potentially other

physical resources

• Destination may not be known initially rather only a

service is requested from source and the destination is derived from the request information

New Demands on Networks (cont’d)

• Integrating Advancing Optical Technologies into the experimental Environment
• Advanced reservation of networking resources - Grid Scheduler (middleware)

interacts with control plane

• Applications requesting optical networking resources – host-to-host connections

(applications interacting w/ control plane (this is not done today)

• Very dynamic on-demand use of end-to-end networking resources - feedback

loop between control plane, Application, and Grid middleware

• Near-real-time feedback of network performance measurements to the

applications and middleware

• Interoperation across Global Grid networks - network interdomain protocols

for Grid infrastructure rather than between operators

• Policy and Security

Research Challenges

Control Plane

“Infrastructure and distributed intelligence that controls the establishment and maintenance of connections in the network, including protocols and mechanisms to disseminate this information; and algorithms for engineering an optimal path between end points.” Draft-ggf-ghpn-opticalnets-1

One Definition of Control Plane

Centralized vs. Distributed…

Key areas for Today’s Control Plane are: 1) Provisioning 2) Recovery

Network Management (Hierarchical ) NE NE NE

Migration

Centralized (vertical)

Network Management NE NE NE

Distributed (Horizontal)

Protocols Protocols

Network Behavioral Control

• Routing - Intra-domain and Inter-domain

1) automatic topology and resource discovery 2) path computation (How do we use the infrastructure)

• Signaling - standard communications protocols between

network elements for the establishment and maintenance of connections

• Neighbor discovery - NE sharing of details of

connectivity to all its neighbors (very powerful tool)

• Local resource management - accounting of local

available resources

Control Plane Functions

EnLIGHTened Computing

Highly-dynamic Grid E-science Applications Driving Adaptive Optical Control Plane and Compute Resources

NSF seed funded project

key Institutions collaborating on the research efforts

• MCNC (Network research), -PI -Gigi Karmous-Edwards,

Yufeng Xin, Steve Thorpe, Bonnie Hurst, Lina Battestilli, Mark Johnson , John Moore

• LSU (Application and Grid research), PI -Ed Seidel, PI -

Gabriele Allen, PI - Seung Jong (Jay) Park , Jon Maclaren, Andrei Hutanu, Lonnie Leger

• Renaissance Computing Institute, RENCI (Grid Middleware

research): (a joint institute between UNC, Duke and NC State ), PI - Dan Reed, Alan Bletecky, Lavanya Ramakrishnan, Joel Dunn

• NCSU (Network research), Savera Tanwir, Harry Perros

EnLIGHTened team significance

Key Partner Institutions (cost share)

• Cisco, Javad Boroumand, Russ Gyurek, Wane Clark, Kevin

McGratten

• AT&T Rick Schlichting, John Strand, Matti Hiltunen
• IBM Steve Hunter, Ed Bowen
• SURA Gary Crane
• Naval Research Lab (NRL) , Hank Dardy
• Calient Networks, Olivier Jerphagnon, Ron Mackey
• UCSB/Calient, John Bowers
• NLR

EnLIGHTened team significance (cont’d)

connectivity diagram with partners

Cisco/UltraLight wave EnLIGHTened wave (Cisco/NLR) LONI wave

Members:

• MCNC GCNS
• Renaissance Comp. Inst.
• LSU CCT

Official Partners:

• AT&T Research
• SURA
• NRL
• Cisco Systems
• Calient Networks
• IBM

NSF Project Partners

• OptIPuter
• UltraLight
• WAN-in-LAB
• DRAGON

International Partners

• GLIF

CHI HOU DAL TUL KAN PIT WDC OGD BOI CLE POR DEN

SVL

SEA Baton Rouge Raleigh

To Asia To Canada To Europe

L.A. San Diego

CAVE wave

Chicago

• 1. Black Hole simulations - Astrophysics LSU
• 2. SCOOP - Ocean observatory - SURA Partner -

Gary Crane

• 3. BIRN project with Mark Ellisman (NIH)
• Optiputer cooperation and EnLIGHTened Wave
• 4. HEP - UltraLight - Harvey Newman
• 5. International research - applications with partner

NRENs across EU- Enlightened is an official EC project partner (sister-project)

Participating Applications in several Science areas!

EC Sister project L.U.C.I testbed

Japan’s G-Lambda research collaboration

Slide: Courtesy of Michiaki Hayashi KDDI R&D Laboratories Inc.

Japan’s G-Lambda research collaboration

Slide: Courtesy of Michiaki Hayashi KDDI R&D Laboratories Inc.

• High bandwidth pipes along very long distances –

terabyte transfers, petabyte, etc

• Dynamic applications adapting to middleware

resource information

• Network resources coordinated with vital Grid

resources – CPU, and Storage

• Advanced reservation and on-the-fly dynamic

requests of coordinated resources (CPU,Storage, network)

Problem Scope

• Deterministic end-to-end connections – low jitter,

low latency

• Applications requiring both high capacity pipes

and Internet (dual NIC hosts)

• Near-real-time feedback loop of

Network/CPU/Storage performance measurements and availability to the applications and middleware

• Global collaboration over global network

resources (GLIF)

Problem Scope

• Coordination of resources per request for both on-the-fly and

advanced reservations - Network resources is an integral part

• f the application’s request for shared resources
• Advanced reservation in distributed form - Borrow from

ATM research

• Optimization of Resource Allocation
• Interdomain across Global Grid networks - network

interdomain protocols, policies (management plane and control plane, Grid … WEB services )

• Dynamic and Adaptive on-demand use of end-to-end

networking resources (requires near real-time feedback loop)- Identification of functions and interactions between the control plane, management plane, and Grid middleware

Enlightened’s Research Challenges

• Monitoring information of resources - i)

identification of information, ii) abstraction of information, and iii) frequency of updates

• Software algorithms to support multiple classes of

software including highly-dynamic, workflow engines, data-driven and event-driven applications

• Rethinking the Behavioral Control of Networks
• Control/management planes interacting with

middleware

• Centralized vs. distributed functionality

Enlightened Research Challenges

Resource Allocation Resource Manager Co-Scheduler Resource Monitoring Applications Edge Routers Workflow Engines Application Abstraction Layer (API) Policy Translate app request to policy

• Discovery
• Performance
• Policy

For SLA Monitoring

Policy Feedback Loop

Abstraction

Middleware Architecture (in -progress)

Conclusions

Further Reference

IEEE Communications Magazine Feature Topic Optical Control Plane for Grid Networks: Opportunities, Challenges and the Vision Guest Editors: Admela Jukan and Gigi Karmous-Edwards March, 2006

Vol.44 No.3 March 2006

An Optical Control Plane for The Grid Community

Conclusions

• Control Plane research is vital to meeting future

generation Grid computing - with a strong focus on “vertical integration”

• GLIF resources should be used for both network

research and E-applications (morphnet concept)

• Reconfigurability is essential top bring down cost

and meet application requirements..

• Currently, we have a view of the behavior of

potential future enterprise applications by focusing

• n the needs of Big E-science applications, but it is

also important to understand the requirements of Industry.

Conclusions

• Next generation networks could be vastly different

than today’s mode of operation - should not constrain research to today’s model

• The Research networks are the ones that will take

these bold steps not the carriers… apply lessons learned to production quickly.

• International Collaboration is a very Key ingredient

for the future of Scientific discovery - The Optical network plays the most critical role in achieving this!

THANK YOU

Thank You!