Autonomic Grid Computing: Concepts, Infrastructure and Applications The Applied Software Systems Laboratory ECE/CAIP, Rutgers University http://www.caip.rutgers.edu/TASSL htt // i t d /TASSL (Ack: NSF, DoE, NIH) Outline • Pervasive Grid Environments - Unprecedented Opportunities • Pervasive Grid Environments - Unprecedented Challenges • Autonomic Grid Computing • Project AutoMate @ TASSL, Rutgers University – Enabling Autonomic Applications in Pervasive Grid Environments Autonomic Applications in Pervasive Grid Environments • An Illustrative Application • Concluding Remarks 1
Grid Computing – The Hype! Grid Computing By M. Mitchell Waldrop May 2002 Hook enough computers together and what do you get? A new kind of utility that offers supercomputer processing on tap. Is Internet history about to repeat itself? Defining Grid Computing … “… a concept, a network, a work in progress, part hype and part reality, and it’s • increasingly capturing the attention of the computing community …” A. Applewhite, IEEE DS-Online “ … grids are networks for computation grids are networks for computation – they are thinking number-crunching entities they are thinking, number crunching entities. • Like a decentralized nervous system, grids consist of high-end computers, servers, workstations, storage systems, and databases that work in tandem across private and public networks …” O. Malik, Red Herring “… a kind of hyper network that links computers and data storage owned by different • groups so that they can share computing power…” USA Today ‘The Matrix’ crossed with ‘Minority Report’ … D. Metcalfe (quoted in Newsweek) • “… use clusters of personal computers, servers or other machines. They link together • to tackle complex calculations In part grid computing lets companies harness their to tackle complex calculations. In part, grid computing lets companies harness their unused computing power, or processing cycles, to create a type of supercomputer …” J. Bonasia, Investor’s Business Daily “… grid computing links far-flung computers, databases, and scientific instruments • over the public internet or a virtual private network and promises IT power on demand…… All a user has to do is submit a calculation to a network of computers linked by grid-computing middleware. The middleware polls a directory of available machines to see which have the capacity to handle the request fastest…” A. Ricadela, Information Week 2
The Grid Vision • Imagine a world – in which computational power (resources, services, data, etc.) is as readily available as electrical power y p – in which computational services make this power available to users with differing levels of expertise in diverse areas – in which these services can interact to perform specified tasks efficiently and securely with minimum of human intervention • on-demand, ubiquitous access to computing, data, and services • new capabilities constructed dynamically and transparently from distributed services – a large part of this vision was originally proposed by Fenando Corbato (The Multics Project, 1965, www.multicians.org) Grid Idea By A Simple Analogy Some power stations One consumer One consumer dispersed dispersed wants to access to everywhere Now the user is that power produce the able to access to electrical power the power grid He/she comes to an agreement with the The produced electrical society power is The electrical distributed over a society provides power network for a new socket in which the user can plug • The user: – Does not need to know anything about what stays beyond the socket. – Can absorb all the power he wants according to the agreement • The power society – Can modify production technologies at any moment – Manages the power network as it wants – Defines terms and conditions of the agreement Ack. F. Scibilia 3
In the same way . . . Computing power is made available over the Internet Some computing One user wants to farms produce access to intensive the computing the computing computational power Now the user power accesses to grid facilities as a grid He/she comes to an user agreement with some society that offers grid services The society will provide for grid facilities allowing the user to access to its grid resources and providing for proper tools • • The user: The user: – Does not need to know what stays beyond its user interface – Can access to a massive amount of computational power through a simple terminal • The society: – Can extend grid facilities at any moment – Manages the architecture of the grid – Defines policies and rules for accessing to grid resources Ack. F. Scibilia What about Grid Computing Grid Computing paradigm is an emerging way of thinking distributed environments in a global scale infrastructure to: infrastructure to: • Share data • Distribute computation • Coordinate works • Access to remote instrumentation Ack. F. Scibilia 4
Key Enablers of Grid Computing - Exponentials • Network vs. computer performance – Computer speed doubles every 18 months – Storage density doubles every 12 S months – Network speed doubles every 9 months – Difference = order of magnitude per 5 years • 1986 to 2000 Scientific American (Jan-2001) – Computers: x 500 – Computers: x 500 – Networks: x 340,000 “When the network is as fast as the computer's internal links, the machine disintegrates across • 2001 to 2010 the net into a set of special purpose – Computers: x 60 appliances ” – Networks: x 4000 (George Gilder) Ack: I. Foster Why Computing Grids now? Thousands of CPUs • Because the amount of working at the same time computational power needed by on the same task many applications is getting very huge huge From hundreds of Gigabytes to Petabytes (10 15 ) produced • Because the amount of data requires massive and complex distributed by the same application. storage systems People of several organizations • To make easier the cooperation of working together to achieve a people and resources belonging to common goal different organizations • To access to particular Because it cannot be moved or instrumentation that is not easily replicated or its cost is too much reachable in a different way expensive. To create a marketplace of • Because it is the next of step in the evolution of distribution of computational power and computation storage over the Internet Ack. F. Scibilia 5
Who is interested in Grids? Research community, to carry out important results from experiments that involve many and many people and massive d l d i amounts of resources Enterprises that can have huge computation without the need for extending their current informatics infrastructure Businesses, which can provide for computational power and data storage against a contract or for rental Ack. F. Scibilia Properties of Grids • Transparency – The complexity of the Grid architecture is hidden to the final user – The user must be able to use a Grid as it was a unique virtual supercomputer The user must be able to use a Grid as it was a unique virtual supercomputer – Resources must be accessible setting their location apart • Openness – Each subcomponent of the Grid is accessible independently of the other components • Heterogeneity – Grids are composed by several and different resources • • Scalability Scalability – Resources can be added and removed from the Grid dynamically • Fault Tolerance – Grids must be able to work even if a component fails or a system crashes • Concurrency – Different processes on different nodes must be able to work at the same time Ack. F. Scibilia 6
Challenged Issues in Grids (i) • Security – Authentication and authorization of users – Confidentiality and not repudiation Confidentiality and not repudiation • Information Services – To discover and monitor Grid resource – To check for health-status of resources – As basis for decision making processes • File Management – Creation, modification and deletion of files – Replication of files to improve access performances – Ability to access to files without the need to move tham locally to the code • Administration – Systems to administer Grid resource respecting local administration policies Ack. F. Scibilia Challenged Issues in Grids (ii) • Resource Brokering – To schedule tasks across different resources – To make optimal or suboptimal decisions To make optimal or s boptimal decisions – To reserve (in the future) resources and network bandwidth • Naming services – To name resources in un unambiguous way in the Grid scope • Friendly User Interfaces – Because most of Grid users have nothing to do with computing science (physicians chemistries science (physicians, chemistries . . .) ) – Graphical User Interfaces (GUIs) – Grid Portals (very similar to classical Web Portals) – Command Line Interfaces (CLIs) for experts Ack. F. Scibilia 7
Recommend
More recommend
