SQLB: A Query Allocation Framework for Autonomous Consumers and - PowerPoint PPT Presentation

1 SQLB: A Query Allocation Framework for Autonomous Consumers and Providers Jorge-Arnulfo Quiané-Ruiz, Philippe Lamarre, and Patrick Valduriez Atlas group, INRIA and LINA – Université de Nantes VLDB Conference September 27, 2007

2 Roadmap 1 Motivation and Problem Definition Satisfaction Model 2 3 SQLB Framework 4 Validation 5 Conclusion A TLAS

3 Context Large-scale D istributed I nformation S ystems (DIS) Autonomous participants (consumers and providers) May join and leave the system at will Have interests towards providers and queries Focus on Query Allocation A TLAS

4 Query Allocation Q uery l oad b alancing (QLB) : maximize overall system performance (throughput and response time) load p 1 query allocate query load System results results p 2 user load p 3 A TLAS

5 Problem Overview However , participants may have certain expectations ( intentions ) that are not only performance-related load I would want I would want results from p 3 to perform but wouldn’t want those of p 1 this query p 1 query allocate query System load It is crucial to satisfy participants! results results p 2 load user I wouldn’t want to perform this If several p 3 query It doesn’t matter if times I perform or not this query A TLAS

6 Problem Statement Assumptions: Large-scale and heterogeneous DIS Autonomous participants Queries must be treated whenever possible Let: q = < c , d , n > be an incoming query P q be the set of providers that are able to deal with q Problem: Allocate each q to a set P q such that good response time and participants’ satisfaction are ensured A TLAS

7 Challenge Query allocation is hard because: Query demand should be satisfied Participants should be satisfied to some (which?) extent Participants’ expectations may be contradictory A TLAS

8 Our Contributions SQLB Model A model to characterize the participants’ expectations in the long-run SQLB Framework A framework to allocate queries based on the participants’ satisfaction A TLAS

9 Roadmap 1 Motivation and Problem Definition Satisfaction Model 2 3 SQLB Framework 4 Validation 5 Conclusion A TLAS

10 Satisfaction Model Captures how well the system meets the participants’ expectations , Three notions: Adequation Satisfaction Allocation Satisfaction They are based on the k last participants’ interactions with the system A TLAS

11 Participant Characterization (1/3) Adequation: enables a participant to know whether it can reach its objectives I am a specialist in network devices Not adequate! A provider of I want to computer add-ons buy CDs and DVDs The Math user I want to buy System a desktop user computer I want to p ’s desire to The k last proposed queries user buy a laser perform query q by the system to p printer A TLAS

12 Participant Characterization (2/3) Satisfaction: enables a participant to know whether it is fulfilling its objectives I am a specialist request for some in network devices sound cards The Math request for some speakers System request for some A provider of monitors computer add-ons request for some Not satisfied! webcams p ’s desire to The queries that p performed perform query q among the k last queries the system proposed to it ( ) A TLAS

13 Participant Characterization (3/3) Allocation Satisfaction: enables a participant to know the reason of its dissatisfaction or satisfaction However, I Request for a PCI prefer to sell network card network devices I want to buy a PCI I sell all kind of network card computer add-ons user The Math I want to buy System a webcam Satisfied because of the user query allocation method! I want to buy a laser user printer p’s adequation p ’s satisfaction A TLAS

14 Roadmap 1 Motivation and Problem Definition Satisfaction Model 2 3 SQLB Framework 4 Validation 5 Conclusion A TLAS

15 Query Allocation Objectives Guarantee good system performance Be self-adaptable to the participants’ expectations Give interesting sources to consumers and interesting queries to providers To do so, participants are required to express their intentions A TLAS

16 Consumer Side: Intention Defines the consumer’s desire to see a given provider performing its query Is the result of merging consumer’s preferences with the provider’s reputation p ’s reputation c ’s preference to allocate q to p The Math Intention of a consumer c to Balance in accordance to Prevents the intention from taking allocate its query q to a provider p c ’s past experiences with p zero values A TLAS

17 Provider Side: Intention Defines the provider’s desire to perform a given query Is the result of merging provider’s preferences with the provider’s utilization p ’s preference to perform q p ’s utilization The Math Intention of a provider p Balance in accordance to It prevents the intention from to perform a query q p ’s satisfaction taking zero values A TLAS

18 Mediator Side: Providers’ Score Defines the provider’s importance to be allocated a given query Is the result of merging the consumer’s and provider’s intention p ’s intention to perform q q.c ’s intention to allocate q to p The Math Score of a provider p Balance in accordance to It prevents the score from taking given a query q q.c ’s and p ’s satisfaction zero values A TLAS

19 Mediator Side: Query Allocation input Consumer’s and providers’ intention w.r.t. q we compute where is the best scored provider and is the worst if p gets the query otherwise A TLAS

20 Roadmap 1 Motivation and Problem Definition Satisfaction Model 2 3 SQLB Framework 4 Validation 5 Conclusion A TLAS

21 Validation Objectives Evaluate if participants are satisfied with the query allocation process Evaluate the impact on performance of the participants’ departure Tested methods Capacity based (QLB approach) Mariposa-like (economic approach) SQLB (our proposal) A TLAS

22 Setup Parameter Value Number of consumers 200 Number of providers 400 Number of mediators 1 Query distribution Poisson k size for consumers 200 k size for providers 500 We implemented our algorithms in Java and used SimJava to simulate the network communication A TLAS

23 Satisfaction Results Providers’ allocation satisfaction Consumers’ allocation satisfaction SQLB has the same performance than Mariposa-like Consumers are satisfied only with the while Capacity based penalizes providers SQLB approach A TLAS

24 Performance Results (1/2) Captive participants : they are not allowed to leave the system Even if not designed for captive environments, SQLB ensures quite good response times A TLAS

25 Performance Results (2/2) Autonomous providers : they may leave the system at will Dissatisfaction: if p ’s satisfaction < p ’s adequation - 0.15 Starvation: if p does not perform at least 25% of queries than it expects Overutilization: if p performs a 220% more of queries than it expects SQLB significantly outperforms Capacity based and Mariposa-like by a factor of 2 in average A TLAS

26 Roadmap 1 Motivation and Problem Definition Satisfaction Model 2 3 SQLB Framework 4 Validation 5 Conclusion A TLAS

27 Summary SQLB Model Characterizes the participants’ expectations Allows to design and evaluate query allocation methods for autonomous environments SQLB framework Allows trading consumers’ intentions for providers’ intentions in accordance to their satisfaction Avoids query starvation Future work Develop an economical version of our approach Consider super-peer and unstructured P2P systems A TLAS

28 Danke! Questions ? Work partially funded by ARA « Massive Data » of the French ministry of research ( Respire project) and the European Strep Grid4All project. A TLAS