information storage and processing for web search
play

Information Storage and Processing for Web Search Nicola Tonellotto - PowerPoint PPT Presentation

Nov 13, 2022 •119 likes •1.43k views

Information Storage and Processing for Web Search Nicola Tonellotto ISTI-CNR nicola.tonellotto@isti.cnr.it Universit La Sapienza 18 October 2016 1 Outline Some info about ISTI-CNR Introduction to Information Retrieval and Web

  1. Query Processing Breakdown � Pre-process the query (e.g., tokenisation, stemming) � Lookup the statistics for each term in the lexicon � Process the postings for each query term, computing scores for documents to identify the final retrieved set � Output the retrieved set with metadata (e.g., URLs) Università La Sapienza – 18 October 2016

  2. Document-at-a-Time (DAAT) Università La Sapienza – 18 October 2016

  3. Dynamic Pruning •What takes time? - Number of query terms ‣ Longer queries have more terms with posting lists to process - Length of posting lists ‣ More postings takes longer times •Aim: avoid (unnecessary) scoring of posting 26 Università La Sapienza – 18 October 2016

  4. Safeness • Safe pruning : the output ordering of the strategy is identical to the output ordering of the full processing • Safe up to rank K : the first K documents are identical to the first K documents of the full processing • Approximate : no guarantees on final ordering of document w.r.t. full processing 27 Università La Sapienza – 18 October 2016

  5. Safeness • Safe pruning : the output ordering of the strategy is identical to the output ordering of the full processing • Safe up to rank K : the first K documents are identical to the first K documents of the full processing • Approximate : no guarantees on final ordering of document w.r.t. full processing 27 Università La Sapienza – 18 October 2016

  6. DAAT Pruning • MaxScore (Turtle & Flood, IPM 31(6), 1995) - Early termination : does not compute scores for documents that won’t be retrieved - By comparing upper bounds with threshold - Suitable for TAAT as well • WAND (Broder et al., CIKM 2003) - Approximate evaluation : does not consider documents with approximate scores (sum of upper bounds) lower than threshold - Exploit skipping • BlockMaxWAND (Ding & Suel, SIGIR 2011) - Two levels: initially on blocks (128 postings), then on postings - Approximate evaluation : does not consider documents with approximate scores (sum of upper bounds) lower than threshold - Exploit skipping • All three use docids sorted posting lists 28 Università La Sapienza – 18 October 2016

  7. Some (Unpublished) Results (50 M docs) Num Terms Ranking Algorithm 1 2 3 4 5 6 7 43.59 38.08 32.68 25.23 29.26 17.57 15.78 Ranked And 43.05 261.59 536.06 807.05 1,107.93 1,402.26 1,756.52 Ranked Or MaxScore 45.01 48.21 51.06 57.28 75.66 95.06 117.61 Wand 62.62 44.98 48.24 55.27 69.39 98.47 120.70 BlockMaxWand 0.71 13.11 40.69 64.62 99.95 149.94 192.65 Average Response Times (msec) Num Terms Ranking Algorithm 1 2 3 4 5 6 7 Ranked And 265.25 182.84 136.33 101.75 94.99 66.70 61.26 Ranked Or 260.74 838.04 1,296.98 1,759.49 2,209.58 2,663.02 3,130.37 245.03 189.39 174.92 175.44 215.57 253.29 313.25 MaxScore Wand 387.55 210.37 184.10 182.05 210.05 289.27 337.07 1.64 43.05 140.12 201.39 280.05 394.48 500.16 BlockMaxWand 95% Response Time (msec) 29 Università La Sapienza – 18 October 2016

  8. Web Search Engine Learned Feature Lookup Query Processing Ranking and Calculation Function Vertical Vertical Core Document Learning to Rank Index Vertical Index Inverted Vertical Feature Technique Index Vertical Index Index Repository Index Training Metadata Feature Indexer Data Processor Processor Text Processor Document Document Collection Collection Crawling 30 Università La Sapienza – 18 October 2016

  9. Learning to Rank is not classification relevant query, Black Box or 
 document not relevant

  10. Learning to Rank is: query, 
 ranked list 
 Black Box d 1 , d 2 , d 3 , … d 17 , d 13 , d 666 , … The goal is to learn the ranking, not the label !

  11. Learning to Rank is: Machine Learning (a.k.a. Black Magic) query, 
 ranked list 
 Black Box d 1 , d 2 , d 3 , … d 17 , d 13 , d 666 , … The goal is to learn the ranking, not the label !

  12. Learning to Rank is: large training set of queries and ideal document ranking 
 q a , d 1 , d 2 , d 3 , d 5 , d 8 , d 13 , d 21 , … 
 q b , d 99 , d 98 , d 97 , d 96 , d 95 , d 94 , … Machine Learning (a.k.a. Black Magic) query, 
 ranked list 
 Black Box d 1 , d 2 , d 3 , … d 17 , d 13 , d 666 , … The goal is to learn the ranking, not the label !

  13. Normalized Discounted Cumulative Gain 
 NDCG@K • Consider only the top-K ranked documents, 
 and sum up (cumulate) their contribution • The contribution (gain) of a result depends on its relevance label • Contribution is diminished (discounted) if the result is in the “bottom” positions • Normalize between 0 and 1 • rel i is the relevance label of the i-th result (e.g., 1..5) • IDCG@k is the score of the ideal ranking

  14. Learning to Rank Approaches • Pointwise • Each query-document pair is associated with a score • The objective is to predict such score • Can be considered a regression problem • Does not consider the position of a document into the result list • Pairwise • We are given pairwise preferences, d1 is better than d2 for query q • The objective is to predict a score that preserves such preferences • Can be considered a classification problem • It partially considers the position of a document into the result list • Listwise • We are given the ideal ranking of results for each query • NB: It might not be trivial to produce such training set • Objective maximize the quality of the resulting ranked list • We need some improved approach…

  15. Decision Tree • Tree-like structure similar to a flow chart. • Every internal node denotes a test over an attribute/feature • Outgoing edges correspond to the test possible outcomes • Every leaf node is associated to a class label (if it is a classification task) or class distribution or predicted value (if it is a regression task) • It is used to label a new data instance on the basis of its attributes • Runs tests on the data instance attributes and traverses the tree according to the tests results • Starting form the root, the data instances follows a path to a leaf • The label associated to the leaf is the prediction of the decision tree.

  16. (Basic) Boosted Decision Trees

  17. (Basic) Boosted Decision Trees • We want to learn a predictor incrementally: • Input: a learning sample { (x i ,y i ): i = 1, …, N }

  18. (Basic) Boosted Decision Trees • We want to learn a predictor incrementally: • Input: a learning sample { (x i ,y i ): i = 1, …, N } • Initialize • Baseline tree predicts the average label value ŷ 0 (x) = 1/N ∑ i y i r i = y i , i = 1, …, N

  19. (Basic) Boosted Decision Trees • We want to learn a predictor incrementally: • Input: a learning sample { (x i ,y i ): i = 1, …, N } • Initialize • Baseline tree predicts the average label value ŷ 0 (x) = 1/N ∑ i y i r i = y i , i = 1, …, N • For t = 1 to M: • Regression tree predicts the residual error • For i = 1 to N, compute the residuals r i ← r i-1 - ŷ t-1 (x i ) • Build a regression tree from the learning sample { (x i ,y i ): i = 1, …, N } • The prediction of the new regression tree is denoted with ŷ t

  20. (Basic) Boosted Decision Trees • We want to learn a predictor incrementally: • Input: a learning sample { (x i ,y i ): i = 1, …, N } • Initialize • Baseline tree predicts the average label value ŷ 0 (x) = 1/N ∑ i y i r i = y i , i = 1, …, N • For t = 1 to M: • Regression tree predicts the residual error • For i = 1 to N, compute the residuals r i ← r i-1 - ŷ t-1 (x i ) • Build a regression tree from the learning sample { (x i ,y i ): i = 1, …, N } • The prediction of the new regression tree is denoted with ŷ t • Return the model ŷ (x)= ŷ 0 (x) + ŷ 1 (x) + … + ŷ M (x)

  21. (Basic) Boosted Decision Trees • We want to learn a predictor incrementally: • Input: a learning sample { (x i ,y i ): i = 1, …, N } • Initialize • Baseline tree predicts the average label value ŷ 0 (x) = 1/N ∑ i y i r i = y i , i = 1, …, N • For t = 1 to M: • Regression tree predicts the residual error • For i = 1 to N, compute the residuals r i ← r i-1 - ŷ t-1 (x i ) • Build a regression tree from the learning sample { (x i ,y i ): i = 1, …, N } • The prediction of the new regression tree is denoted with ŷ t • Return the model ŷ (x)= ŷ 0 (x) + ŷ 1 (x) + … + ŷ M (x) • Function f m should be easy to be learnt: • Decision stump: trees with one node and two leaves

  23. Documents F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  24. Trees 0.4 -1.4 7.1 2.0 0.5 -3.1 1.5 3.2 Documents F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  25. Trees 50.1:F 4 0.4 -1.4 7.1 2.0 0.5 -3.1 1.5 3.2 Documents F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  26. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  27. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  28. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  29. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  30. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  31. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  32. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  33. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  34. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  35. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  36. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  37. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  38. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  39. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  40. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  41. Struct+ Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 2.0 0.2:F 2 3.0:F 8 Exit leaf 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  42. Struct+ Trees 50.1:F 4 -3.0:F 3 Need to store the structure 10.1:F 1 of the tree 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 2.0 0.2:F 2 3.0:F 8 Exit leaf 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  43. Struct+ Trees 50.1:F 4 -3.0:F 3 Need to store the structure 10.1:F 1 of the tree 0.4 -1.4 -1.0:F 3 0.1:F 6 High branch misprediction rate 7.1 2.0 2.0 0.2:F 2 3.0:F 8 Exit leaf 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  44. Struct+ Trees 50.1:F 4 -3.0:F 3 Need to store the structure 10.1:F 1 of the tree 0.4 -1.4 -1.0:F 3 0.1:F 6 High branch misprediction rate 7.1 2.0 2.0 0.2:F 2 3.0:F 8 Exit leaf Low cache hit ratio 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  45. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  46. If-then-else Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  47. If-then-else Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  48. If-then-else Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 if (x[4] <= 50.1) { // recurses on the left subtree Documents # docs = >100K … F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  49. If-then-else Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 if (x[4] <= 50.1) { // recurses on the left subtree Documents # docs = >100K … F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 } else { # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 // recurses on the right subtree # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  50. If-then-else Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 if (x[4] <= 50.1) { // recurses on the left subtree Documents # docs = >100K … F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 } else { # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 // recurses on the right subtree # features = 100–1000 if(x[3] <= -3.0) 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 result = 0.4; # leaves = 4–64 else 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 result = -1.4; … }

  51. If-then-else Trees 50.1:F 4 -3.0:F 3 Need to store the structure 10.1:F 1 of the tree 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 if (x[4] <= 50.1) { // recurses on the left subtree Documents # docs = >100K … F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 } else { # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 // recurses on the right subtree # features = 100–1000 if(x[3] <= -3.0) 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 result = 0.4; # leaves = 4–64 else 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 result = -1.4; … }

  52. If-then-else Trees 50.1:F 4 -3.0:F 3 Need to store the structure 10.1:F 1 of the tree 0.4 -1.4 -1.0:F 3 0.1:F 6 High branch misprediction rate 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 if (x[4] <= 50.1) { // recurses on the left subtree Documents # docs = >100K … F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 } else { # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 // recurses on the right subtree # features = 100–1000 if(x[3] <= -3.0) 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 result = 0.4; # leaves = 4–64 else 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 result = -1.4; … }

  53. If-then-else Trees 50.1:F 4 -3.0:F 3 Need to store the structure 10.1:F 1 of the tree 0.4 -1.4 -1.0:F 3 0.1:F 6 High branch misprediction rate 7.1 2.0 0.2:F 2 3.0:F 8 Low cache hit ratio 0.5 -3.1 1.5 3.2 if (x[4] <= 50.1) { // recurses on the left subtree Documents # docs = >100K … F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 } else { # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 // recurses on the right subtree # features = 100–1000 if(x[3] <= -3.0) 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 result = 0.4; # leaves = 4–64 else 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 result = -1.4; … }

  54. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  55. Vpred Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  56. Vpred Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents double depth4(float* x, Node* nodes) { # docs = >100K int nodeId = 0; F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; # features = 100–1000 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; # leaves = 4–64 return scores[nodeId]; 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 } …

  57. Vpred Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents double depth4(float* x, Node* nodes) { # docs = >100K int nodeId = 0; F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; 16 docs # features = 100–1000 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 nodeId = nodes->children[x[nodes[nodeId].fid] > nodes[nodeId].theta]; # leaves = 4–64 return scores[nodeId]; 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 } …

  58. Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  59. An alternative traversing algorithm Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 7.1 2.0 0.2:F 2 3.0:F 8 0.5 -3.1 1.5 3.2 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  60. An alternative traversing algorithm Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  61. An alternative traversing algorithm ? Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  62. An alternative traversing algorithm Trees 50.1:F 4 ? -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  63. An alternative traversing algorithm Trees 50.1:F 4 ? -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  64. An alternative traversing algorithm Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  65. An alternative traversing algorithm Trees 50.1:F 4 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  66. An alternative traversing algorithm Trees 50.1:F 4 Result 1 1 1 1 1 1 1 1 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  67. An alternative traversing algorithm Trees 50.1:F 4 Result 1 1 1 1 1 1 1 1 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  68. An alternative traversing algorithm Trees 50.1:F 4 Result 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  69. An alternative traversing algorithm Trees 50.1:F 4 Result 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  70. An alternative traversing algorithm Trees 50.1:F 4 Result 0 0 0 1 1 1 0 0 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  71. An alternative traversing algorithm Trees 50.1:F 4 Result 0 0 0 1 1 1 0 0 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  72. An alternative traversing algorithm Trees 50.1:F 4 Result 0 0 0 1 0 0 0 0 0 0 0 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  73. An alternative traversing algorithm Trees 50.1:F 4 Result 0 0 0 1 0 0 0 0 0 0 0 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

  74. An alternative traversing algorithm Trees 50.1:F 4 Result 0 0 0 0 0 0 1 1 0 0 0 1 1 1 0 0 0 0 0 1 0 0 0 0 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 -3.0:F 3 10.1:F 1 0.4 -1.4 -1.0:F 3 0.1:F 6 6 7 7.1 2.0 0.2:F 2 3.0:F 8 0 3 0.5 -3.1 1.5 3.2 1 2 4 5 Documents # docs = >100K F 1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 # trees = 1K–20K 13.3 0.12 -1.2 43.9 11 -0.4 7.98 2.55 # features = 100–1000 10.9 0.08 -1.1 42.9 15 -0.3 6.74 1.65 # leaves = 4–64 11.2 0.6 -0.2 54.1 13 -0.5 7.97 3 …

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Top- k Processing for Search and Information Discovery in Social Applications Lecture 2:

Top- k Processing for Search and Information Discovery in Social Applications Lecture 2:

Top- k Processing for Search and Information Discovery in Social Applications Lecture 2: Network-Aware Search in Social Tagging Sites Sihem Amer-Yahia Julia Stoyanovich Social top- k @ Joint RuSSIR/EDBT Summer School 2011 Summary of last

622 views • 37 slides
search, storage, &amp; beyond History of Information December 5, 2007 a new line? &quot;to

search, storage, &amp; beyond History of Information December 5, 2007 a new line? &quot;to

search, storage, &amp; beyond History of Information December 5, 2007 a new line? &quot;to organize the world's information&quot; store order access HofI Store &amp;c - 2 storing Mesopotamia Ebla (Syria) c 2250 bce Babylon (Iraq) 15,000

505 views • 25 slides
storage &amp; search up in the clouds History of Information April 10, 2012 Tuesday, April 10,

storage &amp; search up in the clouds History of Information April 10, 2012 Tuesday, April 10,

storage &amp; search up in the clouds History of Information April 10, 2012 Tuesday, April 10, 2012 aob http://www.npr.org/series/149920095/starting-up-silicon-valleys-origins 24-HofI12_Storage&amp;Search-PD 3 Tuesday, April 10, 2012

755 views • 56 slides
Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural Sciences Sept. 11 Biological Information, Sept 16 DNA, Gene regulation Sept 18 Translation and Proteins Sept 23 Enzymes and Signal Transduction

436 views • 39 slides
Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural Sciences Sept 16 Introduction / DNA, Gene regulation Sept 18 Translation and Proteins Sept 23 Enzymes and Signal transduction Sept 25 Biochemical

1k views • 56 slides
Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural Sciences Sept. 11 Biological Information, Sept 16 DNA, Gene regulation Sept 18 Translation and Proteins Sept 23 Enzymes and Signal transduction Sept

633 views • 32 slides
Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural Sciences Sept. 11 Biological Information, Sept 16 DNA, Gene regulation Sept 18 Translation and Proteins Sept 23 Enzymes and Signal transduction Sept

752 views • 33 slides
Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural Sciences Sept. 11 Biological Information, Sept 16 DNA, Gene regulation Sept 18 Translation and Proteins Sept 23 Enzymes and Signal transduction Sept

797 views • 36 slides
Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural

Information Storage and Processing in Biological Systems: A seminar course for the Natural Sciences Sept. 11 Biological Information, Sept 16 DNA, Gene regulation Sept 18 Translation and Proteins Sept 23 Enzymes and Signal transduction Sept

492 views • 35 slides
Information Retrieval Data Processing and Storage Ilya Markov i.markov@uva.nl University of

Information Retrieval Data Processing and Storage Ilya Markov i.markov@uva.nl University of

Data processing Data storage Information Retrieval Data Processing and Storage Ilya Markov i.markov@uva.nl University of Amsterdam Ilya Markov i.markov@uva.nl Information Retrieval 1 Data processing Data storage Course overview Data

965 views • 57 slides
CSE 7/5337: Information Retrieval and Web Search Web Search (IIR 19) Michael Hahsler Southern

CSE 7/5337: Information Retrieval and Web Search Web Search (IIR 19) Michael Hahsler Southern

CSE 7/5337: Information Retrieval and Web Search Web Search (IIR 19) Michael Hahsler Southern Methodist University These slides are largely based on the slides by Hinrich Sch utze Institute for Natural Language Processing, University of

791 views • 63 slides
CSE 7/5337: Information Retrieval and Web Search Web Search (IIR 19) Michael Hahsler Southern

CSE 7/5337: Information Retrieval and Web Search Web Search (IIR 19) Michael Hahsler Southern

CSE 7/5337: Information Retrieval and Web Search Web Search (IIR 19) Michael Hahsler Southern Methodist University These slides are largely based on the slides by Hinrich Sch utze Institute for Natural Language Processing, University of

754 views • 72 slides
Top- k Processing for Search and Information Discovery in Social Applications Sihem Amer-Yahia

Top- k Processing for Search and Information Discovery in Social Applications Sihem Amer-Yahia

Top- k Processing for Search and Information Discovery in Social Applications Sihem Amer-Yahia Julia Stoyanovich Social top- k @ Joint RuSSIR/EDBT Summer School 2011 Why top- k ? Practical many applications, with new ones emerging every

700 views • 37 slides
Big Linked Data Storage and Query Processing Prof. Sherif Sakr ACM and IEEE Distinguished Speaker

Big Linked Data Storage and Query Processing Prof. Sherif Sakr ACM and IEEE Distinguished Speaker

Big Linked Data Storage and Query Processing Prof. Sherif Sakr ACM and IEEE Distinguished Speaker The 3rd KEYSTONE Training School on Keyword search in Big Linked Data Vienna, Austria August 21, 2017 http://www.cse.unsw.edu.au/~ssakr/

964 views • 78 slides
Data Processing WWW and search Internet introduced a new challenge in the form of a web

Data Processing WWW and search Internet introduced a new challenge in the form of a web

Data Processing WWW and search Internet introduced a new challenge in the form of a web search engine Web crawler data at a &quot;peta scale Requirement for efficient indexing to enable fast search (on a continuous basis)

824 views • 55 slides
The Root: A new facility for food processing, distribu?on, storage and educa?on Produc(on

The Root: A new facility for food processing, distribu?on, storage and educa?on Produc(on

The Root: Growing Food, Nurturing Community The Root: A new facility for food processing, distribu?on, storage and educa?on Produc(on Processing Storage Making the links between farmers, food processors and consumers to increase local

251 views • 11 slides
Plane Sweep Algorithms and Segment Intersection Carola Wenk 9/1/10 CS 6463: AT Computational

Plane Sweep Algorithms and Segment Intersection Carola Wenk 9/1/10 CS 6463: AT Computational

CS 6463: AT Computational Geometry Fall 2010 Plane Sweep Algorithms and Segment Intersection Carola Wenk 9/1/10 CS 6463: AT Computational Geometry 1 Closest Pair Problem: Given P R 2 , | P |= n , find the distance between the closest

529 views • 24 slides
STRIPS Planning Set of operators , where each operator has Set of parameters Set

STRIPS Planning Set of operators , where each operator has Set of parameters Set

STRIPS Planning Set of operators , where each operator has Set of parameters Set of preconditions Set of effects , consisting of add effects and delete effects. Set of objects to instantiate operators parameters fully

504 views • 26 slides
This webinar is brought to you by Community Law School (Sarnia Lambton) Inc. , a nonprofit,

This webinar is brought to you by Community Law School (Sarnia Lambton) Inc. , a nonprofit,

This webinar is brought to you by Community Law School (Sarnia Lambton) Inc. , a nonprofit, Community Law School (Sarnia Lambton) Inc. , a nonprofit, registered charitable organization devoted to public legal education and community advocacy

502 views • 26 slides
Welcome Back! Professor Shahrokh Valaee Associate Professor Associate Chair, Undergraduate Studies

Welcome Back! Professor Shahrokh Valaee Associate Professor Associate Chair, Undergraduate Studies

Welcome Back! Professor Shahrokh Valaee Associate Professor Associate Chair, Undergraduate Studies Who am I? Associate Chair, Undergraduate Studies Oversees and manages the delivery of the UG program Manages and facilitates annual

330 views • 21 slides
BEPS Action 4 : Interest Deductions and Financial Payments Jacques Malherbe Prof. Em. of the

BEPS Action 4 : Interest Deductions and Financial Payments Jacques Malherbe Prof. Em. of the

VIth Congress of International Tax Law Instituto Brasileiro de Direito Tributrio (IBDT) So Paulo 19-21 August 2015 BEPS Action 4 : Interest Deductions and Financial Payments Jacques Malherbe Prof. Em. of the Catholic University of Louvain

560 views • 24 slides
2008 2008 2008 2008 Investor Community Conference Call Risk Review Tom Flynn Executive

2008 2008 2008 2008 Investor Community Conference Call Risk Review Tom Flynn Executive

2008 2008 2008 2008 Investor Community Conference Call Risk Review Tom Flynn Executive Vice President and Chief Risk Officer May 27 2008 Forward Looking Statements Caution Regarding Forward-Looking Statements Bank of Montreals

711 views • 18 slides
Subcontracting Readings: OOSCS2 Chapters 14 16 EECS3311 A &amp; E: Software Design Fall 2020

Subcontracting Readings: OOSCS2 Chapters 14 16 EECS3311 A &amp; E: Software Design Fall 2020

Subcontracting Readings: OOSCS2 Chapters 14 16 EECS3311 A &amp; E: Software Design Fall 2020 C HEN -W EI W ANG Aspects of Inheritance Code Reuse Substitutability Polymorphism and Dynamic Binding [ compile-time type checks ]

556 views • 18 slides
Opinion Mining Opinion Mining Feiyu Xu DFKI, LT-Lab Xu, LT1, 2013 Outline Outline

Opinion Mining Opinion Mining Feiyu Xu DFKI, LT-Lab Xu, LT1, 2013 Outline Outline

Opinion Mining Opinion Mining Feiyu Xu DFKI, LT-Lab Xu, LT1, 2013 Outline Outline Introduction Definition of subjectivity and opinion Opinion mining as a language technology Research areas of opinion mining Dropping

826 views • 43 slides

More recommend