a pattern aware graph mining system
play

A Pattern-Aware Graph Mining System Kasra Jamshidi Rakesh Mahadasa - PowerPoint PPT Presentation

May 31, 2023 •178 likes •1.43k views

A Pattern-Aware Graph Mining System Kasra Jamshidi Rakesh Mahadasa Keval Vora Simon Fraser University https://github.com/pdclab/peregrine Why should you pay attention? Peregrine executes 700x faster Peregrine consumes 100x less memory

  1. Symmetry Breaking a e b x b d c y v f g Worker 1 Data Graph 70

  2. Symmetry Breaking a e b x b d c y d f g Worker 1 Data Graph 71

  3. Symmetry Breaking a e u x b x b d c y v y d f g Data Graph Worker 2 Worker 1 72

  4. Symmetry Breaking a e d x b x b d c y v y d f g Data Graph Worker 2 Worker 1 73

  5. Symmetry Breaking a e d x b x b d c y b y d f g Data Graph Worker 2 Worker 1 74

  6. Symmetry Breaking a e d a b a b d c y b y d f g Data Graph Worker 2 Worker 1 75

  7. Symmetry Breaking a e d a b a b d c g b g d f g Data Graph Worker 2 Worker 1 76

  8. Symmetry Breaking a e d a b a b d c g b g d f g Data Graph Worker 2 Worker 1 77

  9. Symmetry Breaking u x y v u < v 78

  10. Symmetry Breaking u x y v x < y 79

  11. Symmetry Breaking u x y v u < v x < y 80

  12. Core Pattern u x y v 81

  13. Core Pattern x u v y 82

  14. Core Pattern x u v y 83

  15. Core Pattern a e b b d c d f g Data Graph Pattern-Unaware 84

  16. Core Pattern a e b a b d c d f g Data Graph Pattern-Unaware 85

  17. Core Pattern a e b a b d c d f g Data Graph Pattern-Unaware 86

  18. Core Pattern a e b a b d c g d f g Data Graph Pattern-Unaware 87

  19. Core Pattern a e b a b d c g d f g Data Graph Pattern-Unaware 88

  20. Core Pattern a e b x b d c y d f g Data Graph Pattern-Aware 89

  21. Core Pattern a e b x b d c y d f g Data Graph Pattern-Aware 90

  22. Core Pattern a e b x b d c y d f g Data Graph Pattern-Aware 91

  23. Core Pattern a e b a b d c g d f g Data Graph Pattern-Aware 92

  24. Core Pattern a e b a b d c g d f h g Data Graph Pattern-Aware 93

  25. Core Pattern a e b a b a b d c g d h d f h g Data Graph Pattern-Aware 94

  26. Core Pattern a e b a b a b d c g d h d f h g Data Graph Pattern-Aware 95

  27. Pattern Awareness • Symmetry breaking (RECOMB ‘07) Pattern • Core pattern reduction Matching (SIGMOD ‘16) 96

  28. Pattern Awareness • Early termination Pattern Matching 97

  29. Early Termination bool globalClusteringCoefficient(int bound) { DataGraph G( “path/to/graph/” ); auto triplet = PatternGenerator::star(3); int numTriplets = count(G, {triplet}); auto countAndCheck = [=](auto &&match, auto &&aggregator) { int numTriangles = aggregator.readValue(match.pattern); if (3*numTriangles/numTriplets > bound) aggregator.stop(); else aggregator.map(match.pattern, 1); } auto triangle = PatternGenerator::clique(3); auto result = match<Pattern, int>(G, triangle, countAndCheck); return 3*result[triangle]/numTriplets > bound; } 98

  30. Early Termination bool globalClusteringCoefficient(int bound) { DataGraph G(“path/to/graph/”); auto triplet = PatternGenerator::star(3); int numTriplets = count(G, {triplet}); auto countAndCheck = [=](auto &&match, auto &&aggregator) { int numTriangles = aggregator.readValue(match.pattern); if (3*numTriangles/numTriplets > bound) aggregator.stop(); else aggregator.map(match.pattern, 1); } auto triangle = PatternGenerator::clique(3); auto result = match<Pattern, int>(G, triangle, countAndCheck); return 3*result[triangle]/numTriplets > bound; } 99

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Frequent Pattern Mining Frequent Sequence Mining Frequent Tree Mining Christian Borgelt

Frequent Pattern Mining Frequent Sequence Mining Frequent Tree Mining Christian Borgelt

Overview Frequent Pattern Mining comprises Frequent Item Set Mining and Association Rule Induction Frequent Pattern Mining Frequent Sequence Mining Frequent Tree Mining Christian Borgelt Frequent Graph Mining Dept. of Mathematics

1.52k views • 135 slides
GRAPH MINING AND GRAPH KERNELS Part I: Graph Mining Karsten Borgwardt^ and Xifeng Yan*

GRAPH MINING AND GRAPH KERNELS Part I: Graph Mining Karsten Borgwardt^ and Xifeng Yan*

Graph Mining and Graph Kernels GRAPH MINING AND GRAPH KERNELS Part I: Graph Mining Karsten Borgwardt^ and Xifeng Yan* ^University of Cambridge *IBM T. J. Watson Research Center August 24, 2008 | ACM SIG KDD, Las Vegas Graph Mining and Graph

1.28k views • 60 slides
gSpan: Graph-Based Substructure Pattern Mining Xifeng Yan Jiawei Han Department of Computer

gSpan: Graph-Based Substructure Pattern Mining Xifeng Yan Jiawei Han Department of Computer

gSpan: Graph-Based Substructure Pattern Mining Xifeng Yan Jiawei Han Department of Computer Science University of Illinois at Urbana-Champaign xyan, hanj @uiuc.edu Abstract chemical compound dataset in 10 minutes

303 views • 4 slides
CS6220: DATA MINING TECHNIQUES Chapter 7: Advanced Pattern Mining Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Chapter 7: Advanced Pattern Mining Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Chapter 7: Advanced Pattern Mining Instructor: Yizhou Sun yzsun@ccs.neu.edu January 28, 2013 Chapter 7: Advanced Pattern Mining Pattern Mining: A Road Map Pattern Mining in Multi-Level,

1.06k views • 62 slides
Scope Constrained Frequent Pattern Mining: Constrained Frequent Pattern Mining: A A

Scope Constrained Frequent Pattern Mining: Constrained Frequent Pattern Mining: A A

Scope Constrained Frequent Pattern Mining: Constrained Frequent Pattern Mining: A A Pattern-Growth View Pattern-Growth View Frequent Pattern Mining by Jian Pei and Jiawei Han Constraints presentation by Rafal Rak CMPUT 695

186 views • 7 slides
Arabesque.io A system for distributed graph mining Carlos Teixeira, Alexandre Fonseca, Marco

Arabesque.io A system for distributed graph mining Carlos Teixeira, Alexandre Fonseca, Marco

Arabesque.io A system for distributed graph mining Carlos Teixeira, Alexandre Fonseca, Marco Serafini, Georgos Siganos, Mohammed Zaki, Ashraf Aboulnaga 1 Graphs are ubiquitous 2 2 Graph Mining - Concepts Label Distinguishable

724 views • 57 slides
GRAPH MINING AND GRAPH KERNELS Part II: Graph Kernels Karsten Borgwardt^ and Xifeng Yan*

GRAPH MINING AND GRAPH KERNELS Part II: Graph Kernels Karsten Borgwardt^ and Xifeng Yan*

Graph Mining and Graph Kernels GRAPH MINING AND GRAPH KERNELS Part II: Graph Kernels Karsten Borgwardt^ and Xifeng Yan* ^University of Cambridge *IBM T. J. Watson Research Center August 24, 2008 | ACM SIG KDD, Las Vegas Graph Mining and

1.16k views • 48 slides
Graph Mining Marco Serafini COMPSCI 532 Lecture 11 Classes of Graph Systems Graph

Graph Mining Marco Serafini COMPSCI 532 Lecture 11 Classes of Graph Systems Graph

Graph Mining Marco Serafini COMPSCI 532 Lecture 11 Classes of Graph Systems Graph Computation Think like a vertex Linear algebra Graph Search Find instances of path expressions Graph Mining Mine patterns of

436 views • 16 slides
StreamWorks A System for Real-Time Graph Pattern Matching on Network Traffic GEORGE CHIN,

StreamWorks A System for Real-Time Graph Pattern Matching on Network Traffic GEORGE CHIN,

StreamWorks A System for Real-Time Graph Pattern Matching on Network Traffic GEORGE CHIN, SUTANAY CHOUDHURY AND KHUSHBU AGARWAL Pacific Northwest National Laboratory January 21, 2015 Unclassified 1 Emerging Graph Patterns Goal: Detect

796 views • 61 slides
PEGASUS: A peta-scale graph mining system - Implementation and observations U. Kang, C. E.

PEGASUS: A peta-scale graph mining system - Implementation and observations U. Kang, C. E.

PEGASUS: A peta-scale graph mining system - Implementation and observations U. Kang, C. E. Tsourakakis, C. Faloutsos What is Pegasus? Open source Peta Graph Mining Library Can deal with very large Giga-, Tera-, Peta-byte

552 views • 18 slides
Chapter X: Graph Mining Information Retrieval &amp; Data Mining Universitt des Saarlandes,

Chapter X: Graph Mining Information Retrieval &amp; Data Mining Universitt des Saarlandes,

Chapter X: Graph Mining Information Retrieval &amp; Data Mining Universitt des Saarlandes, Saarbrcken Winter Semester 2013/14 X.13- 1 Chapter X: Graph Mining 1. Introduction to Graph Mining 2. Centrality and Other Graph Properties 3.

576 views • 43 slides
Graph Mining on Big Data System Presented by Hefu Chai,

Graph Mining on Big Data System Presented by Hefu Chai,

Graph Mining on Big Data System Presented by Hefu Chai, Rui Zhang, Jian Fang Outline * Overview * Approaches &amp; Environment * Results * Observations *

795 views • 17 slides
Data Mining: Concepts and Techniques Chapter 9 Graph mining and Social Network Analysis

Data Mining: Concepts and Techniques Chapter 9 Graph mining and Social Network Analysis

Data Mining: Concepts and Techniques Chapter 9 Graph mining and Social Network Analysis Li Xiong Slides credits: Jiawei Han and Micheline Kamber 1 April 2, 2008 Graph Mining and Social Network Analysis Graph mining Frequent

879 views • 62 slides
Frequent Pattern Mining Overview Basic Concepts and Challenges Data Mining Techniques:

Frequent Pattern Mining Overview Basic Concepts and Challenges Data Mining Techniques:

Frequent Pattern Mining Overview Basic Concepts and Challenges Data Mining Techniques: Efficient and Scalable Methods for Frequent Frequent Patterns in Sets and Itemsets and Association Rules Sequences Pattern Interestingness

510 views • 14 slides
Data Mining in Bioinformatics Day 8: Graph Mining for Chemoinformatics and Drug Discovery

Data Mining in Bioinformatics Day 8: Graph Mining for Chemoinformatics and Drug Discovery

Data Mining in Bioinformatics Day 8: Graph Mining for Chemoinformatics and Drug Discovery Chlo-Agathe Azencott Machine Learning &amp; Computational Biology Research Group MPIs Tbingen C.-A. Azencott Graph Mining for Chemoinformatics

654 views • 38 slides
Graph Essentials Graph Basics Social Media Mining Social Media Mining Measures and Metrics

Graph Essentials Graph Basics Social Media Mining Social Media Mining Measures and Metrics

Social Media Mining Graph Essentials Graph Basics Social Media Mining Social Media Mining Measures and Metrics Graph Essentials 2 2 Nodes and Edges A network is a graph nodes, actors, or vertices (plural of vertex ) Connections,

978 views • 63 slides
MA/CSSE 473 Day 36 Kruskal proof recap Prim Data Structures and detailed algorithm. Recap: MST

MA/CSSE 473 Day 36 Kruskal proof recap Prim Data Structures and detailed algorithm. Recap: MST

MA/CSSE 473 Day 36 Kruskal proof recap Prim Data Structures and detailed algorithm. Recap: MST lemma Let G be a weighted connected graph with a MST T; let G be any subgraph of T, and let C be any connected component of G . If we add to

358 views • 18 slides
Proposal for a new recob::Vertex G. Cerati LArSoft Coordination Meeting Dec. 5, 2017

Proposal for a new recob::Vertex G. Cerati LArSoft Coordination Meeting Dec. 5, 2017

Proposal for a new recob::Vertex G. Cerati LArSoft Coordination Meeting Dec. 5, 2017 Introduction Current recob::Vertex not suitable to capture vertex fit information - just an array of doubles for the position, and an integer for an ID - no

782 views • 14 slides
1 2 3 4 By fixed I mean the topology is fixed. Model can be dynamic in that it moves

1 2 3 4 By fixed I mean the topology is fixed. Model can be dynamic in that it moves

1 2 3 4 By fixed I mean the topology is fixed. Model can be dynamic in that it moves either due to a changing overall transformation matrix or via some per-control vertex transformation such as skinned animation. 5 Generalized

997 views • 73 slides
Quadratic functions Elementary Functions In the last lecture we studied polynomials of simple form

Quadratic functions Elementary Functions In the last lecture we studied polynomials of simple form

Quadratic functions Elementary Functions In the last lecture we studied polynomials of simple form f ( x ) = mx + b. Now we move on to a more interesting case, polynomials of degree 2, the Part 2, Polynomials quadratic polynomials. Lecture

488 views • 9 slides
Revolutionaries and Spies Daniel W. Cranston Virginia Commonwealth University dcranston@vcu.edu

Revolutionaries and Spies Daniel W. Cranston Virginia Commonwealth University dcranston@vcu.edu

Revolutionaries and Spies Daniel W. Cranston Virginia Commonwealth University dcranston@vcu.edu Slides available on my preprint page Joint with Jane Butterfield, Greg Puleo, Cliff Smyth, Doug West, and Reza Zamani LSU Combinatorics Seminar 6

760 views • 75 slides
Digital Geometry Processing Algorithms for Representing, Analyzing and Comparing 3D shapes Today

Digital Geometry Processing Algorithms for Representing, Analyzing and Comparing 3D shapes Today

Digital Geometry Processing Algorithms for Representing, Analyzing and Comparing 3D shapes Today Previous lecture summary Triangle mesh basics Shape Simplification Shape Subdivision Last Time Registration registered point

1.24k views • 107 slides
The Buss Reduction for the k -Weighted Vertex Cover Problem Hong Xu Xin-Zeng Wu Cheng Cheng

The Buss Reduction for the k -Weighted Vertex Cover Problem Hong Xu Xin-Zeng Wu Cheng Cheng

The Buss Reduction for the k -Weighted Vertex Cover Problem Hong Xu Xin-Zeng Wu Cheng Cheng Sven Koenig T. K. Satish Kumar {hongx, xinzengw, chen260, skoenig}@usc.edu tkskwork@gmail.com January 5, 2018 University of Southern California, Los

327 views • 29 slides
The Asphericity of Injective Labeled Oriented Trees Stephan Rosebrock Pdagogische Hochschule

The Asphericity of Injective Labeled Oriented Trees Stephan Rosebrock Pdagogische Hochschule

The Asphericity of Injective Labeled Oriented Trees Stephan Rosebrock Pdagogische Hochschule Karlsruhe Germany Stephan Rosebrock (PH Karlsruhe) The Asphericity of Injective LOTs 1 / 32 Introduction Introduction Joint work with Jens

1.21k views • 93 slides

More recommend