Invited Workshop on Compiler Techniques for Sparse Tensor Algebra - PowerPoint PPT Presentation

Invited Workshop on Compiler Techniques for Sparse Tensor Algebra Cambridge MA, January 26th

Sparse Tensors are Everywhere Data Analytics Machine Learning Science and Engineering Movie ratings Convolutional Networks Product Reviews QCD Sparse Networks [GRK 2017] Social interactions Finite Element Method Graph Convolutional Network [KW 2017] Quantitative Trait Loci 2

Sparse Tensors are Everywhere Data Analytics Machine Learning Science and Engineering Movie ratings Convolutional Networks Product Reviews QCD Sparse Networks [GRK 2017] Social interactions Finite Element Method Graph Convolutional Network [KW 2017] Quantitative Trait Loci 2

Sparse Tensors are Everywhere Data Analytics Machine Learning Science and Engineering Movie ratings Convolutional Networks Product Reviews QCD Sparse Networks [GRK 2017] Social interactions Finite Element Method Graph Convolutional Network [KW 2017] Quantitative Trait Loci 2

Sparse Tensors are Everywhere Data Analytics Machine Learning Science and Engineering Movie ratings Convolutional Networks Product Reviews QCD Sparse Networks [GRK 2017] Social interactions Finite Element Method Graph Convolutional Network [KW 2017] Quantitative Trait Loci Scalars have 0 dimensions Vectors have 1 dimension Matrices have 2 dimensions An n-tensor has n dimensions 2

Sparse Tensors are Everywhere Data Analytics Machine Learning Science and Engineering Movie ratings Convolutional Networks QCD Sparse Networks [GRK 2017] Social interactions Finite Element Method Graph Convolutional Network [KW 2017] Quantitative Trait Loci s d r … o W Poor Performance Amazing Peter Lilly Paul Users Billy Hilde Product Reviews Bob Sam Mary Monitor Sweater Laptop Candide Jacket The Iliad Kindle Dubliners … … Products 2

Sparse Tensors are Everywhere Data Analytics Machine Learning Science and Engineering Movie ratings Convolutional Networks QCD Sparse Networks [GRK 2017] Social interactions Finite Element Method Graph Convolutional Network [KW 2017] Quantitative Trait Loci s d r … o W Poor Performance Amazing Peter Lilly Extremely sparse Paul Users Billy Dense storage: 107 Exabytes Hilde Sparse storage: 13 Gigabytes Product Reviews Bob Sam Mary Monitor Sweater Laptop Candide Jacket The Iliad Kindle Dubliners … … Products 2

Too many tensor kernels for a fixed-function library 3