Three-dimensional Radial Visualization of High-dimensional - PowerPoint PPT Presentation

Three-dimensional Radial Visualization of High-dimensional Continuous or Discrete Datasets Fan Dai, Yifan Zhu and Ranjan Maitra Department of Statistics Iowa State University {fd43,yifanzhu,maitra} @ iastate.edu

Motivation Multivariate datasets agriculture, engineering, genetics, social science. . . Complex data structure datasets with many discrete, skewed or correlated features image, voice, surveys. . . need advanced methods for analysis and summaries Display distinct groups while also inherent variability Dai, Zhu & Maitra RadViz3D for High-dimensional Data 2 / 34

Example: Gamma Ray Bursts (GRBs) Extremely energetic explosions observed in distant galaxies. data from NASA’s Burst and Transient Source Experiment 1,599 GRBs with complete information on 9 parameters time for % flux to arrive, peak fluxes in different channels, time-integrated fluences over time-points Nine heavily-skewed “parameters” or attributes use of logarithms to reduce skewness astrophysics community argued long over 2 or 3 types analysis based on summary exclusion of some heavily-correlated attributes recent analysis shows all 9 features important for clustering actually 5 ellipsoidal groups, not 2 or 3 smaller-dimensional 9D example used as a test case Dai, Zhu & Maitra RadViz3D for High-dimensional Data 3 / 34

Visualization tools for continuous multivariate data pairwise scatter plots Dai, Zhu & Maitra RadViz3D for High-dimensional Data 4 / 34

Pairwise Scatterplots: Gamma Ray Bursts Dai, Zhu & Maitra RadViz3D for High-dimensional Data 5 / 34

Background and Current Work Visualization tools for continuous multivariate data pairwise scatter plots limited in providing multivariate assessments parallel coordinates plot ( Inselberg ’85, Wegman ’90 ) Dai, Zhu & Maitra RadViz3D for High-dimensional Data 6 / 34

Parallel Coordinate Plots: Gamma Ray Bursts 2.5 value 0.0 − 2.5 − 5.0 T 50 T 90 F 1 F 2 F 3 F 4 P 64 P 256 P 1024 variable Represent multidimensional data using lines. vertical line represents each dimension or attribute. p � 1 lines connected at appropriate scaled dimensional value represent each observation polar version provided by star plot Dai, Zhu & Maitra RadViz3D for High-dimensional Data 7 / 34

Background and Current Work Many approaches to display continuous multivariate data pairwise scatter plots limited in providing multivariate assessments parallel coordinates plot ( Inselberg ’85, Wegman ’90 ) placement order matters, unclear for large n , p hard to identify groups/patterns with even moderate n . Andrews’ curves represent each observation via trigonometric series Dai, Zhu & Maitra RadViz3D for High-dimensional Data 8 / 34

Andrews’ Curves: Gamma Ray Bursts Plot each X = ( X 1 , X 2 , . . . , X p ) as a curve: f ( t ) = x 1 + x 2 sin t + x 3 cos t + x 4 sin 2 t + x 5 cos 2 t + . . . , t 2 [ � π , π ] Entire curve displays one observation Dai, Zhu & Maitra RadViz3D for High-dimensional Data 9 / 34

Background and Current Work Many approaches to display continuous multivariate data pairwise scatter plots limited in providing multivariate assessments parallel coordinates plot ( Inselberg ’85, Wegman ’90 ) placement order matters, unclear for large n , p polar version provided by star plot Andrews’ curves order in which coordinate enters series important very computationally intensive for larger p Star coordinates plot represents coordinate axes as equi-angled rays extending from center order matters, optimized ( van Long & Linsen ’11 ) Use springs to display observation (radial visualization) Dai, Zhu & Maitra RadViz3D for High-dimensional Data 10 / 34

Two-dimensional radial visualization (RadViz2D) Uses Hooke’s law to project data onto unit circle place p springs (anchor points) on the rim pull each spring by value relative to coordinate from center observations w/ similar relative values in all attributes end up closer to center, others are closer to the anchor points order of placement of springs affects display refinements to improve RadViz2D exist (see later) Dai, Zhu & Maitra RadViz3D for High-dimensional Data 11 / 34

RadViz2D Illustration animation by animate[2019/01/23 X = ( X 1 , X 2 , X 3 , X 4 , X 5 ) = ( 0 . 7 , 0 . 5 , 0 . 3 , 0 . 2 , 0 . 7 ) Maps X 2 R p to 2D point Ψ • ( X ; U ) = UX / 1 0 p X : U projection matrix, columns (anchor points) on S 1 Dai, Zhu & Maitra RadViz3D for High-dimensional Data 12 / 34

Two-dimensional radial visualization (RadViz2D) Uses Hooke’s law to project data onto unit circle place p springs (anchor points) on the rim pull each spring by value relative to coordinate from center observations w/ similar relative values in all attributes end up closer to center, others are closer to the anchor points order of placement of springs affects display refinements to improve RadViz2D exist (see later) Effective for sparse data, in evaluating distinct groups Nonlinear map distorts, affects interpretability High-dimensional observations more difficult to visualize Can fully 3D extension improve performance? Viz3D provides third dimension, constant for all observations ( Artero & de Oliveira, ’04 ) Dai, Zhu & Maitra RadViz3D for High-dimensional Data 13 / 34

Generalizing Radial Visualization Allow anchor points in U on S q , q > 1, not necessarily equi-spaced p springs at u 1 , u 2 , . . . , u p 2 S q , with spring constants X 1 , X 2 , . . . , X p . equilibrium point Y 2 R q + 1 of system satisfies p X X j ( Y � u j ) = 0 , j = 1 Y = Ψ ( X ; U ) = UX / 1 0 p X solves the system. is line-, point-ordering- and convexity-invariant. scaling every coordinate to be in [0,1] allows for Y 2 S q . Dai, Zhu & Maitra RadViz3D for High-dimensional Data 14 / 34

Placement of Anchor Points Suppose: coordinates of X are uncorrelated. For X 1 , X 2 2 R p , let Y i = Ψ ( X i ; U ) , i = 1 , 2. Euclidean distance between Y 1 and Y 2 is ! 0 ! X 1 X 2 X 1 X 2 k Y 1 � Y 2 k 2 = U 0 U � � , 1 0 1 0 1 0 1 0 p X 1 p X 2 p X 1 p X 2 X i , X j very dissimilar, with perfect negative correlation, should be placed as far away as possible (in opposite directions) in our radial visualization. However, k Y i � Y j k 2 ! 0 as h u i , u j i ! 0. may create artificial visual correlation between i th and j th coordinates if h u i , u j i ! 0 < π / 2. need u j s far from the other as possible; so evenly distributed. S q : for larger q , can get larger angles between u j s Also place positively correlated coordinates close together q > 1 has advantage in placing multiple coordinates together Dai, Zhu & Maitra RadViz3D for High-dimensional Data 15 / 34

Three-dimensional Radial Visualization q = 2 in our generalization yields RadViz3D : equi-spaced anchor points for 5 Platonic solids, p = 4 , 6 , 8 , 12 , 20. closely related to Thomson problem in traditional molecular quantum chemistry (Atiyah & Sutcliffe ’03). for other p , approximate through Fibonacci grid, j th anchor point: q u j 1 = cos( 2 π j ϕ � 1 ) 1 � u 2 j 3 , q u j 2 = sin( 2 π j ϕ � 1 ) 1 � u 2 j 3 , u j 3 = 2 j � 1 � 1 , p p where ϕ = ( 1 + 5 ) / 2 is the golden ratio. (González ’10) distributes anchor points along generative spiral on S 2 , with consecutive points as separated as possible, satisfies "well-separation" property (Saff & Kuijlaars ’97). Dai, Zhu & Maitra RadViz3D for High-dimensional Data 16 / 34