e x ploring n u merical data
play

E x ploring n u merical data E XP L OR ATOR Y DATA AN ALYSIS IN R - PowerPoint PPT Presentation

Sep 26, 2023 •115 likes •621 views

E x ploring n u merical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College Cars dataset str(cars) Classes tbl_df, tbl and 'data.frame': 428 obs. of 19 variables: $ name : chr

  1. E x ploring n u merical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  2. Cars dataset str(cars) Classes ‘tbl_df’, ‘tbl’ and 'data.frame': 428 obs. of 19 variables: $ name : chr "Chevrolet Aveo 4dr" "Chevrolet Aveo LS 4dr hatch" ... $ sports_car : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ suv : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ wagon : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ minivan : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ pickup : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ all_wheel : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ rear_wheel : logi FALSE FALSE FALSE FALSE FALSE FALSE ... $ msrp : int 11690 12585 14610 14810 16385 13670 15040 13270 ... $ dealer_cost: int 10965 11802 13697 13884 15357 12849 14086 12482 ... $ eng_size : num 1.6 1.6 2.2 2.2 2.2 2 2 2 2 2 ... $ ncyl : int 4 4 4 4 4 4 4 4 4 4 ... $ horsepwr : int 103 103 140 140 140 132 132 130 110 130 ... $ city_mpg : int 28 28 26 26 26 29 29 26 27 26 ... $ hwy_mpg : int 34 34 37 37 37 36 36 33 36 33 ... $ weight : int 2370 2348 2617 2676 2617 2581 2626 2612 2606 ... $ wheel_base : int 98 98 104 104 104 105 105 103 103 103 ... $ length : int 167 153 183 183 183 174 174 168 168 168 ... $ width : int 66 66 69 68 69 67 67 67 67 67 ... EXPLORATORY DATA ANALYSIS IN R

  3. Dotplot ggplot(data, aes(x = weight)) + geom_dotplot(dotsize = 0.4) EXPLORATORY DATA ANALYSIS IN R

  4. Histogram ggplot(data, aes(x = weight)) + geom_histogram() EXPLORATORY DATA ANALYSIS IN R

  5. Densit y plot ggplot(data, aes(x = weight)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  6. Densit y plot ggplot(data, aes(x = weight)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  7. Densit y plot ggplot(data, aes(x = weight)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  8. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  9. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  10. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  11. Bo x plot ggplot(data, aes(x = 1, y = weight)) + geom_boxplot() + coord_flip() EXPLORATORY DATA ANALYSIS IN R

  12. Faceted histogram ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  13. Faceted histogram ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  14. Faceted histogram ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  15. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

  16. Distrib u tion of one v ariable E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  17. Marginal v s . conditional ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  18. Marginal v s . conditional ggplot(cars, aes(x = hwy_mpg)) + geom_histogram() + facet_wrap(~pickup) `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. Warning message: Removed 14 rows containing non-finite values (stat_bin). EXPLORATORY DATA ANALYSIS IN R

  19. B u ilding a data pipeline cars2 <- cars %>% filter(eng_size < 2.0) ggplot(cars2, aes(x = hwy_mpg)) + geom_histogram() EXPLORATORY DATA ANALYSIS IN R

  20. B u ilding a data pipeline cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_histogram() EXPLORATORY DATA ANALYSIS IN R

  21. Filtered and faceted histogram cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_histogram() `stat_bin()` using `bins = 30`. Pick better value with `binwidth`. EXPLORATORY DATA ANALYSIS IN R

  22. Wide bin w idth cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_histogram(binwidth = 5) EXPLORATORY DATA ANALYSIS IN R

  23. Densit y plot cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_density() EXPLORATORY DATA ANALYSIS IN R

  24. Wide band w idth cars %>% filter(eng_size < 2.0) %>% ggplot(aes(x = hwy_mpg)) + geom_density(bw = 5) EXPLORATORY DATA ANALYSIS IN R

  25. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

  26. Bo x plots E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  27. EXPLORATORY DATA ANALYSIS IN R

  28. EXPLORATORY DATA ANALYSIS IN R

  29. EXPLORATORY DATA ANALYSIS IN R

  30. EXPLORATORY DATA ANALYSIS IN R

  31. EXPLORATORY DATA ANALYSIS IN R

  32. EXPLORATORY DATA ANALYSIS IN R

  33. EXPLORATORY DATA ANALYSIS IN R

  34. EXPLORATORY DATA ANALYSIS IN R

  35. EXPLORATORY DATA ANALYSIS IN R

  36. EXPLORATORY DATA ANALYSIS IN R

  37. EXPLORATORY DATA ANALYSIS IN R

  38. EXPLORATORY DATA ANALYSIS IN R

  39. Side - b y- side bo x plots ggplot(common_cyl, aes(x = as.factor(ncyl), y = city_mpg)) + geom_boxplot() Warning message: Removed 11 rows containing non-finite values (stat_boxplot). EXPLORATORY DATA ANALYSIS IN R

  40. Side - b y- side bo x plots ggplot(common_cyl, aes(x = as.factor(ncyl), y = city_mpg)) + geom_boxplot() Warning message: Removed 11 rows containing non-finite values (stat_boxplot). EXPLORATORY DATA ANALYSIS IN R

  41. Side - b y- side bo x plots ggplot(common_cyl, aes(x = as.factor(ncyl), y = city_mpg)) + geom_boxplot() Warning message: Removed 11 rows containing non-finite values (stat_boxplot). EXPLORATORY DATA ANALYSIS IN R

  42. EXPLORATORY DATA ANALYSIS IN R

  43. EXPLORATORY DATA ANALYSIS IN R

  44. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

  45. Vis u ali z ation in higher dimensions E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College

  46. Plots for 3 v ariables ggplot(cars, aes(x = msrp)) + geom_density() + facet_grid(pickup ~ rear_wheel) EXPLORATORY DATA ANALYSIS IN R

  47. Plots for 3 v ariables ggplot(cars, aes(x = msrp)) + geom_density() + facet_grid(pickup ~ rear_wheel, labeller = label_both) EXPLORATORY DATA ANALYSIS IN R

  48. Plots for 3 v ariables ggplot(cars, aes(x = msrp)) + geom_density() + facet_grid(pickup ~ rear_wheel, labeller = label_both) table(cars$rear_wheel, cars$pickup) FALSE TRUE FALSE 306 12 TRUE 98 12 EXPLORATORY DATA ANALYSIS IN R

  49. Higher dimensional plots Shape Si z e Color Pa � ern Mo v ement x- coordinate y- coordinate EXPLORATORY DATA ANALYSIS IN R

  50. Let ' s practice ! E XP L OR ATOR Y DATA AN ALYSIS IN R

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Linking t w o charts IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L OTLY IN

Linking t w o charts IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L OTLY IN

Linking t w o charts IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L OTLY IN R Adam Lo y Statistician , Carleton College E x ploring cl u sters INTERMEDIATE INTERACTIVE DATA VISUALIZATION WITH PLOTLY IN R E x ploring longit u

596 views • 43 slides
E x ploring relationships E XP L OR ATOR Y DATA AN ALYSIS IN P YTH ON Allen Do w ne y Professor

E x ploring relationships E XP L OR ATOR Y DATA AN ALYSIS IN P YTH ON Allen Do w ne y Professor

E x ploring relationships E XP L OR ATOR Y DATA AN ALYSIS IN P YTH ON Allen Do w ne y Professor , Olin College Height and w eight EXPLORATORY DATA ANALYSIS IN PYTHON Scatter plot brfss = pd.read_hdf('brfss.hdf5', 'brfss') height =

505 views • 38 slides
E x ploring categorical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant

E x ploring categorical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant

E x ploring categorical data E XP L OR ATOR Y DATA AN ALYSIS IN R Andre w Bra y Assistant Professor , Reed College Comics dataset comics # A tibble: 23,272 x 11 name id align &lt;fctr&gt; &lt;fctr&gt; &lt;fctr&gt;

927 views • 33 slides
E x ploring the MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico

E x ploring the MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico

E x ploring the MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico Castanedo Data Scientist at DataRobot Wh y do w e need dimensionalit y red u ction techniq u es ? t - Distrib u ted Stochastic Neighbor Embedding ( t

1.01k views • 28 slides
E x ploring fashion MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R

E x ploring fashion MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R

E x ploring fashion MNIST dataset AD VAN C E D D IME N SION AL ITY R E D U C TION IN R Federico Castanedo Data Scientist at DataRobot What is Fashion MNIST ? 70.000 gra y scale images of 10 clothing categories 28x28 pi x els Identical format

586 views • 47 slides
Introd u ction to NLP feat u re engineering FE ATU R E E N G IN E E R IN G FOR N L P IN P YTH

Introd u ction to NLP feat u re engineering FE ATU R E E N G IN E E R IN G FOR N L P IN P YTH

Introd u ction to NLP feat u re engineering FE ATU R E E N G IN E E R IN G FOR N L P IN P YTH ON Ro u nak Banik Data Scientist N u merical data Iris dataset sepal length sepal w idth petal length petal w idth class 6.3 2.9 5.6 1.8 Iris

474 views • 35 slides
Welcome and Introd u ction SU P E R VISE D L E AR N IN G IN R : R E G R E SSION Nina Z u mel and

Welcome and Introd u ction SU P E R VISE D L E AR N IN G IN R : R E G R E SSION Nina Z u mel and

Welcome and Introd u ction SU P E R VISE D L E AR N IN G IN R : R E G R E SSION Nina Z u mel and John Mo u nt Data Scientists , Win Vector LLC What is Regression ? Regression : Predict a n u merical o u tcome (&quot; dependent v ariable &quot;)

588 views • 30 slides
Vis u ali z ing bi v ariate relationships C OR R E L ATION AN D R E G R E SSION IN R Ben Ba u

Vis u ali z ing bi v ariate relationships C OR R E L ATION AN D R E G R E SSION IN R Ben Ba u

Vis u ali z ing bi v ariate relationships C OR R E L ATION AN D R E G R E SSION IN R Ben Ba u mer Assistant Professor at Smith College Bi v ariate relationships Both v ariables are n u merical Response v ariable a . k . a . y, dependent E x

364 views • 25 slides
Creating transcription helper f u nctions SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON

Creating transcription helper f u nctions SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON

Creating transcription helper f u nctions SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON Daniel Bo u rke Machine Learning Engineer / Yo u T u be Creator E x ploring a u dio files # Import os module import os # Check the folder of

816 views • 46 slides
Inc Inclus lusiv ive e educ educatio tion, n, a mea eans ns of im impr proving ving

Inc Inclus lusiv ive e educ educatio tion, n, a mea eans ns of im impr proving ving

Inc Inclus lusiv ive e educ educatio tion, n, a mea eans ns of im impr proving ving educ educatio tional nal ac accoun untability ability: Explo ploring ing the the attitudes titudes of of Ghanaian teachers towards inclusive

382 views • 20 slides
Data Preparation Data cleaning Data integration and transformation (Data

Data Preparation Data cleaning Data integration and transformation (Data

Data Preprocessing Why preprocess the data? Data Preparation Data cleaning Data integration and transformation (Data preprocessing) Data reduction, Feature selection Discretization and concept hierarchy generation 2

891 views • 21 slides
DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data

DATA MINING LECTURE 2 What is data? The data mining pipeline What is Data Mining? Data mining is the use of efficient techniques for the analysis of very large collections of data and the extraction of useful and possibly unexpected

2.4k views • 94 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 51 / 89 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4

344 views • 17 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 68 / 91 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4 2

729 views • 24 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 68 / 91 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4 2

579 views • 8 slides
Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval

Inf1-DA 20102011 III: 28 / 89 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis testing and correlation III.4

455 views • 23 slides
Uncertainty Session 6 PMAP 8921: Data Visualization with R Andrew Young School of Policy Studies

Uncertainty Session 6 PMAP 8921: Data Visualization with R Andrew Young School of Policy Studies

Uncertainty Session 6 PMAP 8921: Data Visualization with R Andrew Young School of Policy Studies May 2020 1 / 38 Plan for today Communicating uncertainty Visualizing uncertainty 2 / 38 Communicating uncertainty 3 / 38 The Bay of Pigs

656 views • 38 slides
Lagrangian observations; single particle statistics J. H. LaCasce Norwegian Meteorological

Lagrangian observations; single particle statistics J. H. LaCasce Norwegian Meteorological

Lagrangian observations; single particle statistics J. H. LaCasce Norwegian Meteorological Institute Oslo, Norway Lagrangian observations; single particle statistics p.1/ ?? History Stommel and Arons (1960) Lagrangian observations; single

895 views • 71 slides
Sta$s$cs with R Mining So0ware Repositories 2015 University of

Sta$s$cs with R Mining So0ware Repositories 2015 University of

Sta$s$cs with R Mining So0ware Repositories 2015 University of Koblenz Presenter: Hakan Aksu Content 1. Introduc$on to R 2. Basic Sta$s$cs 3. Advanced

874 views • 49 slides
Predictor-Corrector and Morphing Ensemble Filters for the Assimilation of Sparse Data into

Predictor-Corrector and Morphing Ensemble Filters for the Assimilation of Sparse Data into

Predictor-Corrector and Morphing Ensemble Filters for the Assimilation of Sparse Data into High-Dimensional Nonlinear Systems Jan Mandel and Jonathan D. Beezley University of Colorado and National Center for Atmospheric Research American

677 views • 23 slides
Agenda for today Graphics! XploRe Multidimensional Graphics 1-2 Graphics 1 plot (x1 {, x2 {,

Agenda for today Graphics! XploRe Multidimensional Graphics 1-2 Graphics 1 plot (x1 {, x2 {,

0-1 Agenda for today Graphics! XploRe Multidimensional Graphics 1-2 Graphics 1 plot (x1 {, x2 {, ... {x5 }}}) plots the three -dimensional data sets x1 , ..., 2 x5 3 gr = grsurface(x {, col}) generates surface from the function

796 views • 43 slides
Status of NeuroTools Modules utilities and plotting History: Both modules were rather orderless

Status of NeuroTools Modules utilities and plotting History: Both modules were rather orderless

Status of NeuroTools Modules utilities and plotting History: Both modules were rather orderless collections of user- and problem-specific helper functions For NT release 0.1: Code cleaning Some functions moved from utilities to plotting

211 views • 5 slides
Alphas from HERA Voica Radescu (Physikalisches Institut Heidelberg) on behalf of the H1 and ZEUS

Alphas from HERA Voica Radescu (Physikalisches Institut Heidelberg) on behalf of the H1 and ZEUS

Alphas from HERA Voica Radescu (Physikalisches Institut Heidelberg) on behalf of the H1 and ZEUS Collaborations Outline: St.Andrews Impact of inclusion of Jet Data in the HERAPDF fits New preliminary Jet measurements from HERA and

605 views • 29 slides
ND CDR: MPD Chapter 2019/12/17 J. Raaf ND CDR timeline guidance from Mike &amp; Steve

ND CDR: MPD Chapter 2019/12/17 J. Raaf ND CDR timeline guidance from Mike &amp; Steve

ND CDR: MPD Chapter 2019/12/17 J. Raaf ND CDR timeline guidance from Mike &amp; Steve January 6: First drafts of chapter contributions due Goal: Edit and have first draft to collaboration by end of January (at collaboration meeting)

407 views • 14 slides

More recommend