D3: The Crash Course
Chad Stolper CSE 6242 Guest Lecture 1
aka: D3: The Early Sticking Points aka: D3: Only the Beginning
Chad Stolper Assistant Professor Southwestern University
(graduated from Georgia Tech CS PhD)
D3: The Crash Course aka: D3: The Early Sticking Points aka: D3: Only - - PowerPoint PPT Presentation
D3: The Crash Course aka: D3: The Early Sticking Points aka: D3: Only the Beginning Chad Stolper Assistant Professor Southwestern University (graduated from Georgia Tech CS PhD) Chad Stolper CSE 6242 Guest Lecture 1
D3: The Crash Course
Chad Stolper CSE 6242 Guest Lecture 1
aka: D3: The Early Sticking Points aka: D3: Only the Beginning
Chad Stolper Assistant Professor Southwestern University
(graduated from Georgia Tech CS PhD)
http://bl.ocks.org/mbostock/1256572
Chad Stolper CSE 6242 Guest Lecture 2
Chad Stolper 3
http://www.bloomberg.com/graphics/2015-auto-sales/
Chad Stolper CSE 6242 Guest Lecture 4
BUT FIRST....
Chad Stolper CSE 6242 Guest Lecture 5
Why should you learn D3???
Chad Stolper CSE 6242 Guest Lecture 6
If you visualization/system/tool will benefit from interactivity. Otherwise, use anything you want
(e.g., tableau, excel, python:seaborn, R:ggplot2, etc.)
Chad Stolper CSE 6242 Guest Lecture 7
More online discussion: https://news.ycombinator.com/item?id=11995332
This lectures and HW2 is about D3 ver.3
Chad Stolper 8
Chrome Inspector and Console
error messages
Chad Stolper CSE 6242 Guest Lecture 9
Starting a Local Webserver
Necessary for Chrome, not for Safari or Firefox
(This is a security measure: to prevent reading from your file systems)
Chad Stolper CSE 6242 Guest Lecture 10
https://github.com/d3/d3/wiki
If you’re new to Javascript…
https://www.destroyallsoftware.com/talks/wat (starting 1:25)
Chad Stolper CSE 6242 Guest Lecture 12
Prepare for a lot of hair pulling!!! I’m serious.
Javascript 101
using var
same syntax as python’s lists [ ] and dicts { }
Chad Stolper CSE 6242 Guest Lecture 13
Javascript 102: Functional Programming
Chad Stolper CSE 6242 Guest Lecture 14
Some people say javascript is a “multi-paradigm” programming language. http://stackoverflow.com/questions/3962604/is-javascript-a-functional- programming-language
What does that mean?
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Array/map Chad Stolper CSE 6242 Guest Lecture 16
Passing Math.sqrt (a function) as a parameter
Array.map( )
Chad Stolper CSE 6242 Guest Lecture 17
Passing Math.sqrt (a function) as a parameter
MDN – the BEST Javascript reference
US/docs/Web/JavaScript/Reference
Chad Stolper CSE 6242 Guest Lecture 19
Method Chaining
method returns the object that it was called on
group .attr(“x”,5); .attr(“y”,5); //returns group is the same as group.attr(“x”,5) //returns group group.attr(“y”,5) //returns group
Chad Stolper CSE 6242 Guest Lecture 20
SVG BASICS
SVG = Scalable Vector Graphics
Chad Stolper CSE 6242 Guest Lecture 21 https://en.wikipedia.org/wiki/Scalable_Vector_Graphics
x y
(0,0)
Chad Stolper CSE 6242 Guest Lecture 24
x y
(0,0)
http://smg.photobucket.com/user/Pavan2099/ media/RvB/Descart-weeping.png.htmlChad Stolper CSE 6242 Guest Lecture 25
SVG Basics
SVG -> XML Vector Graphics (Scalable Vector Graphics)
Chad Stolper CSE 6242 Guest Lecture 26
SVG Basics
Chad Stolper CSE 6242 Guest Lecture 27
SVG Basics
Chad Stolper CSE 6242 Guest Lecture 28
SVG Basics
<path>
Chad Stolper CSE 6242 Guest Lecture 29
<svg> element
<body> <div id=“vis”> </div> </body>
Chad Stolper CSE 6242 Guest Lecture 30
<svg> element
<body> <div id=“vis”> <svg></svg> </div> </body>
Chad Stolper CSE 6242 Guest Lecture 31
<circle> element
Chad Stolper CSE 6242 Guest Lecture 32
<rect> element
Chad Stolper CSE 6242 Guest Lecture 33
x y width height (0,0)
Chad Stolper CSE 6242 Guest Lecture 34
x y width height (0,0)
Chad Stolper CSE 6242 Guest Lecture 35
Rather than positioning each element, what if we want to position (or style) a group of elements?
Chad Stolper CSE 6242 Guest Lecture 36
<g> element
Chad Stolper CSE 6242 Guest Lecture 37
CSS Selectors Reference
– circle.canary à <circle class=“canary”>
– circle,.canary à <circle> <rect class=“canary”>
Chad Stolper CSE 6242 Guest Lecture 38
AND NOW D3…
Chad Stolper CSE 6242 Guest Lecture 39
Mike Bostock and Jeff Heer @ Stanford 2009- Protovis
Chad Stolper CSE 6242 Guest Lecture 40
Mike Bostock and Jeff Heer @ Stanford 2009- Protovis
Chad Stolper CSE 6242 Guest Lecture 41
Mike Bostock and Jeff Heer @ Stanford 2009- Protovis 2011- D3.js
Chad Stolper CSE 6242 Guest Lecture 42
Mike Bostock and Jeff Heer @ Stanford 2009- Protovis 2011- D3.js
Chad Stolper CSE 6242 Guest Lecture 43
Mike Bostock and Jeff Heer @ Stanford 2009- Protovis 2011- D3.js
New York Times
Chad Stolper CSE 6242 Guest Lecture 44
D3
Chad Stolper CSE 6242 Guest Lecture 45
D3.js in a Nutshell
D3 is a really powerful for-loop with a ton of useful helper functions
Chad Stolper CSE 6242 Guest Lecture 46
D3
Declarative, domain-specific specification language for manipulating the DOM
Define a template for each type of element D3 draws one element for each data point
Chad Stolper CSE 6242 Guest Lecture 47
Importing D3
<html > <head> <script src='lib/d3.js’ charset=‘utf-8’></script> <script src='js/project.js'></script> </head> <body> <div id=“vis”></div> </body> </html>
Chad Stolper CSE 6242 Guest Lecture 48
Importing D3
<html > <head> <script src='lib/d3.js’ charset=‘utf-8’></script> <script src='js/project.js'></script> </head> <body> <div id=“vis”></div> </body> </html>
Chad Stolper CSE 6242 Guest Lecture 49
Importing D3
<html > <head> <script src='lib/d3.js’ charset=‘utf-8’></script> <script src='js/project.js'></script> </head> <body> <div id=“vis”></div> </body> </html>
Chad Stolper CSE 6242 Guest Lecture 50
Importing D3
<html > <head> <script src='lib/d3.js’ charset=‘utf-8’></script> <script src='js/project.js'></script> </head> <body> <div id=“vis”></div> </body> </html>
Chad Stolper CSE 6242 Guest Lecture 51
Importing D3
<html > <head> <script src='lib/d3.js’ charset=‘utf-8’></script> <script src='js/project.js'></script> </head> <body> <div id=“vis”></div> </body> </html>
Chad Stolper CSE 6242 Guest Lecture 52
Assigning the Canvas to a Variable var vis = d3.select(“#vis”) .append(“svg:svg”) <body> <div id=“vis”><svg></svg></div> </body>
Chad Stolper CSE 6242 Guest Lecture 53
Loading Data
Chad Stolper CSE 6242 Guest Lecture 54
rawdata from a CSV file
name school age Adam GT 18 Barbara Emory 22 Calvin GSU 30
[ { ‘name’: ‘Adam’, ‘school’: ‘GT’, ‘age’: ‘18’ }, { ‘name’: ‘Barbara’, ‘school’: ‘Emory’, ‘age’: ‘22’ }, { ‘name’: ‘Calvin’, ‘school’: ‘GSU’, ‘age’: ‘30’ } ]
Chad Stolper CSE 6242 Guest Lecture 55
Problem
for(var d: data){
d = data[d] d.age = +d.age
}
[ { ‘name’: ‘Adam’, ‘school’: ‘GT’, ‘age’: ‘18’ }, { ‘name’: ‘Barbara’, ‘school’: ‘Emory’, ‘age’: ‘22’ }, { ‘name’: ‘Calvin’, ‘school’: ‘GSU’, ‘age’: ‘30’ } ]
Chad Stolper CSE 6242 Guest Lecture 56
Problem
for(var d: data){
d = data[d] d.age = +d.age
}
[ { ‘name’: ‘Adam’, ‘school’: ‘GT’, ‘age’: ‘18’ }, { ‘name’: ‘Barbara’, ‘school’: ‘Emory’, ‘age’: ‘22’ }, { ‘name’: ‘Calvin’, ‘school’: ‘GSU’, ‘age’: ‘30’ } ]
Chad Stolper CSE 6242 Guest Lecture 57 http://stackoverflow.com/questions/24473733/importing-a-csv-into-d3-cant-convert-strings-to-numbers
rawdata from a CSV file
name school age Adam GT 18 Barbara Emory 22 Calvin GSU 30
[ { ‘name’: ‘Adam’, ‘school’: ‘GT’, ‘age’: 18 }, { ‘name’: ‘Barbara’, ‘school’: ‘Emory’, ‘age’: 22 }, { ‘name’: ‘Calvin’, ‘school’: ‘GSU’, ‘age’: 30 } ]
Chad Stolper CSE 6242 Guest Lecture 58
rawdata from a CSV file
name school age Adam GT 18 Barbara Emory 22 Calvin GSU 30
[ { ‘name’: ‘Adam’, ‘school’: ‘GT’, ‘age’: 18 }, { ‘name’: ‘Barbara’, ‘school’: ‘Emory’, ‘age’: 22 }, { ‘name’: ‘Calvin’, ‘school’: ‘GSU’, ‘age’: 30 } ]
Ok, so let’s map this data to visual elements!
Chad Stolper CSE 6242 Guest Lecture 59
D3
Declarative, domain-specific specification language for manipulating the DOM
Define a template for each type of element D3 draws one element for each data point
Chad Stolper CSE 6242 Guest Lecture 62
Enter-Update-Exit
remember this...
Chad Stolper CSE 6242 Guest Lecture 63
Enter-Update-Exit
remember this...
Chad Stolper CSE 6242 Guest Lecture 64
Enter-Update-Exit
that don’t have them yet and set constant or initial attribute values
elements based on the data
anymore
Chad Stolper CSE 6242 Guest Lecture 65
Can be hard to grok: You can select groups of elements that DON’T EXIST YET
http://bost.ocks.org/mike/join/
Chad Stolper CSE 6242 Guest Lecture 66
.enter( ) and .exit( )
has been called
New Data Old Elements Enter Exit Update
Chad Stolper CSE 6242 Guest Lecture 67
.enter( ) and .exit( )
has been called
New Data Old Elements Enter Exit Update
Chad Stolper CSE 6242 Guest Lecture 68
.enter( ) and .exit( )
New Data Old Elements Enter Exit Update
Chad Stolper CSE 6242 Guest Lecture 69
.enter( ) and .exit( )
New Data Old Elements Enter Exit Update
Chad Stolper CSE 6242 Guest Lecture 70
Data Key Functions
index of the point is the key
set a key functions
Chad Stolper CSE 6242 Guest Lecture 72
E-U-E Pattern Template
var group = vis.selectAll(“rect”) .data(rawdata) //rawdata must be an array! group.enter( ).append(“svg:rect”) //ENTER! .attr( ) .style( ) group //UPDATE! .attr( ) .style( ) group.exit( ).remove( ) //EXIT!
Chad Stolper CSE 6242 Guest Lecture 73
Chad Stolper CSE 6242 Guest Lecture 74
E-U-E Pattern Template
var group = vis.selectAll(“rect”) .data(rawdata) //rawdata must be an array! group.enter( ).append(“svg:rect”) //ENTER! .attr( ) .style( ) group //UPDATE! .attr( ) .style( ) group.exit( ).remove( ) //EXIT!
Many online examples
Chad Stolper CSE 6242 Guest Lecture 75
E-U-E Pattern Template
var group = vis.selectAll(“rect”) .data(rawdata) //rawdata must be an array! group.enter( ).append(“svg:rect”) //ENTER! .attr( ) .style( ) group //UPDATE! .attr( ) .style( ) group.exit( ).remove( ) //EXIT!
Many online examples drop the variable name before .enter()
Chad Stolper CSE 6242 Guest Lecture 76
E-U-E Pattern Template
var group = vis.selectAll(“rect”) .data(rawdata) //rawdata must be an array! group.enter( ).append(“svg:rect”) //ENTER! .attr( ) .style( ) group //UPDATE! .attr( ) .style( ) group.exit( ).remove( ) //EXIT!
Many online examples drop the variable name before .enter() I highly recommend you don’t!
Chad Stolper CSE 6242 Guest Lecture 77
.attr( )
and fill
Chad Stolper CSE 6242 Guest Lecture 78
.attr( ) and Functional Programming Input
[ {size: 10}, {size: 8}, {size: 12.2} ]
We want 3 rectangles:
<rect height=“10” x=“5”></rect> <rect height=“8” x=“10”></rect> <rect height=“12.2” x=“15”></rect>
.attr(“height”, function(d,i){ return d.size })
d: the data point
.attr(“x”, function(d,i){ return (i+1)*5; })
i: the index of the data point
Chad Stolper CSE 6242 Guest Lecture 79
<text> elements
Chad Stolper CSE 6242 Guest Lecture 80
<text> elements
the lousy job the W3C did with the <text> definition.
memorize these things or keep referring back to http://www.w3c.org/TR/SVG/text.html (first Google hit for “svg text”) like I do.
Chad Stolper CSE 6242 Guest Lecture 81
<text> elements
Chad Stolper CSE 6242 Guest Lecture 82
text-anchor style
start end middle
Where is (0,0)?
Chad Stolper CSE 6242 Guest Lecture 83
dominant-baseline style
This is my line of text.
hanging default middle
Where is (0,0)?
Chad Stolper CSE 6242 Guest Lecture 84
<text> example
Chad Stolper CSE 6242 Guest Lecture 85
http://tutorials.jenkov.com/svg/text-element.html
The .style() Function
Like attr, but for the style attribute
.style(“prop1”,“val1”) .style(“prop2”,“val2”) .style(“prop3”, function(d,i){ }) <ele style=“prop1: val1; prop2: val2;”>
Chad Stolper CSE 6242 Guest Lecture 86
<text> example
group.append(“svg:text”) .text(function(d){return d.name}) .attr(“x”, function(d,i){return i*5}) .attr(“y”, function(d,i){return height;}) .style(“dominant-baseline”,“hanging”) .style(“text-anchor”, “middle”)
Chad Stolper CSE 6242 Guest Lecture 87
Need to remember what to use .style and when to use .attr
What if you have two different types of circles?
Chad Stolper CSE 6242 Guest Lecture 88
Classing
red = vis.selectAll(“circle.redcircle”) .data(reddata, function(d){return d.id;}) red.enter( ).append(“svg:circle”) .classed(“redcircle”,“true”) red.attr(“fill”,“red”) blue = vis.selectAll(“circle.bluecircle”) .data(bluedata, function(d){return d.id;}) blue.enter( ).append(“svg:circle”) .classed(“bluecircle”, “true”) vis.selectAll(“.bluecircle”).attr(“fill”,“blue”)
Chad Stolper CSE 6242 Guest Lecture 89
(e.g., sizing a circle based on data value)
Chad Stolper CSE 6242 Guest Lecture 90
blow up really quickly…
Chad Stolper CSE 6242 Guest Lecture 91
Scales
Chad Stolper CSE 6242 Guest Lecture 92
Linear Scales
var xscale = d3.scale.linear( ) .domain( [min, max] ) .range( [minOut, maxOut] ) group.attr(“x”, function(d,i){ return xscale(d.size); })
Chad Stolper CSE 6242 Guest Lecture 93
Domain & Range
Chad Stolper CSE 6242 Guest Lecture 94
http://image.slidesharecdn.com/d3-140708145630-phpapp02/95/d3-17-638.jpg?cb=1404831405
Min and Max
But how do you figure out the min and max for the domain?
Chad Stolper CSE 6242 Guest Lecture 95
D3
A really powerful for-loop with a ton of useful helper functions
Chad Stolper CSE 6242 Guest Lecture 96
D3
A really powerful for-loop with a ton of useful helper functions
Chad Stolper CSE 6242 Guest Lecture 97
Min and Max
Chad Stolper CSE 6242 Guest Lecture 98
Min and Max
Chad Stolper CSE 6242 Guest Lecture 99
d3.max( data.map( function(d){ return d.age; }) ) // returns the maximum age
Chad Stolper CSE 6242 Guest Lecture 100
var max = d3.max( data.map( function(d){ return d.age; }) ) // returns the maximum age var yscale = d3.scale.linear( ) .domain( [0, max] ) .range( [0, 100] )
Chad Stolper CSE 6242 Guest Lecture 101
Ordinal Scales
Chad Stolper CSE 6242 Guest Lecture 103
Ordinal Categorical Scales
Chad Stolper CSE 6242 Guest Lecture 104
Think carefully before using a rainbow palette for ordinal data!
http://www.mathworks.com/tagteam/81137_92 238v00_RainbowColorMap_57312.pdf
Ordinal Categorical Scales
return colorscale(d.type) }
Chad Stolper CSE 6242 Guest Lecture 105
Ordinal Categorical Scales
return colorscale(d.type) }
Bird Blue
Chad Stolper CSE 6242 Guest Lecture 106
Ordinal Categorical Scales
return colorscale(d.type) }
Bird Blue
Chad Stolper CSE 6242 Guest Lecture 107
Ordinal Categorical Scales
return colorscale(d.type) }
Bird Blue Rodent Orange
Chad Stolper CSE 6242 Guest Lecture 108
Ordinal Categorical Scales
return colorscale(d.type) }
Bird Blue Rodent Orange
Chad Stolper CSE 6242 Guest Lecture 109
Ordinal Categorical Scales
return colorscale(d.type) }
Bird Blue Rodent Orange
Chad Stolper CSE 6242 Guest Lecture 110
D3 also has visual helper-functions
Chad Stolper CSE 6242 Guest Lecture 111
Axes
yaxisglyph = vis.append(“g”) yaxis = d3.svg.axis( ) .scale( yscale ) //must be a numerical scale .orient( ‘left’ ) //or ‘right’,‘top’, or ‘bottom’ .ticks( 6 ) //number of ticks, default is 10 yaxisglyph.call(yaxis)
Chad Stolper CSE 6242 Guest Lecture 112
D3 even has some entire techniques built in (e.g., treemap)… http://bl.ocks.org/mbostock/4063582
Chad Stolper CSE 6242 Guest Lecture 113
What if the data is changing?
Chad Stolper CSE 6242 Guest Lecture 114
E-U-E Pattern Template
var group = vis.selectAll(“rect”) .data(rawdata) //rawdata must be an array! group.enter( ).append(“svg:rect”) //ENTER! .attr( ) .attr( ) group //UPDATE! .attr( ) .attr( ) group.exit( ).remove( ) //EXIT!
Chad Stolper CSE 6242 Guest Lecture 115
E-U-E Pattern Template
function redraw(rawdata){ var group = vis.selectAll(“rect”) .data(rawdata) //rawdata must be an array! group.enter( ).append(“svg:rect”) //ENTER! .attr( ) .attr( ) group //UPDATE! .attr( ) .attr( ) group.exit( ).remove( ) //EXIT! }
Chad Stolper CSE 6242 Guest Lecture 116
E-U-E Pattern Template
function redraw(rawdata){ var group = vis.selectAll(“rect”) .data(rawdata) //rawdata must be an array! group.enter( ).append(“svg:rect”) //ENTER! .attr( ) .attr( ) group.transition( ) //UPDATE! .attr( ) .attr( ) group.exit( ).remove( ) //EXIT! }
Chad Stolper CSE 6242 Guest Lecture 117
Transitions
Chad Stolper CSE 6242 Guest Lecture 118
Transitions
rect.attr(“height”, 0) rect.transition( ) .delay( 500 ) //can be a function of data .duration(200) //can be a function of data .attr(“height”, 5) //can be a function of data .style(“fill”,”green”) //can be a function of data
Chad Stolper CSE 6242 Guest Lecture 119
So transitions allow a vis to be dynamic… But they’re not really interactive…
Chad Stolper CSE 6242 Guest Lecture 120
Interaction
The on( ) Method
Chad Stolper CSE 6242 Guest Lecture 121
.on( )
rect.on (“click”, function(d){
d.color = “blue”; redraw( rawdata )
}) HTML Events
Chad Stolper CSE 6242 Guest Lecture 122
.on( )
rect.on (“click”, function(d){
d.color = “blue”; redraw( rawdata )
}) HTML Events
d is the data point backing the element clicked on
Chad Stolper CSE 6242 Guest Lecture 123
Where to get learn more…
Reference
Chad Stolper CSE 6242 Guest Lecture 124
When You’re Bored…
http://www.koalastothemax.com/
Chad Stolper CSE 6242 Guest Lecture 125
Thanks! chadstolper@gatech.edu
Chad Stolper CSE 6242 Guest Lecture 126
Good Luck! chadstolper@gatech.edu
Chad Stolper CSE 6242 Guest Lecture 127
Questions? chadstolper@gatech.edu
Chad Stolper CSE 6242 Guest Lecture 128