SLIDE 1
Big Data =
O’Reilly Strata Conference February 29 2012
Pivot/Skate, etc!
Refounded 2006
Neighborhood boundaries Mass transit data
Refocused 2009
SaaS for mapping + on-demand data
Founded 2003
Poor man’s GIS Panamap
Bigger Metad Big Data = OReilly Strata Conference February 29 2012 - - PowerPoint PPT Presentation
Bigger Metad Big Data = OReilly Strata Conference February 29 2012 - - PowerPoint PPT Presentation
Bigger Metad Big Data = OReilly Strata Conference February 29 2012 Pivot/Skate, etc ! Founded 2003 Poor mans GIS Panamap Refounded 2006 Neighborhood boundaries Mass transit data Refocused 2009 SaaS for mapping + on-demand
SLIDE 2
SLIDE 3
Achtung!
NoSQL is no panacea
Big Data isn’t about data Big Data isn’t new Big Data doesn’t present a Boolean quandary With power comes responsibility
AWS bills Lady Gaga tweets Innumeracy (correlation v causation)
SLIDE 4
Big v Important
Big
Heterogeneous Raw Distributed Streaming/real time Search for meaning Time-sensitive Philosophical?
Important
Well-defined schema High value (not free) Test-driven Relational Historical Enterprise-focused
SLIDE 5
Data Exhaust
SLIDE 6
Platforms
SLIDE 7
A Brief History of Metadata
Callimachus Library of Alexandria, Egypt
SLIDE 8
A Brief History of Metadata
“Pinakes” (lists)
Title Category Author Author birthplace Father Word count
Callimachus
SLIDE 9
A Brief History of Metadata
SLIDE 10
A Brief History of Metadata
SLIDE 11
A Brief History of Metadata
SLIDE 12
A Brief History of Metadata
SLIDE 13
Where Is It?
SLIDE 14
Why Can’t We Be Together?
Metadata Data
SLIDE 15
Recap
1876
Taxonomy Pinakes
300 BC
Database
1970
Catalog
1595 AD
Data
SLIDE 16
Oh, How I’ve Missed You
SLIDE 17
Together At Last
SLIDE 18
GIS Data is Unevolved
+ =
SLIDE 19
Enter the Data Curator
SLIDE 20
DIKW Model
Data
Fact, Signal, Symbol
Information
Structural v Functional Symbolic v Subjective
Knowledge
Processed Procedural Propositional
SLIDE 21
Popularity (Google Trends)
!" #" $!" $#" %!" %#" &!" '()"*"%!!*" '()"%"%!!#" '()"$"%!!+" ,-."&$"%!!+" ,-."&!"%!!/" ,-."%0"%!!0" ,-."%/"%!!1" ,-."%+"%!$!" ,-."%#"%!$$" 2-(3.4"5)6-7"89:7-6"2.(;:)<=" ">-?(6(?(" "@A:<"6(?(@" ".B3(CD)" "@6(?("E.:-)CE?@"
SLIDE 22
I Metadata
One Person’s Metadata is Another Person’s Data
SLIDE 23
Thank you!
ian@urbanmapping.com @urbanmapping
R.I.P. Schema