Billion Prices Proj ect: Avoiding the Big Data Small Info S yndrome - - PowerPoint PPT Presentation

billion prices proj ect
SMART_READER_LITE
LIVE PREVIEW

Billion Prices Proj ect: Avoiding the Big Data Small Info S yndrome - - PowerPoint PPT Presentation

Billion Prices Proj ect: Avoiding the Big Data Small Info S yndrome Roberto Rigobon MIT S loan, NBER, CS AC Big distance between Data and Information! The world is not lacking of data, its lacking of information Need a question


slide-1
SLIDE 1

Billion Prices Proj ect:

Avoiding the Big Data – Small Info S yndrome

Roberto Rigobon MIT S loan, NBER, CS AC

slide-2
SLIDE 2

Big distance between Data and Information!

 The world is not lacking of data, it’s lacking of

information

 Need a question before collection  Data without purpose, produces problems not information

 Great Data is not a licenses for Bad Econometrics

 Need to understand phenomena  Measuring is not Predicting  Correlations are hardly Causal

slide-3
SLIDE 3

Inflation and Price Indexes

 Albert o Cavallo  We want t o produce alt ernat ive measures of inflat ion

 We need prices  We need methodology to weight those prices  We need to understand product introductions and

discontinuations

 We need to understand store behavior  How to collect prices of products not sold on the internet?

S ervices?

slide-4
SLIDE 4

Online Information and Indexes

  • Dat e
  • It em
  • Price
  • Descript ion

Our Approach to Daily Inflation S tatistics

Use scraping t echnology Connect t o t housands of

  • nline ret ailers

every day Find individual it ems Develop daily inflat ion st at ist ics for ~20 count ries

1 2 3 4 5

S t ore and process key it em informat ion in a dat abase

slide-5
SLIDE 5

How do we collect data?

Our prices are collected from public online sources, using a technique called “web scraping”

A software downloads a webpage, analyses the html code, “scrapes” price data, and stores it in a database

slide-6
SLIDE 6

Countries covered

slide-7
SLIDE 7

Properties of Inflation Indexes

 Congruence

 S

tores keep markups between online and offline prices relatively constant in the medium run

 Anticipation

 Online Price Indexes trends anticipate official inflation shifts.  Online prices are easier to change, retailers are more

competitive, and consumers have less memory.

 Demand trends

 Changes in inflation trends by retailers reflect changes in the

demand they are facing

slide-8
SLIDE 8

Argentina

slide-9
SLIDE 9

US A

slide-10
SLIDE 10

US Recession

S ep 16 2008

slide-11
SLIDE 11

US 2012

slide-12
SLIDE 12

Argentina Australia Colombia Germany Ireland

Annual Inflation Rates

UK China – S upermarket Index Russia Venezuela

slide-13
SLIDE 13

Other Indexes

 Nat ural Disast er’s Measurement  Employment  Real Est at e Inflat ion and Capit al Gains  GDP and Economic Act ivit y

slide-14
SLIDE 14

Thailand: When Help S hould Be Deployed?

Not es: Product Availabilit y normalized t o 100 on 10/ 1/ 2011

20 40 60 80 100 120

10/ 1 10/ 2 10/ 3 10/ 4 10/ 5 10/ 6 10/ 7 10/ 8 10/ 9 10/ 10 10/ 11 10/ 12 10/ 13 10/ 14 10/ 15 10/ 16 10/ 17 10/ 18 10/ 19 10/ 20 10/ 21 10/ 22 10/ 23 10/ 24 10/ 25 10/ 26 10/ 27 10/ 28 10/ 29 10/ 30 10/ 31 Product Availability In Online Retailers