Contents Contents 1. Establishment of a Big Data Roadmap of the - - PDF document

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

April 2013

Ki-bong Park

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

1. Establishment of a Big Data Roadmap of the Korean Government 2. Beginning of Big Data Use 3. KOSTAT Countermeasures against Big Data Use 4. KOSTAT Pilot Project for Big Data Use in Official Statistics 5. Future Plans

Contents Contents

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

1 / 12 U.S.A.: ‘Big Data Research & Development Initiatives’ , investment in big data research & development (March 2012) England: ‘Open Data Strategy’, Strengthen data access (March 2012) Japan: Published ‘Strategy for Big Data Use’, Selected as a major goal for ‘Active Japan’(May 2012)

Cope with big data issues

• March 15, 2012: Big data national strategy forum (Participation by industries, universities, research institutes and

governmental agencies)

• Sep. 16, 2012: Big data forum (Participation by the public and private sectors)

Establish a ‘Big Data Master Plan’ (National Science & Technology Commission, Nov. 28, 2012)

• Step-by-step big data use by considering benefits and utilities
• Establishment of infrastructure for big data sharing, provision of technical support and expert training

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

Big data use when analyzing welfare and complaints from the general public Beginning of big data use in terms of policy support and customized services

• (Policy support) Link and share data that is located in several ministries, and support

policy-making via data analysis

• (Customized services) Provide user-focused services via an integrated analysis (e.g.

qualification and history)

2 / 12

Holding World-class ‘I T infrastructure’ and ‘data production and dissemination’

• World-best infrastructure including high-speed Internet, 3G smart phones and LTE phones
• Sharp increase in mobile data due to the popularity of smart phones and SNS

Poor data use by businesses when considering the production and dissemination of a huge amount of data

• Just a few enterprises properly understand and use big data.
• Mobile and portal service providers started to use big data based on their own data.

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

3 / 12

Collect, classify, analyze and forecast online complaints of the public to facilitate communication between the government and the public Produce a complaints calendar by month and region after analyzing past complaints and produce a complaints map showing social issues 형태로 제공 Unemployment benefits, use of public transportation Apartment sales

Strengthen policies

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

Policies for adolescents are too passive to prevent their extreme behaviors. Help to make policies to prevent suicides of adolescents by analyzing buzz patterns related to suicides in social data and reflecting their situations and psychology

(Source) Pilot Project of the National Information Society Agency (July ~ Sep. 2012)

4 / 12 e.g.) Suicide context pool e.g.) Online spread of harmful contents

e.g.) Ripple effect of big mouths in a network

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

Collection and analysis of I nternet data Provision of visualized analysis function 5 / 12

Research on big data use in official statistics and pilot production of statistics Establish a task force responsible for big data use and train human resources

Support rapid and accurate production of the Mining and Manufacturing Production I ndex

Media data is automatically collected and used for objective editing (checking changes in establishments and items, finding outliers) before finalizing the Index.

“Earlier dissemination of the Mining and Manufacturing Production I ndex by using media data”

Easier understanding of time-series data (index and volume) by providing visualized analysis function

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

9 / 12

Workflow

Volume information by establishment and item Index information by industry and item

Visualized analysis of survey data

Integrated Internet information on items and establishments

Analysis of media non-typical data

I ndividual verificatio n of I nternet data I nquiry

• ver the

phone Volume table- focused edit

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

I ndustry Source Contents

C21 (Pharmaceutical products) Korea Pharmaceutical Manufacturers Association www.kpma.or.kr / Pharmaceutical news Chong Kun Dan Pharm. Major production and commodities Internet newspapers Related articles C24 (Basic metal products) Korea Metal Journal new.kmj.co.kr / New by product Korea Iron & Steel Association www.kosa.or.kr / Iron & steel information / Survey report, Iron & Steel Journal Internet newspapers Related articles C26 (Electronic components, computer, radio, television and communication equipment and apparatuses) Ministry of Knowledge Economy Website / Press releases, notices, policy Korea Customs Service Website / Policy, press releases Korea Semiconductor Industry Association Real-time news on semiconductor Semiconductor Network News Korea Display Industry Association News on display industry Internet newspapers Related articles C28 (Electrical equipment) Internet newspapers Related articles

※ 4 industry groups (C21, C24, C26, C28, 162 items, 1438 establishments) that are surveyed in the Monthly Survey of Mining and Manufacturing

6 / 12

(Media data) Notices on the related websites and I nternet news articles (Survey data) Time-series index and volume data by industry, item and establishment from 2005 to the current month for the Monthly Survey of Mining and Manufacturing

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

7 / 12

Scrolling of articles and documents on the I nternet from the previous month to the current month

• Collect Internet data that contains words such as increase and

decrease for survey items and establishments

• Scroll Internet news on a real-time basis
• Analyze attached documents in the PDF or MS word format on the

websites and load data into the analysis server

I ntegrated analysis of attached documents from the websites and I nternet news articles

• Improve retrieval accuracy by registering search words (e.g. items)

in advance

• Provide website and Internet news according to the order of

accuracy

Analysis of non-typical data

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

8 / 12

Online link to the DB for the Mining and Manufacturing Survey System Visualization of time-series index and volume data by industry, establishment and item (e.g. in graphs)

• Volume graph by item and establishment

(Volume/month-on-month/year-on-year)

• I ndex graph by industry and item

(Volume/month-on-month/year-on-year)

I ndex by industr y I ndex by item

Volume by establishmen t

Volume by item

Visualization of typical data

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

10 / 12

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

11 / 12

Define business processes and responsibilities

Examine applicability and efficiency in statistical production/ accumulate big data use techniques Expand the system (e.g. expand analysis range) Expand to all industries in Monthly Survey of Mining and Manufacturing Expand to the Monthly Service I ndustry Survey

광업제조업 동향지수 빅데이터 활용 Pilot Project MSIS2013(2013.4.23~ 25, Bangkok)

Thank you for watching