Responsible data science Informa3on ethics & privacy Dino - - PowerPoint PPT Presentation

Responsible data science Informa3on ethics & privacy

Dino Pedreschi

EUI-SoBigData.eu workshop 11 October 2017

URBAN MOBILITY ATLAS

Urban Mobility Atlas http://kdd.isti.cnr.it/uma2/

REAL TIME DEMOGRAPHY

GSM Calls

Profile Map

Temporal Profile

A Sociometer based on mobile phone data for real 3me demographics

8

San Pietro Square

DIVERSITY & WELLBEING

Big Data: Diversity and economic development

THE POLYCENTRIC CITY

FLUXES ORIGINATING IN TUSCAN CITIES

EMERGENT CITY STRUCTURE

POLYCENTRIC CITY

Ethics and Security

The GDPR

Ø Will enter into force on 25 May 2018 Ø Introduces important novelKes Ø New ObligaKons Ø New Rights

Privacy by Design

Privacy by design big data analy3cs

Ø Design analyKcal process that implement the privacy-by- design & by-default principle Ø Consider privacy at every stage of their business Ø Integrate privacy requirements “by design” into their business model.

19

Privacy by Design Methodology in Big Data Analy3cs

The framework is designed with assumptions about § The sensitive data that are the subject of the analysis § The attack model, i.e., the knowledge and purpose of a malicious party that wants to discover the sensitive data § The target analytical questions that are to be answered with the data Design a privacy-preserving framework able to § transform the data into an anonymous version with a quantifiable privacy guarantee § guarantee that the analytical questions can be answered correctly, within a quantifiable approximation that specifies the data utility

Privacy Risk Assessment

Knowledge Discovery and Delivery Lab (ISTI-CNR & Univ. Pisa) www-kdd.isK.cnr.it

Privacy Risk Assessment Framework

Simula3on of privacy harmful Inferences

# w e e k s

• f

B K

Data dimension: The spa(al area in which the analysis is performed. Background Knowledge dimension: The temporal window (in weeks) in which the a9acker recorded the user ac(vity. I-RACu: An indicator of the risk of re- iden(fica(on of the users

# w e e k s

• f

B K

Privacy-by-design for big data analy3cs

• All case studies discussed have been designed

within a privacy-preserving framework

• taking into account data minimiza3on in the

deployment of the service

• transforming raw data into aggregated data

with a quan3fied (low) risk of privacy breach

But we need to go further!

• A city cannot be managed centrally, from a

control room.

• Our ciKes are complex networks of

interacKons

– the outcome for everybody depends not only on individual choices but it is condiKoned by everybody else's choices.

• A granular capability of ciKzens to self-organize,

collaborate and coordinate their acKons from the bobom-up is more efficient and resilient

• But requires to align individual interests and

goals with those of the collecKvity in the system.

– We humans have a limited percepKon of ourselves as a social, collecKve living being

TOWARDS A PERSONAL DATA ECOSYSTEM

• An avalanche of personal informaKon that, in

most cases, gets lost – like tears in rain.

• Yet, only each one of us, individually, has the

power to connect all this personal informaKon into a personal data repository – and make sense of it.

A user-centric ecosystem for personal big data

31

Personal Data Ecosystem

Where am I? Comparison with the community

• We need a Personal Data Ecosystem

– to acquire, integrate and make sense of our own data – and to connect with our peers and the surrounding urban community and infrastructure

• to the purpose of developing the collec3ve

awareness needed to face our grand challenges

A smart city is a city of par3cipa3ng, aware ci3zens

Big Data, Big Risks

• Big data is algorithmic, therefore it cannot be biased!

And yet…

• All traditional evils of social discrimination, and many

new ones, exhibit themselves in the big data ecosystem

• Because of its tremendous power, massive data

analysis must be used responsibly

• Technology alone won’t do: also need policy, user

involvement and education efforts

36

• By 2018, 50% of business ethics

violaKons will occur through improper use of big data analyKcs

• [source: Gartner, 2016]

AI and Big Data 37

The danger of black boxes

• The COMPAS score (CorrecKonal Offender Management Profiling

for AlternaKve SancKons)

• A 137-quesKons quesKonnaire and a predicKve model for “risk of

crime recidivism.” The model is a proprietary secret of Northpointe, Inc.

• The data journalists at propublica.org have shown that the model

has a strong ethnic bias

– blacks who did not reoffend are classified as high risk twice as much as whites who did not reoffend – whites who did reoffend were classified as low risk twice as much as blacks who did reoffend.

AI and Big Data 38

The danger of black boxes

• An accurate but untrustworthy classifier may result

from an accidental bias in the training data.

• In a task of discriminaKng wolves from huskies in a

dataset of images, the resulKng deep learning model is shown to classify a wolf in a picture based solely

• n …

AI and Big Data 39

The danger of black boxes

• An accurate but untrustworthy classifier may result

from an accidental bias in the training data.

• In a task of discriminaKng wolves from huskies in a

dataset of images, the resulKng deep learning model is shown to classify a wolf in a picture based solely

• n … the presence of snow in the background!

AI and Big Data 40

Deep learning is crea3ng computer systems we don't fully understand

AI and Big Data 41

Transparent algorithms to build trust

• Systems that recommend

humans making a decision should explain why

Delp 17 – 19 February 2016

Soccer Player Ratings

Soccer Player Ratings

How humans evaluate sports performance?

Goalkeepers Forwards (FW)

goals suff.

goal diff

goals suff.

goal diff

Defenders Midfielders

Human evalua3on line Technical features

Machine performance

Human evalua3on line Technical features Technical + Contextual features

Machine performance

Social Mining & Big Data Analy3cs

H2020 - www.sobigdata.eu September 2015- August 2019