Data Provenance for Attributes: Attribute Lineage Dennis Dosso, Susan - - PowerPoint PPT Presentation

TaPP 2020

Data Provenance for Attributes: Attribute Lineage

Dennis Dosso, Susan Davidson, Gianmaria Silvello

dosso@dei.unipd.it (University of Padua, Italy) susan@seas.upenn.edu (University of Pennsylvania, USA) silvello@dei.unipd.it (University of Padua, Italy)

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Overview

2

• Data Provenance & Lineage
• An Example
• Conclusions and Future Work

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Data Provenance & Lineage

3

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Data Provenance & Lineage

4

Data Provenance is a form of metadata describing the life of data

• A relational database instance I
• A query Q
• An output Q(I)
• A tuple t in Q(I)

The lineage of t is the set of all and only the tuples in the input that were used for the generation of the output We introduce a new type a lineage defined for attributes The idea: it is the set of all the attributes in the input that are used by the query to produce an attribute in a tuple of the output What we want to do: define lineage for a attribute value in the

• utput

It has a different level of granularity, and can help in tasks such as finding attribute hotspots in I

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

An Example

5

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Example

6

tId Name BasedIn phone a1 BayTours (a1,1) San Francisco (a1,2) 415-1200 (a1,3) a2 HarborCruz (a2,1) Santa Cruz (a2,2) 831-3000 (a2,3) tId Name Destination type price e1 BayTours (e1,1) San Francisco (e1,2) car (e1,3) 50 (e1,4) e2 BayTours (e2,1) Santa Cruz (e2,2) bus (e2,3) 100 (e2,4) e3 BayTours (e3,1) Santa Cruz (e3,2) boat (e3,3) 250 (e3,4) e4 BayTours (e4,1) Monterey (e4,2) boat (e4,3) 400 (e4,4) e5 HarborCruz (e5,1) Monterey (e5,2) boat (e5,3) 200 (e5,4) e6 HarborCruz (e6,1) Carmel (e6,2) train (e6,3) 90 (e6,4)

SELECT DISTINCT a.name, a.phone FROM Agencies a, ExternalTours e WHERE a.name = e.name AND e.type = ’boat’

Q1 :

tId Name Phone

• 1

BayTours (o1,1) 415-1200 (o1,2)

• 2

HarborCruz (o2,1) 831-3000 (o2,2)

Example taken from: Cheney J, Chiticariu L, Tan WC. Provenance in databases: Why, how, and where. Now Publishers Inc; 2009.

Agencies

ExternalTours

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Example

7

Join

tId Name BasedIn phone a1 BayTours (a1,1) San Francisco (a1,2) 415-1200 (a1,3) a2 HarborCruz (a2,1) Santa Cruz (a2,2) 831-3000 (a2,3) tId Name Destination type price e1 BayTours (e1,1) San Francisco (e1,2) car (e1,3) 50 (e1,4) e2 BayTours (e2,1) Santa Cruz (e2,2) bus (e2,3) 100 (e2,4) e3 BayTours (e3,1) Santa Cruz (e3,2) boat (e3,3) 250 (e3,4) e4 BayTours (e4,1) Monterey (e4,2) boat (e4,3) 400 (e4,4) e5 HarborCruz (e5,1) Monterey (e5,2) boat (e5,3) 200 (e5,4) e6 HarborCruz (e6,1) Carmel (e6,2) train (e6,3) 90 (e6,4)

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Example

8

Selection

tId Name BasedIn phone Destination type price ¨

• 1

BayTours (a1,1, e3,1) San Francisco (a1,2) 415-1200 (a1,3) Santa Cruz (e3,2) boat (e3,3) 250 (e3,4) ¨

• 2

BayTours (a1,1, e4,1) San Francisco (a1,2) 415-1200 (a1,3) Monterey (e4,2) boat (e4,3) 400 (e4,4) ¨

• 3

HarborCruz (a2,1, e5,1) Santa Cruz (a2,2) 831-3000 (a2,3) Monterey (e5,2) boat (e5,3) 200 (e5,4)

tId Name Phone

• 1

BayTours (o1,1) 415-1200 (o1,2)

1

BayTours (o0

1,1)

415-1200 (o0

1,2)

• 2

HarborCruz (o2,1) 831-3000 (o2,2)

b

tId Name Phone

• 1

BayTours (o1,1) 415-1200 (o1,2)

• 2

HarborCruz (o2,1) 831-3000 (o2,2)

Output Lineage of this attribute

tId Name BasedIn phone Destination type price ˙

• 1

BayTours (a1,1; e1,1) San Francisco (a1,2) 415-1200 (a1,3) SanFrancisco (e1,2) car (e1,3) 50 (e1,4) ˙

• 2

BayTours (a1,1; e2,1) San Francisco (a1,2) 415-1200 (a1,3) Santa Cruz (e2,2) bus (e2,3) 100 (e2,4) ˙

• 3

BayTours (a1,1, ; e3,1) San Francisco (a1,2) 415-1200 (a1,3) Santa Cruz (e3,2) boat (e3,3) 250 (e3,4) ˙

• 4

BayTours (a1,1; e4,1) San Francisco (a1,2) 415-1200 (a1,3) Monterey (e4,2) boat (e4,3) 400 (e4,4) ˙

• 5

HarborCruz (a2,1; e5,1) Santa Cruz (a2,2) 831-3000 (a2,3) Monterey (e5,2) boat (e5,3) 200 (e5,4) ˙

• 6

HarborCruz (a2,1; e6,1) Santa Cruz (a2,2) 831-3000 (a2,3) Carmel (e6,2) train (e6,3) 90 (e6,4)

{a1,1, a1,3, e3,1, e3,3, e4,1, e4,3}

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Example

9

tId Name Phone

• 1

BayTours (o1,1) 415-1200 (o1,2)

• 2

HarborCruz (o2,1) 831-3000 (o2,2)

tId Name Phone

• 1

BayTours (o1,1) 415-1200 (o1,2)

• 2

HarborCruz (o2,1) 831-3000 (o2,2)

tId Name Phone

• 1

BayTours (o1,1) 415-1200 (o1,2)

• 2

HarborCruz (o2,1) 831-3000 (o2,2)

{a1,1, e3,1, e4,1, e3,3, e4,3}

{a1,1, a1,3, e3,1, e3,3, e4,1, e4,3}

Attribute lineage “classic” lineage

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Conclusions and Future Work

10

• Attribute lineage: a new form of data provenance
• Different levels of granularity
• Applications: individuation of hotspots in a database, given a

set of queries Future work:

• New forms of provenance at the attribute level
• Attribute Why-Provenance
• Attribute How-Provenance

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Thank You

11

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Definitions

12

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

Definition

13

Given a database I, a SPJRU query Q0 over I, a tuple t:U 2 Q(I) and an attribute location c = (Q0, t, A) with A 2 U, then the lineage of c according to Q0 and I, denoted as Lin(Q0, t, A) is an element of P(FieldLoc), defined as follows:

• 1. Lin(σθ(Q), t, A) =

= (SS

c0=(Q,t,B)|B2θ(Where(c0) [S Lin(c0))

if θ(t) ?

• therwise
• 2. Lin(πU(Q), t, A) =

= SL

c0=(Q,t0,A)|t0[U]=t (Where(c0) [S Lin(c0))

• 3. Lin(ρA7!B(Q), t, C) = Lin(Q(I), t[B 7! A], C[B 7! A])[SWhere(Q, t[B 7!

A], A).

• 4. Lin(Q1 o

n Q2, t, A) = Where(c1)[SLin(c1)[SWhere(c2)[SLin(c2), where c1 = (Q1(I), t[U1], A0), c2 = (Q2(I), t[U2], A0).

• 5. Lin(Q1 [ Q2, t, A) =

(Where(c1)[SLin(c1))[L(Where(c2)[SLin(c2)), where c1 = (Q1(I), t, A), c2 = (Q2(I), t, A).

Dennis Dosso, Susan Davidson, Gianmaria Silvello TaPP 2020

From attributes to tuples

14

Attribute Lineage —> Lineage

KLin = {P(TupleLoc)⊥, ⊥, ∅, ∪L, ∪S}

K0

Lin = {P(FieldLoc)?, ⊥, ∅, ∪L, ∪S}

h(⊥) = ⊥ h(∅) = ∅ h(x ∪L y) = h(x) ∪L h(y) h(x ∪S y) = h(x) ∪S h(y) h({(R, t, A)}) = {R, t} h(Where(c)) = ∅ ∀c

The homomorphism “discards” the information about the attribute location in a tuple