Scalable Learning and Inference in Large Knowledge Bases
Yang Chen
Data Science Research Lab University of Florida
Data Science Research
Scalable Learning and Inference in Large Knowledge Bases Yang Chen - - PowerPoint PPT Presentation
Scalable Learning and Inference in Large Knowledge Bases Yang Chen Data Science Research Lab University of Florida @ D ata S cience R esearch Agenda Ontological Knowledge Introduction Conclusion Pathfinding Expansion Agenda Ontological
Data Science Research Lab University of Florida
Data Science Research
Known Place of Birth 30%
Known ethnicity 1%
Runtime/min 125 250 375 500 Input size 3000000 6000000 9000000 12000000 YAGO YAGO2s DBpedia
Input Size Runtime/min
Runtime/min 125 250 375 500 Input size 100000000 200000000 300000000 400000000 YAGO YAGO2s DBpedia Freebase
Input Size Runtime/min
Relational Classification Entity Resolution Alchemy Tuffy Alchemy Tuffy Runtime/min 125 250 375 500
3 1 420 68
1M Rules 500K Rules 200K Rules 100K Rules Runtime/s 4500 9000 13500 18000
Tuffy
Freebase DBpedia YAGO2s YAGO2
948,047 4,484,907 11,020,000 388,474,630
YAGO YAGO2s Freebase Runtime/min 2000 4000 6000 8000
7,200 293.4 4.56 1,993.2 19.4 3.59
OP AMIE+
Relational Joins Partition- ing Parallel Inference Cross Validation
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
Relational Joins Partition- ing Parallel Inference Cross Validation
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
p x y exports United States computer exports Canada Aluminum imports United States Aluminum imports United States Clothing dealsWith Canada United States isLocatedIn Washington, D.C. United States isLocatedIn Ottawa Canada isLocatedIn Stanford University Stanford, CA hasCapital Canada Ottawa hasCapital Unites States Washington, D.C. wasBornIn Donald Knuth Milwaukee, Wisconsin isCitizenOf Donald Knuth United States worksAt Donald Knuth Stanford University H(x, y) b1(x, z) b2(y, z) dealsWith exports imports dealsWith isLocatedIn isLocatedIn isCitizenOf wasBornIn HasCapital worksAt wasBornIn isLocatedIn isLocatedIn hasCapital isLocatedIn
Relational Joins Partition- ing Parallel Inference Cross Validation
F1 F4 F5 R1 R2 R3 F1 R1 R2 R3 F4 R1 R2 R3 F5 R1 R2 R3
F1 F1 R1 F2, F5 R2 F4 R3 F4 F2, F3 R1 F1 R2 F2 R3 F5 F5 R1 F3, F4 R2 F4 R3 F1 0, R1, R2 F2 R1, R2, R3 F3 R1, R2 F4 0, R2, R3 F5 0, R1, R2, R3
F2 F3
100K Rules 200K Rules 500K Rules 1M Rules Runtime/s 4500 9000 13500 18000
16,507 9,045 4,271 2,196
ProbKB Tuffy
200M 100M 50M 20M 10M 5M Runtime/h 12.5 25 37.5 50
6.374 9.668 11.842 16.499 24.693 41.915
Relational Joins Partition- ing Parallel Inference Cross Validation
Rules
YAGO2 YAGO2s
Facts
YAGO2 YAGO2s Rules
YAGO2 YAGO2s Rules Facts
YAGO2 YAGO2s Rules Facts
Test Train OP Rules
Test Train OP Infer Rules Facts
Test Train OP Infer Verify Rules Facts
Precision 0.25 0.5 0.75 1 Recall 0.25 0.5 0.75 1
Freebase YAGO2s
Music Book Film People Location # Correct Inferred Facts 7500000 15000000 22500000 30000000
916,438 1,354,632 1,361,939 1,384,209 21,463,725
bornIn(Mandel, Berlin) bornIn(Mandel, Baltimore) isLocatedIn(Baltimore, Berlin)
isLocatedIn(Baltimore, Berlin) bornIn(Freud, Baltimore) bornIn(Freud, Berlin)
bornIn(Mandel, Berlin) bornIn(Mandel, Baltimore)
Precision 0.225 0.45 0.675 0.9 Estimated # of correct facts 7500 15000 22500 30000
Without constraints With constraints
Others 3% Incorrect facts 6% Incorrect rules 33% Ambiguous join keys 24% Ambiguities (detected) 34%
Others 3% Incorrect facts 6% Incorrect rules 33% Ambiguous join keys 24% Ambiguities (detected) 34%
Francis Bacon Aristotle Plato Cicero Philosophy John Locke Meta physics
Francis Bacon Aristotle Plato Cicero Philosophy John Locke Meta physics i n fl u e n c e d B y
Francis Bacon Aristotle Plato Cicero Philosophy John Locke Meta physics
mainInterest
Francis Bacon Aristotle Plato Cicero Philosophy John Locke Meta physics
Francis Bacon Aristotle Plato Cicero Philosophy John Locke Meta physics i n fl u e n c e d B y
influencedBy
influencedBy
influence
Francis Bacon Aristotle Plato Cicero Philosophy John Locke Meta physics
mainInterest
mainInterest
coreSubject
mainInterest
p x y influencedBy Francis Aristotle influencedBy Francis Plato influencedBy Francis Cicero influence Francis John Locke mainInterest Aristotle Philosophy mainInterest Plato Philosophy coreSubject Cicero Philosophy mainInterest John Locke Meta physics x w Francis 1.0
p x y influencedBy Francis Aristotle influencedBy Francis Plato influencedBy Francis Cicero influence Francis John Locke mainInterest Aristotle Philosophy mainInterest Plato Philosophy coreSubject Cicero Philosophy mainInterest John Locke Meta physics x w Francis 1.0
x w Francis 1 Francis 3 Plato 3 Aristotle 6
p x y influencedBy Francis Aristotle influencedBy Francis Plato influencedBy Francis Cicero influence Francis John Locke mainInterest Aristotle Philosophy mainInterest Plato Philosophy coreSubject Cicero Philosophy mainInterest John Locke Meta physics x w Francis 1.0
x w Francis 1 Francis 3 Plato 3 Aristotle 6
Runtime/ms 17.5 35 52.5 70
Iter 3. Query 1Query 2Query 3 Query 1Query 2Query 3 Query 1Query 2Query 3
Runtime/ms 1 100 10000 SemMemDB Douglass
10,900 11.29
Data Science Research