nifify towards better quality entity linking
play

NIFify: Towards Better Quality Entity Linking Datasets Henry - PowerPoint PPT Presentation

Sep 23, 2022 •135 likes •405 views

NIFify: Towards Better Quality Entity Linking Datasets Henry Rosales-M endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl May 14, 2019 LA-WEB 2019 - 10th Latin American Web Congress

  1. NIFify: Towards Better Quality Entity Linking Datasets † Henry Rosales-M´ endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl May 14, 2019 † LA-WEB 2019 - 10th Latin American Web Congress

  2. Example

  3. Example - Entity Recognition

  4. Example - Entity Disambiguation

  5. Name Variations in Entity Linking Michael Joseph Jackson Michael J. Jackson King of Pop

  6. Name Variations in Entity Linking Michael Jackson

  7. Are there benchmark datasets to measure Entity Linking results?

  8. Overview of popular EL datasets Dataset Mn Typ Format MSNBC MSNBC ✗ ✗ IITB ✓ ✗ IITB AIDA/CoNLL ✓ ✗ AIDA ACE2004 MSNBC ✗ ✗ AQUAINT ✗ ✗ MSNBC DBpedia Spotlight ✓ ✗ Lexvo KORE50 AIDA ✓ ✗ N3-RSS 500 ✓ ✗ NIF Reuters 128 ✓ ✗ NIF News-100 ✓ ✗ NIF Wes2015 NIF ✓ ✗ SemEval 2015 Task 13 ✓ ✗ SemEval Thibaudet ✗ ✓ RENDEN Bergson RENDEN ✗ ✓ DBpedia Abstracts ✗ ✗ NIF MEANTIME ✓ ✓ CAT VoxEL NIF ✓ ✗

  9. Overview of popular EL datasets Dataset Mn Typ Format MSNBC MSNBC ✗ ✗ IITB ✓ ✗ IITB AIDA/CoNLL ✓ ✗ AIDA ACE2004 MSNBC ✗ ✗ AQUAINT ✗ ✗ MSNBC DBpedia Spotlight ✓ ✗ NIF KORE50 ✓ ✗ NIF N3-RSS 500 ✓ ✗ NIF Reuters 128 ✓ ✗ NIF News-100 ✓ ✗ NIF Wes2015 NIF ✓ ✗ SemEval 2015 Task 13 ✓ ✗ SemEval Thibaudet ✗ ✓ RENDEN Bergson RENDEN ✗ ✓ DBpedia Abstracts ✗ ✗ NIF MEANTIME ✓ ✓ CAT VoxEL NIF ✓ ✗

  10. Proposal NIFify: a tool that simultaneously supports the creation, visualization, and validation of NIF datasets, as well as the comparison of EL systems.

  11. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code

  12. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code • NIF-Dataset validation Eaglet Demo Source Code NIF-Dataset Validation

  13. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code • NIF-Dataset validation Eaglet Demo Source Code NIF-Dataset Validation • Benchmarking GERBIL Benchmark Demo Source Code Visualization NIF-Dataset Creation Orbis Benchmark Demo Source Code Visualization

  14. Related Work • NIF-Dataset creation QRTool BENGAL Automatic NIF Creation Demo Source Code • NIF-Dataset validation Eaglet Demo Source Code NIF-Dataset Validation • Benchmarking GERBIL Benchmark Demo Source Code Visualization NIF-Dataset Creation Orbis Benchmark Demo Source Code Visualization NIF-Dat

  15. NIFify - Creation

  16. NIFify - Creation

  17. NIFify - Creation

  18. NIFify - Creation

  19. NIFify - Validation

  20. NIFify - Validation

  21. Errors found in current NIF datasets Spelling Error Link Error Format Error Dataset DBpedia Spotlight 8 23 4 N3-RSS 500 1 34 – Reuters 128 4 71 – News-100 9 1515 – Wes2015 – 609 – VoxEL – 8 – • https://users.dcc.uchile.cl/~hrosales/dataset_errors.html

  22. Errors found in current NIF datasets

  23. NIFify - Benchmarking

  24. NIFify - Benchmarking

  25. Conclusion • NIFify: Creation/Validation/Visualization/Benchmark • Demo: https://users.dcc.uchile.cl/~hrosales/NIFify_v2.html • Source Code: https://github.com/henryrosalesmendez/NIFify_v2

  26. NIFify: Towards Better Quality Entity Linking Datasets † Henry Rosales-M´ endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl May 14, 2019 † LA-WEB 2019 - 10th Latin American Web Congress

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Entity Linking and Coreference Resolution CSCI 699 Instructor: Xiang Ren USC Computer Science

Entity Linking and Coreference Resolution CSCI 699 Instructor: Xiang Ren USC Computer Science

Entity Linking and Coreference Resolution CSCI 699 Instructor: Xiang Ren USC Computer Science Entity Linking: CSCI 699 Entity Linking: The Problem Query Entity NIL Given a source document, identify entities mentioned in text, and find

2.26k views • 126 slides
(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking Reflector overview Represent the data A bit code Learnings MOTIVATION practicing Clojure How will the backend &

739 views • 25 slides
Entity Linking Enityt Linking Laura Dietz dietz@cs.umass.edu University of Massachusetts Use

Entity Linking Enityt Linking Laura Dietz dietz@cs.umass.edu University of Massachusetts Use

Entity Linking Enityt Linking Laura Dietz dietz@cs.umass.edu University of Massachusetts Use cursor keys to fl ip through slides. Problem: Entity Linking Query Entity NIL Given query mention in a source document, identify which Wikipedia

938 views • 59 slides
linking, cross-lingual entity linking) TAC 2011 Summarization Track Guided Summarization task

linking, cross-lingual entity linking) TAC 2011 Summarization Track Guided Summarization task

Overview of the TAC2011 Summarization (Guided, AESOP, MultiLing) RTE (within a corpus including novelty detection and ablation testing) Knowledge Base Population (monolingual entity linking, cross-lingual entity linking) TAC 2011 Summarization

596 views • 10 slides
Cross-Lingual Cross-Document Coreference with Entity Linking Sean Monahan, John Lehmann, Timothy

Cross-Lingual Cross-Document Coreference with Entity Linking Sean Monahan, John Lehmann, Timothy

Cross-Lingual Cross-Document Coreference with Entity Linking Sean Monahan, John Lehmann, Timothy Nyberg, Jesse Plymale, Arnold Jung 2010 Entity Linking Task Link entity mentions in text to Knowledge Base (KB) Each entity mention is

390 views • 28 slides
Entity Linking with Multiple Knowledge Bases Bianca Pereira MSc. / PhD Day November 2015

Entity Linking with Multiple Knowledge Bases Bianca Pereira MSc. / PhD Day November 2015

Entity Linking with Multiple Knowledge Bases Bianca Pereira MSc. / PhD Day November 2015 Motivation Entity Linking is the task of grounding entity mentions in text with Knowledge Base entries.

439 views • 17 slides
MedLinker Medical Entity Linking with Neural Representations and Dictionary Matching *Daniel

MedLinker Medical Entity Linking with Neural Representations and Dictionary Matching *Daniel

MedLinker Medical Entity Linking with Neural Representations and Dictionary Matching *Daniel Loureiro and Alpio Mrio Jorge Medical Entity Linking Medical literature is growing rapidly. This information is extremely important, but

612 views • 19 slides
Design Challenges for Entity Linking Xiao Ling , Sameer Singh, Daniel S. Weld Entity Linking

Design Challenges for Entity Linking Xiao Ling , Sameer Singh, Daniel S. Weld Entity Linking

Design Challenges for Entity Linking Xiao Ling , Sameer Singh, Daniel S. Weld Entity Linking Seattle beat Portland yesterday. 2 Entity Linking Seattle beat Portland yesterday. 3 Entity Linking Seattle beat Portland yesterday. Seattle

724 views • 69 slides
Entity Linking via Low-rank Subspaces Akhil Arora , Alberto Garca-Durn, and Bob West SMLD

Entity Linking via Low-rank Subspaces Akhil Arora , Alberto Garca-Durn, and Bob West SMLD

Entity Linking via Low-rank Subspaces Akhil Arora , Alberto Garca-Durn, and Bob West SMLD November 13, 2019 What is Entity Linking? Michael Jordan is one of the leading figures in machine learning, and in 2016 reported him

568 views • 44 slides
CROSS-LANGUAGE ENTITY LINKING PAUL MCNAMEE JAMES MAYFIELD* DOUGLAS W. OARD TAN XU KE WU

CROSS-LANGUAGE ENTITY LINKING PAUL MCNAMEE JAMES MAYFIELD* DOUGLAS W. OARD TAN XU KE WU

CROSS-LANGUAGE ENTITY LINKING PAUL MCNAMEE JAMES MAYFIELD* DOUGLAS W. OARD TAN XU KE WU VESELIN STOYANOV DAVID DOERMANN * TODAYS DESIGNATED BLOWHARD CROSS-LANGUAGE ENTITY LINKING KNOWLEDGE BASE QUERY !" " # $ % & ' ( '#

452 views • 26 slides
Full-document Entity Extraction and Disambiguation Silviu Cucerzan Microsoft Research Machine

Full-document Entity Extraction and Disambiguation Silviu Cucerzan Microsoft Research Machine

TAC Entity Linking by Performing Full-document Entity Extraction and Disambiguation Silviu Cucerzan Microsoft Research Machine Learning Group Gaithersburg, MD November 15, 2011 KBP Entity Linking - Task Description For a name string and a

738 views • 38 slides
FOFE-based Deep Neural Networks for Entity Discovery and Linking Nargiza Nosirova Mingbin Xu ,

FOFE-based Deep Neural Networks for Entity Discovery and Linking Nargiza Nosirova Mingbin Xu ,

Overview What is FOFE? Entity Discovery methods FOFE-based Entity Linking Results and Conclusion FOFE-based Deep Neural Networks for Entity Discovery and Linking Nargiza Nosirova Mingbin Xu , Nargiza Nosirova , Kelvin Jiang , Feng Wei and Hui

379 views • 18 slides
The MSR System for Entity Linking at TAC 2013 Silviu Cucerzan Microsoft Research Machine

The MSR System for Entity Linking at TAC 2013 Silviu Cucerzan Microsoft Research Machine

The MSR System for Entity Linking at TAC 2013 Silviu Cucerzan Microsoft Research Machine Learning and Intelligence / MS_MLI Gaithersburg, MD 11/19/2013 Task Description For a string at a given offset in a document, determine which entity

368 views • 25 slides
Fine-Grained Evaluation for Entity Linking Henry Rosales-M endez, Aidan Hogan and Barbara

Fine-Grained Evaluation for Entity Linking Henry Rosales-M endez, Aidan Hogan and Barbara

Fine-Grained Evaluation for Entity Linking Henry Rosales-M endez, Aidan Hogan and Barbara Poblete University of Chile { hrosales,ahogan,bpoblete } @dcc.uchile.cl Nov 5, 2019 EMNLP-IJCNLP 2019, Hong Kong Example Example - Entity

720 views • 52 slides
Using Hospital Data to Measure Quality of Care and Linking it to DRG of Care and Linking it to

Using Hospital Data to Measure Quality of Care and Linking it to DRG of Care and Linking it to

Using Hospital Data to Measure Quality of Care and Linking it to DRG of Care and Linking it to DRG (Case-Mix) Payments Presented by Jugna Shah, MPH President, Nimitt Consulting Inc. Nordic Case-Mix Conference Helsinki, Finland J ne 2010

450 views • 21 slides
Lecture 24: NER & Entity Linking Kai-Wei Chang CS @ University of Virginia kw@kwchang.net

Lecture 24: NER & Entity Linking Kai-Wei Chang CS @ University of Virginia kw@kwchang.net

Lecture 24: NER & Entity Linking Kai-Wei Chang CS @ University of Virginia kw@kwchang.net Couse webpage: http://kwchang.net/teaching/NLP16 CS6501-NLP 1 Organizing knowledge Its a version of Chicago the Chicago was used by default

322 views • 14 slides
Asymptotically optimal minimizers schemes Guillaume Marc ais, Dan DeBlasio, Carl Kingsford

Asymptotically optimal minimizers schemes Guillaume Marc ais, Dan DeBlasio, Carl Kingsford

Asymptotically optimal minimizers schemes Guillaume Marc ais, Dan DeBlasio, Carl Kingsford Carnegie Mellon University Computing read overlaps Roberts, et al. (2004). Reducing storage requirements for biological sequence comparison. 1

575 views • 39 slides
Geranium renardii Kaip dalinsims? Globularia meridionalis Hatiora Gaertneri Images : du Net

Geranium renardii Kaip dalinsims? Globularia meridionalis Hatiora Gaertneri Images : du Net

Geranium renardii Kaip dalinsims? Globularia meridionalis Hatiora Gaertneri Images : du Net Roy Etzel - Feelings Retour bureau

761 views • 43 slides
P15814(2) HS2 London to the West Midlands: Appraisal of Sustainability Main Report Volume 1

P15814(2) HS2 London to the West Midlands: Appraisal of Sustainability Main Report Volume 1

28 | National Planning Policy Framework where the benefjts of the development, at this site, clearly outweigh both the impacts that it is likely to have on the features of the site that make it of special scientifjc interest and any broader

331 views • 8 slides
humane assessment with Moose Stphane Ducasse clearVue INRIA Wednesday, August 24, 2011

humane assessment with Moose Stphane Ducasse clearVue INRIA Wednesday, August 24, 2011

humane assessment with Moose Stphane Ducasse clearVue INRIA Wednesday, August 24, 2011 moosetechnology.org Wednesday, August 24, 2011 humane-assesment.com Wednesday, August 24, 2011 Wednesday, August 24, 2011 Wednesday, August 24, 2011

1.08k views • 77 slides
MOL2NET , 2019 , 5, ISSN: 2624-5078 2 http://sciforum.net/conference/mol2net-05 Introduction The

MOL2NET , 2019 , 5, ISSN: 2624-5078 2 http://sciforum.net/conference/mol2net-05 Introduction The

MOL2NET , 2019 , 5, ISSN: 2624-5078 1 http://sciforum.net/conference/mol2net-05 MOL2NET, International Conference Series on Multidisciplinary Sciences MDPI USINEWS-03: US-IN-EU Worldwide Science Workshop Series, UMN, Duluth, USA, 2019 PEQUI OIL

413 views • 5 slides
Deep Learning Basics Rachel Hu and Zhi Zhang Amazon AI d2l.ai Outline Installations

Deep Learning Basics Rachel Hu and Zhi Zhang Amazon AI d2l.ai Outline Installations

Deep Learning Basics Rachel Hu and Zhi Zhang Amazon AI d2l.ai Outline Installations Deep Learning Motivations DeepNumpy & Calculus Regression Optimization Softmax Regression Multilayer Perceptron (train

754 views • 73 slides
Facilities for Testing Control Software Pieter J. Schoenmakers <tiggr@ics.ele.tue.nl>

Facilities for Testing Control Software Pieter J. Schoenmakers <tiggr@ics.ele.tue.nl>

Facilities for Testing Control Software Pieter J. Schoenmakers <tiggr@ics.ele.tue.nl> Eindhoven University of Technology November 1997 Overview What is control software? What is the problem? The

472 views • 10 slides
Improving Hadoop MapReduce Performance on Supercomputers with JVM Reuse Thanh-Chung Dao and

Improving Hadoop MapReduce Performance on Supercomputers with JVM Reuse Thanh-Chung Dao and

1 Thanh-Chung Dao Improving Hadoop MapReduce Performance on Supercomputers with JVM Reuse Thanh-Chung Dao and Shigeru Chiba The University of Tokyo 2 Thanh-Chung Dao Supercomputers Expensive clusters Multi-core processors Large

401 views • 38 slides

More recommend