NLP Resource Creation and Enrichment using Deep Learning Kevin - - PowerPoint PPT Presentation

▶

Nov 03, 2023 395 likes •554 views

NLP Resource Creation and Enrichment using Deep Learning Kevin Patel Guided by: Prof. Shivaram Kalyanakrishnan Prof. Pushpak Bhattacharyya April 1, 2016 Kevin Patel Deep Learning for NLP resources 1 / 5 Natural Language Processing (NLP)

SLIDE 1

NLP Resource Creation and Enrichment using Deep Learning

Kevin Patel Guided by:

Prof. Shivaram Kalyanakrishnan
Prof. Pushpak Bhattacharyya

April 1, 2016

Kevin Patel Deep Learning for NLP resources 1 / 5

SLIDE 2

Natural Language Processing (NLP)

Different NLP tasks

Kevin Patel Deep Learning for NLP resources 2 / 5

SLIDE 3

Natural Language Processing (NLP)

Different NLP tasks

Machine Translation

Kevin Patel Deep Learning for NLP resources 2 / 5

SLIDE 4

Natural Language Processing (NLP)

Different NLP tasks

Machine Translation Information Retrieval

Kevin Patel Deep Learning for NLP resources 2 / 5

SLIDE 5

Natural Language Processing (NLP)

Different NLP tasks

Machine Translation Information Retrieval Dialogue Systems

Kevin Patel Deep Learning for NLP resources 2 / 5

SLIDE 6

Natural Language Processing (NLP)

Different NLP tasks

Machine Translation Information Retrieval Dialogue Systems

Resource driven

Kevin Patel Deep Learning for NLP resources 2 / 5

SLIDE 7

Natural Language Processing (NLP)

Different NLP tasks

Machine Translation Information Retrieval Dialogue Systems

Resource driven

WordNet IndoWordNet, EuroWordNet FrameNet Parallel Corpora Sense-annotated Corpora Pretrained vector repositories

Kevin Patel Deep Learning for NLP resources 2 / 5

SLIDE 8

Deep Learning

Kevin Patel Deep Learning for NLP resources 3 / 5

SLIDE 9

Deep Learning

Traffic Sign Recognition Handwriting recognition (English and other languages such as Chinese, Arabic) Breast Cancer Prognosis

Kevin Patel Deep Learning for NLP resources 3 / 5

SLIDE 10

Deep Learning

Traffic Sign Recognition Handwriting recognition (English and other languages such as Chinese, Arabic) Breast Cancer Prognosis

Deep Learning in NLP

Kevin Patel Deep Learning for NLP resources 3 / 5

SLIDE 11

Deep Learning

Traffic Sign Recognition Handwriting recognition (English and other languages such as Chinese, Arabic) Breast Cancer Prognosis

Deep Learning in NLP

SENNA : POS, chunking, NER, SRL

Kevin Patel Deep Learning for NLP resources 3 / 5

SLIDE 12

Deep Learning

Traffic Sign Recognition Handwriting recognition (English and other languages such as Chinese, Arabic) Breast Cancer Prognosis

Deep Learning in NLP

SENNA : POS, chunking, NER, SRL DSSM : web-search ranking, contextual searching, advertising relevance

Kevin Patel Deep Learning for NLP resources 3 / 5

SLIDE 13

Deep Learning

Traffic Sign Recognition Handwriting recognition (English and other languages such as Chinese, Arabic) Breast Cancer Prognosis

Deep Learning in NLP

SENNA : POS, chunking, NER, SRL DSSM : web-search ranking, contextual searching, advertising relevance

A crucial development - word vectors (word embeddings, word representations, etc.)

Kevin Patel Deep Learning for NLP resources 3 / 5

SLIDE 14

Deep Learning for NLP resources

Enriching existing resources Automatic linking of Synsets Within a language specific wordnet Cross lingual Refining pretrained vector repositories Detection and removal of non-specific vectors Estimating appropriate task specific representation for

ut-of-vocabulary words

Creating new resources Creating vector representations of complex lexical entities such as Synsets Phrases Sentences Question/Answer pairs Investigating compositional and non-compositional methods of creating vectors

Kevin Patel Deep Learning for NLP resources 4 / 5

SLIDE 15

Thank You

Questions?

Kevin Patel Deep Learning for NLP resources 5 / 5