Term Extraction and Course Supervisor : Jin Guo Clustering - - PowerPoint PPT Presentation

▶

Sep 23, 2022 445 likes •604 views

COMP 762 Term Extraction and Course Supervisor : Jin Guo Clustering Presented by: Shruti Bhanderi Overview Text Chunking STS subcontractors shall track the progress of development activities in the progress report. Processing of Extracted

SLIDE 1

COMP 762

Term Extraction and Clustering

Course Supervisor : Jin Guo Presented by: Shruti Bhanderi

SLIDE 2

Overview

SLIDE 3

Text Chunking

STS subcontractors shall track the progress of development activities in the progress report.

SLIDE 4

Processing of Extracted Terms

STS subcontractors the progress development activities the progress report

Remove determiners, cardinal numbers and possessive pronouns.

STS subcontractors progress development activities progress report

Lemmatization

STS subcontractor progress development activity progress report

SLIDE 5

Compute Similarities between Terms

1. Syntactic Similarity Measures
2. Semantic Similarity Measures

SLIDE 6

Syntactic Similarity

Syntactic Measures Distance-based Token-based Corpus-based Levenstein Cosine SoftTFIDF

SLIDE 7

Semantic Similarity

❖ Is-a (vertical) and has-a (horizontal) relation chains

(WordNet).

HSO LESK LCH PATH LIN JCN RES WUP

SLIDE 8

SLIDE 9

Clustering

SLIDE 10

Clustering algorithms

❖ K means. ❖ Hierarchical Clustering ❖ Expectation Maximization

SLIDE 11

K means

SLIDE 12

Hierarchical Clustering

Agglomerative Divisive

Bottom up Top down

SLIDE 13

Expectation Maximization

SLIDE 14