types 2 Exploring word-frequency differences in corpora Tanja Sily - - PowerPoint PPT Presentation

▶
types 2
SMART_READER_LITE
LIVE PREVIEW

types 2 Exploring word-frequency differences in corpora Tanja Sily - - PowerPoint PPT Presentation

Mar 25, 2023 672 likes •1.09k views

types 2 Exploring word-frequency differences in corpora Tanja Sily & Jukka Suomela Comparing word frequencies Corpus linguists do this all the time Significance of differences observed? Bag-of-words tests (e.g. chi-square,

slide-1
SLIDE 1

types2

Exploring word-frequency differences in corpora

Tanja Säily & Jukka Suomela

slide-2
SLIDE 2

Comparing word frequencies

  • Corpus linguists do this all the time
  • Significance of differences observed?

– Bag-of-words tests (e.g. chi-square, log-likelihood ratio test) assume words occur randomly in texts,

  • verestimate significance

– Tests based on resampling: assumption-free, yield confidence intervals

  • types2: permutation testing (resampling)
slide-3
SLIDE 3

Exploring word frequencies

  • Typically: static tables, figures

– Not conducive to rapid exploration

  • Interpretation of results?

– Need to go back to the concordances & metadata

  • types2: online interface with interactive

figures, linked data

slide-4
SLIDE 4

How does it work?

  • Do a corpus search

– BNCweb, WordSmith Tools…

  • Narrow down to relevant hits
  • Input for types2: relevant hits +

corpus metadata

  • Output: plots, results, web pages…
slide-5
SLIDE 5

Example: Productivity in the BNC

  • Derivational suffixes: -er, -or

– Sociolinguistic variation in their productivity? – Productivity ~ type frequency

  • BNC = British National Corpus

– Demographically sampled spoken component, both gender & social class known: 2.6 Mw – BNCweb (Lancaster University) – MorphoQuantics (Laws & Ryder 2014)

slide-6
SLIDE 6

BNC raw search results word, POS, class, lemma relevant hits meta- data, word counts data- base plots, results, web pages types2 BNCweb Morpho- Quantics

slide-7
SLIDE 7
slide-8
SLIDE 8
slide-9
SLIDE 9
slide-10
SLIDE 10
slide-11
SLIDE 11
slide-12
SLIDE 12
slide-13
SLIDE 13
slide-14
SLIDE 14
slide-15
SLIDE 15
slide-16
SLIDE 16
slide-17
SLIDE 17
slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20
slide-21
SLIDE 21
slide-22
SLIDE 22
slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25
slide-26
SLIDE 26
slide-27
SLIDE 27
slide-28
SLIDE 28
slide-29
SLIDE 29
slide-30
SLIDE 30

Conclusion

  • Linked data helps with

– Generating hypotheses

  • Age? Setting? Relationship?

– Interpreting results

  • Male overuse of -er: playful name-calling,

focus on tools & occupations?

  • types2: free tool, works with multiple

corpora & concordancers

slide-31
SLIDE 31

References

  • Laws, J.V. & C. Ryder (2014) MorphoQuantics.

http://morphoquantics.co.uk

  • Laws, J.V. & C. Ryder (2014) Getting the measure of

derivational morphology in adult speech: A corpus analysis using MorphoQuantics. Language Studies Working Papers: University of Reading, Vol. 6, 3–17.

  • Suomela, J. (2014) types2: Type and hapax

accumulation curves. http://users.ics.aalto.fi/suomela/types2/

  • Suomela, J. (2015) bnc-affix: Analysing productivity of

affixes with BNC & MorphoQuantics data. https://github.com/suomela/bnc-affix

slide-32
SLIDE 32

Example: Productivity in the CEEC

  • Derivational suffixes: -ness, -ity

– Sociolinguistic variation in their productivity?

  • CEEC = Corpora of Early English

Correspondence

– Long 18th century, 1680–1800: 2.2 Mw – WordSmith Tools (Mike Scott) – Pruned down to relevant hits in Excel

slide-33
SLIDE 33
slide-34
SLIDE 34
slide-35
SLIDE 35
slide-36
SLIDE 36
slide-37
SLIDE 37
slide-38
SLIDE 38
slide-39
SLIDE 39
slide-40
SLIDE 40
slide-41
SLIDE 41

“If you find any thing that has the least appearance of coxcombicality, affectation, importance, conceit, &c., have no mercy upon it.”

Thomas Twining to Richard Twining, 1788