Cognitive psychology: From semantic categories to narratives - - PowerPoint PPT Presentation

▶
cognitive psychology from semantic categories to
SMART_READER_LITE
LIVE PREVIEW

Cognitive psychology: From semantic categories to narratives - - PowerPoint PPT Presentation

Dec 15, 2022 114 likes •362 views

URBAN SOUND SYMPOSIUM April 3-5, 2019 in Ghent, Belgium Cognitive psychology: From semantic categories to narratives Jean-Dominique Polack Institut Jean Le Rond D Alembert Equipe Lutheries Acoustique Musique Sorbonne

slide-1
SLIDE 1

Cognitive psychology: From semantic categories to narratives

Jean-Dominique Polack

Institut Jean Le Rond D’Alembert Equipe Lutheries – Acoustique – Musique Sorbonne Université / CNRS UMR 7190 4 pl. Jussieu, F-75252 Paris cedex 05

URBAN SOUND SYMPOSIUM April 3-5, 2019 in Ghent, Belgium

slide-2
SLIDE 2

Introduction:

some definitions

  • Psychology:

the science of the mind or of mental states and process

  • Linguistics:

the science of “language envisaged in itself and for

itself"

(Saussure, Cours de linguistique générale)

  • Perception:

the art or faculty of aprehending by means of the senses or

  • f the mind
  • Mind:

(in a human or other conscious being) the element, part, substance,

  • r process that reasons, feels, wills, perceives, judges, etc.

(from New Webster’s dictionary, 1989)

Object: experimental study of relationships between meaning and perception

2 Urban Sound Symposium, Ghent, April 2019 Jean-Dominique Polack

slide-3
SLIDE 3

Outline

1. Introduction 2. Concepts 3. Methodology 4. Some examples 5. Discussion 6. Conclusion: focusing on the human subject

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 3

slide-4
SLIDE 4

The Filter model

Physical stimulus

Physical measurement Perceptual measurement Affective measurement Filter 2, non sensory factors Mood Context Emotion Background Expectation

Likes/dislikes

M2 Filter 1, the senses Sensory sensitivity and selectivity

Perceived stimulus

M1 M3

Objective Subjective +/-

Pedersen, 1999

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 4

  • 2. concepts psychophysics

Mind material in nature

slide-5
SLIDE 5

ecological approach (Gibson)

  • rejects stimulus/response paradigm

– casts doubt on sensation

  • theory of affordances

– values and meanings are directly perceived

  • meaningful perception is direct and immediate

– no time for checking properties (classical categories)

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 5

slide-6
SLIDE 6

categorization (Rosch, Lakoff)

  • experimental categories not based on common properties

– but similarity of shapes

  • existence of prototypes

– elements that better represent category:

robin for birds

  • Existence of basic level

– at which our knowledge is organized cognitive economy – at which the world is perceived

co-occurences are not random

– based on similarities and differences

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 6

The body is in the mind

slide-7
SLIDE 7

linguistics (Saussure, Greimas)

  • “Language is based on oppositions” (Saussure, Cours de linguistique générale)

– just as experimental categories – not a list of labels

  • “We perceive differences, and the world takes sense in front of us

and for us” (Greimas, Sémantique structurale)

  • “Meaning springs out of the two terms of an opposition” (idem)

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 7

=> elementary structure of signification

slide-8
SLIDE 8

semantic model (semiotic square)

S1 S2 S2 S1

elementary structure of meaning after Greimas = categories

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 8

complex (opposition) neutral (opposition) positive negative

S1 + S2 neither S1 nor S2 implication implication

slide-9
SLIDE 9

actantial model

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 9

slide-10
SLIDE 10
  • 3. Methodology
  • 1. free categorization

– free sorting – content analysis

with grammatical structure

– actantial categories

  • 2. ecological validity

– specifically design listening room – stereophonic recording and playback as basic level of cognition

  • 3. role of instructions

– compensate for missing context – exact wordings designed with care need for accurate transcriptions

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 10

slide-11
SLIDE 11
  • 4. examples from soundscapes

4.1 free categories: loudness similarity

Figures indicate loudness (in dB A) event sequences amorphous sequences

Maffiolo 1999

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 11

slide-12
SLIDE 12

italics: physical properties amorphous sequences normal: events, activities, and sound sources event sequences

  • Maffiolo, 1999

Physical properties Sound events, sources and activities

Judgements – loudness % responses

High screeching, motorcycles, pedestrians, discussion, near us, many sound events Bus starting, road works, cannon woman, very loud, very unpleasant, sound sources Background noise, annoying, intense, stationary, low frequencies

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 12

slide-13
SLIDE 13

4.2 semantic categories (verbalisation) Method of analysis (Mzali, 2002)

Open questionnaire

  • general analysis: mean values
  • more precise linguistic analysis for some categories
  • Free responses

Size all the responses verbally Analysis Filter: constructing the grid of categories

announcements mobile phones

  • ther

people newspapers doors Rolling noise

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 13

slide-14
SLIDE 14

semantics of annoyance

10 20 30 40 50 60 70

Général Vibrations Evénements Sources % de toutes les réponses

"agréable" "désagréable" "gênant" "indifférent"

Mzali, 2002

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 14 = pleasant = unpleasant = annoying = indifferent

General

% of all responses

Vibrations Events Sources

slide-15
SLIDE 15

4.3 prototypical categories (Vogel, 1999)

most frequent labels after listening to sounds

alone traffic parks global

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 15

Hoop whistle firemen bike bell

slide-16
SLIDE 16

physical properties interpreted sources

alone traffic parks

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 16

influence of context

slide-17
SLIDE 17

4.4 graphic categories: naive point of view

Maffiolo and Vogel, 1997

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 17

slide-18
SLIDE 18

4.5 actantial categories (Taupin 2017)

§ Interactions between members of a pair § Production of 25 boards of collages § Access to imaginaries and mind maps

Presentation & question § Instructions : “Imagine the city where you would like to drive”

§ Sample : § N=40 students

  • wners of a driving

license, non exposed to Western movie films § Aged between 21 and 24 § 21 JH/ 19 JF § Collection of free comments on collages § Games and word associations § Free comments

  • n images of an

unknown city (Paris) § Free expression of words characterizing the benefits of the experiences § Free categorization

  • f words by pairs

~ 10 min ~ 15 min ~ 60 min ~ 15 min ~ 15 min Warm-up Collages Comments

  • n collages

Benefits & categorization

  • f key words

§ Outputs are narratives and not simple comments

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 18

slide-19
SLIDE 19

§ Interactions between members of a pair § Production of 25 boards of collages § Access to imaginaries and mind maps § Collection of free comments on collages

~ 60 min ~ 15 min Collages Comments

  • f collages

我的主跟一号作品差不多，但是我想的是一个城市的一个小 角落。 大家都知道城市染非常重，生活力很大，我想的是在城市 当中有么一个地方——或者是主公园或者是文化街区，供大 家养生放松身心。 开到那躺在草坪上晒太阳，有很漂亮的花，有很自然的 街景，旁有很清澈的湖水和河流之的，我在里面可以遛 狗等等，跟小物行密的交流。 旁的商可能有比高端的养生会所，或者是瑜珈，在里面 可以吃一些食物。 My subject is pretty much the same as the work N ° 1. But what I imagine is rather a small corner in a city. As we all know, the pollution in the city is hyper-severe, the pressure of life is very large. I imagine having this kind of place within the city--, either an amusement park or a cultural district that can offer everyone (a place to) nourish life and relax the body and mind. I can drive up there, lie down on the lawn and sunbathe. There are very pretty flowers, the views of the street very natural. Next to it, there is water from a very clear lake and the river etc. There, we can take our dogs around and have intimate communications with small animals. In the shops next door there are top of the range clubhouses to feed life, or yoga clubs, in which you can eat something. My healthy life (5)

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 19

examples of narrative

slide-20
SLIDE 20

actantial structure of “My healthy life”

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 20

slide-21
SLIDE 21

Collage in Seoul Pleasure in “Repetition”

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 21

slide-22
SLIDE 22
  • 5. Conclusion: focusing on the human subject

living in the world sound as signal physics/ acoustics relevant perceives psychophysics acts

The human subject

cognitive psychology meaningful talks/ communicates linguistics member of a group sound as a collective representation sociology/social psychology

after D. Dubois Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 22

slide-23
SLIDE 23

Thank you for your attention

Urban Sound Symposium, Ghent, April2019 Jean-Dominique Polack 23

References

  • D. Dubois, S. David, P. Resche-Rigon, V. Maffiolo, M. Mzali (1998) “Etude de la qualité sonore des espaces verts de la ville de Paris”, Report to Paris City
  • D. Dubois (2000) Categories as acts of meaning: the case of categories in olfaction and audition, Cognitive Science Quarterly 1(1), 35-68
  • D. Dubois Ed. (2009) “Le sentir et le dire” (L’Harmattan, Paris)
  • J. Fontanille (2004) “Pratiques sémiotiques” https://www.unilim.fr/pages_perso/jacques.fontanille/textes-pdf/CPratiques_semiotiques2004_06.pdf

J.J. Gibson (1979) “The ecological approach to visual perception” (Lawrence Erlbaum Associates, 1986) A.J. Greimas (1970) “Sémantique structurale” (Presses Universitaires de France, 1986)

  • C. Guastavino (2003) “Etude sémantique et acoustique de la perception des basses fréquences dans l’environnement sonore urbain” (doctoral thesis, Université Pierre

et Marie Curie)

  • C. Guastavino, B. Katz, J.D. Polack, D. Levitin, and D. Dubois (2005) Ecological validity of soundscape reproduction. Acta Acustica 91, 333-341
  • L. Hjemslev (1943) “Prolégomènes à une théorie du langage” (Editions de Minuit, 1968)
  • G. Lakoff (1987) “Women, fire, and dangerous things – what categories reveal about the mind” (The University of Chicago Press)
  • V. Maffiolo, S. David, D. Dubois, C. Vogel, M. Castellengo, J.D. Polack (1997) Sound characterization of urban environment, InterNoise 97, 1239-1242
  • V. Maffiolo (1999) “Contribution à la caractérisation sémantique et acoustique de la qualité de l’environnement sonore urbain” (doctoral thesis, Université du Maine,

Le Mans)

  • H. de la Motte-Haber (1994) Principales théories scientifiques en psychologie de la musique : les paradigmes, in “Psychologie de la musique”, edited by A. Zenatti

(Presses Universitaires de France), 27-53

  • M. Mzali (2002) “Perception de l’ambiance sonore et évaluation du confort acoustique dans les trains” (doctoral thesis, Université Pierre et Marie Curie)

C.K. Ogden and I.A. Richards (1923) “The meaning of meaning” (Routledge and Keagan, London)

  • J. Poitevineau, B. Lecoutre, M.P. Lecoutre, and K. Rovira (2002) Méthode des arbres de similarité additive de Sattah et Tversky, Cahier du LCPE 4, 15-28,

http://www.lam.jussieu.fr/Publications/CahiersLCPE/cahier6.pdf

  • F. de Saussure (1916) “Cours de linguistique générale” presented by T. Mauro (Payot, Paris, 1976)
  • E. Rosch (1987) Principles of categorization, in “Cognition and categorization” ed. By E. Rosch and B.B. Lloyd (Lawrence Erlbaum Associates, Publishers)
  • P. Taupin (2017) “Imaginaires d’ambiance automobile et sémiotique des récits: une approche d’innovation expérientielle digitale en Chine” (doctoral thesis,

Université Pierre et Marie Curie)

  • P. Taupin (2018) The contribution of narrative semiotics of experiential imaginary to the ideation of new digital customer experiences, accepted by Semiotica
  • C. Vogel (1999) “Etude sémiotique et acoustique de l’identification des signaux sonores d’avertissement en contexte urbain” (doctoral thesis, Université Pierre et

Marie Curie) Webster (1989) “New Webster’s dictionary of the English language” (the Delair Publishing Company)