Pacific Belltower sound installation for live sonification of - - PowerPoint PPT Presentation

▶
pacific belltower
SMART_READER_LITE
LIVE PREVIEW

Pacific Belltower sound installation for live sonification of - - PowerPoint PPT Presentation

Feb 06, 2023 18 likes •351 views

Pacific Belltower sound installation for live sonification of earthquake Internet data PerMagnus Lindborg , PhD International Computer Music Conference ICMCEMW, Shanghai, 18 October 2017 1 Wednesday, October 18, 2017 Pacific Belltower

slide-1
SLIDE 1

PerMagnus Lindborg, PhD

International Computer Music Conference ICMC–EMW, Shanghai, 18 October 2017

Pacific Belltower

sound installation for live sonification

  • f earthquake Internet data

1

Wednesday, October 18, 2017

slide-2
SLIDE 2

2

Pacific Belltower

PerMagnus Lindborg

sonification ~ data-driven art earthquakes ~ concept implementation in Max parameter mapping & auditory perception

Wednesday, October 18, 2017

slide-3
SLIDE 3

Wednesday, October 18, 2017

slide-4
SLIDE 4

Pacific Belltower, with Chen Qiangbin (ICMC Chair) & Ping Jin (ICMC Music Chair)

(sound, 2 min)

Wednesday, October 18, 2017

slide-5
SLIDE 5

“Questions of aesthetics and musicality remain open in the field of sonification.” (Barrass & Vickers 2011)

concrete abstract ars informatica ars musica ‘Aesthetic Perspective Space’

(Vickers & Hogg 2006)

listening modes / intentions

(Schaeffer 1966; Tuuri & Eerola 2012)

“Perceptualization” (Grinstein & Smith 1990)

“Sonification is the use of nonspeech audio to convey information.… the transformation of data relations into perceived relations in an acoustic signal for the purposes of facilitating communication or interpretation.” (Kramer 1994)

…for discovery of patterns in data i.e. ‘scientific sonification’ …for generating sonic material, i.e. ‘aesthetic sonification’

sonification ~ data-driven art?

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-6
SLIDE 6

6

interactive parameter mapping

2005 2003 2013 2014 2015 2016 2017

MessagierEsquisse

TreeTorika Locust Wrath Locust Wrath #2 LW24 LWiOS Pacific Belltower Swordles Man bör kalla

2008

increased spatial resolution

perceptual principles, i.e. cross-modal association

(Lindborg & Friberg 2015, Lindborg 2016)

research-led practice (Dean & Smith)

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-7
SLIDE 7

https://i.ytimg.com/vi/bKr5nbxVzSg/hqdefault.jpg

7

https://www.google.com.sg/search?q=earthquake&client=firefox-b- ab&source=lnms&tbm=isch&sa=X&ved=0ahUKEwjH47j8y6XQAhUMK

  • 8KHWq1AAwQ_AUICCgB&biw=1452&bih=1101&dpr=0.9

Pacific Belltower

PerMagnus Lindborg

https://en.wikipedia.org/wiki/2017_Chiapas_earthquake Wednesday, October 18, 2017

slide-8
SLIDE 8

8

Wat Rakhang, Bangkok

https://en.wikipedia.org/wiki/Bell_tower_(wat)

Children's Bell Tower, Bodega Bay, USA

https://media-cdn.tripadvisor.com/media/ photo-s/07/b8/85/a8/children-s-bell-tower.jpg

Pacific Belltower

PerMagnus Lindborg

Perchance, he for whom this bell tolls may be so ill, as that he knows not it tolls for him… No man is an island… Never send to know for whom the bell tolls; it tolls for thee. John Donne (1623)

Wednesday, October 18, 2017

slide-9
SLIDE 9

Wednesday, October 18, 2017

slide-10
SLIDE 10

10

Internet

data parsing

http://www.iris.washington.edu/seismon/eventlist/index.phtml

sonification

visualisation

parameter mapping spatialisation

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-11
SLIDE 11

11

data parsing

sonification

visualisation

parameter mapping spatialisation

Pacific Belltower

PerMagnus Lindborg

http://www.iris.washington.edu/ seismon/eventlist/index.phtml

Wednesday, October 18, 2017

slide-12
SLIDE 12

Wednesday, October 18, 2017

slide-13
SLIDE 13

time management ~ trigger a peal

  • n the hour + quarters of hour

Wednesday, October 18, 2017

slide-14
SLIDE 14

retrieving data from a website using Jitter, formatting it for FTM (matrices)

Wednesday, October 18, 2017

slide-15
SLIDE 15

parsing text data scan line by line (consider regexp)

Wednesday, October 18, 2017

slide-16
SLIDE 16

mapping epicentre depth to pitch (f0) of FM synthesis bells

Wednesday, October 18, 2017

slide-17
SLIDE 17

mapping magnitude to FM harmonicity

Wednesday, October 18, 2017

slide-18
SLIDE 18

mapping geographic DIRECTION to spatialisation

Wednesday, October 18, 2017

slide-19
SLIDE 19

Wednesday, October 18, 2017

slide-20
SLIDE 20

Wednesday, October 18, 2017

slide-21
SLIDE 21

Wednesday, October 18, 2017

slide-22
SLIDE 22

22

Wednesday, October 18, 2017

slide-23
SLIDE 23

Mapping strategies

23

Pacific Belltower

PerMagnus Lindborg

(Spence, “Crossmodal…tutorial” 2011) (Tuuri & Eerola, “Taxonomy… Listening Modes” 2012) (Huron, “Sweet anticipation” 2010) Lindborg PM (2016). “Interactive Sonification of Weather Data for The Locust Wrath” . Leonardo, MIT Press.

Wednesday, October 18, 2017

slide-24
SLIDE 24

(1 - reflexive) “Is there an immediate danger!?”

  • innate responses
  • structural crossmodal associations

Auditory system: ecological approach urgency peal of bells, on the hour

24

Mapping strategies

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-25
SLIDE 25

Auditory system: ecological approach

25

Mapping strategies

Pacific Belltower

PerMagnus Lindborg

(2 - kinaestethic) affordances of perceptual experiences:

  • “How does the sound physically manifest itself?”
  • enactive perception (doing, cf. Noë 2004)
  • categorisation by sound source, early processing (Lindborg 2016 “Taxonomy…”)

sound source recognised as bells, connotations

Wednesday, October 18, 2017

slide-26
SLIDE 26

(2 - kinaestethic) “Where does the sound come from? Is it approaching or receding?”

  • processing of spatial cues is largely pre-attentive
  • gestural signatures (friend or foe)
  • kinaesthetic action-sound couplings (mostly acquired)

Lindborg & Liu “LWiOS”

spatialisation congruence w. reality geography

26

Auditory system: ecological approach

Mapping strategies

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-27
SLIDE 27

(3 - connotative) Kinaesthetic affordances of perceptual experiences

  • “What does the sound evoke in me? Is it aggressive or inviting?”
  • contextual orientations and anticipations
  • listening mode depends on emotional crossmodal associations

cognitive appraisal of response alternatives (cf. “decisional consequences”)

harmonicity (FM synth) inharmonious = more energetic magnitude

27

Auditory system: ecological approach

Mapping strategies

Pacific Belltower

PerMagnus Lindborg

shallow = more dangerous = high pitch pitch epicentre depth

Wednesday, October 18, 2017

slide-28
SLIDE 28

28

Wednesday, October 18, 2017

slide-29
SLIDE 29

border between aesthetic sonification and electroacoustic music is blurred: “the difference… is largely one of perspective.” (Vickers & Hogg 2006) strong principles for aesthetic sonification can be found in experiences of natural, non-designed environments listeners “might be able to recognise structural elements in music that represent the conventions or rules of the cultural field… [the] meanings of semantic listening [are] affordances of cultural behaviour” (Tuuri & Eerola 2012). 29 sonification should embrace soundscape research (Gresham-Lancaster & Sinclair 2005)

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-30
SLIDE 30

30

Yale-NUS, 2016

Aalto University

Volume 2 Symposium, 2016 Nov.

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-31
SLIDE 31

31

Tests with parametric speakers - Acouspade ADM/NTU, 2017

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-32
SLIDE 32

Thanks for setup help!

32

Deoshor & Kimmie

Pacific Belltower

PerMagnus Lindborg

Wednesday, October 18, 2017

slide-33
SLIDE 33

Thanks for listening!

permagnus@ntu.edu.sg

www.permagnus.org

33

… questions?

PerMagnus Lindborg, PhD

International Computer Music Conference ICMC–EMW, Shanghai, 18 October 2017

Pacific Belltower

sound installation for live sonification

  • f earthquake Internet data

Wednesday, October 18, 2017