May I guide you? Context-Aware Embodied Cooperative Systems in - - PowerPoint PPT Presentation

Cognitive Interaction Technology – Center of Excellence

www.techfak.uni-bielefeld.de/~frabe

!

KogWis 2010 Doctoral Symposium

Context-Aware Embodied Cooperative Systems in Virtual Environments

May I guide you?

Felix Rabe Ipke Wachsmuth

Cognitive Interaction Technology – Center of Excellence

www.techfak.uni-bielefeld.de/~frabe

!

• Virtual Human – Max
• has a Belief – Desire – Intention (BDI) cognitive architecture
• Virtual Environment – Virtual Tübingen
• large model, allows controlled experiments
• developed at Max Planck Institute for Biological Cybernetics

Introduction

Cognitive Interaction Technology – Center of Excellence

www.techfak.uni-bielefeld.de/~frabe

!

Interest in the improvement of behavior and assistance

• f virtual humanoid agents by adding awareness and

memory of goals and executed actions. How to detect, memorize, and remember events? How to compare episodes of events (remember similar)? How to use this information in interaction?

Research Motivation and Questions

Cognitive Interaction Technology – Center of Excellence

www.techfak.uni-bielefeld.de/~frabe

!

• CAVE-Setting: Max + Virtual Tübingen
• Extend the BDI cognitive architecture with

Event Memory

• based on Zwaan’s Event Indexing Model
• Events are the basic elements of Episodes
• Scenario: Explore Virtual Tübingen
• dialogue based information exchange
• Max recognizes actions, e.g., what is looked at
• if interest is shown, use for reference later on

Approach

Event Intentionality Space Protagonist Time Causality Event Intentionality Space Protagonist Time Causality Event Intentionality Space Protagonist Time Causality Event Intentionality Space Protagonist Time Causality Event Intentionality Space Protagonist Time Causality

Cognitive Interaction Technology – Center of Excellence

www.techfak.uni-bielefeld.de/~frabe

!

• Event Indexing Model (Zwaan, Langston, Graesser, 1995)
• Event Memory leads to Episodic Memory (Tulving, 1972)
• is a part of Autobiographic Memory, plays a role in Person Memory
• Memory for agents and virtual characters is still a hot topic
• Extending Cognitive Architecture with Episodic Memory

(Nuxoll, Laird 2007)

• Making Them Remember – Emotional Virtual Characters with Memory

(Kasap, Moussa, Chaudhuri, Magnenat-Thalmann, 2009)

• Comparing Forgetting Algorithms for Artificial Episodic Memory Systems

(Nuxoll, Tecuci, Ho, Wang, 2010)

Relevance and Significance

Cognitive Interaction Technology – Center of Excellence

www.techfak.uni-bielefeld.de/~frabe

!

Expected Results

• Functional Event Memory
• Better interaction, believable partner
• Better experience in Virtual Environments
• Better orientation, faster learning of Environment

Cognitive Interaction Technology – Center of Excellence

www.techfak.uni-bielefeld.de/~frabe

!

Zwaan, R. A., Langston, M. C., & Graesser, A. C. (1995). The construction of situation models in narrative comprehension: An event-indexing model. Psychological Science, 6(5), 292–297. Tulving, E. (1983). Elements of Episodic Memory. Number 2 in Oxford Psychology Series. Clarendon Press, Oxford. Baddeley, A., Conway, M. A., and Aggleton, J. P., (Eds.). (2002). Episodic Memory: New directions in

• research. Oxford University Press, Oxford.

Nuxoll, A. M. and Laird, J. E. (2007). Extending cognitive architecture with episodic memory. In R. C. Holte, & A. Howe, (Eds.), Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, (pp. 1560–1565), Menlo Park, CA: The AAAI Press. Tecuci, D. G., & Porter, B. W. (2007). A generic memory module for events. In D. C. Wilson, & G. C. J. Sutcliffe, (Eds.), Proceedings to the 20th Florida Artificial Intelligence Research Society Conference (FLAIRS-07), (pp. 152–157), Menlo Park, CA: The AAAI Press. Kasap, Z., Moussa, M. B., Chaudhuri, P., and Magnenat-Thalmann, N. (2009). Making them remember– emotional virtual characters with memory. IEEE Computer Graphics and Applications, 29(2):20–29. Nuxoll, A., Tecuci, D., Ho, W. C. and Wang, N. (2010) Comparing Forgetting Algorithms for Artificial Episodic Memory Systems, Remembering Who We Are - Human Memory for Artificial Agent, AISB 2010

References