Opportunistic Composition of Human- Opportunistic composition - - PowerPoint PPT Presentation

▶
opportunistic composition of human
SMART_READER_LITE
LIVE PREVIEW

Opportunistic Composition of Human- Opportunistic composition - - PowerPoint PPT Presentation

Mar 30, 2023 163 likes •380 views

Opportunistic Composition of Human- Opportunistic composition Computer Interactions in Ambient Spaces Ambient env. Our approach Plastic HCI Augustin Degas Requirements Ergonomic criteria Sylvie Trouilhet - Jean-Paul Arcangeli, IRIT

slide-1
SLIDE 1

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

1

Opportunistic Composition of Human- Computer Interactions in Ambient Spaces

Augustin Degas

Sylvie Trouilhet - Jean-Paul Arcangeli, IRIT Gaëlle Calvary - Joëlle Coutaz, LIG Stéphane Lavirotte - Jean-Yves Tigli, I3S

slide-2
SLIDE 2

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Fast changing software environment
  • Needs
  • Evolution of the context of use (platform, user,

environment)

  • Opening and dynamics of the context
  • A growing number of available devices in a connected

world

  • Smartphone, camera…

2

Ambient Environnement

project

slide-3
SLIDE 3

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Software bricks: a software component
  • Application: assembly of components

3

Component composition

Provided service Required service

slide-4
SLIDE 4

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Opportunistic component (re)composition
  • Use components available in the environment, that can

be assembled, in order to suggest to users appropriate applications

  • Take advantage of the circumstances to produce

applications:

  • Useful
  • According to the context
  • Continuously (recomposition with new opportunities)
  • Bottom-up software development
  • No pre-established plan

4

Our opportunistic approach

slide-5
SLIDE 5

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • 5 functional requirements
  • User request of a component
  • Context evolution
  • Appearance of a component
  • Disappearance of a component
  • Update
  • 7 extra-functional requirements
  • Decentralization
  • Dynamic adaptation
  • Combinatorial optimization
  • Recomposition
  • Learning and context awareness
  • Utility of the result
  • Non dependent of user needs

5

When and how compose?

slide-6
SLIDE 6

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Design time – help the developer
  • Maximize the reuse for each new target
  • Reduce the development cost
  • Take into account the use
  • Execution – help the end-user
  • Distribute an application or a task on multiple devices or

another device

  • Keep ease of use and habit, ensuring also to adapt to the

specificities of the devices → Common preoccupations Software Development - HCI: Mobility Adaptation to users

  • Specificity:

User role

Plastic HCI

6

slide-7
SLIDE 7

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

An exemple of adaptation of HCI

7

slide-8
SLIDE 8

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Ergonomics of the resulting application
  • Application that respects ergonomic criteria
  • Continuous adaptation
  • Controllability of the composition
  • Control by the user of his interactive ambient

environment

  • Non-intrusivity of the composition
  • User assistance
  • Non-expert users
  • Time saving
  • Response time

5 requirements of the field

8

slide-9
SLIDE 9

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Taking into account the “Significance of the

denominations and behaviours”

Ergonomic criteria

9

slide-10
SLIDE 10

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Second possible composition

Ergonomic criteria

10

slide-11
SLIDE 11

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Third possible composition

Ergonomic criteria

11

slide-12
SLIDE 12

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Fourth possible composition
  • Four functionally equivalent solutions
  • Two solutions that satisfy the ergonomic requirement

Ergonomic criteria

12

slide-13
SLIDE 13

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Two types of components available:
  • Functional components
  • User Interface components
  • A same composition process:
  • Try to compose what is

– Available – Connectable – Might be useful

Control of the emergence of assembly

13

slide-14
SLIDE 14

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Selection of services: opportunism for the control of the

consistency

  • Connector factory
  • Semantic binding
  • Assembly emergence: opportunism for the exploration of

the utility

  • Adaptive Multi-Agent System
  • Learning of previous connections
  • Controllability
  • Meta-HCI for the control of the composition by the user

A three component model

14

slide-15
SLIDE 15

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Set of functions that are necessary and sufficient to

controle and evaluate the state of the interactive ambient space [Coutaz, 06] [Coutaz et al., 16]

  • Used differently:
  • Catalogue of estimated relevant composition
  • Validation of the composition of HCI

Meta-HCI

15

slide-16
SLIDE 16

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Agent
  • Autonomous software entity
  • Evolves in a software environment
  • Has its own goal
  • Life Cycle: Perception, Decision, Action
  • SMA
  • AMAS

The multi-agent system

16

[Boes, 14]

slide-17
SLIDE 17

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • An AMAS as composition engine
  • Composition based on the cooperation of agents
  • Agentification of component services

Service agent

17

composant 1 composant 2 composant 3 composant 2 composant 2

slide-18
SLIDE 18

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Local goal: connect at best
  • Life cycle
  • Perception
  • Messages of other agent services that want to be

connected

  • State of the neighbours
  • Its state
  • Decision
  • Announce, Response, Connection, Disconnection, Do

nothing

  • Action

Service agent

18

slide-19
SLIDE 19

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • Agentification of the knowledge
  • Learn the good composition, in terms of context and

ergonomics

  • Thanks to the validation of the user in the meta-HCI

Context agent

19

[Boes, 14]

slide-20
SLIDE 20

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • An AMAS in Java
  • A class by agent
  • That handle the connections of software components
  • WComp
  • UPnP
  • Integrated in the execution environment Wcomp
  • To be experimented and evaluated

Prototype

20

slide-21
SLIDE 21

Opportunistic composition

Ambient env. Our approach

Plastic HCI

Requirements Ergonomic criteria

Control of the emergence of assembly Multi-agent System

Service agent Context agent

Conclusion

  • A novel approach for adaptive software engineering
  • Component-based
  • Bottom-up
  • Context-sensitive
  • Emergence and plasticity of applications and user

interfaces

Conclusion

21