The Markup Way to multimodal toolkits Stphane Sire Stphane Chatty - - PowerPoint PPT Presentation

▶
the markup way to multimodal toolkits
SMART_READER_LITE
LIVE PREVIEW

The Markup Way to multimodal toolkits Stphane Sire Stphane Chatty - - PowerPoint PPT Presentation

Mar 04, 2023 356 likes •503 views

The Markup Way to multimodal toolkits Stphane Sire Stphane Chatty IntuiLab http://www.intuilab.com W3C Workshop on Multimodal Interaction INRIA Sofia Antipolis, July 19-20, 2004 IntuiLab ? Foundation: Damien Figarol / Laurent

slide-1
SLIDE 1

The Markup Way to multimodal toolkits

Stéphane Sire Stéphane Chatty IntuiLab http://www.intuilab.com

W3C Workshop on Multimodal Interaction INRIA Sofia Antipolis, July 19-20, 2004

slide-2
SLIDE 2

IntuiLab ?

  • Foundation:
  • Damien Figarol / Laurent Karsenty / Stéphane Chatty
  • Intuitive User Interaction Style
slide-3
SLIDE 3

Portfolio

slide-4
SLIDE 4

Iterative Design Process

mockup prototype development and test specifications

Example: three stages of a strip for Air trafic Control

slide-5
SLIDE 5

Model driven approach

  • Markup benefits
  • team work support
  • specialized editors (WYSIWIG)
  • thin and fat client deployment

WYSIWIG editor PROGR. LANGUAGE

<?xml version="1.0" ?> <svg> <defs> ... use IntuiKit::Simple; new GUI::Rectangle ( -width=>50, -height=>100); new GUI::Gradient(-spec=> '=axial 0|blue |red'); ...

slide-6
SLIDE 6

IntuiKit Core Model

activated deactivated not rendered

slide-7
SLIDE 7

Component Tree

component component component component component component

slide-8
SLIDE 8

Component services

  • Properties
  • Customization
  • Code execution
  • event handlers vs. methods
  • Events
  • input vocabulary
  • output vocabulary
  • Behaviour
  • State information and control structures
slide-9
SLIDE 9

Well covered with W3C Markup

  • Properties
  • CSS
  • Graphics
  • SVG with transformations and animations
  • Bindings
  • XML Events
  • Speech Grammars
slide-10
SLIDE 10

Less covered with W3C Markup

  • Control structures
  • distributed flow of control
  • FSM and Switch
  • Core architecture
  • IntuiKit::Component and IntuiKit::Element
  • definition vs. instantiation
  • Gestures
  • Events
  • EMMA ?
slide-11
SLIDE 11

Sample control sructure

Switch

1 2 3

Component FSM step1 step2 step3

slide-12
SLIDE 12

Core architecture

Code Behind Markup Behind Markup Only Code Only XML

  • Progr. Language

XML Progr. Language component definition component instantiation

slide-13
SLIDE 13

Discussion

  • Do we need a component model ?
  • XUL/XBL
  • SVG RCC for Xforms rendering
  • XAML: code behind
  • Do we need more advanced control

structures ?

  • How to represent the distributed flow of

control ?