Gerard J. Kim Korea University The Needs (1) Augmented/Mixed - - PowerPoint PPT Presentation

▶
gerard j kim korea university the needs 1 augmented mixed
SMART_READER_LITE
LIVE PREVIEW

Gerard J. Kim Korea University The Needs (1) Augmented/Mixed - - PowerPoint PPT Presentation

May 25, 2023 224 likes •372 views

AR/MR Standardization Activities at ISO JTC 1 SC24 4th meeting of International AR Standards Community Basel, Switzerland October 24-25 2011 Gerard J. Kim Korea University The Needs (1) Augmented/Mixed reality is becoming widespread

slide-1
SLIDE 1

AR/MR Standardization Activities at ISO JTC 1 SC24

4th meeting of International AR Standards Community Basel, Switzerland October 24-25 2011 Gerard J. Kim Korea University

slide-2
SLIDE 2

The Needs (1)

Augmented/Mixed reality is becoming widespread Mobile devices and ubiquitous computing, sensors and displays Commercialization has started Many active vendors, but no sharable content standards Evolving technologies Different underlying architectures Different views (abstraction levels)

10/23/11

2

slide-3
SLIDE 3

10/23/11

3 3

Seka kai C Camera ra Wiki kitude La Laya yar Scan S Searc rch

slide-4
SLIDE 4

The Needs (2)

Common baseline reference architecture Consolidation and integration of existing or evolving content standard Geography and Points of Interests (OGC/Web3C) Virtual world (Web3D) Documents (HTML) Mash ups / Cloud (Script / HTTP / OCCI) Content Resources (MPEG) … Brand new constructs Vision-based AR/MR Location sensor-based AR/MR New displays (HMD, HUD, Portable projector, …) New content types (haptics, audio, tactile, …)

10/23/11

4

slide-5
SLIDE 5

About ISO JTC 1 SC24

Computer graphics, Image processing, Environmental Data Specializes in the standardization of interfaces for information technology-based applications relating to Computer graphics Image processing Virtual/augmented reality/mixed reality Environmental data representation Interaction with and visual presentation of information Working groups – for focusing on specific topics WG6 – Multimedia Presentation and Interchange (X3D, …) WG7 – Image Processing and Interchange WG8 – Environmental Data Representation (SEDRIS, …) WG9 - Augmented Reality Continuum Concepts and Reference Model

10/23/11

5

slide-6
SLIDE 6

Augmented Reality Continuum?

Medium which combines physical reality and virtual (it’s a Continuum) The boundaries from physical to virtual world are not precise à to support an entire continuum of realities, define the term Augmented Reality Continuum (ARC)

10/23/11

6

[Paul Milgram’s Reality-Virtuality Continuum (1994)]

Virtual Environment Real Environment Mixed Reality Augmented Reality Augmented Virtuality

HITLab KBS

slide-7
SLIDE 7

The Fit

AR/MR contents are implemented as “Virtual” contents Video background imported into the virtual space Virtual world representation is the very scope of SC24 X3D is an ISO standards for representing virtual space from SC24

10/23/11

7

Virtual cam f ’ = f fov ’ = fov T = T ’

slide-8
SLIDE 8

The Prep

AR/MR Study group has carried out a preliminary study since 2009

Comprehensive survey and analysis of the state of the art in the field Already have a rough architecture and content model to start with

Has closely worked with the relevant SDO’s and researchers Web3D, OGC, Web3C, Khronos Group, IEEE / ACM, … Has participated in grass root efforts among the industry leaders International AR Standards Community (led by Christine Perey) Wikitude, Layar, Nvidia, Fraunhofer/InstantReality, … Balanced look into the Academic approach into the problem Practical needs of the industry

10/23/11

8

slide-9
SLIDE 9

Study Group Findings

Need for making clear and precise terms Need for and a rough AR/MR reference architecture Reuse of existing standards and need for extension Rough but comprehensive content model

10/23/11

9

slide-10
SLIDE 10

10/23/11

10

An example reference architecture

slide-11
SLIDE 11

10/23/11

11

<!doctype html> <html> <head> <meta charset="UTF-8"> <title>예제 문서</title> </head> <body> <p>예제 단락</p> … </body> </html>

Augmentation: :

  • 2D/3D Constructs

(HTML5 + X3D)

  • Abstract behavior

Phys ysical W Worl rld: :

  • POI definitions

(OGC)

  • Sensored objects

(K-Mart) Binding o

  • f
  • Augmentation a

and Phys ysical wo worl rld (KML/GIST/K-Mart) Complicated behavior only y using XD XDOM and We WebGL Access cloud servce (JS JSON)

<script type="text/javascript"> function person(lastname,age,eyecolor) { this.firstname=firstname; this.lastname=lastname; this.age=age; this.eyecolor=eyecolor; } myFather=new person("John","Doe",50,"blue"); document.write(myFather.age + " years old."); </script>

Behavi vior: r: Script

Preliminary File format structure

slide-12
SLIDE 12

Conclusion

The topic may be somewhat specific but highly important, enough to be treated separately We now have pretty good “concensus-ed” ideas/directions about:

What to represent Underlying system architecture Corresponding file format structure

To do (hopefully by SC24 WG 9)

Exact definition of terms and scopes Need to work on the right abstraction level and syntax Work with different standard bodies and industry Draft standards documents

A WG will be an ideal driving force and focal point

Swift, immediate and focused actions

10/23/11

12

slide-13
SLIDE 13

First WG9 Workshop

Nov 17, 2011 Seoul, Korea Since it is an ISO event, national representatives and liaison officers and special invitees can participate … CFP to national bodies have gone out (probably ^^) Will discuss and decide upon definite future directions and action items with time line… Your input is valuable and welcome If you are not a national representative, I can communicate your ideas indirectly on your behalf! gjkim@korea.ac.kr dxp.korea.ac.kr/SC24-WG9

10/23/11

13