1 VTT TECHNICAL RESEARCH CENTRE OF FINLAND Applications Augmented - - PDF document

1

Project summary

Augmented Reality for Building and Construction (AR4BC)

Charles Woodward, VTT 9.2.2009

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Introduction

• Background
• Building Information Models (BIM) and 4D models are increasingly used for data

sharing and communication purposes in real estate and construction sector

• Augmented Reality (AR), and more generally Mixed Reality (MR), is enabling new

kind of interaction with virtual building models at real environments

• Finland is one of the leading countries in BIM adoption, and VTT leading research

institute in BIM / AR development for construction industry

• Objectives
• To provide mobile AR (MR) tools linking real situation at construction site to BIM

information, planning and follow-up

• Combining top-level technology and know how from VTT’s two knowledge centres

and partner companies into novel world class solutions and products

2

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Applications

• Augmented on-site visualisation (Augmented Reality)
• linking project plans with actual situation on site
• determine already installed and missing parts, those to be installed next
• display part information, tolerances, weight, other measures
• display ready building before and during construction
• also, indoors applications for sales presentation
• Augmented site journaling (Augmented Virtuality)
• feedback to system: sign (tag) installed parts in 4D model
• attach images to 4D model, with links to the parts they show
• construction log book, for communication between parties
• tool for building inspector during and after construction
• augmented 4D models, incl. virtual walk-though inside BIM model
• Augmented Reality + Augmented Virtuality = Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Technology

• Augmenting / tracking
• vision based tracking, matching with 4D model (orientation)
• combined with GPS and map information (position)
• Interactive, hybrid and other tracking methods as required
• Interaction with BIM models
• wireless 4D BIM model interaction methods, client / server solutions
• retrieval and feedback of model data, inclusion of image data
• Visualisation on mobile devices
• conversions from BIM to visualisation, e.g. OSG
• 3D graphics on mobile devices, e.g. visibility culling, LOD
• Hardware
• hand held / wearable PCs, miniature cameras
• optional data glasses (video or optical), accelerometer, compass
• wireless solutions, robustness, weight, power consumption, price
• with view on camera phones, client/server solutions

3

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Specs (1/3)

• Server software 4D Studio, ARServer
• formats IFC (VTT’s own parser), OSG (incl. VRML, 3DS, etc.)
• creation of scheduled 4D model (MS Project + 3D model)
• 4D visualization, e.g. timeline, clipping, transparency etc.
• interaction with colors, materials, textures, lighting etc.
• nD-properties: elements, wall, electricity, pipings, etc. (basic implementation)
• producing 4D/nD view from selected viewpoint, provided by mobile client
• transmitting selected model parts (according to time, distance) to mobile client
• attaching mobile feedback to 4D model: photos, reports, comments, …
• visualization of augmented 4D model by different means

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Specs (2/3)

• Mobile software / exteriors AROutSide, ARClient
• matching camera view to 4D model
• based on model / feature based tracking
• additionally GPS, compass, accelerometer, user interaction
• photorealistic visualization: lighting, masking
• downloading 4D model (view) from server for tracking purposes
• downloading 4D model (view) from server for visualization (incl., visibility culling, LOD)
• functionality: e.g.. Show model / nD features at time X, beteween X-Y, after Y
• measurements, discrepancy checking btw real and virtual model
• feedback to server, e.g. element installed / missing / fault, photo / comment
• possible safety-, training- and life cycle applications as side result
• efficiency considerations: e.g. still-image principle vs. real time video
• hand held PC (-> camera phone & data glasses)
• WLAN & 3G data transmission

4

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Specs (3/3)

• Mobile software / interiors ARInSide
• simplified version of AROutSide
• markerless tracking based on 3D model of room
• viewing and instaling elements based on 3D model
• visualizing elements e.g. behind walls, ceilings etc.
• interaction properties: selecting and moving parts, etc.
• other properties: storing video and still images
• equipment: hand held PC (& data glasses)
• also, miniature projectors -> X-ray vision
• WLAN data transmission (if required)

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Other tasks

• Specifications
• software architecture, data formats, tasks, time tables
• Demonstrations ja user tests
• Skanska new Helsinki head offices / ready building
• Skanska new Helsinki head offices / during construction
• Finnish pavillion at Sanghai World Expo 2010
• other demonstrations, TBD
• comparisons, equipment, display devices, user interfaces
• demonstrations with commercial applications (Tekla, Buildercom)
• Other
• patent research
• hardware research, new equipmen, data glasses etc.
• Interational co-operation
• scientific publications
• disemination

5

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Partners

• VTT Digital Information Systems
• Charles Woodward (project manager), Mika Hakkarainen, Petri Honkamaa,

Otto Korkalo, Sanni Siltanen, Kari Rainio, Tatu Harviainen, Miikka Aittala

• VTT Materials and Building
• Kalle Kähkönen, Janne Porkka
• Companies
• vertical representation of Finnish B&C sector, software, users
• Tekla, Skanska, Pöyry, Buildercom, DeskArtes, Adactive
• Tekes
• Finnish Funding Agency for Technology and Innovation
• International co-operation
• project co-operation, joint workshops, researcher exchange
• Labein Tecnalia (Spain), TU Munchen (Germany), Fraunhofer IGD & ZGDV

(Germany)

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Contact

• Prof. Charles Woodward

charles.woodward@vtt.fi

• tel. +358-20 722 5629

Videos and Demos availabe at:

http://www.vtt.fi/multimedia