SEMpIA From Mplayer Ubiquitous Games towards distributed systems for - PowerPoint PPT Presentation

SEMpIA From Mplayer Ubiquitous Games towards distributed systems for U-cities Professor E. Gressier-Soudan CNAM, Paris, France CEDRIC Lab, Team SEMpIA

Who Am I ? (Research) SEMpIA � Head of Embedded and Mobile Systems for Ambiant Intelligence ( SEMpIA ) research team at CEDRIC since 2008 � Ubiquitous architectures for ubiquitous Mgames, � Involved in Interactive Applications related to Musée des Arts et Métiers (MAM) Paris � Head of the PLUG (PLay Ubiquitous Games and play more) project, founded by the French National Research Agency ended march 2010 - 410K€/3labs/3companies 20/07/2010 2

Research profile of the team SEMpIA � Project driven research (found rising required) � Application awareness � Partnership based research 20/07/2010 3

Roadmap of the presentation SEMpIA � Mixed Reality Games Projects, � Towards U-cities � Conclusion 20/07/2010 4

SEMpIA SoundPark: Towards Highly Collaborative Game Support in a Ubiquitous Computing Architecture R. Pellerin 1 , N. Bouillot 2 , T. Pietkiewicz 1 , M. Wozniewski 2 , Z. Settel 3 , E. Gressier-Soudan 1 , J. R. Cooperstock 2 1 CNAM-CEDRIC-SEMpIA, 2 McGILL-CIM-SRH, 3 University of Montréal DAIS'2009, June 2009, Lisbon, Portugal

SoundPark: a mixed reality ubiquitous game, audio based SEMpIA � The goal : � A team collects sounds spread in the Jane Mance park in Montreal � The winner is the first team who gathers the complete assembling � Have fun (researchers had fun !) � Two types of players : � Scouts are clue discoverers, Clues provide hints to get piece of sounds � Hunters are sound catchers, guided by scout’ indications, they bring sounds back to their home base � They play in a real world and evolve in a 3D audio virtual world � Public is able to watch the game session as a 3D world on a PC 20/07/2010 6

Players’ devices SEMpIA Audio 3D from virtual world (music from instruments) hints more hints the panini the panini WIFI BlueTooth HUNTER SCOUT (blind in the virtual world) 20/07/2010 7

Scout Mobile phone reads RFID clues SEMpIA Nokia 6131NFC BlueTooth 20/07/2010 8

Video available from : http://www.audioscape.org/srewiki/bin/view/Audioscape/SoundPark SEMpIA 20/07/2010 9

Soft/Hard Architecture SEMpIA Game logic Sound Processing Inherit from OMA-Gaming Services specification Same architecture used in the PLUG project 20/07/2010 10

uGASP Server : Service/Component Architecture oriented SEMpIA � uGASP server is SCA compliant : OSGi based, that means it is implemented as a set of components � OSGi bundles can be dynamically loaded using Injected Plain Old Java Object brings 20/07/2010 11

uGASP components SEMpIA 20/07/2010 12

SoundPark project Conclusion SEMpIA � SoundPark has been issued in three months � Resources : 10,5 man.month full time � SoundPark is a proof of concept of : � what an ubiquitous computing architecture can be right now using off-the-shelf components � what a mixed reality ubiquitous game can be today � Challenge : be a real game with hundreds of players 20/07/2010 13

SEMpIA PLUG PLay Ubiquitous Games and play more (A government founded project by Agence Nationale de la Recherche)

Musée des Arts et Métiers: History and Thematic Collections SEMpIA Construction Scientific instrumentation Mechanics Communication Energy Transport 20/07/2010 15

The Musée des Arts et Métiers � Mission: SEMpIA � teach the history of science and innovations (edu team) � promote science as a whole � create a community of people around a scientific heritage � Patrimony: � Historical artifacts that visitors can’t manipulate 20/07/2010 16

Goals of PLUG SEMpIA � To experiment ubiquitous games and their architecture � To define new ways to interact with museums and their content � To study acceptance of ubiquitous games and associated technology 27 months, R&D project, started January 2008 20/07/2010 17

PLUG the Secret of the Museum "RFID technology: fostering human interactions" SEMpIA IADIS’2009 , June 2009, Carvoeiro, Portugal Annie Gentes, Camille Jutant, Aude Guyot, Michel Simatic

Pervasive Computing applied to MAM SEMpIA Content Technology Museum RFID (IoT, WSN) Application Game design Users Visitors / Players/Citizens 20/07/2010 19

PLUG: Reconsidering RFID SEMpIA Challenge � To augment reality: add contents, create new links between places, people, artifacts � To foster new forms of interactions between people To invent a new technical architecture 20/07/2010 20

Goals of the Game SEMpIA Research contribution (experimented summer 2007 by SEMpIA) 20/07/2010 21

SEMpIA Some kind of geo-localized information system 20/07/2010 22

A fully ubiquitous Architecture… SEMpIA RFID powering & read/write 2.5G/3G+ mobile communications + Internet Nokia 6131NFC 20/07/2010 23

Conclusion Ubiquitous passive RFID based architecture SEMpIA + NFC enabled devices + game strategy + specific context Revealing and fostering social interactions and visitors enjoyed… 20/07/2010 24

PLUG the Paris Overnight University SEMpIA � Main Features : � More teaching related to history of sciences and technologies (a weakness of the first game… find the right tradeoff/balance with game) � Content centric � Quest or Tresor Hunt oriented � Non player characters to enhance immersion and provide atmosphere (players are under cover agents)… Flow oriented approach vs magic circle approach � Gameplay is enriched with Affective Computing features � Players are monitored (how they follow the game design rules and how they can be helped) � i-Phone based and RFID based � uGASP middleware based 20/07/2010 25

Immersion & non-player characters Big Z, exam SEMpIA Prof Augustine Meulard, Students Advisor Inspector/Guide Players/Infiltration Becoming a real student of the secret Université Paris Nuit degree 20/07/2010 26

iPhone and RFID based SEMpIA Object Room TAGS TAGS 20/07/2010 27

Affective Computing SEMpIA � Players' heart rate � RF communications : ZigBee based 140 120 100 80 Joueur 1 � Monitoring Joueur 2 60 40 � DB and a monitoring Laptop 20 0 � Emotional states Fréquence cardiaque Déplacement 20/07/2010 28

Game states Approach : SEMpIA Define steady state values and thresholds – A priori Game states consider : – Monitor and ajust values Socialization – Change Gameplay if needed, Race condition – Change Game Design if required Progression – Physical and Emotional state – Graphic of how the player progress and value analysis 20/07/2010 29

Tracability of players' behavior SEMpIA … sorry it is in french ! 20/07/2010 30

Game master Interface SEMpIA 20/07/2010 31

Network Management (Nagios based) SEMpIA 20/07/2010 32

And U-cities ? SEMpIA � Lets present some more projects ! � FireMen rescue inside buildings (SURPAT) � Electric Car Recharging � Cloud Computing for MMO (PLAYONLINE) 20/07/2010 33

SURPAT : Background - Application Context SEMpIA � Disasters show a great potential of destruction Fire in the lunneville Castle � Lost of Lifes and Goods… potential Lost of Rescuers

SURPAT : Background –Urgency Plan SEMpIA An urgency plan is given to the firefighters

Keys of our solution SEMpIA � WSN : � 6lowpan over 802.15.4 � Fault tolerant and adaptative routing � Safe implementation � Reliable & Trustable network � Distributed Memory vs REST/SOA application layer � Localization/Identification of rescuers and goods : active RFID based solution � Pervasive Information System � All are building blocks of Ubiquitous Computing that can be reused for U-cities 20/07/2010 36

From buildings to towns SEMpIA � Buildings are reduced town � Same problems but you have to scale : � from thousands of sensors to millions of sensors � From thousands of people to millions of people � More complex interactions � Social Aspects have to be taken into account 20/07/2010 37

Cities from past to future SEMpIA Las Vegas today New Songdo City South Korea Shanghai today Luc Shuiten (proj 2100) Metropolis Fritzlang 1927 REN Towers Films Brazil, Blade Runner… 20/07/2010 38

Future life will lead to… U-Cities SEMpIA Mobility � Smart user, smart car, smart house, smart office, smart city… 20/07/2010 39

CS Research for U_cities Virtual SEMpIA pervasive Cloud Computing IS/DB Middleware(REST/SOA) Mobile ATAWAD Internet Networks Mixed Reality iPh WN iPh SN Real AnyTime AnyWhere AnyDevice I3D/IIHM 20/07/2010 40

The Age of The Pussyfoot by Frederik Pohl, 1965 SEMpIA � Science Fiction Inventions and Ideas : http://www.technovelgy.com/ct/Auth orSpecAlphaList.asp?BkNum=287 � Have a close look to the "Joymaker", the ultimate smartphone 20/07/2010 41

…Groupe Archigram : Computer City SEMpIA Denis Crompton 1964 Social Interaction and digital ubiquity "Speculative proposal for a computer system detecting and facilitating patterns of activity amongst a ‘city’ area of 100,000 people " 20/07/2010 42