Ahmed Farooq Introductions Haptics, an Emerging Science Research - - PowerPoint PPT Presentation

Ahmed Farooq

Introductions Haptics, an Emerging Science Research In Public Kiosks Commercial Product Some Other Kiosks Summary

Most public machines like ATMs and Kiosks are designed to

accommodate the maximum usability features for the largest user groups, but unfortunately the disabled and Senior Citizens are often minimized due to lesser use & lower numbers. The completed and unnatural designs not only cause usability concerns but in some cases, accessibility is also compromised. Blind and disabled users may have serious accessibility issues which may hinder or restrict use of such public machines.

Haptics resolves such issues and provides a bridging effect for

disabled and blind users. It adds another somatosensory channel for Human Computer Interaction (HCI) that can prove to be critical. In this presentation I would try to highlight some of the research that is being carried out to facilitate these user groups and to enhance the usability for existing users of Public Computing Machines.

The study of Haptics has grown dramatically with the advent of touch in

computing, as many researchers are involved in the development, testing, and refinement of tactile and force feedback devices (simulating object hardness, weight, and inertia), along with supporting software, that allow users to sense and manipulate three-dimensional virtual objects and more and more such Interfaces are being designed for common Public Computing Machines. Video

Nokia, Samsung LG, Blackberry and Apple are all moving closer to

developing truly localized Haptic computing devices which will enhance a more realistic experience for mobile users and provide an impetus to other Haptic Interface developer [24]. Immersion besides closely working with Samsung and LG [2] is now also working on Public Computing Machines to create a more haptic culture that didn’t exist a few years ago.

Even small cellular phones today are

gaining new functions. To address the interface needs of these systems, designers have increased their reliance on touchscreen technologies. These technologies allow the designer to break up the functions of the phone into discrete subsections which can be presented hierarchically

• n simple screens.

This type of display, however,

presents particular access problems for people with visual impairments, blindness, or literacy problems or is disabled, in some way or form.

The magnitude and significance of this problem is growing rapidly, as such

systems are being increasingly used in automated transaction machines, government service kiosks, personal electronic telecommunication devices, and even home appliances.

Such systems now a days appear on car phones, pocket cellular phones,

personal digital assistants ATMS, Public Kiosks and other devices which may be used by people with disabilities or within such environments which restrict vision, and hence restrict accessibility.

Created by Researchers Karon E. MacLean at “Interval Research

Corporation”. Haptic Interfaces today have primarily been optimized and converted from regular Interfaces [3]

The design allows an arbitrary relation between user and environment,

whether direct or abstract, whereas prior emphasis has dwelt on creating just the outer hardware layer, where as this model shows that there is much to be done by creatively disposing the interaction model into abstract forms[4] .

Direct Manipulation Discrete and

Continuous Control

Mediating Dynamic

System

Annotations Container Manipulation Displaying Interaction

Potential

Embedding Haptic

Interfaces

Container Manipulation

The company is working on contracts with Nokia, Samsung, LG,

Medtronic, VW, BMW, Microsoft, Sony & 3M’s touch screen division. The convergence of MP3 and Digital Video players, Digital Cameras, Navigation Devices, Televisions and Mobile Internet with Instant Messaging, Text Messaging and Cellular Telephones fuels the need for increased screen geography. The pull of increased screen geography for these pocket sized mobility devices drives the need for Haptics[2].

3M touch screen division (applications includes casino gaming, ATM’s,

Kiosks and waiter and waitress stations). The company is working with the leading ATMs Giant NCR on a project to come out in 2010 [2]. The company has already received acclaims from Casino Journal for adding Haptics to improve the user video experience.

Currently the group has developed an

information Kiosk icon of the museums in Tampere, Finland [5]. The kiosk includes an interactive agent that helps and entertains users. The behavior of the agent can be altered using the computer vision component designed for it

Haptic input through touchscreens has been used with kiosks for a long

• time. However, haptic feedback has been limited just to the pressure

produced against the finger when it is pressed on screen. Here, the researchers have had two approaches to improve haptic feedback.

• 1. Placing a transparent foil on top of the screen containing thin metal guides

to help the user to follow the navigation interface with their fingers

• 2. Using vibration through a vibrating pen that is used to inspect contents of

the display (as shown in earlier seminar sessions.) Similar techniques have been employed in smaller screens to good effect especially in Mobile Devices[6]

TAUCHI was also involved in designing and testing multimodal gaming

and learning environments for visually impaired and blind children. This research started in 2001 funded by Nordic Development Centre for Rehabilitation Technology (NUH) [6].

The Group designed and implemented multimodal games for visually

impaired and blind children primarily for children aged 3.5 to 7.5 an later 6 to 10 years or age.

A research group in the US is conducting research on selection

apparatus schemes, providing user friendly interface for visually impaired people [7]

The touch points are designed such that a different sensations are

felt when a user slides the finger along the selection structure.

An exit is designed to help lead the object from each touch point to

corresponding touch button using the T-Bar.

Thus, a visually impaired person may slide a finger along the guide

structure, feel a touch points and use the associated exit to locate a corresponding touch button.

Commercial Products

This technique uses hybrid

haptic and auditory techniques to allow individuals non visual access to touchscreen systems, even if they have a wide variety of forms and formats[8]

Verbal names Screen description Empty space sound Auditory ridge around objects Verbal announcement Edge hysteresis Text Fields

Separate activation button Last current choice Hot lists Speedlists Incorporation of hot lists in

the speedlist

Hierarchical access

Another alternative EZ access technique “Talking Touch and Confirm”, a

user explores the screen with his/her fingertip. Touching items on a screen generates haptic feedback and causes the corresponding option to be read

• ut [9].

Acoustic cues are given to guide the individual in exploring the screen. To

actually activate the item, the user merely needs to press a pre-specified button.

This system also offer a list form of selection menus which make the

process simpler

But there are multiple problems with audio feedback in public kiosks !

Video

The haptic software application is developed in a combination VRML-

based scene and the Python scripting language. Using the VRML nodes, the developers have created the virtual environment, the Python scripting language provides the procedural method to handle programmed events[10].

The grid is placed on an elastic membrane providing force feedback

resistance and friction when the pen’s end-effecter of the Phantom Desktop makes contact with the virtual grid object [10,11].

(1;6;0); (2;6;0);

(3;6;0); (4;6;0); (4;5;0); (4;4;0); (5;4;1); (6;4;1); (7;4;1); (7;5;0); (7;6;0); (7;7;0); (7;8;0); (¡1;¡1;¡1); (6;6;0); (6;7;1); (6;8;1); (¡1;¡1;¡1):

The kiosk, which uses video and multilingual

audio prompts and vibrations, is a new systems designed to make the ballot accessible to most people with disabilities[18].

kiosk would serve the visually and audibly

disabled, and those lacking fine motor

• control. Using yellow "up" and "down"

triangle buttons (which vibrate when enabled), voters scan an on-screen and audible ballot. When the preferred candidate's name is highlighted or spoken, users cast their vote by pressing a large, diamond-shaped, green button [17]

In August this year the Australian Government in

corporation with the Australian Electoral Commission (AEC) started trials on a project for electronic voting for the vision impaired and military personnel [19].

The system is similar to the web interface for

kiosks for the Beijing Olympics earlier this year. The system is a combination electronic server display unite along with a haptic key pad that produces vibrations on active key selections.

A privately funded company

FormaLogix has developed a solution to one of the footwear industry’s oldest problems – the problem of fit. The VFit kiosk uses digital imagers to capture a 3 dimensional image of the user’s feet and compares that to an exact 3D form of the inside of a specific shoe [21]. FormaLogix VFit technology is able to determine exactly what size a person wears in a particular shoe style and brand without the person ever trying on the shoe

AXSionics has designed an ID card that is equipped

with a fingerprint scanner and six optical sensors. Initially, the user identifies himself or herself using the

• fingerprint. The bank’s website then sends a flicker

code, which the sensors of the ID card register and

• decrypt. In the process, the monitor displays six rapidly

flashing fields that alternate between black and white[12].

The flicker code contains the details of the funds

transfer previously submitted to the bank and the associated transaction number (TAN). Using an integrated cryptographic key, the ID card decrypts the code and displays the deciphered information on its small screen. The user checks to make sure the transaction data is complete and finally confirms the transfer by entering the TAN currently displayed

Japanese, commuters use their mobile phones to pay for

their bus rides. They also use the phone to get cash from an ATM, make credit-card purchases or for basic personal identification[13,14]

A Fujitsu phone, the F900iC uses NFC smart-card

technology called FeliCa developed by Sony, as well as a fingerprint reader that authenticates the user and unlocks the handset “Fingerprint recognition, using haptic technology, seen as key enabler for the advance of m-commerce” Immersion Corporation and Atrua Technologies are working with handset manufacturers to put their fingerprint technology into cell phones. Immersion has announced a relationship with Samsung, which hasn't revealed its haptics plans yet, while Atrua has started shipping its products to Japanese electronics manufacturer [2,13,14,15].

• The Vectra Concept Terminal is an

award-winning conceptual ATM machine that was the first in the world [22]. to use haptic technology is similar to the I-drive in BMW [25]

• The technology provides
• Single point-of-entry for data, and
• Higher level of security.

The Vectra has been employed by many companies to facilitate the disabled users [22], the company’s design team members are currently working on the second model which will feature strategic audio responses on finger presses “similar to talking Finger Print”

• EMIS and PAERS have jointed introduced a

Health Information Portal for patients (HIP).

• Provides a safe and controlled environment

for patients to view their medical records,

• Unique fingerprint authentication offers a

secure, reliable and accurate method for patient identification.

• Research by the groups has shown that

patients feel having access to their medical records improves trust, understanding of their illness and the doctor-patient relationship [23].

• HIP kiosks are also available with an

integrated printer to allow patients to print and take away information.

• A polarized screen ensures privacy, as only

the patient sat directly in front of the kiosk can view the information shown on-screen.

Another company working on

ATMs for the disabled have designed a Kiosk known as the Envoy Secure Access [20]. The company claim to have resolved the issues confronted by disabled users by adding audio and haptic feedback

• The Kiosk is especially designed to accomodate users with

wheelchairs and walking sticks.

• The Kiosk has a hand reciever to provide audio feedback as

well as tactile touch screens to facilitate selection.

Other Kiosks

Interactive Marketing By Immersion Infiniti Interactive Kiosk

Some of the research and devices highlighted in this paper prove

researchers’ claim of Haptics, being the new evolutionary step in mass

• computing. Perhaps the most effective way of introducing haptic devices is

through Public Computing Machines which can act are an ease through barrier for the technology to be accepted in the masses, especially the disabled.

As more and more devices and interfaces make it into production there

might even come a day when disabilities of any kind may not play any role in computing abilities of an individual.

[1] Immersion ] Immersion Solution Solutions, s, accessed Dec 2 accessed Dec 2008 http://www.immersion.com/industrial/docs/TouchSense_Solutions_may08v2.pdf [2] ] Immersi Immersion Corporation The Haptics, Vi n Corporation The Haptics, VibeTonz Tonz and and Touc TouchSe hSense co company any July 16, 2 2008, 08, a access ssed D Dec 200 2008 http://www.equitygroups.com/nasd/immr/messages/139353.html [3] ] De Designin signing with with Haptic Feedback by Ka Haptic Feedback by Karon ron E. M . MacLean cLean Interv Interval R al Research Corporation search Corporation http://www.cs.ubc.ca/~maclean/publics/icra00-DesignWithHaptic-reprint.PDF http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=844146 [4] ] Aladdin Aladdin: : Exploring ploring L Lang nguage age wit with a a Ha Haptic D ptic Door Kn

• or Knob by K
• b by Karo

aron E. M . MacLe acLean http://www.cs.ubc.ca/~maclean/publics/IntTR-Aladdin.PDF [5] ] Hap Haptics ics Re Rese search arch in in TAUC UCHI: Aiding HI: Aiding Visually Impaired C Visually Impaired Children ildren and d En Enabling abling Hap Haptic Inter ic Interaction action by R by Roope

• ope

Ra Raisa isamo at at Ta Tampere Uni Unit f for Co Comput uter-Human I

• Human Intera

ract ction (TA n (TAUCH CHI) Depa partment nt of Computer S

• f Computer Sciences

iences http://www.dcs.gla.ac.uk/haptic/haptics%20web%20pages_files/Raisamo.pdf [6] U ] User frie er friendly selection ndly selection app appar aratu atus b s base sed on d on touch touch screens for screens for Visu Visuall lly Im y Impaire paired. . www.freepatentsonline.com/7187394.html, accessed Dec 2008 [7] ] E- E-governm governmen ent for for th the disab e disabled led: service thr service through te text- xt-to-

• -speech

speech and and speech speech recogniti recognition n tec technologies, gies, acce accessed ssed De Dec 200 2008 http://www.editlib.org/index.cfm?fuseaction=Reader.NoAccess&paper_id=26721&CFID=8808016&CFTOKEN=3910 8558 [8] [8] Us Use of au audio-ha

• haptic interface tech

chniques to allow nonv nonvisua ual access ss to to touchs hscreen ap applia iances es Gr Gregg egg C C. . Vander nderheid heiden at Tr at Trace R&D ace R&D Ce Center, nter, Univer University of sity of Wisconsin Wisconsin-M

• Madison

dison http://trace.wisc.edu/docs/touchscreen/chi_conf.htm

[9] Cro Cross s Pr Product

• duct, Cros

Cross Dis Disability In ability Interface terface E Exte tension ions: : EZ Acce EZ Access”, ss”, by Gregg by Gregg C.

• C. V

Vander nderheiden heiden et al al (here ereafter fter “V “Vander derheiden eiden III”) III”) http://trace.wisc.edu/kiosks/ez/resna_ez_access_paper.html [10] 0] Novel Novel Shoulder- Shoulder-Surf urfing R ng Resistan sistant t Haptic-based Haptic-based Gr Graphical P aphical Passw ssword

• rd by

by Be Behzad hzad Malek lek Mauricio ricio Orozco Orozco Abdulmotaleb Abdulmotaleb El S El Sadd ddik Mult ltimed imedia ia Commu Communication nications s Rese Research arch L Laboratory U tory Univer ersity of Ottawa, ON, sity of Ottawa, ON, C Canada da http://www.mcrlab.uottawa.ca/confs/2006/EH2006Final.pdf [11] 1] Hapti Haptic-Based Se ased Sensib ible le Gr Graphic aphical Password by l Password by M Mauricio Orozco1 uricio Orozco1, , Be Behzad hzad Male lek2, k2, Moh Mohamad Eid1, , and and Abdulmotaleb Abdulmotaleb El El Sadd ddik1 k1 Multime Multimedia C ia Communic mmunication tions Re s Rese search arch L Labor boratory tory (MC (MCRLAB) Sch AB) School of Information

• ol of Information

Tech echnology a nology and En d Engin gineering (SIT eering (SITE) Univer University of sity of Ottaw Ottawa, , ON, , Can anada http://www.discover.uottawa.ca/publications/files/VC2006Mauritz_V6.pdf [12] 2] Sieme Siemens s Hapti Haptic ID C ID Card rd http://w1.siemens.com/innovation/en/news_events/innovationnews/innovationnews_articles/2008/e_21_ino_0807_1 .htm [13 [13] Ha Hapt ptics Opens M- M-Co Commerce D Door B By Bra Brad Sm Smith h WirelessWeek - Se September 1 15, 2 2004 004 a access essed o

• n 10

10 N Nov v 200 2008, 8, accessed Dec 2 accessed Dec 2008 http://www.wirelessweek.com/haptics-opens-m-commerce-door.aspx?terms= [14] 4] Fu Fujitsu jitsu for FeliCa for FeliCa F900iC 3 00iC 3G FOM FOMA an an M M-Commerc

• Commerce

e tool for the tool for the Japanese Japanese Market, rket, accessed Dec 2 accessed Dec 2008 http://wirelesswatch.jp/2004/06/08/fujitsu-for-felica-f900ic-3g-foma/ [15] 5] ECM ECMA In Intern ternation ation Near Fei ear Feild Communication Ju mmunication June ne 2004 2004 http://www.ecma-international.org/activities/Communications/2004ga-067.pdf

[16] 6] En Enablin abling Disabled Shoppers: Disabled Shoppers: M Multi-chan lti-channel re el retailer tailers, s, mee meet you your multi- r multi-able abled shopp pper ers, s, who hav who have m money ney to to spend end B By Lynne Lynne Br Brow

• wn

n Jan 20 an 2008 08, a , access ssed De Dec 200 2008 http://www.internetretailer.com/article.asp?id=24897 [17 [17] Opti-Wall Kiosk Improv

• ves

es A Access ss fo for t the D Disabled: N News ws Releas ase from: R Ritta ttal Limited 0 05/09 /09/2008 2008 a accessed Ma May y 29, 29, 2 2008 008 http://www.engineeringspecifier.com/Industry-News/Opti-Wall-Kiosk-Improves-Access-for-the-Disabled.asp [18] 8] The The Q Quad ad Media ESS Ballot box Media ESS Ballot box http://quadmedia.com/ [19] 9] Electronic Electronic Votin ting in Au in Austr stralia for for Mi Military Per litary Person

• nnel and th

nel and the e Disabled Disabled Oct 20 t 2006, acce , accessed Dec 2 ssed Dec 2008. http://www.tomw.net.au/blog/2006/10/electronic-voting-in-australia-for.html [20 [20] ENVOY O Y Online K Kios

• sk

http://www.amaticakiosk.com/casestudies/health/nhs.asp [21] 1] VFIT, VFIT, accessed Dec 2 accessed Dec 2008 http://www.formalogix.com/formalogix/product/product.htm [22] 2] Diebold Diebold – Vectra, Vectra, accessed Dec 2 accessed Dec 2008 http://www.diebold.com/solutions/default.htm http://www.balanceinc.com/portfolio/diebold

[23] 3] He Health alth Inform Information ation Por Portal b al by EMIS EMIS http://www.emis-online.com/products/health-information-portal/ [24] 4] One La One Laptop ptop Per C Per Child ild Projec Project (O t (OLPC May 29, 2008), accessed C May 29, 2008), accessed Dec Dec 2008 2008 http://internetbestsecrets.com/2008/05/olpc-2-to-add-multitouch-and-haptic.html [25] 5] I-dr I-drive in ive in BMW BMW http://www.bmw.com/com/en/insights/technology/technology_guide/articles/idrive.html

Any Questions