Evalutation of E- -newspaper newspaper Evalutation of E - - PowerPoint PPT Presentation

Evalutation of E Evalutation of E-

• newspaper

newspaper prototypes prototypes

E E-

• newspaper prototypes:

newspaper prototypes: User evaluations and tests User evaluations and tests

• Evaluations of 3 E

Evaluations of 3 E-

• newspaper prototypes

newspaper prototypes from Aftonbladet, Göteborgs Posten and from Aftonbladet, Göteborgs Posten and Sundsvalls Tidning tested on 36 users Sundsvalls Tidning tested on 36 users

• The test was done on users from Halmstad,

The test was done on users from Halmstad, Sundsvall and Gothenburg Sundsvall and Gothenburg

• The duration of the test was around 45

The duration of the test was around 45 minutes minutes

• On each test two prototypes was evaluated,

On each test two prototypes was evaluated,

• ne main test and one comparing test was
• ne main test and one comparing test was

conducted conducted

Selection of readers Selection of readers

• The readers was selected from the

The readers was selected from the newspapers focusgroups and the selection newspapers focusgroups and the selection was based on age, gender and newspaper was based on age, gender and newspaper reading reading

The main test The main test

• 5 minutes of free browsing/reading to let the user get familiar

5 minutes of free browsing/reading to let the user get familiar with the prototype with the prototype

• A number of tasks were then given the user. The first tasks lead

A number of tasks were then given the user. The first tasks lead the reader to the first page, index page and the index of the the reader to the first page, index page and the index of the different sections of the paper different sections of the paper

• The main test continued with task oriented navigation (finding

The main test continued with task oriented navigation (finding articles). Problems were observed and noted and after every articles). Problems were observed and noted and after every finished task, questions about perceived problems were asked finished task, questions about perceived problems were asked

• The test was finished with an interview about usability and

The test was finished with an interview about usability and navigation specific questions navigation specific questions

The comparative test The comparative test

• One more prototype were tested with the

One more prototype were tested with the same approach as the main test but with a same approach as the main test but with a limited set of tasks limited set of tasks

• The comparative test was finished with

The comparative test was finished with questions about what solutions the test questions about what solutions the test person preferred, which prototype that were person preferred, which prototype that were easiest to use, which prototype that easiest to use, which prototype that supported the best overview etc. supported the best overview etc.

The prototype from Aftonbladet The prototype from Aftonbladet

• Based on a design from the traditional

Based on a design from the traditional newspaper newspaper

• 4 levels of information; First page, table of

4 levels of information; First page, table of contents, section index and the article level contents, section index and the article level

• No hyperlinks within the paper except the

No hyperlinks within the paper except the bottom menu and the thumbnails on the bottom menu and the thumbnails on the section index section index

The prototype from Aftonbladet The prototype from Aftonbladet

The prototype from Aftonbladet The prototype from Aftonbladet

Main points from the Aftonbladet test Main points from the Aftonbladet test

Observations and interviews: Observations and interviews:

• A lot of respondents had trouble to know under which section

A lot of respondents had trouble to know under which section an article could be found an article could be found

• Half of the testpersons used the t.o.c during their search for

Half of the testpersons used the t.o.c during their search for

• articles. The other half based their search on their conclusions
• articles. The other half based their search on their conclusions
• f where the article could be found
• f where the article could be found
• Most people had trouble finding information on the t.o.c due to

Most people had trouble finding information on the t.o.c due to the amount of presented information the amount of presented information

• Non of the users really browsed the newspaper, most users

Non of the users really browsed the newspaper, most users navigated through the section index’s thumbnails to the navigated through the section index’s thumbnails to the articles articles

Main points from the Aftonbladet test Main points from the Aftonbladet test

Concluding interviews: Concluding interviews:

• 10 of the 12 test persons thought it was easy to find

10 of the 12 test persons thought it was easy to find the articles. The main reason mentioned was the the articles. The main reason mentioned was the section index (the thumbnails). section index (the thumbnails).

• The most frequently mentioned problem was the lack

The most frequently mentioned problem was the lack

• f direct navigation from the
• f direct navigation from the t.o.c

t.o.c and the first page: and the first page:

– ”... if links from the main index would have worked it would be great”.

• All test persons thought it was easy to learn the

All test persons thought it was easy to learn the navigational aid and liked the information structure navigational aid and liked the information structure regarding the different levels of information. regarding the different levels of information.

Main points from the Aftonbladet test Main points from the Aftonbladet test

Concluding interviews (cont.): Concluding interviews (cont.):

• 10 of 12 persons said it was easy to get an

10 of 12 persons said it was easy to get an

• verview of the information. The overview
• verview of the information. The overview

was provided through the was provided through the t.o.c t.o.c and the first and the first page according to the answers. page according to the answers.

• 7 persons said that it was hard to get a

7 persons said that it was hard to get a feeling of how much information there was in feeling of how much information there was in the newspaper and also that it was hard to the newspaper and also that it was hard to get a feeling of what was read and what not. get a feeling of what was read and what not.

GP’s prototype GP’s prototype

• The prototype was tested in two formats, A4

The prototype was tested in two formats, A4 and A5. The design is primarily done for the and A5. The design is primarily done for the A5 format A5 format

• 3 levels of information (first page, index and

3 levels of information (first page, index and articles) articles)

• First page contains hyperlinks to articles and

First page contains hyperlinks to articles and the index page contains sectionlinks the index page contains sectionlinks

• ”The thumb navigation” is used for

”The thumb navigation” is used for sequential browsing and also support sequential browsing and also support navigation back to index navigation back to index

GP’s prototype GP’s prototype

” ”the thumb” the thumb”

• Inspired by how people hold

Inspired by how people hold newspapers when reading newspapers when reading

– Support reading behavior from physical world – People move their hands while reading – ”thumb grip” was used by most of the users

Result of ”the thumb” Result of ”the thumb”

• Support movement of hand and change of

Support movement of hand and change of grip grip

– Thumb moves and ends up where you put your hand (”thumb”)

• The basic functions of ”the thumb”

The basic functions of ”the thumb” navigation navigation

– Sequential reading – ”Hide function” (step1 & 2) – Forward and backward ”page turning” (step1 & 2) – Access to menu (step 2)

• Left or right hand navigation (never implemented)

– Access to Index (step 2)

Step 1 Step 2

GP’s prototyp GP’s prototyp

Main points from the GP test Main points from the GP test

Observations and interviews: Observations and interviews:

• Most of the navigational aid was used without any trouble.

Most of the navigational aid was used without any trouble.

• 3 users had big problems using ”the thumb navigation”, the rest

3 users had big problems using ”the thumb navigation”, the rest used used mainly this navigational aid mainly this navigational aid

• In all but one case the test persons misunderstood the index pag

In all but one case the test persons misunderstood the index page e which only contained links to sections and not articles which only contained links to sections and not articles

• In most cases there was no trouble finding information on the in

In most cases there was no trouble finding information on the index dex page and therefore most users got to the right section. Half of page and therefore most users got to the right section. Half of the the users reported perceived problems as: users reported perceived problems as:

– ”I want a shortcut.” – ”I don’t want to browse to find what I’m looking for.” – ”I had to browse a long time.”

• For the other half of the users there were no observations of an

For the other half of the users there were no observations of any y critical problems regarding navigation and these users did not critical problems regarding navigation and these users did not perceive any problems. perceive any problems.

Main points from the GP test Main points from the GP test

Concluding interviews: Concluding interviews:

• 11 persons felt it was easy to find, but most of them had

11 persons felt it was easy to find, but most of them had comments like: comments like:

– ”The news were far inside the newspaper” – ”Relatively easy, however, I would like the headings of the articles function as hyperlinks”

• The suggested changes from the users were to incorporate

The suggested changes from the users were to incorporate hyperlinks to the articles on the index page and the possibility hyperlinks to the articles on the index page and the possibility to browse back on the article level. to browse back on the article level.

• Half of the test persons thought the “thumb navigation” was

Half of the test persons thought the “thumb navigation” was easy to use. easy to use.

• All but one thought the navigational aid was easy to learn

All but one thought the navigational aid was easy to learn

Main points from the GP test Main points from the GP test

Concluding interviews (cont.): Concluding interviews (cont.):

• Overall the users were positive to the information structure.

Overall the users were positive to the information structure. Some users suggested that the index page should be Some users suggested that the index page should be rearranged to match the traditional paper rearranged to match the traditional paper

• Some users also reported that it was hard to find information

Some users also reported that it was hard to find information

• n the index page
• n the index page
• 8 users thought it was easy to get an overview of the

8 users thought it was easy to get an overview of the information and 4 of these mentioned the first page as the information and 4 of these mentioned the first page as the reason and 3 mentioned the index page reason and 3 mentioned the index page

• 11 users said it was hard to get a feeling of how much

11 users said it was hard to get a feeling of how much information the prototype contained and 8 users said it was information the prototype contained and 8 users said it was hard to get a feeling for what was read and what was not. hard to get a feeling for what was read and what was not.

Sundsvalls Tidning’s prototype Sundsvalls Tidning’s prototype

• A5 format
• 3 levels of information

(first page, section index and articles)

• Direct navigation through

hyperlinks on the right menu and on the first page and section indexes

• Sequential browsing

through the arrows in the bottom menu

Sundsvalls Tidning’s prototype Sundsvalls Tidning’s prototype

Main points from the ST test Main points from the ST test

Observations and interviews: Observations and interviews:

• 10 of 12 users used all parts of the navigational aid.

10 of 12 users used all parts of the navigational aid. Most users navigated with the help of the right menu Most users navigated with the help of the right menu and the section indexes and the section indexes

• The browsing function was used quite sparsely

The browsing function was used quite sparsely

• We observed very few problems and none were

We observed very few problems and none were listed as critical problems. Very few of the users listed as critical problems. Very few of the users reported perceived problems after finishing the reported perceived problems after finishing the different tasks. different tasks.

Main points from the ST test Main points from the ST test

Concluding interviews: Concluding interviews:

• All 12 users said it was easy to navigate and find information.

All 12 users said it was easy to navigate and find information. The The most mentioned reason was the menu on the right, but also the most mentioned reason was the menu on the right, but also the

• verview presented through the first page and the section indexe
• verview presented through the first page and the section indexes

s (and also the structure of the section indexes) (and also the structure of the section indexes)

• All users said that they understood how to browse.

All users said that they understood how to browse.

• 2 users suggested to change the browse function (the arrows in t

2 users suggested to change the browse function (the arrows in the he menu) to mimic the functionality on the web: menu) to mimic the functionality on the web:

– ”More as on the web, back to where i were and not one page back. I would probably read in the same way as on the web and not as I read on paper”.

• All users were positive to the menus in the prototype and report

All users were positive to the menus in the prototype and reported that ed that the navigational aid was easy to learn the navigational aid was easy to learn

• The test persons were also very positive regarding the informati

The test persons were also very positive regarding the information

• n

structure of the newspaper structure of the newspaper

Main points from the ST test Main points from the ST test

Concluding interviews (cont.): Concluding interviews (cont.):

• 9 users thought it was easy to get an overview of the

9 users thought it was easy to get an overview of the information due to the right menu information due to the right menu

• 2 users said that they would like more informative pages and

2 users said that they would like more informative pages and said that the first page did not support an overview said that the first page did not support an overview

• Only 2 users reported to get a feeling of what was read and

Only 2 users reported to get a feeling of what was read and what not: what not:

– ”That is harder, maybe easier if you browse” – ”Not as well as in the traditional newspaper”. – ”Hard to know how much information the paper contains [pause], very hard”. (The user did not notice the section and pagination marker in the bottom of the newspaper)

Conclusions regarding navigational Conclusions regarding navigational aids in the E aids in the E-

• newspaper

newspaper

• Based on the results, the following “guidelines” can

Based on the results, the following “guidelines” can be suggested be suggested: :

– 4 “levels” of information seems preferred:

• First page
• Table of content
• Section index
• Article

– The index page should be structured based on the traditional newspaper and it is preferred to present page numbers to support sequential reading – The E-newspaper should contain the same sections as the traditional newspaper – Don’t present to much information in to few sections (task oriented navigation) – The users need a navigational aid that support direct navigation from all information levels (task oriented navigation)

Conclusions regarding navigational Conclusions regarding navigational aids in the E aids in the E-

• newspaper

newspaper (cont.)

(cont.)

– To support an overview of the information, thumbnails of pages seems to provide a good solution – The most preferred pagination system was the one based on the traditional newspaper. – The users preferred a pagination system that also incorporate the total amount of pages to support the feeling of how much information the E- newspaper contained – Feedback that an article is spanning over many pages should be incorporated