and the test seeks to evaluate how well the narrative visualization communicates its
content and facilitates sharing the experiences of another.
User Scenario: Reginald wants to visit the Museum of Nature while on vacation.
He doesn't know much about it and goes to its website and looks at a map of its
floor plan. This gives him an idea of what's inside and where everything is but not
a great idea of what the experience is like. He sees that he is able to browse the
narrative visualizations of others. He decides to view several to get a better idea
of what the exhibits are like to actually see in person and the different things
people saw. He sees that he can plan a tour using a web application on the
website and then follow it with an app on his smartphone. The app would also
allow him to create a visualization of his own. A few weeks later when he returns
home his family wants to hear about his trip. He shows them the narrative
visualization that he made and walks them through his trip.
71
Table 2. Sub-Test 2 Usability Criteria
Usability Criterion Metric
Effectiveness: The accuracy and completeness
with which specified users can achieve
specified goals in particular environments [41].
6 scalar questions using a 7-point Likert scale.
Operability: The amount and effort necessary
to control and operate a software product [43].
5 timed tasks.
Satisfaction: the comfort and acceptability of
the work system to its users and other people
affected by its use [41].
3 questions asking user to rank visualizations.
Sociability: how well the system facilitates,
engages, and prompts social activity.
3 scalar questions using a 7-point Likert scale.
72
Chapter 6: Experimental Results
6.1 Demographic Observation
The user tests were conducted over two weekends. They took place at Carleton
University in the HCI graduate student office. The setup was a cubicle with a desktop
computer that they would use to test the prototype that had been developed. The
computer was the same one that had been used for the pilot tests. The average time it took
to complete the user test was approximately half an hour.
Twenty participants were tested in total. There were 8 females and 12 males and they
ranged in age from 20 to 61 with varying degrees of computer literacy that they were
asked to rate themselves on.
Table 3. Test Demographics
Participant
Number
Gender Age Computer
Literacy
1 Female 26 6
2 Male 20 7
3 Male 61 5
4 Female 25 7
5 Male 24 6
6 Female 26 7
7 Female 26 5
8 Male 22 7
9 Male 22 5
10 Male 21 7
11 Female 21 6
12 Male 21 7
13 Male 32 6
14 Female 41 6
15 Male 24 7
16 Male 24 3
17 Male 22 6
18 Female 27 7
19 Male 24 7
20 Female 57 4
Average 12m/8f 28.3 6.05
73
The computer literacy on average was 6.05 out of 7 so users had a high degree of selfreported
computer literacy. This combined with the consideration of selecting
participants who were familiar with web technology ensured that the participants already
knew how to use the technology and only had to focus on evaluating the system and the
visual narratives rather than learning how to use the technology. A more finalized version
of the prototype could take these things into consideration and seek to test users who
aren't familiar with web technologies or who lack computer literacy.