Getting a Measure of Satisfaction from Eyetracking in Practice
Full Day Workshop
Sunday 23rd April - CHI2006, Montreal, Canada
www.chi2006.org

Update May

A big thank you to all the attendees for a great workshop!

Download the summary poster for the workshop here: Workshop poster

Thank you for all filling out your feedback forms. If you have any further feedback for Tony or I please drop us a line, we would always like to improve.

Finally don't forget you can keep the discussion alive on the Yahoo group: groups.yahoo.com/group/Eyetracking/

best wishes,
Tony, Natalie & Janet

Attendee position papers

Download your follow attendee position papers here:

• Sune Alstrup and John Hansen (IT University of Copenhagen, Denmark)
• Duncan Brumby and Edward Cutrell (Drexel University USA & Microsoft Research, USA)
• Laura Cowen (IBM, UK)
• Andrew Duchowski (Clemson University, USA)
• Laura Granka and Kerry Rodden (Google, USA)
• Ying-Hua Guan (Chung Yuan Christian University, Taiwan)
• Keith Karn (Xerox and Rochester University, USA)
• Isabelle Peyrichoux (CESART, Canada)
• Janet Read (University of Central Lancashire, UK)
• Tony Renshaw (co-facilitator) (Leeds Metropolitian University, UK)
• John McCarthy, Jens Riegelsberger (Framfab, UK)
• Anthony Santella (Rutgers University, USA)
• Charlotte Sennersten & Craig Lindley (Gotland University, Sweden)
• Katerina Tzanidou (The Open University, UK)
  

What is the workshop about?
Eyetracking is now a standard offering from commercial HCI analysts. However, what are the best ways to exploit the strengths and minimise the weaknesses of this technique?

This workshop aims to gather individuals who have an interest in using eyetracking for the evaluation and design of digital interfaces such as websites, games, iTV, mobile phones and more.

There are two expected outcomes from this workshop.

1. Firstly, to define best practice, suggest answers to continuing areas of doubt and highlight unanswered questions about eyetracking in both its scientific and practical sense
2. Secondly, to explore how best to measure the satisfaction element of the ISO 9241 definition of usability through eye movement analysis, especially in the genre of display cited above

(Please note: interactive eyetracking such as eye typing is not within the focus of this workshop)

Download the extended workshop abstract

Who should come?
This workshop is aimed at both practitioners and academics:

• Practitioners who use eyetracking in their work for design and evaluation purposes
• Academics who are involved in applying eyetracking research to the commercial domain

We aim to select participants who have experience in using eyetracking or, if little experience, have developed a position or view on the use of eyetracking for commercial purposes. The workshop is not positioned as a tutorial and we do not wish to involve attendees who cannot actively participate in the discussions.

We aim to have 12-15 participants, making the number of anticipated attendees 18 including the three workshop leaders. We will select participants to get a range of experience and attitudes to research in, or the commercial use of, eyetracking.

At the recent British HCI 2005 conference, the workshop attracted academics as well as practitioners. Academics who use eyetracking for design work, and who wish to appreciate the commercial parameters that may impact upon the implementation of their research ideas will be interested in attending. Eyetracking is also an excellent area where communication between academic and practitioner worlds needs to be encouraged to promote sharing of best practice and ideas.

Due date for position papers is 15 January 2005. People will be notified of acceptance to workshop by 31 January 2006 in time for participants to sign up for early registration in early February.

What would I need to do before the workshop?

• Prior to the workshop interested parties are asked to submit a position paper (maximum 2 pages) by email by 15 January 2006.
  Download the template for a position paper
  
• Position papers from all accepted attendees will be posted on a workshop website prior the workshop.
• Attendees will be asked to read position papers from their fellow workshop attendees and prepare a 5 minute presentation on three topics, addressed in the accepted position papers and argue for their inclusion as topics for discussion in the themed breakout groups.
• Attendees are encouraged to review references and reports that are recommended or referenced by their fellow workshop attendees.
• Attendees are also encouraged to participate in an online eyetracking discussion group both before and after the workshop.

What is the outline of the day?

Introduction

We believe one of the values of the workshop will be get people talking in-depth about the issues and problems they have about eyetracking. To this end discussion groups will take up a large part of the workshop time and presentations will be of limited duration. During the 5 minute initial presentation time allowed to each attendee, the other attendees will be asked to make notes on 'post it' notes of recurring/interesting points they think ought to be discussed further which they will then be asked to allocate to an appropriate theme(s) by posting the notes under the appropriate theme heading.

After discussions, the breakout groups will be encouraged to present their conclusions in a prescribed format with the aim of facilitating the closing workshop discussion and consolidation of the workshop outcomes discussion by the workshop leaders prior to production of the workshop poster and future article(s).

Overview of workshop activities

Morning:

• Introductions and summary presentations of position papers
• Attendees choose break-out groups to attend
• Breakout session one, followed by reporting back to group and group discussion.

Afternoon:

• Breakout one continued followed by reporting back to group and group discussion.
• Breakout two followed by reporting back to group and group discussion.
• Wrap-up of the day and next steps

Conclusions from the workshop will be documented throughout the day. Post workshop the discussions and best practice guidelines agreed upon by the group will be documented and distributed by the facilitators principally as downloadable files via the internet. It is our intention to develop a Journal Special Issue, based on the workshop, to which participants will be invited to submit papers, and we will produce a summary report for publication on the world wide web.

What is the detailed break-down of the day?

Who are the organisers?

Tony Renshaw gained his PhD in Human Computer Interaction at Leeds Metropolitan University. His research topic entitled 'Designing for Visual Influence' featured the use of eye tracking to explore the nature of eye movements over various visual display designs. Tony's work has resulted in several peer reviewed publications at conferences such as CHI, INTERACT, HCI and in 'Interacting with Computers' (see below). He is now part of a team headed by Professor Janet Finlay, set up within the university, offering usability testings of web sites and software applications to a variety of customers, large and small, work which builds on Tony's PhD research. Prior to that Tony had a career in the Computer Services division of International Computers Ltd. as a Finance Manager.

Tony co-chaired a similar workshop to the one proposed at the 19th British HCI conference in Edinburgh this year (2005) The one day workshop attracted participants from America, Australia, and several European countries.

Publications

• Renshaw, J. A., Finlay,J.E.,Ward,R.D.,and Tyfa,D (2002) The Impact of Object Dimensions on
  Eye Gaze Human Computer Interaction 2002, 2, p86-89.
• Renshaw, J. A., Finlay,J.E.,Ward,R.D.,and Tyfa,D (2003) Designing for Visual Influence: An Eye
  Tracking Study of the Usability of Graphical Management Information Human-Computer
  Interaction INTERACT '03, 1, 144-151.
• Renshaw, J. A., Finlay,J.E.,Ward,R.D.,and Tyfa,D (2004a) Regressions Re-visited: a New
  Definition for the Visual Display Paradigm CHI 2005, Late Breaking Results, p1437-1440.
• Renshaw, J. A., Finlay,J.E.,Ward,R.D.,and Tyfa,D (2004b) Understanding visual influence in
  graph design through temporal and spatial eye movement characteristics. Interacting with
  Computers, Vol 16, p557-578.
• Renshaw, J. A., Finlay,J.E.,Ward,R.D.,and Tyfa,D (2005) A Back-track to Satisfaction, Human
  Computer Interaction 2005, 2, p73- 76.

Natalie has been a usability consultant in Amberlight for a period of 2 years after having completed an MSc in Human Computer Interaction at the University of London Interaction Centre. Natalie has conducted UCD assessment and design for clients of international standing as well as small high tech companies. She has also been involved in a number of eyetracking studies. Prior to working in HCI Natalie worked as a Management Consultant for Booz Allen Hamilton in Australia.
Natalie ran a recent workshop at the 19th British HCI conference in Edinburgh this year (2005) in conjunction with Tony Renshaw (see details below) of Leeds Metropolitan University. The workshop was conducted along similar lines to those proposed here. The one day workshop attracted participants from America, Australia, and several European countries.

Professor Janet Finlay is co-ordinator of the Interaction Design research activity within the Interactive Systems and Learning Environments Group at Leeds Metropolitan University. Her current research interests focus on objective usability assessment methods, patterns for interaction design, genre analysis and user experience and e-learning. Janet co-organised a Workshop at CHI'2003 with Sally Fincher, John Thomas, Sharon Greene, Paul Matchen, Lauretta Jones and Pedro Molina on Perspectives on Patterns: Concepts and Tools.
Publications Janet has co-authored and edited several books, amongst them Human-Computer Interaction, now in its third edition, and has published numerous articles and papers in HCI.