IT 4 Communities Heuristic Evaluation

by Danny Hope & Ben Lobo

1st February 2007



























hobo


Table of Contents



Key

Usability Issue

Severe Usability Issue

Introduction

This report was commissioned by IT4Communities to identify the areas of their website which visitors are likely to find difficult to use and which might prevent or hinder visitors from carrying out the activities that the website aims to support.

The results presented here are the outcome of an evaluation methodology called heuristic evalution [Nielsen and Molich, 1990; Nielsen 1994] in which usability experts evaluate a website with reference to specific usability heuristics or principles. The heuristics used in this report were developed by Jakob Nielson [Nielson 1994b].

The evaluation was carried out by Hobo Internet in January 2007 as part of a project to redevelop the IT4Communities website (http://www.it4communities.org.uk).

Methodology

It was decided that two independent evaluators would carry out the analysis. The evaluators first met with staff from IT4Communities and were given an overview of the website in order to gain some knowledge about the domain and to obtain some insight into the goals and activities of typical users of the website.

The evaluators then analysed the site independently of each other, making notes about usability issues that they could identify using the ten usability heuristics as a guiding reference.

Following their analyses, the evaluators compared and combined their notes to produce the results detailed below.

References

Nielsen, J., and Molich, R. (1990). Heuristic evaluation of user interfaces, Proc. ACM CHI'90 Conf. (Seattle, WA, 1-5 April), 249-256.
Nielsen, J. (1994). Heuristic evaluation. In Nielsen, J., and Mack, R.L. (Eds.), Usability Inspection Methods. John Wiley & Sons, New York, NY.
Nielsen, J. (1994b). Heuristic evaluation. In Nielsen, J., and Mack, R.L. (Eds.), Usability Inspection Methods, John Wiley & Sons, New York, NY.

Results

Sitewide (including navigation issues)

The site provides very little feedback to users about where they are. [1]

The top menu is above the site logo and there is a significant space between the menu and the page content which may cause the menu to be overlooked. The hierarchical position of these tabs suggests that they might be links to other, related, websites.

The navigation contains links to the page you're already on. [1]

Users can't tell which links they have followed in the past. [1, 4]

General lack of task-oriented design. [1, 6, 10]

The site doesn't seem to have been developed with common tasks in mind. Instead it looks like a branded, slightly customised out-of-the-box database front end.

It's hard to tell that you've come to the right place, 'Making IT Volunteering Happen' could mean anything.

Even if users know the purpose of the website and have an idea of the tasks they want to carry out, the design and architecture does little to direct users towards their goals or inform them what the next steps in a task might be.

Orange headings could be mistaken for links. [4]

Too many styles in general. [8]

The inclusion and position of the IT4C logo in the header is problematic [4]

The IT4Communities logo and tagline in the header might get overlooked because it looks like a banner advert.

The LHM varies significantly from page to page within main sections of the site and with no apparent consistency or logic. [4]

The LHM presents too many options which do not pertain to common tasks.

Arbitrary Subdivision of The LHM. [4, 8]

The LHM usually contains three separate boxes each of which contains various menu items but no information is provided that denotes what each box relates to. The user will not be able to get an understanding of what to expect in these boxes and, therefore, these items just act as additional elements on the page which distract from the task in hand.

Some menu items link to anchor points within pages. [4]

This is not a common behavior for menu items.

Navigation makes direct links to PDF files without warning. [1]

Specifically 'Choosing a Charity checklist' in the LHM exhibits this behavoiur.

Link and page names are different. [4, 6]

The labels in the navigation menus should match closely if not exactly with the title and main heading of the pages that they link to. Failure to do this inhibits the user's capabilities for recall and hinders navigation back to a previously visited page.

Specific examples:

Link title
Page name
IT Consotium IT4Communites in the ICT Hub
Request a New Project

Volunteer Request


Unnecessary visual devices used to add semantic meaning. [1, 4, 8]

The LHM contains several styled boxes within a single larger box. Each mini box has a border as well and uses horizontal lines as well as bullets to delineate the elements. These elements may be irrelevant and may make it more difficult to interpret the interface rather than easier.

Text is generally too small for average users by default. [10]

Menu items are difficult to click. [5]

The clickable area of the links in the top menu and LHM is relatively small (when considered with the amount of space that there is to aim at around the links).

No sitewide search facility. [4]

As a rule-of-thumb, about one in three people expect to find a search facility.

The main logo image is not a link back to the home page. [4]

Non standard location for site map link. [4]

The order of top menu headings may not be optimized for the goals and expectations of site visitors. [2]

e.g. the 'Site Map' and 'About IT4C' links may be less relevant to the average user's task than the Volunteers, Charities and Companies links so they might be better if they placed after those links.

Documents are not properly structured [4]

Nested headings (i.e. h1, h2, etc) are not used properly (if at all) and there is a general lack of structure within pages.

Content is not presented or written in an easily digestible format. [2]

e.g. The Companies home page

Confusing terminology is used throughout the site. [2]

Inappropriate terminology is used in content, as link titles and form field labels.

Examples (this is not a complete list):

URLs are all ugly and unhelpful. [7]

Don't make references to the physical layout of a page. [4]

e.g. Instructions on the volunteers page to 'Use the links on the left' make reference to the physical shape of the rendered page. This is bad because the way a page will be rendered (e.g. on a mobile device) can't always be predicted.

Forms

Forms take a long time to complete. [7]

Form fields do not provide enough clarity about what they are for. [2, 6]

It should be clear to users what they are supposed to enter into free text fields. There should be no doubt as to why a particular form field has been included on a form and, if it's a required field, why it is required. It should be clear what the effect of making selections in a form will be.

Specific fields which might cause confusion:

Required fields are not obvious. [6]

Multiple selection lists are hard to use. [6]

Free text fields require formatted data. [5]

e.g. An error is generated when a user enters a post code such as 'BN12PQ' ('Post code must consist of two strings separated by space character') but there is no information suggesting that this is necessary.

Forms should not need a cancel button. [8]

If users wish to not submit a form they can simply not press the submit button and go back.

(In some instances) form labels are almost indistinguishable from links. [6]

Volunteer and Charities registration forms

Validation error messages are not displayed near the problems they refer to. [6, 9]

Error messages and information about incorrectly submitted form data appear at the top of the form instead or next to the form field that they refer to. This puts a burden on users to marry the error message with the location of the error.

Validation error messages are not optimised for the target audience. [2, 9]

For example: 'Years in industry must be an integer.'

Not all errors are reported at the same time when a form is submitted. [1, 5]

When a form is submitted with errors, only some of the errors are highlighted to the user. After fixing these errors and resubmitting the form, more errors relating to different fields are reported.

Volunteer registration and login

By default drop-down lists (generally) show no options. [1, 6]

Members are required to login after successful registration. [8]

Following registration, members are not rewarded in any way. Instead they then have to login.

The login form uses the term 'User' the sign-up form used 'Login ID'. [4]

General members area issues

Links related to user's accounts are too far from the user's name. [6]

The name is in the top right whereas the other links are in the submenu towards the bottom left.

After logging in there is no feedback to inform users that they are now logged in. [1, 6]

Once logged in users are shown nothing particulary useful and there is no clear task-oriented information or guidance.

When logged in the links to the account information and member's area are not highlighted and are easily overlooked. [6]

After creating an account, why is it necessary to agree to the disclaimer again when amending or updating your account details? [5]

No feedback is provided to inform the user that they have been logged out. [1]

Searching for work packages

The search controls are not intuitive or easy to use and provide poor feedback [1, 6]

Users can't see all the options that have been selected in the lists so can't easily tell what the current search relates to. Also, multi-selection lists are less usable than indivdual links.

The search controls are too prominent. [8]

The search controls take up so much space at the top of the page that they may obscure the results from most users.

The search results are too many steps away from initial sign-up. [7]

The results appear inflexible and information could be presented more efficiently. [7]

The instructions to 'Click a column heading to sort by that column' should not be necessary. Even though the table columns can be sorted in this way, it is not clear from the design of the table. Results should be sorted by something relevant to the user by default (e.g. post code), not by ID number as at present.

Requests for work packages

Search capabilities are unnecessary for this task. [8]

A search interface is highly inappropriate for a dataset that typically contains 1 item.

Whole pages used for status messages. [1, 8]

After confirming that they want to update their details, a whole page is used to tell users that 'Your account was updated successfully.'

Unnecessary confirmations. [3, 8]

When updating a profile, a confirmation page is displayed which asks the question 'Do you really want to update your account details?'.

Lack of feedback about the number of steps involved in a task [1]

Assuming that the charity is signing up in order to define a project, there's no hint that this process involves more than one step.

Some comments about email

Emails that get sent out do not pose any major usability problems. But there are some missed opportunities so we thought there should be some comments:

Too much text. [8]

e.g. 'Your project [my project] has been published to the IT4Communities website as [My Project]' I don't need to know what it's been published as unless name has become unrecognizable.

The sender is unclear. [1, 2, 4, 7]

Messages come from IT4C <it4cemail@ems-uk.com>, are signed by Nigel Davies and mention info@it4communities.org.uk in the footer - which is true?

Messages do not encourage action. [6]