The added value of the comparative results is further illustrated when considering user
performance on the TelecomB website. Comparing their results with that of TelecomA will boost
the organisation’s confidence in the success of their web design. However, when compared to the
results of TelecomC, the results appear less positive for TelecomB.
For TelecomC the outcomes were very positive. Their obvious superior results compared to the
other two websites provide objective evidence that they have made design decisions that support
usability – in particular with regard to the top-up functionality.
We recommend that comparative UX and usability studies include at least three competing
organisations. Although we only tested one function – mobile data top-up – in our comparative
evaluation and still obtained very useful comparative data, we would recommend that more than
one function is tested for a more complete comparison.