OneStopTesting - Quality Testing Jobs, eBooks, Articles, FAQs, Training Institutes, Testing Software, Testing downloads, testing news, testing tools, learn testing, manual testing, automated testing, load runner, winrunner, test director, silk test, STLC

Forum| Contact Us| Testimonials| Sitemap| Employee Referrals| News| Articles| Feedback| Enquiry
Testing Resources
  • Testing Articles
  • Testing Books
  • Testing Certification
  • Testing FAQs
  • Testing Downloads
  • Testing Interview Questions
  • Career In Software Testing
  • Testing Jobs
  • Testing Job Consultants
  • Testing News
  • Testing Training Institutes
  • Introduction
  • Designing Test Cases
  • Developing Test Cases
  • Writing Test Cases
  • Test Case Templates
  • Purpose
  • What Is a Good Test Case?
  • Test Specifications
  • UML
  • Scenario Testing
  • Test Script
  • Test Summary Report
  • Test Data
  • Defect Tracking
    Software testing
  • Testing Forum
  • Introduction
  • Testing Start Process
  • Testing Stop Process
  • Testing Strategy
  • Risk Analysis
  • Software Listings
  • Test Metrics
  • Release Life Cycle
  • Interoperability Testing
  • Extreme Programming
  • Cyclomatic Complexity
  • Equivalence Partitioning
  • Error Guessing
  • Boundary Value Analysis
  • Traceability Matrix
    SDLC Models
  • Introduction
  • Waterfall Model
  • Iterative Model
  • V-Model
  • Spiral Model
  • Big Bang Model
  • RAD Model
  • Prototyping Model
    Software Testing Types
  • Static Testing
  • Dynamic Testing
  • Blackbox Testing
  • Whitebox Testing
  • Unit Testing
  • Requirements Testing
  • Regression Testing
  • Error Handling Testing
  • Manual support Testing
  • Intersystem Testing
  • Control Testing
  • Parallel Testing
  • Volume Testing
  • Stress Testing
  • Performance Testing
  • Agile Testing
  • Localization Testing
  • Globalization Testing
  • Internationalization Testing
    Test Plan
  • Introduction
  • Test Plan Development
  • Test Plan Template
  • Regional Differences
  • Criticism
  • Hardware Development
  • IEEE 829-1998
  • Testing Without a TestPlan
    Code Coverage
  • Introduction
  • Measures
  • Working
  • Statement Coverage
  • Branch Coverage
  • Path Coverage
  • Coverage criteria
  • Code coverage in practice
  • Tools
  • Features
    Quality Management
  • Introduction
  • Components
  • Capability Maturity Model
  • CMMI
  • Six Sigma
    Project Management
  • Introduction
  • PM Activities
  • Project Control Variables
  • PM Methodology
  • PM Phases
  • PM Templates
  • Agile PM
    Automated Testing Tools
  • Quick Test Professional
  • WinRunner
  • LoadRunner
  • Test Director
  • Silk Test
  • Test Partner
  • Rational Robot
    Performance Testing Tools
  • Apache JMeter
  • Rational Performance Tester
  • LoadRunner
  • NeoLoad
  • WAPT
  • WebLOAD
  • Loadster
  • OpenSTA
  • LoadUI
  • Appvance
  • Loadstorm
  • LoadImpact
  • QEngine
  • Httperf
  • CloudTest
  • Perl Testing
  • Python Testing
  • JUnit Testing
  • Unix Shell Scripting
    Automation Framework
  • Introduction
  • Keyword-driven Testing
  • Data-driven Testing
    Configuration Management
  • History
  • What is CM?
  • Meaning of CM
  • Graphically Representation
  • Traditional CM
  • CM Activities
  • Tools
  • What Is Software Testing?
  • Effective Defect Reports
  • Software Security
  • Tracking Defects
  • Bug Report
  • Web Testing
  • Exploratory Testing
  • Good Test Case
  • Write a Test
  • Code Coverage
  • WinRunner vs. QuickTest
  • Web Testing Tools
  • Automated Testing
  • Testing Estimation Process
  • Quality Assurance
  • The Interview Guide
  • Upgrade Path Testing
  • Priority and Severity of Bug
  • Three Questions About Bug
    Home » Testing Articles » Usablity Testing Articles » Expert usability review vs. usability testing

    Expert usability review vs. usability testing

    A D V E R T I S E M E N T

    One question we're often asked is which method is best: usability testing or expert usability reviews? Well, if they were sports cars, expert usability reviews might be a Porsche (pretty decent car and better than no car at all), but usability testing would be in a different league, namely Formula 1.

    So, what's the difference?

    • An expert usability review is when a usability specialist inspects a website to identify potential usability problems
    • Usability testing involves getting people from the target audience to evaluate your site whilst performing tasks

    They're quite similar in many ways in that both:

    • Find and prioritise usability problems
    • Evaluate designs in the context of tasks

    Do they find the same problems?

    The answer depends on how precisely you measure this, on balance no, not reliably. Generally speaking, expert usability reviews tend to find high level breaches of design rules and consistency. Usability testing is better at finding issues related to special domain knowledge and task flows.

    If you were to carry out an expert usability review before conducting usability testing, and compare the two sets of findings, you can see how the issues you found compared to their real experiences. Did you find all the problems? Which ones did you miss? Which ones that you thought might be issues turned out not to be? This will give you a good feel for how expert usability reviews hold up against usability testing.

    Often, expert reviews will:

    • Miss usability issues that arise during usability testing
    • Find some issues that usability testing didn't
    • Report false alarms (i.e. not real issues)

    And that's the problem. No matter how good an expert you are if you just rely on an expert usability review you'll find different sorts of issues and overlook some potentially serious ones.

    Consider the case of a health website aimed specifically at new mums. The expert usability review found plenty of great issues, but might have missed the main killer one that caused participants to pass comments like "That's just so insensitive!" and "I wouldn't use this site anymore". And all because of a seemingly benign bit of banner advertising for a local gym placed next to an article about breast feeding. A reviewer would have difficulty predicting the indignant reaction of new mothers who felt the site was rubbing their nose in it. After all there would be little chance of them going anywhere near a gym with a newborn.

    How much overlap is there between expert usability reviews & usability testing?

    Naturally, there is some overlap in the problems found in both expert usability reviews and usability testing. Research conducted by Fu, Salvendy and Turley in 2002 estimated this to be around 41%. Not as high as you might expect. Interestingly, expert usability reviews tend to find more problems compared to usability testing. But it's quality over quantity.

    Expert usability reviews are good...

    Expert usability reviews are more common than usability testing simply because they're cheaper and quicker to do. Typically, it'll only take a few days to inspect a site and write a report and because you don't need to hire labs nor recruit users, costs are significantly cheaper. Because of this, they're often preferred to usability testing, especially when time and budget are squeezed.

    There are however some pitfalls. For a start, a lot depends on the reviewer's level of experience. No two usability experts will find exactly the same issues so the method is also open to practitioner variation. The biggest problem however is simply that they sometimes miss the real problems that cause users to fail tasks. This can be especially true when the target audience has a particular skill set. For example, an accountant may be better placed to diagnose certain types of issues related to online accountancy tasks than a non-accountant reviewer.

    ...But usability testing is da Daddy!

    Usability testing takes more time to plan and organise and is more expensive too - recruiting and incentivising people from a target audience can be costly. But it's definitely worth the effort! The results give a truer picture of the real problems people encounter because they're derived from real users in the first place.

    It's inconceivable how sites go live without checking to see that they're actually usable. It's like building a car but not test driving it. "Yes, we've built this great website. Umm, well no, we've not checked to see if people can use it yet. But don't worry because all the links work and the pages download quickly."

    Another advantage of usability testing is that there's less conjecture and feedback comes straight from the horse's mouth. Videos of user sessions in particular, can provide a powerful persuasion tool for reluctant stakeholders. It's hard to argue with recordings of people in tears of frustration.

    Use real users and accept no substitute!

    Both expert usability reviews and usability testing have their time and place. In practice, people often use expert usability reviews early on to straighten up their design in preparation for usability testing. (Indeed this is critical for accessibility testing, since it's a waste of time to recruit and test users who can't even get into your site in the first place.)

    Whilst an expert usability review is better than nothing, it's still vital to put your website in front of users as early as possible too, rather than leaving it too late. Key elements such as site structure and navigation should be assessed with users at the earliest opportunity. Otherwise you risk having your website completely overhauled at a late stage.

    Ultimately, the key is to appreciate that expert usability reviews and usability testing are different beasts. The most effective approach is to try and integrate both techniques. Remember though, you must test your site with real users - accept no substitute!

    Have us conduct usability testing for you!

    Find out whether site visitors can actually use your website by having us run usability testing for you.

    This article was written by Lisa Halabi. Lisa's crazy about usability - so crazy that she's head of usability at Webcredible, an industry leading user experience consultancy, helping to make the Internet a better place for everyone. She can often be found developing information architecture and is extremely talented at training for web writing.

    More Usablity Testing Articles
    1 2 3 4 Next

    discussionDiscussion Center


    Yahoo Groups
    Y! Group
    Sirfdosti Groups
    Contact Us

    Looking for Software Testing eBooks and Interview Questions? Join now and get it FREE!
    A D V E R T I S E M E N T

    Members Login

    Email ID:

    Forgot Password
    New User
    Testing Interview Questions
  • General Testing
  • Automation Testing
  • Manual Testing
  • Software Development Life Cycle
  • Software Testing Life Cycle
  • Testing Models
  • Automated Testing Tools
  • Silk Test
  • Win Runner
    Testing Highlights

  • Software Testing Ebooks
  • Testing Jobs
  • Testing Frequently Asked Questions
  • Testing News
  • Testing Interview Questions
  • Testing Jobs
  • Testing Companies
  • Testing Job Consultants
  • ISTQB Certification Questions
    Interview Questions

  • WinRunner
  • LoadRunner
  • SilkTest
  • TestDirector
  • General Testing Questions

  • Testing Forum
  • Downloads
  • E-Books
  • Testing Jobs
  • Testing Interview Questions
  • Testing Tools Questions
  • Testing Jobs
  • A-Z Knowledge
    Study ABROAD ?

    Study Abroad

    Vyom Network : Free SMS, GRE, GMAT, MBA | Online Exams | Freshers Jobs | Software Downloads | Programming & Source Codes | Free eBooks | Job Interview Questions | Free Tutorials | Jokes, Songs, Fun | Free Classifieds | Free Recipes | Bangalore Info | GATE Preparation | MBA Preparation | Free SAP Training
    Privacy Policy | Terms and Conditions
    Sitemap | Sitemap (XML)
    Job Interview Questions | Placement Papers | SMS Jokes | C++ Interview Questions | C Interview Questions | Web Hosting
    German | French | Portugese | Italian