Pairwise Testing


I’ve just this morning read an interesting article on combinatorial or pairwise testing (http://www.testingeducation.org/wtst5/PairwisePNSQC2004.pdf and http://shrinik.blogspot.com/2007/03/boundary-value-exploration-bve.html .) This article has been around for while but it covers a very valid point. Pairwise testing is Domain testing or as ISTQB call it Equivalence Partitioning. Equivalence Partitioning “…is based on the premise that by testing one value within a class the result is representative of all values within that class.”

The technique, on the surface, has merit but how do we test for the unknown? What if our test data doesn’t cover that exception? Pairwise testing is a valid technique BUT as with all testing, it should be combined with the testers skill and judgement. To follow one technique for the sake of the technique is but to limit one’s effectiveness.

Judgement and skill are hallmarks of a good tester. Education and knowledge of the ‘craft’ are more important than the expertise in a particular system or application. There are many good subject matter experts but not alot of really good testers…testers that can think, change and adapt.

As Robert Sauborin likes to frequently quote in his course slides     “No! Try not, Do. Or do not.There is no try.” – (Master Yoda instructing young Luke Skywalker in the ways of the force.)

In otherwords, look beyond what you do know…there may be another way to test your product…do it and evaluate for yourself. In is only after a period of exploration and experimentation that we can become aware of what the system can do.

Just because you (or the team) have always tested the system the same way doesn’t necesarily mean that it is the be all and end all of testing. Look outside the square and think!!

Advertisements

Author: bjosman

Principal Consultant at OsmanIT brian.osman@osmanit.com

2 thoughts on “Pairwise Testing”

  1. Brian,

    Good post. Thanks for getting the word out about pairwise testing.

    You might also be interested in a Combinatorial Testing article I co-wrote recently that showed that, on average, over 10 real-world projects, defects found per tester hour increased by 2.4X.

    It is at: https://hexawise.com/Combinatorial-Softwar-Testing-Case-Studies-IEEE-Computer-Kuhn-Kacker-Lei-Hunter.pdf

    -Justin Hunter
    Blog: http://hexawise.wordpress.com
    Company: http://hexawise.com
    New Testing Forum: http://testing.stackexchange.com

  2. Having read this I believed it was extremely informative.

    I appreciate you spending some time and effort to put this short article
    together. I once again find myself spending a lot of time both reading and leaving comments.

    But so what, it was still worth it!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s