QA: The Misnomer That Never Dies

Quality AssuranceOver the span of my testing career I don’t know how many times I’ve had this conversation, in its many forms and permutations. The good old conversation about testing vs. quality assurance. The conversation we (software testers) have about not being ‘quality assurance’ professionals. That we cannot assure anything, least of all quality. Testers can assure quality as much as a doctor can assure health. Imagine the conversation:

[Patient] So doc, now that I’ve done my yearly checkup, can you guarantee I am entirely healthy?
[Doctor] Well, you are healthy, and we checked for all of the most common sicknesses and diseases for someone your age, gender, background. However I cannot guarantee there is nothing else wrong somewhere we didn’t check.
[Patient] But you said you were doing a thorough checkup.
[Doctor] And I did.

You get the idea. The doctor takes what we testers may call a ‘risk-based’ approach to our yearly checkups. He takes into account our family history, background, gender, age, habits and makes a decision on which exams we need, as he couldn’t possibly ask us to do all the available medical exams out there. That could be seen as a waste of time and money.

The same goes for testing. Only that the conversation happens between the Software Tester and the Project Manager, or the Product Owner, or the Dev Lead, or whomever else. I believe that one reason that this still happens is because some testers still insist in calling themselves ‘Quality Assurance’ professionals. How can we possibly not assure quality if that is precisely what our job titles say? I’ve had this conversation countless times with ‘QA’ people everywhere. There is a feeling that being called a ‘tester’ is demeaning, or less important than a QA. A Quality Assurance Engineer once told me ‘but I do so much more than just test’. That may be true, but you still do NOT ensure quality. You just can’t. This is not a new topic, Michael Bolton wrote his popular blog post Testers Get Out of the Quality Assurance Business* over 5 years ago, and it was not a new topic then.

The fact that we, as a community, are still talking about this has to mean something. I’m not sure what yet, but it has to. It could mean that we are talking about this to the same people over and over, or if we are talking to new people about it, the message must not be getting across because by now we’d have made an impact. Maybe we have made an impact, but I just don’t feel it. Confirmation bias? Maybe.

So what can we do? How can we move on to bigger and better conversations? How can we impact the still large part of our industry that believes they can, and do ensure quality? How can we kill and bury this misnomer once and for all? I wish I had the answer to that, but I don’t. I do, however have some suggestions and some things I have been trying:

Keep talking about it

We need to continue talking about the foolishness of the term Quality Assurance when referring to Software Testers. It is not only inaccurate, it is irresponsible. A physician would never call themselves a ‘Health Assurance Professional’. One dictionary definition of ‘doctor’ is a qualified practitioner of medicine. As we are qualified practitioners of software testing, investigation, reporting and communication.

Understand what software testing is [and is not]

There are still so many testers out there that are unable to articulate what they do. I interview a lot of testers, and the answers to questions such as: ‘what is testing?’ or ‘what is the most important skill a tester can have?’ or ‘what does a tester do?’ range from unsatisfactory to completely pitiful. There are a sea of free information about testing out there, read it. And I’m not talking about LinkedIn forums, don’t go there. I’m talking about blogs such as Satisfice and Developsense. Start with this post, and beware, you will need to read it more than once. Read it until you understand it, until you internalize it. Then move on to read as many other blog posts on those sites as you can.

Talk to other Software Testing professionals

When I started to really understand what testers are supposed to do, when I began learning about the craft of software testing, I was all but confused. I was told by the courses and certifications I had done that I was put in a team to assure quality. One way to better understand and clarify such doubts is by having a conversation with experienced practitioners. Do your research first, then approach one of them. They have helped me [and still do to this day] to grow in understanding of our profession, helped me to be better at articulating concepts, theories and how to practice software testing as a professional. If you don’t know how or who to reach out to, contact me.

Do you find yourself having this conversation too? How to you tackle it? Any suggestions on how to stop this madness once and for all?

*BTW, if you haven’t read this post yet, drop everything you are doing and read it. Now. 

Let’s Test – ER on My First Presentation

This is my third post about Let’s Test Conference in Sweden. In the first I talked about my thoughts still at the venue, just after the conference finished. The second was all about the people. This post is my experience report (ER) on my presentation at Let’s Test, more of a reflection really.

This was my first ever presentation. After many anxious nights preparing my presentation, thinking about what it was going to be like, worrying about not doing a good job – its all over. My first track presentation at a conference is behind me now. But there is still a lot of reflecting I want to do on the experience. This is my first attempt to do so.

Preparing for the journey…

There were a few reasons I couldn’t wait to go to Let’s Test, meeting awesome testers I only knew via Twitter, conferring and exchanging ideas with great minds in testing were at the top of the list, but the reason I couldn’t stop thinking about the conference (the most dreaded reason) was to get a first presentation under my belt. Even though most of the material was about my own experiences, I spent a lot of time preparing for it, including countless hours on Prezi making it look good – maybe as compensation for the fear of not presenting well. I’m glad I did that as it was one less thing to worry about during the presentation.

I was lucky enough to be paired with and amazing presentation mentor via the A Line in the Ladies Room program: Dawn Haynes. Dawn has many years experience as a presenter and teacher so having her help was amazing! Especially when last minute nerves hit me on Sunday after I got to Runo. Thanks Dawn for all your support, it meant the world to me. I had lots of other lovely people supporting me there like Scott Barber, David Greenless, Lee Hawkins, Martin Hynie to name a few, and there were many more lovely people there cheering me on, too many to list here but although that whole day was much of a blur to me, I really appreciate your support.

The moment of truth arrives…

Of course there had to be technical difficulties just before the start – don’t all first timers have that? My computer went to sleep and somehow lost the connection to the projector and we couldn’t make it work. It was a few minutes after the presentation was meant to start that the projector decided to work again. Phew…

So, after the technical issues, I have to admit I was nervous. Very nervous. That is when James Bach enters the room. Needless to say I was even more nervous then! The pressure of having one of the biggest names in testing on my first presentation was huge*. But there I was and there was nothing much I could do – apart from presenting. I have to say tho that jumping out of the window (One Flew Over the Cookoo’s Nest style) did cross my mind more than once.

*Note: James was kind enough to ask me if I was OK with him being there, the day before the presentation, so I had the opportunity to say no, but I thought his feedback would be invaluable so I decided to say yes, and I’m glad I did. He did give me very kind and constructive feedback, for which I’m very grateful.

After I decided that jumping out wasn’t the best idea, I proceeded to present the material I had rehearsed so many times before. I knew what time I should be moving to the next slide not to go over time, but on the day I completely forgot to look at the watch until the second last slide. To my horror I realized that the presentation had only gone for 30 minutes, and I had a 45 minutes presentation – which meant I was going to have to stretch the last two slides for 15 more minutes. Needless to say that didn’t happen, so I finished early. Luckily there were lots of questions so we had a lively discussing for the remainder of the time.

Interestingly enough, I felt much more comfortable during the question time then during the presentation. I think it is because I prefer to interact with people one-on-one, and during open season it felt more personal as I was directing myself to the one person asking the question. There were other takeaways for me (and I’m sure as I process and think about the experience many more will pop up!). Here are some of them:


  • Preparation is crucial. Prepare, prepare, prepare – when you think you have prepared enough, put the presentation down for a few days and then prepare some more. Try to anticipate the questions that will be asked and ask yourself if you’d know the answer (thanks Dawn Haynes for the tip)
  • We can be our harshest critics. And I don’t think that is an entirely bad thing
  • You don’t need to know all the answers. But you will need to know the material. Being humble and admitting you don’t know the answer to a question is much better than the alternative
  • You are the expert in your own experiences – don’t be afraid to share them with the authority that you have (thanks James Bach for your feedback)
  • Ask for feedback. Learn from your mistakes. Improve on your qualities. There’s always room to improve.
  • Focus on your motive. Why are you presenting that specific topic? Remember that when you are about to quit, or too nervous, there is a reason you are doing this, and whatever it is, it is worth it! Keep at it.
  • Those who were trying to help me told me it will get better with time, the more presentations you do the easier it gets. I don’t know that yet, but I’ll let you know when I do!

Test Art…

And finally here are scketchnotes from two very talented testers that pretty much summarize my talk better than I could ever do:

Finally, I just wanted to encourage everyone out there that has an idea or an experience (good or bad) worth sharing – to get out there and to do it. I was absolutely out of my comfort zone presenting, and if I can do it, believe me, anyone can! And if you need help, drop me a line, I’d love to help you on your journey.

Let’s Test – It Is All About The People

There20140604-214842.jpg are lots of great blog posts about Let’s Test 2014 appearing every day, and a common theme between them is about how Let’s Test is about conferring with other like minded testers.

I had heard about how much happens in the corridors, over lunch and dinner and in between sessions at Let’s Test. I was wondering if that was really the case and I am happy to report that it is just like that.

People seem to be so relaxed at Let’s Test that sharing ideas, experiences and challenges seems to just happen.

Let’s Test prides itself about being a conference for testers by testers, and one of their stickers read: Because people matter. The whole conference is about getting people to talk. The fact that we are all stuck in a resort far from everything for 3 days helps a lot! There is no escaping – not that anyone would want to anyway. I loved the fact that we had all meals taken care of, no planning required. All we had to do was to serve ourselves and chat some more.

A few things I was reminded of during my interactions with other amazing testers at Let’s Test:

  • Everyone has something to learn and something to share. At Let’s Test most attendees are eager to do both! Even the most introverted people are seated around a table talking testing
  • As soon as you start talking about your testing challenges with other testers you realize that you are not alone. Some challenges we face in our industry seem to be epidemic and the more we talk about them, the more we can use the power of the collective to try to solve them
  • You never know when you are going to have your next light bulb moment, so keep the interactions going, participating in the community, discussing and serendipitous learning moments will happen when you least expect!

I’m glad I made it to Let’s Test this year. Thanks to everyone that I had a chance to chat with. And I’m certainly going to be there next year again doing much of the same thing!

When do registrations open for Let’s Test 2015?!


Let’s Test – Here, Now and Us

So, Let’s Test 2014 is over. Much like Elvis, almost everyone’s left the building, only a few of us remain as we wait for our respective flights home.

I’m tired, and for those who have attended Let’s Test before you’d know why. But, although I’m tired, my mind is on fire going over all the events that took place over the past 3 days. Wow, was it only three days? Definitely feels like more! So instead of resting, I’m here writing this post (first of many I’m sure – I couldn’t possibly synthesize everything in one post) about conferring the context-driven way.

I arrived here on Sunday (May 25th) and I had a plan, I wanted to live blog some of the sessions I attended (following on Michael Larsen‘s footsteps), instead of just taking my usual notes on Evernote and keeping them for myself. Why not let others impart a little about what was going on here – after all last year it was me seating at my desk at work, following on Twitter what was going on in Sweden, hoping that people would keep tweeting and blogging about it. This year I was one of the lucky ones here and wanted to pay it forward.

Well that was the plan until I attended the first workshop of the conference on Monday morning: Steve Smith‘s on Managing Change: Knowing When and How to Intervene based on the Satir Change Model. Thanks Martin Hynie for the tip to attend this workshop, there were so many great workshops at the same time, chances were I was going to miss this one if you didn’t tell me about Steve’s presentation skills magic. One of the first things he did (after making everyone stand on their feet and make groups to introduce themselves) was to write this on the whiteboard:

20140528-234948.jpgWhich means: forget about where and how you are going to use this later, or anyone else – you are here now with the rest of us for a reason. Make the most of it. It may not sound like much, but the way Steve delivered it made me re-think my strategy at conferences. I often take lots of notes so I can refer to them later, which I often do. But sometimes I can do that to the detriment of actually participating fully on the session and taking it all in.

So, in true CD style, after I was presented presented with this new information I changed my previously designed script and decided to go the completely opposite direction: I decided not to blog live – or to take any notes for that matter. I was fully present at Steve’s workshop and entirely engaged in the activities instead. It was liberating and I learned so much about how to navigate through change, and how to be better at helping others too. I met a ton of amazing testers in that session that I’ve got a feeling I’ll be friends with for a long time.

The workshop was about change and how to cope with it. I learned lots about that. But I also learned from Steve that by being fully present and engaged on whatever you are doing right now can have a major impact in what you experience. I used to think that notes were going to help me remember what I learned, but what I realized was that by experiencing something fully I’d remember them just as much.

I still plan to share some of the learning I took away from Let’s Test, I still want to pay it forward. But I just had to adapt to a much better plan, instead of blindly following the plan I had set. Not only projects unfold over time in ways that are often not predictable, but also many other things in life too!

[Yet Another] 2013 Retrospective

Over the past few days I’ve been inspired by other testers who blogged about their 2013 retrospective. Seems like 2013 was a great year for testers and testing everywhere. This inspiration was all I needed to get my creative writing juices flowing again. I haven’t blogged in ages and you’ll see why below.

APRIL 2013

Critical Thinking for Testers and WeTest Workshop
In April 2013 I made a last minute decision to fly to Wellington, NZ to attend Michael Bolton’s Critical Thinking for Testers Workshop. There are certain courses that do not add much to what you already know. This course was not one of these!  I’m glad I made the journey to NZ as the course was very insightful and deeply impacted the way I test and see things. I was challenged and inspired by Michael. I was also very fortunate to be able to attend the Wellington Testers (WeTest) Workshop as someone cancelled last minute. WeTest is a LAWST style meetup where one person presents, followed by facilitated open season. Michael Bolton talked about Regression Obsession, a topic I was very interested on as back then I was working for a company that suffered from that, and I was trying to change it.

JUNE 2013

WTANZ Revival
After attending a couple of Weekend Testing Americas sessions at the fun hour of 3 AM on Sundays, I was persuaded by Michael Larsen to revive WTANZ, Australia and New Zealand’s chapter of Weekend Testing. With Michael’s help, and the support of many testers downunder, such as Anne-Marie CharrettDavid GreenlessRichard Robinson, Oliver Erlewein and most recently Dean Mackenzie (WTANZ’s newest co-facilitator), WTANZ re-started with a bang in June. We’ve had 6 session since June and have a great year planned for 2014! Stay tuned!

JULY 2013

I went back to NZ in July for the third Kiwi Workshop on Software Testing (KWST3). The topic was ‘Lighting the way: educating others and ourselves about software testing. Raising a new generation of thinking creative testers’. We all shared our experiences on educating other testers and ourselves. Yet another challenging and inspiring workshop!


Straight after KWST, came the second Australian Workshop on Software Testing (OZWST2). I attended the first OZWST in 2012 in Adelaide and was not going to miss the second, especially because it was in Sydney, just down the road from me. We had Rob Sabourin as the content owner and the topic was ‘Collaboration in Testing’. In true context-driven style we changed the format of the workshop a bit to suit the ER’s that were being presented and the attendee’s experiences.

Move to USA
Then it came the big one: after 16 years, it was time to say goodbye to Australia and move on to the land of opportunity! In August 2013 we moved to Miami Beach, FL and since then life has been just as chaotic as it has been fun!

Awesome Trinity of Testing
In August all the stars aligned over Madison, WI and three testing events happened back to back, with the main attraction being CAST 2013.

This was my first time ever at CAST. I was expecting it to be great, but it exceeded all my expectations. I met so many of my Tweeps there, people I felt I knew, however all I really knew was their icons on Twitter and a few 140 character long conversations. It was a surreal experience! To some I had to introduce myself as ‘testchick’ which was hilarious! Having a large crew from downunder at CAST also made it special. I planned to write a whole blog post about CAST this year but life got in the way. Also, thanks to my mentor and friend Anne-Marie Charrett I did a lightning talk at CAST about How to Introduce CDT in Factory Environments.  It was terrifying, but a challenge I needed to tackle as public speaking is not my strong suit. Luckily I didn’t pass out, or make too much a fool of myself and survived the experience with lots of lessons learned.

Before CAST, there was Test Retreat, a 2 day Open Spaces style conference where the attendees set the agenda. The topic was “Deliberate Practice”. And the day after CAST Test Leadership Camp took place. One lesson I learned is that 3 conferences in a row is probably too much! Especially when they are all collaborative conferences.

After the first day of CAST a bunch of us hit the Great Dane pub. There I cornered Michael Larsen and didn’t leave him until he decided to give me my Miagi-Do entry challenge. It was not the first time I asked, Michael is a busy man and I had asked many times before, however I wasn’t going to miss this opportunity! And it paid off, after doing the lightsaber challenge I did well enough to enter this not-so-secret society.


New Country, New Job
In November I started a new challenge, I took a job with SmartBear down in the Florida office. The first few months are always a massive learning curve, so I’m waiting to feel like I can keep my head above water – but you know how it goes in testing, that may never really happen!


Workshop on Self-Education in Software Testing (WHOSE)
And to close the year off I attended WHOSE in Cleveland, OH. This was by far the most challenging and mentally exhausting workshop I’ve ever attended. The aim of the workshop was to create a skills inventory for context-driven testers with the purpose of promoting self-education in testing. We covered a lot of ground in 2.5 days, we worked really hard! And every single one of us left with homework to be completed in the next few months. Watch this space, there’s something really cool being put together.

Phew, that is it, 2013 in a nutshell.

Wishing anyone that gets to read this a fabulous 2014!

Challenges of a Sapient Tester in a Factory Environment

I attended the Kiwi Workshop on Software Testing (#KWST3) two weekends ago. This is my second KWST3 post, and there are more to come!

My KWST3 Experience Report (ER) was about my journey from being a factory tester to becoming a sapient tester. There is another blog post coming out soon which will detail this journey, however today’s post is about some of the challenges I have encountered on the way, after becoming a thinking tester in a factory environment. I will discuss the challenges and some of the solutions that helped me.

Since becoming a sapient tester, I haven’t been so lucky yet to work for a company (or department, or manager) that fosters context-driven testing, hence I have been on a mission to try to help decision makers understand what they stand to lose if they continue on the path of factory testing. But it is not always easy, actually I won’t lie to you, it has not been easy once.

Resisting Change is Natural

Changes Ahead

When trying to implement any type of change it is important to keep in mind that people resist change, it is natural. Even talking about change can trigger reactions in people that are irrational and even unpredictable. Resistance to change is often related to fear of the unknown. Change often means people will have to get out of their comfort zones, and not everyone enjoys that. Some people just like to do things the same familiar way day-in-and-day-out. And lastly people are not aways motivated to change, mostly because they don’t believe there is anything in it for them.

Managers are often the catalysts for change, and I have found the road to implementing change from bottom up a bumpy one indeed for three main reasons:

  1. Lack of freedom to implement change, as management and/or stakeholder buy in is slow.
  2. Managers can be reluctant to implement change that comes from the bottom as they feel there is too much at stake. Arguments such as ‘if its not broken, why fix it’ are examples of such behaviours.
  3. Managers and/or stakeholders do not fully understand what we do. Hence they are not in a position to make an informed decision about changes to testing processes, which brings trepidation and insecurity, and they are again reluctant to change – bringing us back to point two and getting into a vicious cycle.

Lessons Learned

I am no expert in change, however in trying to influence to think about their testing processes and methodologies I have come across a few ways to approach people to talk about change in less threatening ways. Unfortunately I haven’t found a magic formula that works every time, and some of these have failed miserably in the past, but I’m happy to share them and you can analyse if any of them will work in your context:

Don’t Call it ‘Change’

The word ‘change’ carries so much stigma that I’ve found it best to leave it out of the conversation all together. When you approach a decision maker, try using words such as ‘ideas’, ‘improvement’, ‘revision’, etc.

Be Prepared

Think ahead of time about what questions they might ask, try to put yourself on their shoes and imagine what sorts of questions would they have? Write them down and have answers ready.

Start Small

Small changes are less threatening and therefore more palatable to most people. If you are lucky enough to have a maverick manager, by all means go for the big-bang approach, however if your decision makers are of the more conservative type start small. If the change you are proposing is massive, break it down into chunks and find what the logical fist step is and go for that one. For example suggest doing exploratory testing once a week or half a day every day. This way they’ll still have the execution rate of the scripted test cases they crave and you will have the opportunity to explore and at the same time gather important evidence you will need in future conversations.


Starting small is a compromise. Be prepared to compromise even more, it may be the only way to go. The important thing is to take steps (as small as they are) in the right direction. The only thing that is not OK is to stay stuck in the same place. Try to understand the reason behind the other person’s reluctancy. Is it time? Are they worried your testing will get delayed? Then maybe offer to try it for one week and have daily checkpoints with them.

Maybe they don’t know exactly what ET is and are worried you will not really test anything because you are not following a script and that you won’t achieve anything.  Maybe invite them to sit with you for one hour every day so you can show and explain how you do exploration. The point here is to be more then a tester, be an investigator, a psychologist, a diplomat and answer like a lawyer! Be creative, try new things and do not take no for an answer.

Gather Accurate and Systematic Evidence

Once you start exploring, ensure you do it in an organised way. Gather information such as defects and issues found and how these wouldn’t be found by following a script. Capture evidence of your explorations such mindmaps, diagrams, videos, anything you can use in the future to back up your case for exploration. A lot of the insecurity around ET relates to the lack of knowledge of what it actually is. To many, ET is synonym with unstructured, free-format testing – and it is up to us to change that mentality by presenting accurate and systematic evidence. With enough data to substantiate your ideas you should be in a better position to influence and pioneer change.

Be Patient

Remember, changing processes and mindsets takes time. Be prepared to be in it for the long run.

Find a Support System

The test community worldwide is a tight-knit group of people who are always willing to help and lend a hand. There are times when fighting the good fight alone feels too hard, however with the support and guidance of others in the community it is much easier to keep going. I felt like giving up many times, but people in my community supported me all the way.

If you would like to find out more, to discuss anything mentioned above, or if you’d like to get connected with someone in the test community email me and we can explore these ideas together.

3 Practical Takeaways from Playing the Dice Game

Last weekend (5-6/07/13) I attended KSWT3, the third Kiwi Workshop in Software Testing. It was an amazing experience to have 19 talented and passionate testers CONFerring together. There were so many take aways from those two action packed days, I have material to write a few blogs (and I will). Somehow the Dice Game takeaways were at the forefront of my mind, so my first KSWT3 blog post will be about that.

SmallDiceThis was my first time playing the Dice game. I had heard about it many times, so I was really glad when it was announced that after lunch we would have a chance to play it. Richard Robinson was the facilitator and I had two team mates sharing this momentous occasion with me: Jennifer Hurrell and Erin Donnell.

Games, puzzles and challenges are a staple in any good software testing conference, especially peer-conferences such as KWST. Maybe because it is such a great way to practice critical thinking skills, lateral thinking and (especially for me in this case) to get us out of our comfort zone – all very relevant testing skills.

I will not go into the detail about what the game is or how to play it, because if you are reading this blog chances are you are a tester, and if so you either know the dice game or, in the case you don’t, you should find someone that can play it with you. I’m not going to spoil the fun!

What I AM going talk about are the three life skills I learned from playing it, which relates to other games and challenges also. Overall, I learned much more than just to play the Dice Game during that session. I learned the power of harnessed frustration, the hinderance of perfectionism and the benefit of team work.

The Power of Harnessed Frustration

I can’t deny, the Dice Game frustrated me. I sat there trying to work it out, and tho in the begining it was fun, after some time trying to figure it out I was ready to throw that pile of dice as far as I could!

Frustration is an emotion us testers know well. It is a powerful emotion and we can let all that energy go to waste or we can let it be a trigger to do something about the situation. For example, when we feel frustrated it is a great time to defocus. I found out that I can focus really well, and sometimes when I focus too much I can get tunnel vision, so I’m now consciously defocusing especially at work, but also in other situation too. Next time frustration hits, I’ll remember it as a trigger to defocus, stand back and see the bigger picture.

Anne Marie Charrett has a great post about defocussing if you want to read more.

The Hinderance of Perfectionism

I am a competitive perfectionist, which at times can be a good thing, but sometimes it can also be a hindrance. In this case it was a hindrance because I wanted to crack the game, I wanted to beat it, I didn’t want to fail, and that added to the frustration. Soon this became a cycle, the more I wanted to crack the game the more frustrated I became, which made me want to crack the game more, which made me more frustrated… Well you get the picture.

Perfectionists know that tho it is often a good thing to want things done well, to want to excel in what you do, however we must also remember that to try to achieve perfection in any project (especially in testing) is not an achievable goal. A more achievable goal is to strive to be a skilled and professional tester instead, one who is always learning and becoming better.

The Benefit of Team Work

I had the benefit (and pleasure) to play the dice game in a team of three. We decided in the beginning that we were going to play together, instead of against each other. Hence we were ‘thinking out loud’ throughout the game and as we took turns rolling the dice we also explained why we were doing what we were doing.

I found that playing it in a team setting certainly made it more fun, and I have no doubt that we found the answer within 30 minutes only because we were sharing our thoughts and feeding off each other’s ideas. It was a true example of when 2+2=5.

That is also true in testing. I find that testing in a team where we are openly sharing ideas, collaborating and using team work doesn’t only make testing more fun, but it is also much more productive as we leverage of each other’s strengths. As Kaner and Bach stated in Testing in Pairs:

“Based on our (and others’) observations of effective testing workgroups at several companies. We noticed several instances of high productivity, high creativity work that involved testers grouping together to analyze a product or to scheme through a test or to run a series of tests. We also saw/used it as an effective training technique”

I am definitely adding more pair testing to my daily testing routine, be it testing with another tester or even pairing with a developer, creativity and ideas can flow more freely when we join together with other brilliant minds!

So all in all it was a great experience to play the dice game. I learned life skills that I have been using since and am looking forward to keep using them and getting better at them also.

IMG_1974 IMG_1973

Weekend Testing ANZ is Back!

Earlier today Weekend Testing ANZ was re-ignited. A global group of 19 tester came together to test, share and learn. It was a truly amazing experience. 

It was my first time facilitating a Weekend Testing session, so I was nervous to say the least. I was unsure if anyone was going to turn up at all, and if anyone did, if the session was going to be productive and worth while. It was at the forefront of my mind that the session happens on  the weekend, and people have lots of things to do and places to be and they were all choosing to be here – so the minimum I could do was to put up a fun session for those who chose to give up 2 hours of their weekend to be here. 

A lot of planning went into it. I started thinking about mission, charters and applications over one month in advance. I had the help of many experienced testers in the planning stages, which helped tremendously. Special mention to Michael Larsen the founder of Weekend Testing Americas who is experienced in facilitating Weekend Testing sessions and guided me through the whole process. 

There were many others who provided encouragement and support, and there were a lot of people twitting about the session, which helped the attendance too! Thanks to everyone who one way or another helped make this session happen! 


ImageFor those who don’t know what Weekend Testing is, it is a global community of testers that get together over Skype, mainly on weekends to test, practice exploratory testing, share their knowledge and learn from others. The typical structure of a Weekend Testing session is as follows:

  • 5 min introduction
  • 10 min setting the mission and charter(s)
  • 50 min testing
  • 50 min debriefing

During the Testing stage, participants follow the mission and charter and test the application. Testing can be done individually or in pairs in separate chat sessions over Skype. Questions are asked, defects reported and discussion begin to emerge. 

At the Debriefing stage, participants discuss their findings with the mission/charter in mind. 

For more information and to find out about next sessions check Weekend Testing’s website and follow @WTANZ_@WTAmericas,  and @WeekendTesting on Twitter. 


For this session the mission/charter was testing using Oracles. As we didn’t have test cases, formal requirements or any other information deemed necessary by some to perform testing, the focus was to use Oracles to help in identifying issues and guide the test. 

As defined by Michael Bolton: “An oracle is a way of recognising a problem” and are also principles that “like all heuristics, are fallible and context-dependent; to be applied, not followed”. Interesting discussions emerged based on this topic, and participants highlighted that combining oracles when trying to put a case forward (i.e. bug advocacy) could help make a stronger point. 

The role of bias was also discussed in the context of using Oracles, as well as using personas testing in conjunction with Oracles. 

The strengths and weaknesses of the application were mentioned, and many participants showed frustration with the website’s UI, especially during account creation. There was also confusion as to the application’s purpose – was it a news aggregator or a mail client? The website’s documentation didn’t offer much help. 

The transcript and more details about this session can be found here.


Nervousness aside, I had fun at the session. I have learned that no matter how much you prepare in advance, that these sessions are dynamic and that we cannot always foresee all issues that could happen (i.e. technical issues I had just before the session was about to start). It is good to plan, but we need to be prepared and embrace the unexpected. And that goes for other testing too. That is another reason why meticulously preparing extremely detailed test cases ahead of time can potentially be an futile exercise, as only when we sit in front of the application, with mouse and keyboard at hand will we really know what needs to be tested. We cannot foresee many of the scenarios to be tested in advance. 

I also love these sessions as it is a place where testers are not judged and are free to make mistakes, to ask questions and to learn by experience. Everyone in these sessions are eager to learn and share, from the least to the most experienced. And every time I join in I learn something new – that is the beauty of Weekend Testing!

Stop Ignorance in Testing

Scripted testing… There are so many things wrong with it, its hard to know where to begin. Many test experts and prolific bloggers have written about this theme, therefore there is an abundance of literature about topics such as scripted testing vs. exploratory testing out there.

The highest form of ignorance is when you reject something you don’t know anything about. Wayne Dyer

ST is like an old wives’ tale, an urban legend, something that gets passed down from generation of testers to generation, and gets propagated and perpetuated due to the ignorance of testers everywhere. I was once an ignorant tester myself, who like many others learned from another unenlightened tester that the way to test is to write countless numbers of test scripts, with detailed steps, which will be diligently reported upon daily and you will get a gold star if you execute the pre-set quota of test cases for the day.

In this day and age however, there is no excuse to be uninformed about anything, which is why it shocks me how many testers still don’t know there are alternatives to scripted testing, especially here in Sydney.

This week I had coffee with a ‘seasoned’ tester, and the conversation about exploratory testing came up. This tester had heard about it, but like many others, had assumed that it was just ad-hoc-free-for-all testing. So I started asking questions about the validity and pitfalls of scripted testing with them. I find that this topic comes up very often in conversations with other testers, and I feel I’m repeating myself constantly, as I never pass up the opportunity to talk about context-driven testing, exploratory testing, and other fun topics like that!

Like I said in the beginning, there is plenty of information on the web about why scripted testing is not the way to better testing. Below is a list I had on Evernote, which I usually send on an email to testers that are interested in learning more about ET:

Every time I have an opportunity, I attempt to stop ignorance in testing. I chat and challenge testers that are still on the dark side. The list proposed above is just a starting point for testers interested in learning the craft of testing, for those looking for alternatives to what they know, deep down is fake testing!

Should Testers Learn to Code?

I attended CITCON Sydney 2013 this last weekend. Let me start by saying that if you haven’t attended one, you don’t know what you are missing out! These conferences are held all around the world and they are a great forum for idea exchange. If there is one happening near you, I strongly suggest you attend it!

The creators describe CITCON as:

The Continuous Integration and Testing Conference, a world-wide series of free Open Spaces events for developer-testers, tester-developers and anyone else with an interest in Continuous Integration and the type of Testing that goes along with it.

CITCON 2013CITCON 2013 Sessions

In a nutshell, you show up on a Friday night, and after a brief introduction to how CITCON works (by the way, it is pronounced ‘kit-con’!) everyone present has the opportunity to suggest topics. After the topics have been suggested by all interested in doing so, we all vote for topics we’d like to attend. Hence the agenda for the conference is set by the attendees. What a genius idea!

Should testers learn to code?

In one of the sessions I attended, the topic of programmers learning to be better testers came up. As far as I could tell, the room had more testers than developers, I’d say 2:1 ratio. Hence when this subject came out no objections were raised and almost everyone agreed that programmers could be better at what they do if they became better testers (or learned to think a little more like testers). However, when the reverse argument popped up it was a different story altogether.

It was interesting to see how testers reacted to the comment that we could become better testers by learning  to code. There was an interesting debate among the testers presents, some were in favor, others were not.

As a testers who knows a bit about coding, I find that after I learned to program I was able to find different types of bugs, to communicate in more meaningful ways with developers and to automate a few repetitive tests for myself and my team. In my opinion the time I spent learning how to code was time well spent.

During that CITCON workshop, someone raised a very valid point saying that we are all in this together, we (meaning testers and developers) should have the bigger picture in mind (i.e. the product we are delivering, the customer and the users). Therefore its not only important for developers to learn better testing skills, but it is just as important for testers to learn coding skills.

It is intriguing to me that developers in the room seemed OK with with fact that they should learn testing skills, however the same was not true for all testers. I don’t want to generalise here, the sample population from both industries in the room was extremely small, nonetheless this is not the first time I hear this argument. And I believe there are good arguments going both ways.

Some good testers cannot code

I once asked Elisabeth Hendrickson this very question and she said that she does not believe every tester should know how to code. Elisabeth wrote an interesting post about this topic, and in it she expressed her views that there are very good testers out there who cannot code:

Testers who specialize in exploratory testing bring a different and extremely valuable set of skills to the party. Good testers have critical thinking, analytical, and investigative skills. They understand risk and have a deep understanding where bugs tend to hide. They have excellent communication skills. Most good testers have some measure of technical skill such as system administration, databases, networks, etc. that lends itself to gray box testing. But some of the very best testers I’ve worked with could not have coded their way out of a For Loop

So like anything else in context driven testing it depends!

Not all testers should HAVE to code

Now, let me clarify a very important point. I am not a developer, never been one, nor do I want to be. I know how to code well enough to help me be a better tester, however that does not make me a developer by any stretch of the imagination. There is an important distinction between testers having to code and testers knowing code. Clearly, not all testers should code.

However in my experience, knowing a programming language helps a tester get a better perspective when testing. It helps facilitate dialog between testers and developers and it comes in handy more often than not. Michael Bolton’s post At Least Three Good Reasons for Testers to Learn to Program: tooling, insight and humility. It provides compelling arguments, worth reading.

Not all testers enjoy coding

I am a tester, and I enjoy the challenge and the craft of testing. I learned a bit of JAVA and C# at uni, and since then I decided to brush up my skills, and I’m currently working towards a JAVA certification. I have been able to use the skills I’m learning to simplify testing tasks, such as writing Selenium scripts for data creation and regression checking.

However I enjoy coding. An argument I have heard is that not all testers enjoy coding, and that is OK. Testing skills and programming skills are very different, however the question here is: just as programmers who learn better testing skills become better programmer and better team members, wouldn’t the same be true for testers that know how to code?

Of course, as with anything in testing, it depends. It depends on the person, on the type of testing they are doing, on the application they are testing.

Increased employability 

Finally, as Elisabeth Hendrickson explains in her post, 79% of testing jobs advertised in the USA require some form of programming skills, from basic to advanced. Up to 90% of testing jobs in agile environments require the same skills. Elisabeth concludes that at a minimum professional testers should know SQL.

Inevitably, testers that wish to continue to be current and competitive in the international job market, will need to learn at least the basics a programming language, weather they like it or not.

Look at race car drivers for example. They are not required to know mechanics or engineering, however you’d be hard pressed to find a race car driver and does not know the basics of mechanics and that is not interested in how his car works. They do not need to be fully qualified mechanics, but they know they are the ones racing the car and sooner of later they’ll need to troubleshoot issues they encounter on the racetrack. The more they know about engines, the earlier they can detect issues and relay them to the mechanics team. In the same way, testers do not need to know how to code, and there are great testers out there that don’t. However software is our craft, it is our race car’s engine, and if we don’t know the first thing about how it runs, we could be missing an opportunity to become even better at what we do. And if there are good testers that don’t know how to code, imagine how much better they could be if they did.