Training New Testers Remotely – Part 3 of 3

Thursday, June 3rd, 2010

I was impressed by what Cong had done. I thought his summary was thoughtful and showed understanding of the concepts. I went through bugs and reviewed the answers to each of the 4 questions. I learned a few things about the details of our product that I didn’t know before.

I picked up the phone and called him to talk to him about his findings. I gave him credit for doing what he did. When discussing the bugs I asked him if he could do this process for every bug or if it would be too time consuming. His answer was something to this effect “Well even for bugs that I thought were trivial I still learned something from talking with the developer so I’ll have to use judgement in the future”

In discussion of one particular bug I asked him to think about whether it was something we should write down as a test idea for future release and also to help future testers learn about the product. I didn’t give explicit directions/instructions on whether this is an expctation/requirement for him. He will have to figure that out for himself and decide where the info would go.

One point we discussed was that there was no response to my initial request until it was done. Throughout the week I wasn’t sure if he was putting any effort into it. I’m also at fault for not setting expectations for an initial response. We both learned a lesson from this and can now communicate more effectively in the future.

I feel like now when I respond to his daily updates we can speak a common language and have a common understanding.

Here is my summary of this interaction

What went well

  • Attempting to make Cong feel safe and that I wasn’t threatening or unhappy with his work. I am his boss’ boss afterall and I had never given him a direct request before
  • Clearly set completion date
  • Set out expectations on how the end result should be delivered
  • Gave some local options for getting help
  • Follow up via phone to discuss findings and do a little bit more coaching

What could be improved

  • I could have picked up the phone in the beginning and explained the exercise, following up with the email writeup
  • In my initial request I could have asked Cong to respond and either accept, reject or negotiate my request and give him a date to do this by
  • I could have followed up with him mid-week to see how things were going with the task
  • I could have set up a skype call with him

Things to remember when coaching remotely

  1. Look for things that will teach you about something of interest to you – not only the person who you are coaching
  2. It’s important to set two deadlines – one for the initial response/commitment and one for the actual deadline
  3. If you’ve not met the person or had very little interaction with them make sure they don’t feel threatened
  4. Give the person options for getting local help
  5. Follow up via phone/skype, give feedback watching for anything from #1

I’d love to hear any comments on this situation or thoughts/experiences you have with remote coaching/training

Bugs in the Wild – BrainMine

Wednesday, June 17th, 2009

I was using a mind mapping tool called BrainMine. I found a bug that exhibited itself if you printed the mind map and then edited and/or moved a node afterwards. What do you think is going on underneath the covers here?  Would your automation have caught this? How would you automate this test?

The video is here

I wasn’t up on my BB Test assitant skills when this video was taken so you’ll have to infer my troubleshooting process from what you see in the video.

Bugs in the wild – Outlook – Useless Error message

Wednesday, February 27th, 2008

What do I do with this information as a user? I don’t know how to troubleshoot this – nor do I have time to. Why can’t it tell me what RSS feeds it’s having a problem with.Useless Outlook Error Message.JPGOf course I searched for the error message using google. :) I searched for “outlook RSS feeds error” and “RSS feeds error 8004010F” neither of which yeilded a link to a solution.

Observation Skills – team activities

Sunday, January 27th, 2008

I like to do testing exercises with my team. Below is a list of links to various activities I have done with the team at some point in time. I usually turn these things into an interactive session. I thought I would share my list with you in case you want to do some of them with your team (or by yourself)

Observation skills
Which way is she spinning?

A similar picture

Cartoon
Powers of Observation

Activity – watch videos and answer questions at the end
New TV Show

Observation – General Link
http://www.smart-kit.com/scategory/brain-art/>Brain Art

Are the two blocks different colors?

How many differences can you find?
Spot the Differences

Activity for Team
How many F’s?

Activity
Optical Illusion

Cartoon
Perception

Video
The Amazing Color Changing Card trick

Where  possible with these exercises I get the team write out their observations before we go into discussions about what they see. This is to help prevent certain biases from showing up – mainly confirmation and hindsight biases

Confirmation bias, according to wikipedia, is a tendency to search for or interpret new information in a way that confirms one’s preconceptions and avoid information and interpretations which contradict prior beliefs.

Hindsight bias, sometimes called the I-knew-it-all-along effect, is the inclination to see events that have occurred as more predictable than they in fact were before they took place. Hindsight bias has been demonstrated experimentally in a variety of settings, including politics, games and medicine. In psychological experiments of hindsight bias, subjects also tend to remember their predictions of future events as having been stronger than they actually were, in those cases where those predictions turn out correct.”

When we did these exercises it made for some really interesting discussions – especiallly the spinning dancer and the different color blocks.  Doing these exercises can help you become aware of (and possibly manage) confirmation and hindsight bias.

Places you might find more information and exercises
Inattentional Blindness
Selective Attention

2 hour parking challenge

Tuesday, January 8th, 2008

Michael Hunter, of Braidy Tester fame, posted a challenge on his blog. He showed a parking sign photo and asked how many different ways it could be interpreted. I decided to take 45 minutes during one of our weekly test team meetings and try it out. What the hell does this have to do with testing you might ask? Well - thanks for asking. Here is how it relates for me

  • Idea generation – we always need to generate new ideas for testing
  • Clarification – requirements are mostly ambiguous and this was practice at clarifying them.
  • Sharing and discussion of ideas – “It could be interpreted this way” which lead to someone else saying “Yes and this way too” - Team work, supportive attitude with a focus on sharing.
  • Time boxing so we don’t get carried away - Important in testing and just about anything else
  • Coming up with alternate solutions/problem solving – It’s good to be seen as a problem solver instead of “Bearer of Bad News”

Needless to say we had a great time doing this activity. I time boxed the idea generation to 15 minutes and then had about 15 minutes of discussion.  We used index cards to write down our ideas. We went around the room and each person read an idea from their card. We ran into some duplicate ideas but that was ok – we weren’t focused on having every idea be unique. The puprose was to put on our “thinking caps”

Now it’s easy to take an idea and tear it to shreds.  To quote Edward De Bono in The Thinking Course “..critical destuction of one hypothesis has never produced a better one. It is creativity that produce the better hypothesis.” As a follow up challenge I asked the team to come with a sign that wasn’t ambigous. We explored some great ideas and had a great discussion. A few of the ideas and designs came out to be really clear and (mostly) unambiguous (I’ll have to get them and post it with this article.) The discussion was going so well that it actually went over time and into lunch.

Here are the results which were summarized by Aqiqul Hoda and Michael Hetmanczuk. The participants were Adam White, Alan Walker, Ali Khan, Aqiqul Hoda, Christy Gnanapragasam, Herb Bal, Joseph Kubik, Michael Hetmanczuk, Mortaza Abhari, Thomas Yook and Zhe Chen

1. Can park for 2 hrs from Mon to Sat between 7AM to 6PM.
2. If you have Zone 4 Permit you could park as long as you want.
3. No Limits of parking on Sundays and Holidays.
4. No Parking for Zone 4 permit vehicles.
5. No parking on Sun and holidays.
6. No parking in the Night.
7. Zone 4 permit vehicles parking only between 6 PM to 7 AM and Sun and
holidays.
8. 2 hr parking this side of street.
9. 2 hr parking both side of street.
10. 2 hr parking from this sign onward.
11. Parking at 6PM allowed can go past 6 PM for 2 hrs.
12. Parking once a day only.
13. Zone permits vehicles parking only after hrs but not on sun and
holidays.
14. Zone permit sign maynot be related to parking.
15. 2 hours limit parking between 7am and 6pm on days except Sunday and
Holiday.  Above has exception by Zone 4 permit means Zone 4 permit could
park at anytime
16. Board number 2: hour parking
17. Is the #2 the sign ID or does it indicate 2 hours?
18. Can we park during other ours or only 7 AM – 6 PM
19. Where is the sign?
20. Does it mean I can park from 6 AM – 7 PM?
21. Hol?  What qualifies as a holiday?
22. Does this apply to bikes?
23. Except sun/holiday means on Sunday and holidays – no parking at all
24. On sunday/holiday you can park all day
25. On sunday/holiday the 2 hour limit is lifted, but parking is only
allowed from 7 AM to 6 PM.
26. Zone 4 permit means you can park all the time.
27. Zone 4 permit means you can park 7 AM – 6 PM.
28. Except Zone 4 permit means you can’t park at all if you have a zone
4 permit.
29. Except Sun/Holiday: means only those with a zone 4 permit can park
on sun/holiday.
30. Could be interpreted as 1 hour parking.  The #2 could be something
else, i.e. street number, parking spot.
31. Except sun-holiday: starts on sunday, ends on a holiday.
32. What is a zone 4 permit?  Do I automatically get one?
33. Does that mean I can park long on sunday-holiday?
34.  Maximum of 2 hour parking allowed between 7 AM and 6 PM except
sunday or holiday.
35. If you have zone 4 permit pass you can park the car anytime.
36. Within this zone, a maximum of 4 vehicles are permitted to park.
37. The #2 indicates it is a second sign that indicates “hour parking”
zone between 7 AM and 6 PM except on sundays, holidays.

CAST Conference coming up

Friday, January 4th, 2008

It’s been a while since my last post. I’ve got lots to write about and not enough time to do it.

 The one thing I do want to mention is the upcoming CAST conference which will be held in Toronto this year. Some of the best minds in software testing will be at this conference. Speakers like Michael Bolton, Robert Sabourin, Jerry Weinberg, Cem Kaner. Not to mention I’ll be doing a presentation as well :)

The full program is available on the website – you can find it here http://www.associationforsoftwaretesting.org/drupal/conference

Make your reservations soon – Jerry’s tutorial is selling out quickly (if it’s not already sold out)