Skip to main content

Your tests tell the real story.......

Projects and products are increasing in complexity. That’s life at the moment, ask our many financial institutions. Change embracing methodologies, legacy systems interfacing with new development mean that most systems of documentation struggle to keep up, coupled with the belief that being ‘agile’ means that even basic documentation is frowned on.

We, as testing focussed individuals are perfectly placed to bridge that gap. An organic set of acceptance, exploratory and automated tests which flex with changing business needs and technical design modifications, document the flow of the project and patterns emerge for key decision points. Coverage areas, non-coverage areas, tests which prove legacy behaviour, new tests added, and old tests retired as functionality has changed all add context to the project or product story.

This is also a slight riposte to the ‘automate everything’ theory, clicking ‘go’ is not a facilitator for analysis or learning. Learning is gained from a stepped approach, I have fielded arguments that it’s a little heavy, but I think in terms of story telling a little effort goes a long way.
  • Mind Map – for each item of work (user story for example), create a mind map, nice and simple. This is your one stop shop for recording business needs, test ideas, caveats, technical details and anything else you wish to record. This tells the project story at a high level without too much detail and acts as a prompt for conversation. Print off and make it visible every so often.
  • Test Management Tool – this usually raises a few eyebrows, given the current mood in a lot of organisations. I see tests being created all over the place in text files, spreadsheets and a plethora of other tools. If your organisation has a Test Management Tool, don’t fight it and use it to store acceptance tests. You get free version control and safer storage in the main. Creating your business driven, scenario based tests and storing means you have one place to begin collaborating from.
  • Automation – You might have many automated tools, for creating data, setting environments to the right state and tests themselves. Regardless of tool choices, your tests should tell the story from a business facing point of view. Better to say ‘Create an Online Customer with a Balance of £50’ rather than the ‘Insert Cust into Offshore DB’. And comment your code; the amount of non commented test automation code I see is frightening.
 So, tell the story of your project or product and use the above thoughts to radiate that information. The team will thank you for it as future decision making is much better when history and context are simple to find.


Popular posts from this blog

Wheel of Testing Part 2 - Content

Thank you Reddit, while attempting to find pictures of the earths core, you surpass yourself.
Turns out Steve Buscemi is the centre of the world.

Anyway. Lets start with something I hold to be true. My testing career is mine to shape, it has many influences but only one driver. No one will do it for me. Organisations that offer a career (or even a vocation) are offering something that is not theirs to give. Too much of their own needs get in the way, plus morphing into a badass question-asker, assumption-challenger, claim-demolisher and illusion-breaker is a bit terrifying for most organisations. Therefore, I hope the wheel is a tool for possibilities not definitive answers, otherwise it would just be another tool trying to provide a path which is yours to define.

In part one, I discussed why I had thought about the wheel of testing in terms of my own motivations for creating it, plus applying the reasoning of a career in testing to it. As in, coming up with a sensible reflection of real…

Getting started with testability

At TestBash Netherlands, I said that, in my experience, a lot of testers don't really get testability. I would feel bad if I didn't follow that up with a starting point for expanding your mindset and explicitly thinking about testability day to day, and making your testing lives better! 

In large scale, high transaction systems testability really is critical, as compared to the vastness and variability of the world, testing done within organisations, before deployment, is limited by comparison. We need ways to see and learn from the systems we test where it matters, in Production.
Being able to observe, control and understand is central to testing effectively, and there are loads of resources and experience reports out there to help. I was/am inspired by James Bach, Seth Eliot, Matt Skelton, Sally Goble, Martin Fowler and a little bit of PerfBytes/Logchat, so lets see if it works for you! 

Overall Model:

Heuristics of Software Testability by James Bach…

The Team Test for Testability

You know what I see quite a lot. Really long-winded test maturity models. 

You know what I love to see? Really fast, meaningful ways to build a picture of your teams current state and provoke a conversation about improvement. The excellent test improvement card game by Huib Schoots and Joep Schuurkes is a great example. I also really like 'The Joel Test' by Joel Spolsky, a number of questions you can answer yes or no to to gain insight into their effectiveness as a software development team.

I thought something like this for testability might an interesting experiment, so here goes:

If you ask the team to change their codebase do they react positively?Does each member of the team have access to the system source control?Does the team know which parts of the codebase are subject to the most change?Does the team collaborate regularly with teams that maintain their dependencies?Does the team have regular contact with the users of the system?Can you set your system into a given state…