Tuesday, 31 January 2017

Getting started with testability



At TestBash Netherlands, I said that, in my experience, a lot of testers don't really get testability. I would feel bad if I didn't follow that up with a starting point for expanding your mindset and explicitly thinking about testability day to day, and making your testing lives better! 

In large scale, high transaction systems testability really is critical, as compared to the vastness and variability of the world, testing done within organisations, before deployment, is limited by comparison. We need ways to see and learn from the systems we test where it matters, in Production.

Being able to observe, control and understand is central to testing effectively, and there are loads of resources and experience reports out there to help. I was/am inspired by James Bach, Seth Eliot, Matt Skelton, Sally Goble, Martin Fowler and a little bit of PerfBytes/Logchat, so lets see if it works for you! 

Overall Model:

Heuristics of Software Testability by James Bach

http://www.satisfice.com/tools/testable.pdf

In particular, the intrinsic testability of a system. I firmly believe that a system with high testability has high supportability in this regard. If you could build a system that gave those with operational responsibility with the ability to observe, control and understand what was happening, they would be stoked right? 


Videos:

Seth Eliot introduces testing in production with some compelling examples


Sally Goble then talks about shifting testing away from current models and leveraging production:

Articles:

Perfect Testing 

Feature Toggles

https://martinfowler.com/articles/feature-toggles.html

Rethinking Pipelines



Data Driven Quality

Signal vs Pass/Fail

Ask for Testability - Interesting Idea on Scriptable API's to drive the product

http://www.developsense.com/blog/2014/05/very-short-blog-posts-18-ask-for-testability/

A Map for Testability - Visualising testability in early product conversations

http://www.a-sisyphean-task.com/2014/07/a-map-for-testability.html

Putting Your Testability Socks On - Analysis of the SOCKS testability mnemonic

http://www.a-sisyphean-task.com/2012/07/putting-your-testability-socks-on.html

Audio:





No comments:

Post a Comment