It's one thing to apply Agile principles to a new project or to a small initiative. It's another thing entirely to apply these principles to a large organization with many moving parts, focused teams, and existing products. How do larger companies take agile and actually "make it scale?"

In today's show, Matthew Heusser and Michael Larsen go in-depth with Yoav Ziv to discuss the advantages and pitfalls of applying Scaled agile approaches to an organization and examine how these changes are having an effect on organizations and testing teams.

As the weeks turn into months and COVID-19 infections continue in many places around the globe, plans for Career Development and conferring with others are transforming to meet the unique challenges. In this episode, Smita Mishra and Anna Royzman join Matt Heusser and Michael Larsen to talk about ways that conferences and other providers of learning opportunities are coming together to address ways in which to create meaningful learning opportunities and the fact that going to a conference in person and attending a conference online from home are not at all the same thing. We also bring back the immediate news portion of the show with a quick discussion of both the technology and ethics of contact tracing and happily announce that The Testing Show will be moving to a two-week format starting in July.

It's tempting to think that, in an area like Software Testing, "it's all been done" in some ways or another. To say that there's some "secret weapon" out there can raise some skeptical eyebrows. Yet Maya Ben Lerner and Leandro Melendez both say that there is indeed an area that can unleash great power if approached from the right angle. We don't want to spoil the surprise... well, OK, we do a little bit. That angle is infrastructure automation. Even with that, there's a lot of meat to discuss, so join Maya and Leandro as they talk with Matthew Heuser, Michael Larsen, and returning guest Mike Lyles on how to make your environments stand up and help you take control of your testing.

In this "COVID" edition of The Testing Show, Matthew Heusser and Michael Larsen welcome James Back to discuss the state of testing and the push towards DevOps. Are we missing something with this push? Are we losing the actual testing that is needed? Are there testers legitimately excited about these changes? Have a listen and find out!

With Shelter at Home orders in place in many cities and entire countries due to COVID-19, we are experiencing an experiment not yet tried in our history. Many are working from home who have not had the opportunity to before and it is creating some unique challenges.

Matthew Heusser and Michael Larsen welcome back Yadira Arevalo and Elle Gee to have a frank conversation about the stresses and realities of working remotely. We talk about both the challenges and opportunities with so many working remotely, as well as ways to do the best work possible and cope with what may be a new normal.

In what is proving to be a challenging month for most of the world, we decided to tackle the topic of SAFe, basically the Scaled Agile Framework.

Matthew Heusser and Michael Larsen have a chat with Jennifer Fawcett about SAFe. What is it? Why does it matter to your organization as a whole and to testing and testers in particular?

We've heard of Performance Testing but what is Performance Assurance? In a One on One conversation, Matt Heusser talks with Leandro Melendez about the difference between Performance Testing and Performance Assurance and how the changing landscape of systems and infrastructure makes Performance Assurance an area worth paying attention to.

As it is a new year, we decided it would be interesting to discuss the hiring of testing talent as well as being the testing talent and looking to be hired. What do recruiters actually look for? Do I have the right skill set? What do hiring managers actually look for? How important is a culture fit and why does it matter? Also, what are the areas that we can't fake on our interviews?

These questions and many more are being asked by Matthew Heusser and Michael Larsen as they talk about the details of interviewing testing talent with Yadira Arevalo and Elle Gee.

Agile Testing has now been around in some form or another for two decades, yet it seems that what people are calling Agile Testing and what Agile Testing actually is are still two different things. Why is there such a gap in both understanding and practice? Matt Heusser and Michael Larsen welcome Lisa Crispin, Elle Gee and Jamie Phillips to discuss exactly that. In the process, we get into how Agile is practiced in both small teams and in larger organizations, where it is practiced well, and some of the common pitfalls even the best of Agile organizations still face.

In many organizations the security testing is often done by an outside group or entity, often late in the project and with very little interactions by members of the main team. This month, Matthew and Michael are joined by Uri Bar-El, a cyber and security expert who has seen a few things in a twenty-year plus career. We are also joined again by Elle Gee to have a look at the unique challenges we face in the cyber realm and things we can do to meet those challenges head-on.

Coverage is a broad area and asking ten people will probably get you ten different answers. We didn't ask ten people but we did ask three and this podcast sums up that discussion. Join us as we delve into the topic of coverage with Perze Ababa, Elle Gee, Matthew Husser, and Michael Larsen to see the good, the bad, the ugly, and the just plain necessary of coverage as it relates to software testing.

For this episode of The Testing Show, Matt and Michael step back and invite Elle Gee, Jessica Ingrassellino, Rachel Kibler, Claire Moss, and Lihi Segev to share and discuss their own journies in the world of technology and the various and varied experiences they have had and highlight areas that have been successes in varied places like Australia, Israel and the U.S., as well as areas where we as an industry can do better.

How often do we look at an application and wonder what the people who were designing it were thinking? When jumping through hoops that seem odd or out of place, it's easy to ask "how can this have been designed this way?!" If it makes you feel better, there are people who research the areas of Usability and User Experience (UX) specifically. Michael Larsen talks with Charlotte Dijksman of Test Birds and Nick Leal of Qualitest about the good, the bad and the just plain out there of Usability and UX.

This time on The Testing Show, Matthew Heusser and Michael Larsen welcome Mahesh Chikane and Smita Mishra to talk about the unique challenges and opportunities facing the software testing community in India.

SAP (Systems Applications and Products in Data Processing) is a large suite of software products best described as being an Enterprise Resource Planning (ERP) system. Many large scale companies use SAP to cover a variety of processes related to accounting, finance and commerce, as well as a variety of other functions. While a tester may not be working directly with it, it's a very good bet that if you visit sites that are large enough, you are absolutely interacting with a SAP system(s) somewhere. For this episode, Matthew Heusser and Michael Larsen welcome Simon Evans to talk about all things SAP, the ways in which it shows up in so many places, and ways that testers can level up and come to grips with this large ecosystem of inter-related systems.

We are all familiar with stress testing when we put an application under load or negative conditions but what about when we put ourselves under those same conditions? Rachel Kibler and Elle Gee join Matthew Heusser and Michael Larsen to talk about this more human element of software testing that often gets overlooked and how applying it to our everyday testing activities might help us do better testing overall.

DevOps is a common term and one that seems to be hard to pin down or to define. Additionally, it seems that for many, the idea behind DevOps seems to be an elimination of testers or testing. Our guests Lisa Crispin of mabl and Jessica Ingrassellino of Salesforce.org are here to discuss how software testers are indeed important in the process of DevOps and some ways we can get involved in ways we may not have considered. A key element is Observability (#olly) and we get into the details of considering observability as part of the DevTestOps equation.

Over the past several decades, we have witnessed many changes in the way that we do things. Catalogs are mostly things of the past, as are phone books, a crew of phone operators and a variety of other services that we may often take for granted today. Each of those transformations, however have gone through their share of growing pains to bring us where we are today and truth be told, there’s still plenty of room for improvement. For this episode, Matt Heusser and Michael Larsen welcome Shachar Schiff and Gerie Owen to talk about the benefits of digital transformations, where things have gone well, where things have gone not so well and a few surprises along the way. In addition, they discuss the continuous nature of digital transformation and the software testers unique role in that process:

Artificial Intelligence and Machine Learning are the hip buzzwords at the moment and if you listen to enough people, they are the hot new technologies that are poised to make software testers obsolete. Is that accurate? Well, yes and no. More of a “kind of but not really”. Today, Matt Heusser and Michael Larsen chat with Daniel Geater and Jason Arbon to get to the bottom of this “AI and Machine Learning” thing. Is it real? It sure is. Is it going to transform testing? Potentially yes? Should testers be scared? Absolutely not. There are opportunities galore with this AI/ML world and Daniel and Jason are happy to tell you all about them.

Today as we see the ideas of server-less architecture, cloud-based implementations and more distributed services come into play, the way that we think of performance and performance testing is changing. Nevertheless, it’s still critical and can be a make or break element of a site or applications suffers or demise. To talk about the ways that performance impacts testers as well as ways to discuss the broader implications of the changing performance space, Scott Barber and Caleb Billingsley join Matt Heusser and Michael Larsen to chat about ways to have conversations with those who make the larger decisions. Also, the conversation covers ways to give those who are not as familiar with the performance space a point of reference to get in and start tuning up their performance game.

Over the years, a variety of metrics have been gathered to measure and determine how well or how poorly the processes of software quality and software delivery have progressed. Sometimes these metrics are helpful. A lot of the time they are benign or irrelevant. Sometimes they can actually be hurtful or stymie progress, which defeats their purpose altogether. Matt and Michael welcome Tom Cagley and Nausheen Sayed to discuss meaningful metric, what they are, how to find them, how to make them work for us, and we discuss some metrics train wrecks.

As the software delivery process matures and grows, a variety of teams are forming and becoming part of the everyday testing landscape. These teams may or may not resemble anything that many testers are familiar with. New roles and responsibilities are coming into play, with many software testers taking on roles such as Scrum-master, Release Manager, Product Owner and other positions that would have been seen as out of the ordinary for testers a decade or so ago. The role are blending, the responsibilities are blending, so how does a tester determine what the best course of action is and how to participate in this brave new world? Perze Ababa, Paul Grizzaffi, Matthew Heusser, Michael Larsen, Gerie Owen and Peter Varhol all gather together to consider what makes for good testing teams and good teams in general.

August is a busy time of year for software testing conferences (not to mention conferences in other industries). This month, we decided that, with everyone heading off to conferences hither and yon that we would dedicate a show to the topic, and we have done exactly that. Anna Royzman (Test Masters Academy), Claire Moss (DevOps Days) and Mike Lyles (Software Test Professionals) join us as guests in their capacity as conference organizers, speakers and attendees (not necessarily in that order) to riff on Conferences and Conferring with Matthew Heusser, Michael Larsen and Perez Ababa. Want to know where to go, what format to take part in or if you want to try your hand at speaking/presenting? We’ve got something for all those bases!

Like many software users, it’s a good bet that you received a lot of pop-up messages or emails telling you that you had to log in to various sites and read a number of new statements and provide Consent to companies to let you use their services. If that’s how it seemed, you are not alone, there was indeed a lot of that, and it was for a very specific purpose. After Many of 2018, individuals and companies doing business with or using data belonging to anyone residing in the European Union had to, by law, make it clear that users had rights concerning how their data was being used and that they had choices as to what they could do about it. These changes are called The General Data Protection Regulation, or GDPR and is now law regarding data protection and privacy for all individuals within the European Union (EU) and the European Economic Area (EEA).

On today’s show, we welcome Daniel Leigh who helps us understand GDPR a little better, what the ramifications of these new laws are, what they mean to companies doing business in or dealing with data relating to anyone residing in the EU, what they mean for software development and data protection and privacy, and how software testers can help make a difference in this new reality of consent and privacy.

Additionally, in our news segment, what would it have cost various companies like Yahoo, eBay, and Equifax, based on how they responded to their data breaches in the past, were they subject to the new GDPR rules?

It seems that "Automating Everything" is an implicit of not an explicit goal in many organizations. In the process of trying, many projects fail in accomplishing this goal. Our guest Graeme Harvey gives a popular talk about this and takes an interesting journey on approaching and discussing how to do this via comparisons to the book and movie "The Martian". Graeme joins Perze Ababa, Matt Heusser, Michael Larsen, Gerie Owen and Peter Varhol to riff on ideas from the book and movie and how to use these principles in our everyday automating experiences.

Also, in our news segment, it seems Elon Musk is realizing that "automating all the things" can actually be a detriment as it has been a major cause of impact to the delayed delivery of the Tesla Model 3.