Microsoft® SE: Page 3 of 3

Subtitle: 

Global Users, Global Testing

With no serious bugs or usability issues, Microsoft Security Essentials has quickly become a fan favorite.

Boston Globe: “Microsoft is now changing the game, the same way it changed the Internet browser business - by giving the software away.”

Houston Chronicle: “In the past, I've recommended AVG Free for those who want a no-cost security option. Given its light footprint, I think Microsoft Security Essentials is now the better choice.”

NetworkWorld: “Security Essentials has a pleasing interface, is simple to use, and has appropriate defaults. Its warning pop-ups let you deal with an issue quickly or dig in for details.”

The Register: “We gave the software a quick spin and found the initial install process quick and painless.”

With a community of 20,000+ testers, uTest is in a unique position to implement some unconventional QA procedures. Much like the uTest Bug Battles – a competition where testers compete to find bugs in today’s high-profile apps – the final phase in Microsoft Security Essentials’ testing would involve some outside-of-the-box thinking. To be certain that Microsoft Security Essentials contained no fatal flaws, Shie issued a “Showstopper Challenge” to his testing team: Find a showstopper bug (a bug that MUST be fixed prior to launch) and win a prize.

“The bar was set incredibly high for this release,” said Shie. “But the uTest community performed as expected. It was interesting to incentivize a release like that – fun for the testers and reassuring for our development team.”

Summary
With the help of a dedicated uTest project manager and a select group of QA professionals, the Microsoft Security Essentials team was able to confidently launch a high-profile app on an aggressive schedule. Completing five distinctly different test cycles, Shie was able to achieve an even greater degree of testing coverage – and greater confidence before launching.

As future projects arise – whether they’re mobile, web or desktop applications – Microsoft now knows it has an efficient, low-cost way to complement their existing QA efforts.

In their own words..."

On uTest complimenting the beta phase:
“Beta’s are not as effective as other methods of testing. An issue must affect a large amount of users in order for it to be discovered and reported by a beta community. The uTest community, on the other hand, was able to review the software from a tester’s point-of-view, and that made all the difference in the world.”

On increased testing coverage with uTest:
“We wanted to test across every possible angle, which is impossible if you’re relying solely on your in-house team. We needed exposure in areas like South America and China, and uTest enabled us to achieve this with relative ease.”

On crowdsourced software testing:
“It was really quite impressive to watch bugs and feedback come in from all over the world. The theory works!”

- Shie Erlich, Testing Manager, Microsoft

Pages