QA Organization Transformation

CaseStudyLast Mile has been engaged with an end to end IoT services provider, providing a roadmap and putting in place the building blocks for an effective QA organization. We have been engaged with them, helping align their testing of the Server release, and later putting in place an end to end test mechanism which cuts across Apps, Server and Devices.

A little bit of a background.. our client is the world’s most trusted and globally connected platform for the internet of things. Their mission is simple. Helping their customers get more out of life. Their platform integrates Life products like cameras, security devices, nursery products from a variety of manufacturers that they have now acquired. Their ecosystem spans the entire connected world, from devices (like Cameras, Firmware which works on several  devices), a distributed Server and Apps that allow the human experience.

 

Our key goal was to bring in an effective QA organization to bridge some of the key challenges that they encountered in the release of different product elements

  • Integrate the test teams spread across different locations;
  • Integrate the testing that was done at local level (device, server, apps) to ensure an integrated release
  • Bring in a structure to the QA organization to provide better release decision making
  • Standardize the processes and tools used to promote reusability where possible
  • Bring in focus on Customer Experience on the products developed and shipped out
  • Bridge the gap across Dev/Test and Various teams through effective co-working

 

Post our engagement, over the last 10 months, what we have achieved, and now in the position of enabling them to take it forward, was to ensure that

  • We defined the QA organizational framework for the teams
  • Enabled cross functional skills (functional, non-functional, automation and user experience testing) through
    • Skill Upliftment and Cross Skilling
    • Building Domain Expertise by closely working with Dev and device & firmware teams
    • Scaling the team by adding skilled resources
  • Defined how to arrive at release readiness objectives and promoted the body of knowledge to be enhanced through checklists & Release notes
  • Brought in Test Accelerators
    • Automation – Focus to bring in Automation of Server API queries for Functional and performance testing using Jmeter. Current Test Suit has 600+ test scripts
    • Tools –Testlink as a Test Management Tool (from excel based test cases), Jmeter for Test Automation, JIRA for Defect Management
  • Improved Test Coverage to include Sanity, Regression, Functional and Non-functional with focus on E2E perspective
  • Brought in the concept of “adequate” documentation with the focus on ensuring key documents are created and managed
    • At the Requirements level
    • At the Test level
    • For the Release