Home Automation: Performance and Reliability
Matter is a new and upcoming home automation framework and we are ready to provide testing and quality assurance service for the home accessories and application that support it.
Problem
Client had asked us to create a testing environment and take over the complete testing vertical of the company. Performance metrics, benchmarking, reliability and usage statistics were the deliverables required by the client. Testing environment had to cover a wide range of platforms including, iOS, watchOS, tvOS, Alexa, Google Home and Android. Testing lab had to be setup to including all the accessories and testing scenarios.
Solution
We leased a dedicated estate, setup a team and built the tools and frameworks to run the tests in automated environment and manual environment. We setup a lab with all the equipments in it. Lab was equipped to run isolated network tests without external interference.
Daily tests were run using our in-house testing software and frameworks that we have written specifically for software testing.
We created dashboard to show the performance and benchmarking metrics, memory usage on the controller, performance discretely for cellular, WiFi, Thread and Bluetooth. Every platform had it’s own set of dashboards.
Results
The team had tracked down and successfully fixed over 40 bugs in a span of 6 months. The end user experience had drastically improved.
The cost of testing was pared by 40% after 1 year.
The client has a now had a trustworthy partner to depend on test any new release. Feature testing does not take more than a week.
Technology
Python, Selenium
Xcode, iOS, Swift
Android Studio, Android, Java
JavaScript
Bash