iBETA CASE STUDIES
We have worked with some of the biggest brands in gaming and technology since 1999 covering a wide scope of testing and certification services. We’re excited to share some of our case studies with you.
A shoe brand with an international web presence was creating a complex shoe customizer page for their website. The new page allowed customers to select the style, material, pattern, and color for a pair of shoes and displayed their choices in real-time on a rotating 3D model of the shoe. Customers could also customize the shoes with short messages or their own uploaded images.
This new feature needed to be tested on the localized websites for 13 different countries, each with its own set of payment and shipping options.
iBeta proposed a comprehensive test matrix to cover the functional points of the customizer, a wide selection of desktop and mobile web browsers, and a full array of order flow payment and shipping options.
We worked with the client to maximize coverage across the targeted countries within the available budget and timeframe.
iBeta completed all the testing on time despite having to rework the test execution schedule to accommodate delayed delivery of some functionality.
A company created a system to sell movie tickets via mobile and web and needed help testing a mobile app customer interface, a web customer interface, a tablet-based Point of Sale system, and the seamless integration of them all.
iBeta provided an ongoing test team focused on each product. All of the iBeta testers were fully integrated with each Agile development team, but they are also cross-trained on the other products which allowed for nimble allocation and re-allocation of test efforts as needed. The iBeta team enabled the company to maintain a high cadence of releases compromising quality or diminishing the experience of paying customers.
A clothing company specializing in B2B sales was expanding the capabilities of two brand websites to include B2C sales. As part of this change, websites would be shifted to hosting on a new eCommerce cloud platform.
The websites needed end-to-end testing of the new shopping cart order flow and extensive desktop and mobile browser compatibility testing. Both sites needed to be tested within the same tight window of time before launch.
Given a short testing timeframe, iBeta proposed an approach to maximize testing time and minimize the time spent creating test documents. iBeta’s test plan focused on exploratory testing for the majority of site pages with scripted testing focused on certain high-priority shopping cart flow options.
Extensive site-wide testing was executed in the most popular browser platforms while higher-risk eCommerce functionality received compatibility-focused coverage across a much wider selection of platforms.
A software security company was developing a mobile analytics SDK for iOS and Android to help app developers identify and prevent fraudulent behavior. They needed to have the behavior of SDK code tested for compatibility with a variety of different mobile devices. They also needed to test the stability and resilience of the SDK code and its communications with the back-end server in the event of improper integration.
The company provided basic Android and iOS test apps which implemented all the SDK functionality with a simple UI.
The iBeta test team created an exhaustive set of test scenarios and executed them on a collection of iPhones and Android phones. The test team discovered numerous crash scenarios and isolate definitive steps needed to reproduce each.
Then the iBeta team took the source code of the test apps and rewrote the instructions implementing the SDK functionality to trigger all the failures and error conditions that might be caused by mistakes during app development.
iBeta’s testing helped the company ensure their SDK code could safely handle anything that the end-users and developers could throw at it.
A client created an application for managing state wide childcare entitlements and needed to verify that it met state-mandated specifications. This required the simulation of more than 4000 mobile devices to check children in and out of daycare, conduct daily administrative activities, and keep records of all interactions for later reporting.
We worked with developers to create the use cases, code them, and execute them as part of test scenarios. We also did a data load to simulate one year of operation for roughly 100k families.
We found a series of issues with load balancing, server instance provisioning (specifically, fewer CPUs provisioned than had been planned with an attendant reduction in capacity), and user access (users were looking through much more data than necessary).
The final version of the system exceeded all specifications and could handle up to 30,000 children being actively checked in and out of daycare in addition to 4000+ staff users conducting day-to-day operations.
A large eCommerce company was developing a new mobile app store and needed it to work flawlessly from day one. This required that the app store work for the users on their chosen Android devices and to include a fully functional developer portal for future application purchases.
iBeta provided a full test team to plan and execute end-to-end testing of the developer portal throughout the development process.
iBeta built an extensive library of Android devices customized to the exact needs of the app store launch. The selection covered different manufacturers, OS versions, carrier networks, and physical components like screen aspect ratio and pixel densities. Using actual devices enabled thorough, deep testing that could not be matched by emulators.
A major cable television network was concerned that their properties and brand were not being shown in the best light when displayed for download on electronic sell-through platforms, for viewing on video-on-demand on cable/satellite providers, or for streaming on over-the-top video distributors.
The network needed a partner who could monitor the presentation of their brand across the huge array of platforms where their shows are featured including web, iOS/Android, Apple TV/Roku/Fire TV, game consoles, and cable/satellite set-top boxes.
Before working with iBeta, the network tried working with a different vendor. The network was not able to consistently get the precise, detailed feedback and flexible reporting they required until they worked with us.
Over the course of a year, iBeta performed a comprehensive audit of 40 different shows. Each show is audited on 40 different viewing platforms.
Each audit included screen captures of all relevant screens. The captured images were reviewed by our testers to verify that show imagery was correct and pixel-perfect, show description copy appeared exactly as it was written, and network attribution and branding was properly displayed.
iBeta delivered detailed checklist reports with annotated screen captures for the audited platform, summary reports focused on platforms with issues, and overall summary reports with statistics to track error trends between audits.
A marketing agency for one of the largest consumer electronics companies in the world was preparing to roll out a high-profile 6-week digital advertising campaign. They would be launching rich media ads on 90 websites in 14 markets around the globe.
To further complicate matters, the campaign displayed 3 different user experiences based on the capabilities of a wide range of desktop web browser versions and mobile browser/OS versions.
To satisfy the famously high standards of their client, this agency needed a testing partner that could rapidly ramp-up a massive, around-the-clock test team to quickly cover a huge testing matrix for each revision during development and live launch on every publisher website.
iBeta was able to quickly configure secure lab space to meet ultra-strict confidentiality and data security requirements, and build a team of 70+ testers and test leads working around the clock within two weeks.
The test team assisted with the full life cycle of the advertisements from FPO assets to live launches of various localized builds, verifying the visual display, compatibility, and rich media functionality.
These tests required the test team to be flexible and meet strict deadlines with fast turnarounds for a high volume of tasks and assignments.
A facial recognition software development company needed to stand out amongst its competitors and chose iBeta’s biometrics certification program to accomplish this.
iBeta conducted a number of spoof tests to try to thwart the facial recognition technology. Using artifacts like digital and paper photos, lifelike dolls, high resolution video, and realistic latex masks, the team confirmed that the liveness detection was fully functional and resistant to attack.
The company was the first to ever receive level two Presentation Attack Detection (PAD) certification for their secure facial recognition software and is now considered to be a global standard in biometrics authentication technology.
A world-renowned ICT company needed third-party testing of their palm vein authentication technology to gain EPCS compliance certification.
In accordance with the Electronic Prescriptions for Controlled Substances (EPCS) regulations set forth by the U.S. Drug Enforcement Administration, iBeta conducted rigorous testing of the company’s palm vein authentication technology. We employed a number of spoof tests including the use of topical lotions and variable skin conditions with great success.
The technology’s near-infrared light could accurately detect an intricate system of veins in the hand to determine a person’s identity without fail and is now used as part of a broader EPCS strategy by many different medical practices.