The challenge
Raízen needed to validate that ShellBox worked correctly in real-world operating environments, ensuring stability and reliability over critical features linked to login, payments, and user experience inside the mobile app.
The main challenge was to run tests against real usage scenarios distributed across different areas of Buenos Aires (AMBA), covering:
- multiple payment methods,
- different devices,
- a variety of operating systems,
- transactional validations,
- and compliance with business rules in real operational contexts.
The project also required complete traceability over incidents, evidence, and execution results, allowing monitoring and analysis of the application's behavior during the different field test cycles.
The solution
From Qualis Lab we assembled a specialized QA team focused on mobile validations and real transactional testing on ShellBox.
The engagement included:
- Daily transaction execution replicating real usage scenarios.
- Login and in-app payment process validation.
- Testing over multiple payment methods.
- Verification of business rule compliance.
- Operational validations across different AMBA areas.
- Testing on different mobile devices, brands, versions, and operating systems.
- Three complete field test cycles.
- Implementation of a live management and reporting solution built by Qualis Lab.
We also developed and deployed an internal management and reporting platform that enabled:
- Real-time execution logging.
- Capture of evidence and failures.
- Centralized bug management.
- Full traceability by cycle, scenario, device, and location.
- Operational tracking of incidents detected during testing.
This approach made it possible to validate the complete end-user experience in real operational and consumption scenarios.
Results
- Successful validation of critical features in real environments.
- Greater stability over mobile login and payment processes.
- Early detection of operational and transactional incidents.
- Increased coverage over devices and real usage scenarios.
- Improved traceability and tracking of bugs detected in the field.
- Better visibility over app behavior across different areas and operational contexts.
- Strengthened quality and reliability of the ShellBox experience.
Technology
- Mobile Testing
- Field Testing
- Functional Testing
- Payment Validation
- QA Mobile
- Real Device Testing
- Fintech QA
- Bug Tracking
- Test Evidence Management
- Android Testing
- iOS Testing
- ShellBox
- Real-Time Reporting