END TO END / FIELD TESTING
Step-by-Step Mobile Application Testing Process followed:
1. Identified Types of Testing – It was a mandatory requirement that the application has to work in all iOS and Android devices as the end consumers can have diverse devices. To ensure that the app worked in all the devices we selected combination of manual testing, automation testing and testing in cloud simulator – Device Anywhere.
2. Performed Manual and Automated Testing –The development process followed for this project was SCRUM and each sprint was two weeks long. Every two weeks development team delivered a logically completed product to the QA team and QA would run their test cases on the build. Regression was a challenge because in each build QA had to ensure that previously completed items were still working. To accomplish this, QA team had automated basic set of functionality using Experitest and ran the automation script on each build which saved good amount of time. We used JIRA to file and track defects.
3. Provided 24 hours of QA Support – We follow a SCRUM development model (QA team is integral part of the development team throughout the project). We provided 24 hours QA support during the development phase since we had onsite as well as offsite teams working on this project. This ensured timely and steady progress in the app implementation.
4. Beta Testing – After this initial setup, once the particular build was moved from the QA bucket, user acceptance testing was conducted for this QA/ST build. This was achieved by asking the beta users (a set of hundred students from the University) to browse every single page within the mobile app. This ensured that every bug was fixed before the app was released. And that the app captured all necessary features and functionality.
5. Performance Testing – The functionality, performance (stability, responsiveness, resource usage, stability parameters as per standards) and user interface for the delivered build was thoroughly tested.
6. Device Testing – The app was tested across multiple OS versions/devices using the Device Anywhere simulation tool and also physically tested in our dedicated mobile application testing labs.
7. Maintained Test Case Sheet –During the whole process the QA team maintained the test case sheet (with all functionality implemented), at last certified the build to release. The entire end-to-end mobile application testing process involved collective effort between onsite and off- site teams.
8. Generated Test Summary Report – Finally QA manager generated the test summary report. This is a management report which provides details of any important information uncovered by the tests conducted, includes assessments of the quality of the testing effort, the quality of the software system under test and statistics derived from incident reports. The report also records different types of testing performed and how long did it take to complete the testing. This helps to improve any future test planning. This final document indicates whether the software system under test is fit for use and has met acceptance criteria defined by project stakeholders.
This project was a good learning for our team and we were pleased to release the app successfully as planned.