Archive for August 1st, 2011
The Client
Our client
is a leading e-Marketing firm that develops websites for top 100 cosmetics companies.
The Challenge
Short release cycles and rapid turnaround of new site functionality meant an increased demand for QA testing. Our client needed to augment their IT department by building a QA team capable of meeting tough deadlines. Since most of the development is done during the business hours, our client wanted to test after developers were gone for a day making it possible to have a 24/7 model that minimized downtime and allowed the project team and developers to review test results and bugs when they are back in the office the next day.
The Solution
They turned to RentTesters offshore U.S. Trained overseas testing experts in Canada, India, and Ukraine. To establish the most effective way to utilize and manage the offshore team, RentTesters placed a QA Lead at the client’s site to manage our offshore team and to provide a face-to-face focal point that could interface with the project team on a daily basis.
Our certified QA engineers and worked with the project team to implement a test strategy using QA best practices to ensure quality was embedded in the development process. We designed several test efforts for their validation to ensure that all aspects of the website were thoroughly tested within each release cycle:
- Black Box Testing
- White Box Testing
- Test Automation
- Load & Performance Testing
- Functional Testing
- UI Testing
- Beta Testing
- Database Testing
- Migration Testing
- Installation Testing
- Compatibility Testing
- Usability Testing
- System Integration Testing
- Exploratory Testing
The Benefit
- Improved Customer Experience – Great employee retention. Over 90% worked with us for over 3 years, and continue on supporting our clients with 24/7 On Demand access to diverse skill set in an as-needed basis
- Reduced Costs – Significantly reduced the QA cost by having access to experienced engineers at 50% of typical U.S. salaries.
- Expertise – RentTesters’ experience with all aspects of the testing process ensured a successfully managed and executed validation process.
Customer Quote:
“We needed to manage our project costs and On-Demand was the way we accomplished that. RentTesters resources integrated with our onsite teams in a very cohesive way. Our onsite QA Project Manager was great to work with.”
—QA Manager, Enterprise Quality Assurance
For more on how RentTesters can help your company improve testing processes, check us out online at www.renttesters.com or call 1.888.789.1482.
The Client
E-Marketing firm that specializing in building sites for the automotive industry.
The Challenge
The Client wanted their site ready for high traffic during Super Bowl weekend when there the count of simultaneous users was expected to exceed current performance capacity. Limits and performance benchmarks during expected peak use needed to be established to allow for adequate performance tuning because the competition is just clicks away. Without enough in-house testing resources, an outside vendor who could perform on-demand Performance, Load, and Stress Testing services was needed.
The Solution
Our client turned to RentTesters for our extensive experience in Load, Stress, and Performance Testing as well as system tuning. Because the site was built on Flash, we proposed to use Load Runner for Load and Stress testing.
The first step was to create use cases and user flows for testing. We developed eight test cases to be tested and our Performance Test Engineer developed data-driven scripts in Load Runner using isolated excel spreadsheets allowing us to run tests with different data sets. Once the scripts were prepared, a test back-end environment was set up to mimic production capacity along with several cloud hosts to generate client requests. We started running scripts with 10 users and added users incremented by 10 every two minutes until peak was reached allowing us to see performance degradation. We captured:
- Response times for entire transaction.
- Server metrics such as CPU utilization, memory usage, and queue length.
- Relevant database metrics such as CPU utilization, memory usage, recompilations, buffer cache, hit ration, and queue length.
RentTesters identified several performance bottlenecks and memory leaks that were addressed by development team. We collected:
- Transaction response time.
- Number of users passed/failed.
- Number of transactions passed.
The rest results allowed the team to performance tune so that when we re-ran the scripts to validate performance, scalability, and stability of the application for 15,000 concurrent users.
The Benefit
- Improved Customer Experience – Client team was not impacted by the test, since all testing was done on RentTesters servers.
- Reduced Costs – Client saved time and money on load and performance testing leveraging on-demand services.
- Expertise – Client successfully handled more than 230,000 requests on the super bowl week end.
Customer Quote:
“RentTesters help us prepared for more than 230,000 requests on the super bowl week-end.”
—Development Manager, eMarkerting firm, California.
For more on how RentTesters can help your company improve testing processes, check us out online at www.renttesters.com or call 1.888.789.1482.
The Client
Our client is an SQA department in a large Fortune 100 company.
The Challenge
Our client lacked an effective tool to manage their testing process. The testing team decided on HP Quality Center, but wanted a certified HP Business Partner to help them create a Proof of Concept, present to Senior Management, acquires Licenses. As well, a consultant experienced with Quality Center installation, configuring, and training was critical to be able to launch the tool prior to a large upcoming project.
The Solution
RentTesters provided a soup to nuts solution for the client involving a Validation Package with e-Signature for Quality Center to provide an efficient means for automating the management of the validation testing process within a regulated environment while delivering all of the benefits of using Electronic Signatures. The implementation of the Validation Accelerator provided measurable efficiencies into the validation process and streamlines the supporting test activities through automated test management.
We included a services engagement to configure Quality Center for our client’s particular compliance practices particular workflow in support of their specific validation testing process. The Validation Package for Quality Center included:
- Client Specific project template configuration, including workflow and eSignature implementation, validation documentation, and validation services.
- Computer System Validation process Integration, including adaptation of tool to existing client validation processes, development of supporting procedures (i.e. QC project implementation procedure), as well as training, maintenance, and support.
The Validation Accelerator leverages a comprehensive set of validation documents to accelerate the validation effort, including:
- Validation Master Plan
- Configuration Specification (CS)
- System Requirements Specification (SRS)
- Installation Qualification (IQ)
- Operational Qualification (OQ)
- Performance Qualification (PQ)
- SOP checklist
- Traceability Matrix
- Final Validation Report
In addition, RentTester’s provided a turn-key validation project including validation documentation as well as consulting services to execute the validation scripts. Through our powerful solutions, we helped our client increase productivity and quality through benchmarks and best practices that are driven by our workflow in Quality Center.
The Benefit
- Improved Customer Experience – Easier FDA audits with secure and easily accessible records. Support internal workflows for document review and change control. Manage all quality assurance documentation centrally.
- Reduced Costs – Past experience means faster implementations. And, faster implementations mean fewer hiccups and downtime – all of which safe money.
- Expertise – Leveraging a certified Business Partner means getting a Quality Center expert who has access to a large network of HP expertise.
Customer Quote:
“We knew RentTesters was well versed with Quality Center use and implementations. That was definitely a big part of our success in obtaining budget approvals and getting up and running on time.”
—QA Manager, Enterprise Quality Assurance
For more on how RentTesters can help your company improve testing processes, check us out online at www.renttesters.com or call 1.888.789.1482.
Case Study: EDI Testing
The Client
Our customer is a large
pharmaceutical company delivering on biotechnology solutions for more than 35-years using human genetic information to discover, develop, manufacture, and commercialize medicine that treats patients with serious or life-threatening conditions. They are among the world’s leading biotech companies, with multiple products on the market and a promising development pipeline.
The Challenge
Our customer processed 844 Product Transfer Account Adjustments, 845 Price Authorization Status, 849 Response to Product Transfer Account Adjustment, 850 Purchase Order, 867 Inventory, and 810 Invoice were going through migration and needed to re-test trading partner connectivity between their largest customers McKesson, AmerisourceBergen, and Cardinal Health.
The Solution
RentTesters performed a Free Rapid Assessment and created a list of maps to be tested and data to be exchanged allowing us to identify the scope of work. We then worked with the Trading Partners to propose test scenarios, dates, and identified a point of contact to work with at the Trading Partner’s site.
RentTesters helped develop, implement, and manage the approach to maximize EDI testing results. Our experience developing solutions for every kind of EDI testing project included:
- Trading Partner Testing Services – Implementing a robust testing process to establish a successful trading relationship with EDI partners and ensuring that EDI communications are successful – both the connections and at the document level validating that everything conforms to highly regulated format requirements.
- On-Demand – Supported Trading Partner testing allowed a cost effective way to maintain the resources focus on critical projects.
Our testing involved receiving EDI transactions from Trading Partner test environments to our client’s test environment where data was validated on both ends. We verified:
- Map variations.
- Positive and Negative test scenarios.
- All inbound and outbound transactions.
- Incoming data and data integrity the data base.
- Security testing and disaster recovery testing.
The Benefit
- Improved Customer Experience – Because of our client’s high volume of transactions, they were able to save time on error checking and transaction validation in production.
- Reduced Costs – The value of outsourcing the EDI Testing allowed a rapid return on investment. Our client was able to integrate with their trading partners seamlessly and pain free while saving money and increasing the productivity of their business unit.
- Expertise – RentTesters’ experience with EDI testing process ensured a successfully managed validation process with all Trading Partners. Our resources EDI knowledge were applied to manage the testing processes ensured our client avoided the pitfalls of trying to take a learn-as-you-go approach to achieve success with valuable Trading Partner relationships.
Customer Quote:
“My team was able to focus on their critical deliverables while RentTesters managed and tested the EDI transactions. They worked seamlessly with our Trading Partners.”
—QA Manager, Enterprise Quality Assurance
For more on how RentTesters can help your company improve testing processes, check us out online at www.renttesters.com or call 1.888.789.1482.
Case Study: Iphone App Testing
The Client
Our client is a Global leader in Thin Computing.
The Challenge
Our client was developing an iPhone application that would allow users to remote desktop to any physical or virtual desktop. They needed a partner with iPhone app testing expertise who also had a deep understanding of Usability Testing and App Store certification testing experience.
The Solution
They turned to RentTesters for our extensive iPhone app testing experience and services. We began by a Free Rapid Assessment to understand the application’s functionality and processes. Our solution provided for both offsite and onsite resources with testing to be done at our San Francisco testing lab with two on-site days per week at the client site.
Our team manually tested functionality based on the requirements in the test environment to verify that all functions are implemented correctly and according to the specifications. We analyzed and recorded all test results.
We developed a set of features and test cases to be verified and created a test case management system that allowed our customer to monitor the progress of testing. We developed and executed following iPhone app test cases:
- Functional Testing – Ensuring functionality of each function specified.
- Performance and Scalability Testing – Backend applications will need to manage the traffic of multiple iPhone devices at the same time. RentTesters will identify all the load issues and will help make system more scalable.
- Usability & Compatibility Testing
RentTesters effectively verified the effectiveness and Usability on the various devices including interoperability with other applications running on the iPhone device. RentTesters certified the iPhone Application on iPod/iPhone/iPad:
- UI Response – Verify response of each function and measure the performance of each response.
- Settings response – Verify all settings available for the application and test the functionality of each setting.
- Crash Points – Identify all crash points, and will work with development team to resolve them.
- Low Connectivity – Validate the behavior of iPhone App in Low connectivity mode and verify proper behavior.
- Response Memory Handling – Measure memory usage of the iPhone application and identify all memory leaks
- App Sleep Mode – Test the application response in the sleep mode.
- Accelerometer – Ensure that iPhone application properly responds to rotations.
- Battery Usage – Measure the battery usage and will provide feedback on increasing battery life.
- Retrials in Case of network disconnect – Test behavior in case of network disconnect.
Execution
- Build Acceptance Testing – Performed after every code drop to verify that the application build is stable and ready to be tested.
- High priority defect fixes – Verify after build acceptance suite execution is complete.
- iPhone App Test case Execution – High priority test cases are executed first, followed by medium and low priority test cases.
- iPhone App Regression Testing – Verification of application functionality ensuring that new code did not break the existing functions and the system is not adversely affected by any code or configuration changes.
- iPhone App Ad-Hoc Testing – Testing random actions in an attempt to break the system. Such executions include (but are not limited to) inputting invalid values, malicious input, and unnatural navigation.
- iPhone App Compatibility Testing -Test in the following OS/Device combination:
| 3.x | 4.1 | 4.2 | 4.3.2 | |
| iPad 1st gen | X | X | ||
| iPad 2 | X | X | ||
| Edge | X | X | ||
| 3G | X | X | ||
| 3GS | X | X | ||
| iPhone 4 | X |
The Benefit
- Improved Customer Experience – Leveraging a testing partner with extensive experience with App Store and iPhone testing streamlined the development, testing, and release process. It also helped to ensure the bottom line – excellent app reviews.
- Reduced Costs – Another advantage of partnering with a testing expert with iPhone app experience is saved time and money and releasing on time and within budget.
- Expertise – Our iPhone app testing experience allows us to hit the ground running meaning our clients don’t have to deal with a long ramp-up time.
Customer Quote:
“We really need a testing partner who not only had experience with iPhone apps, but who knew how to navigate the App Store certification process. RentTesters helped us through the entire process.”
—CIO, iPhone App Development
For more on how RentTesters can help your company improve testing processes, check us out online at www.renttesters.com or call 1.888.789.1482.
