12
Nov
14

UserTesting Launches Peek, A Free Service For Basic User Testing

Advertisements
02
Aug
11

Case Study: Mobile App Testing on Real Handsets


The Client

Our client is a leading iPhone app developer that introduces more than 100 different new applications a year. To keep up with its competitive advantage our client needed to release a quality apps to the market fast. With a lot of applications in the App Store and the ever evolving iPhone, iPod and iPad devices and OS’s, there is a huge burden on the company to test their applications on real devices connected to real live global network.

The Challenge

Prior to working with RentTesters our client worked with other mobile testing companies. There were two major problems with this approach, however. The first was the recruiting beta testers, you are not necessarily testing on all devices/OS, and recruiting process is slow and painful, and not always a good investment. The second issue was that there was no way to consolidate and leverage the mobile testing expertise aggregated over the years by the QA teams.

The Solution

RentTesters Mobile Testing Experts reviewed application and its design and requirements, and provided proposal with a test approach to a client. We leveraged our expertise in mobile application testing with:

Our team developed a set of test cases to ensure that mobile applications function properly on all supported devices/OS:

Our experts leveraged our proven methodology:

Define Testing Scope (Define a list of supported devices/OS/carriers)

Build Test Plan and Test Cases

Setup Test Environment (back end and devices)

Execute Tests

Review and work with dev team to resolve found defects

Re Test fixes

Create Test Summary Report

Obtain Quality Certificate

Our mobile QA engineers are well versed with various mobile platforms such as iOS, Android SDK, iPhone SDK, HTML5\CSS3, REST and RIM\BlackBerry and were responsible for:

  • Test on multiple iPod, iPhone and iPad devices
  • Create and execute tests for handheld devices
  • Construct test environments to simulate real world environments
  • Extract appropriate logs and gather diagnostic information for issues encountered during testing
  • Construct test cases for the defined test plan; modify the existing test cases as the test requirements change
  • Collaborate daily with the QA, Development, and Product team to ensure that quality standards are met
  • Use feedback from customer support to expand test scenarios
  • Assist product team in resolving layout and formatting issues (e.g. design, user-flow experience)
  • Research, identify, reproduce, isolate and report defects
  • Verify resolved defects against all applicable environments
  • Track and verify defects in Production with the help of Customer Advocates
  • Provide input/status updates regarding test progress/results on a daily basis

The Benefit

Our client releases their application to App Store, and all of their submissions were approved from the first submission and have 4+ stars in App Store with great reviews and feedback.

For more on how RentTesters can help your company improve testing processes, check us out online at http://www.renttesters.com or call 1.888.789.1482.

 

02
Aug
11

Case Study: iMany CARS Government Pricing Testing


The Client

Our client is a global company specializing in the development, production, and marketing of generic and proprietary branded pharmaceuticals as well as active pharmaceutical ingredients. Our client is among the top 20 companies and one of the largest generic pharmaceutical companies in the world.

The Challenge

Our client merged with another Pharma manufacturer and needed to verify and test combined systems and operations in the areas of Commercial Contracting and Medicaid Rebate processing into a single system for the combined companies.

The Solution

Our client utilizes the I-many suite of applications for contract management (I-many CARS, I-many Medicaid and I-many Government Pricing) and RentTester is the exclusive provider of Software Quality Assurance resources and is responsible for providing full time, day-to-day, on site and remote test support.

RentTester resources developed testing scripts and processes to merge iMany CARS Customer, Product and Contract data, automated membership loads and general data cleanup across the two companies. As well, we tested the merging of I-many Medicaid systems for Medicaid rebate processing.

  • Medicaid Rebate Testing – Validate transfer summary level data from one company’s I-many Medicaid system into our client’s I-many Medicaid system and use only our client’s I-many Medicaid system to manage this function going forward.
  • Commercial Contracting Testing – Validate that the project was to test transfer contract, customer, membership, eligibility and historical transaction data from I-many DPS system into our client’s I-many CARS system and use only the I-many CARS system to manage this function going forward.

RentTester performed an analysis of our client’s GPS system examining each requirement in detail. Our team produced a test plan/cases document to serve as the foundation for scope of the implementation phase of the project.

RentTester tested a full implementation of new compliance requirements into the I-many Government Pricing System.

Our deliverable included:

  • Test Strategy & Test Plan
  • Test cases and test scripts to test changes to existing price calculations:
    • ASP, AMP, NFAMP, PHS, FCP, IFF
  • Implementation testing of additional application functionality:
    • FSS module, Alerts
  • Enhancement and automation of data integration verification.
  • Data reconciliation between GP and source systems validation.
  • Historical data conversion testing.
  • Testing enhancements to existing interfaces to bring in new data fields.

The Benefit

  • Improved Customer Experience – Having in-house outsourced testing resources means that you have people familiar with internal processes who can ramp up or down according to your project needs.
  • Reduced Costs – Past experience means faster implementations. And, faster implementations mean fewer hiccups and downtime – all of which save money.
  • Expertise –RentTesters’ extensive experience with the Pharmaceutical and Biotechnology field means you can count on resources to come in and hit the ground running.

 

Customer Quote:

“We had a complicated merger and while we needed additional resources in testing, we couldn’t afford to lose time while ramping up new people. RentTesters’ experience with our processes and with Pharma in general was a great asset.”

—QA Manager


For more on how RentTesters can help your company improve testing processes, check us out online at http://www.renttesters.com or call 1.888.789.1482.

 

02
Aug
11

Case Study: Release and Configuration Management


The Client

A small start-up with 100 employees.

The Challenge

Our client need to successfully integrate two products after a merger acquisition – a Java/WebLogic Platform with Oracle Back End, JSP Front End product and a Windows based Visual Basic/C++ with ASP Front End product. Without an established release and configuration process, integration would be challenging to tackle. They needed a consultant to come in and help set up a process and strategy that they could take forward.

The Solution

RentTesters performed a Free Rapid Assessment and established a baseline for all subprojects that allowed us to assist the development team with creating a framework and then branch out the core files to head. Because releases must incorporate system changes and errors discovered by users and by hardware changes as well as new system functionality a solution was developed to include:

  • Procedures for branching, merging and labeling the code.
  • Build and deployment scripts and optimized them to the point of a one-click deployment. (Utilizing Visual Build for COM scripts and ANT for Java suite).
  • Policies and procedures for maintaining source control tool Microsoft Visual Source Safe.
  • Versioning scheme and release process.
  • Concepts of staging the code.
  • A lab for software compatibility.

The Benefit

  • Improved Customer Experience – Being a start-up, resources were lean and it made more sense to bring in an outside consultant with Release and Configuration Management experience to develop, create, and kick off a process that they could maintain internally for future projects. As a result the client gained a Streamlined Automated Release and Build and Deployment Process with a single optimally managed code repository.
  • Reduced Costs – Past experience means faster implementations. And, faster implementations mean fewer hiccups and downtime – all of which save money.
  • Expertise – Improved quality and productivity with automated software assembly processes. Client gained better visibility into projects for fast delivery of higher quality software as well as traceability across the software development lifecycle.

 

Customer Quote

“Without a robust Release and Configuration team, we needed a consultant with the right kind of experience and expertise to come in and develop something we could follow. RentTesters had a very doable solution for our team to follow.

—Director of Development


For more on how RentTesters can help your company improve testing processes, check us out online at http://www.renttesters.com or call 1.888.789.1482.

 

01
Aug
11

We are working on the content and will publish soon!

01
Aug
11

Case Study: Hybrid Offshore Delivery Model


The Client

Our client is a leading e-Marketing firm that develops websites for top 100 cosmetics companies.

The Challenge

Short release cycles and rapid turnaround of new site functionality meant an increased demand for QA testing. Our client needed to augment their IT department by building a QA team capable of meeting tough deadlines. Since most of the development is done during the business hours, our client wanted to test after developers were gone for a day making it possible to have a 24/7 model that minimized downtime and allowed the project team and developers to review test results and bugs when they are back in the office the next day.

The Solution

They turned to RentTesters offshore U.S. Trained overseas testing experts in Canada, India, and Ukraine. To establish the most effective way to utilize and manage the offshore team, RentTesters placed a QA Lead at the client’s site to manage our offshore team and to provide a face-to-face focal point that could interface with the project team on a daily basis.

Our certified QA engineers and worked with the project team to implement a test strategy using QA best practices to ensure quality was embedded in the development process. We designed several test efforts for their validation to ensure that all aspects of the website were thoroughly tested within each release cycle:

The Benefit

  • Improved Customer Experience – Great employee retention. Over 90% worked with us for over 3 years, and continue on supporting our clients with 24/7 On Demand access to diverse skill set in an as-needed basis
  • Reduced Costs – Significantly reduced the QA cost by having access to experienced engineers at 50% of typical U.S. salaries.
  • Expertise – RentTesters’ experience with all aspects of the testing process ensured a successfully managed and executed validation process.

Customer Quote:

“We needed to manage our project costs and On-Demand was the way we accomplished that. RentTesters resources integrated with our onsite teams in a very cohesive way. Our onsite QA Project Manager was great to work with.”

—QA Manager, Enterprise Quality Assurance


For more on how RentTesters can help your company improve testing processes, check us out online at http://www.renttesters.com or call 1.888.789.1482.

 

01
Aug
11

Case Study: Website Performance Testing


The Client

E-Marketing firm that specializing in building sites for the automotive industry.

The Challenge

The Client wanted their site ready for high traffic during Super Bowl weekend when there the count of simultaneous users was expected to exceed current performance capacity. Limits and performance benchmarks during expected peak use needed to be established to allow for adequate performance tuning because the competition is just clicks away. Without enough in-house testing resources, an outside vendor who could perform on-demand Performance, Load, and Stress Testing services was needed.

The Solution

Our client turned to RentTesters for our extensive experience in Load, Stress,  and Performance Testing as well as system tuning. Because the site was built on Flash, we proposed to use Load Runner for Load and Stress testing.

The first step was to create use cases and user flows for testing. We developed eight test cases to be tested and our Performance Test Engineer developed data-driven scripts in Load Runner using isolated excel spreadsheets allowing us to run tests with different data sets. Once the scripts were prepared, a test back-end environment was set up to mimic production capacity along with several cloud hosts to generate client requests. We started running scripts with 10 users and added users incremented by 10 every two minutes until peak was reached allowing us to see performance degradation. We captured:

  • Response times for entire transaction.
  • Server metrics such as CPU utilization, memory usage, and queue length.
  • Relevant database metrics such as CPU utilization, memory usage, recompilations, buffer cache, hit ration, and queue length.

RentTesters identified several performance bottlenecks and memory leaks that were addressed by development team. We collected:

  • Transaction response time.
  • Number of users passed/failed.
  • Number of transactions passed.

The rest results allowed the team to performance tune so that when we re-ran the scripts to validate performance, scalability, and stability of the application for 15,000 concurrent users.

The Benefit

  • Improved Customer Experience – Client team was not impacted by the test, since all testing was done on RentTesters servers.
  • Reduced Costs – Client saved time and money on load and performance testing leveraging on-demand services.
  • Expertise – Client successfully handled more than 230,000 requests on the super bowl week end.

Customer Quote:

“RentTesters help us prepared for more than 230,000 requests on the super bowl week-end.”

—Development Manager, eMarkerting firm, California.


For more on how RentTesters can help your company improve testing processes, check us out online at http://www.renttesters.com or call 1.888.789.1482.