SOASTA
Supplier: SOASTA
Supplier: SOASTA
Use of the product:
SOASTA is a leader in cloud testing and headquartered in Mountain View City, California. SOASTA chose CloudTest platform as the solution for the auto-test of Internet, mobile application and CloudTest platform has provided developers, QA experts and IT operation teams with incomparable experience in speed, scalability and accuracy for their testing work. SOASTA innovative solution brought test creation, automatic configuration and execution together, offering actionable information faster through analysis. You can visit SOASTA at http://www.soasta.com/. Ⅰ. SOASTA, the leader of cloud testing. SOASTA has many successful customers and not limited to Walmart, Apple, Disney, Starbucks, BBC, SAP, Salesforce, Chegg, Gilt Groupe, Hallmark, Intuit, Microsoft and Netflix. You can see SOASTA's representative cases as follows: Lenovo: 200,000 user tests for online application store. Microsoft: pressure test for office.com. Gilt Groupe: 100,000 rapidly increasing online visitors within one hour. Chegg: 25,000 students choosing their textbooks simultaneously. MySpace: 1 million concurrent video related business test. Apple: iCloud online cloud testing service. Intuit Turbo Tax Online: online production went 200% more than its originally expected capacity. SOASTA can help you with the following problems: Increasing pressure on background from fast-developing internet and mobile applications. For example, more adoption of technology like HTML5/AJAX has led to many failing in CS framework based testing software in meeting customer's need of function and performance. However, SOASTA has innovated a new testing software based on B/S framework which reached a fairly high standard in test creation's scalability and scales in the field. The popularization of smart phone and explosive increase of mobile application brought IT industry a new technology revolution. Different from traditional development period (maybe 6 months for development and 2 months for test), mobile application requires new versions and updates to be compressed into weeks or even days. So it becomes a new problem to effectively compress release period, enhance developing agility and ensure high quality product simultaneously. SOASTA came up with the only solution that is constant integration which can realize automatic test on multiple mobile devices between different systems. However, after web application and mobile applications' automation test and huge amount of test on its background service component test, there is a new problem. The IT manager has to effectively collect and track users' behaviors and experiences all over the country and even the world to analyze in which way the product can improve and strengthen before and after each launching, which might be as important as previous function and performance test. Having launched series products of Cloud Test and Touch Test, SOASTA combines customers' practical needs and launched the first business RUM solution based on SAAS in the field. Ⅱ. Representative Cases of SOASTA Global Cloud Testing SOASTA has plenty of servers for business and the largest test cloud in the world, so that SOASTA will be better equipped and more experienced than other companies in cloud computation field. At present, SOASTA global test cloud has about 500,000 public cloud servers covering more than 20 countries/regions and over 100 cities, and this number is still increasing steadily. SOASTA has many famous public cloud suppliers as global partners in the US like Amazon EC2, Microsoft, Azure, IBM, Rackspace and GoGrid. SOASTA CloudTest-the first and largest test cloud in the world. Traditional lab-based tools can only test hundreds or thousands of users at most, and other companies which offer online testing can only reach tens of thousands of user concurrency, while SOASTA CloudTest platform can simulate tens of millions of real user behavior and concurrency. It's also scalable and reliable so you can access it according to your needs and location. Ⅲ. SOASTA's Requirement for Cloud Testing; How did SOASTA make it? If you study these characteristics carefully, you will find these are exactly the characteristics of another current technical revolution in this field, cloud computation and cloud service. Since its founding, SOASTA realized that it was not going to solve the problems of the fast-developing web and mobile applications with physical servers and exclusive hardware due to the two features of them: large scale and online distribution. So let's look at it from a new perspective. We don't necessarily have to build and maintain such a big group of testing servers on our own or to rent IDC to host these facilities. Instead, why don't we cooperate with public cloud suppliers and explore the blue ocean of the testing market? Now that public cloud suppliers have established server rooms across the world for cloud service, it could perfectly suit the requirements in terms of size, flexible access, real-time online and excellent service quality can also be guaranteed. Then why not just incorporate them? Finally, SOASTA's CloudTest platform based its framework on distributed public cloud for large-scale software testing. Almost all famous public cloud service suppliers (also known as IaaS) are SOASTA's partners. Just to name a few famous ones: EC2 of Amazon, RackSpace based on Open Stack technology, GoGrid, Smart Cloud of IBM, Cloud and Savvis of HP and so on. SOASTA is both their partner and their client. When we offer our customers testing service, we are also paying for these partners' cloud hosts at the same time. This cloud host renting mode which charges by hour and by your need is actually a very classical case in cloud application. Take Amazon, SOASTA's biggest partner, as an example. In 2012, SOASTA rented cloud hosts on AWS at a total number of 1.5 million which made many cloud service suppliers jealous, leaving alone that our cloud hosts doesn't need to be called manually but by provided API interface. We just need to configure the needed server number and location on CloudTest management interface. With one simple click deployment, our program will automatically dock with AWS program and call their resources to activate cloud hosts worldwide with fast and efficient API at a charge. Then what kind of cloud framework supplier can cater such a large-scale and loosely distributed software system like SOASTA in terms of technology and business? First of all, it has to have various functions. All overseas cloud suppliers can provide its users with web-based management interface. For SOASTA, besides the basic server requirements (e.g. quadcore or octacore CPU, 4GB or 8GB RAM, hard drive from 20 GB to 40 GB etc.), VM creation, startup, closedown and restart. We also care about the following functions: Whether it supports functions like re-size and re-build. Since SOASTA employs record and playback to achieve multi-thread function simulation for users with VM computational resources and to check the complexity of test scenarios and scripts, we may need to dynamically modify computational resources. Although we prefer to achieve this dynamic and scalable function with API, whether management interface supports it will be a determining factor. Whether it supports creating a mirror of the host or new host from the mirror and whether the new host can automatically modify files in etc/hosts folder. As SOASTA's testing software needs to dynamically start a new VM among cloud service suppliers across the world in time, we can't start and install needed software one by one. So we will at first install one or two prototypes, some of which will be traffic load generator while others, a statistics result processor. These created image files are a requirement and these copies will stay in the provider's storage matrix. Thus, if we need to start dozens or even tens of thousands of VM of the same type, we just need to create new hosts with these mirrors. Cloud supplier has to provide us with public and private IP addresses of the corresponding host. Supplier needs to provide us with enough public network IP address (IP range list beforehand would be the best). The IP address can be either continuous or non continuous according to customer's need. Since many enterprises have special requirements for test-starting host's IP address, the resources provided by suppliers should also be flexible and abundant. In terms of background charging, SOASTA's cloud testing service requires IaaS providers can receive payment by hour and by the actual usage. The data here should be one-way i.e. the data sent from the cloud host. Let's take Amazon's charging standard as an example. The first 1 GB data in the first month is free and 0.12 dollar for every GB within the range of 1GB to 10TB and 0.09 dollar every GB within the range of 10 TB to 40 TB. The more data you use, the more money you save. Most fundamentally, it has to have the support of a powerful and high performance API. The previous 4 points are our basic requirements for a cloud provider but finally we will use their bottom API instead of their management interface provided. Ⅳ. A Comparison with Overseas Cloud Computation Service as SOASTA's global business advances, we hope our products can be used in the fast-developing Chinese market. With support from American headquarter, SOASTA China evaluated 5 different cloud infrastructure suppliers. Comparing with our previous knowledge about the technical features of overseas cloud providers, we found they have characteristics below: Currently Chinese cloud suppliers' major customers are small and medium enterprises, most of which are game websites, travel websites or small e-commerce, though some of them are public service providers. So it varies a lot in purposes and needs. Chinese cloud providers don't pay much attention to the product's scalability as a result of the preference of stability over startup and shutdown performance. Most of cloud suppliers only support payment by month or by year, and their management background doesn't support payment by hour. Almost no cloud provider would charge by data used but by the peak bandwidth of each host taking, for example 2 Mbps or 10 Mbps. Most Chinese clients rent limited or stable number of cloud hosts, so they don't need a mirror much. Besides, most cloud suppliers don't support self-made mirror or to create a cloud host from the mirror. At present, no cloud providers can really service the whole country and the management interface and charging system of each computer room is comparatively independent in different places, users need to create different accounts and their mirror can't be moved at will. Moreover, they aren't compatible between different districts, even some aren't compatible with them themselves. Chinese costumers mainly call the cloud host through web management interface, so they don't need API as much and cloud providers neglect API development, which leads to a problem of calling cloud resources quickly and in large scale. During the evaluation process, UCloud, a cloud computation pillar company located in a cloud base in Yangpu, Shanghai, impressed us. UCloud team has the most brilliant brains from Chinese top professional cloud computation companies like Tencent and SNDA, and they also have rich experience in cloud computation development and operations and a penetrating understanding of customers' needs enabling them to offer a 24/7 excellent customer service. Having used many cloud hosts of UCloud duplet in eastern China and BGP in northern China, we found that UCloud cloud platform charges by hour or by the actual use from the start. They are extremely fast in host operations like startup and closedown with its unique accelerated VM management system. They can support original host mirror and the new host created by the mirror and not to mention the mirror migrations between the two data centers are very fast. They will provide configurable firewall on the interface to make the hosts safe and easy to operate and control. They also have a very professional customer-centered support team who always responds fairly quickly, solving customers problem 24/7 even deep in the night and have advanced API development including various functions on the web management interface besides basic ones. Now UCloud is an official strategic partner of SOASTA. SOASTA can call UCloud cloud hosts for all kinds of cloud testing tasks accordingly at any time, not only offering testing service for Chinese enterprises but also providing overseas enterprises with testing requests from China. As a world-famous cloud testing platform, SOASTA brought cutting-edge testing ideas and technology to Asia, especially to China. We hope we can develop Chinese cloud testing market with outstanding cloud infrastructure providers like UCloud and leave a glorious mark in the whole cloud computation revolution. –by Tony Wang, the technical director of SOASTA China |