WO2017012219A1

WO2017012219A1 - Software test method, apparatus and system

Info

Publication number: WO2017012219A1
Application number: PCT/CN2015/093612
Authority: WO
Inventors: 高琳旭
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-07-17
Filing date: 2015-11-02
Publication date: 2017-01-26
Also published as: CN106708716A

Abstract

The present invention provides a software test method, apparatus and system. The software test method comprises: acquiring configuration information of a test path of software to be tested; controlling, according to the configuration information, a cloud server to generate a virtual server; controlling the virtual server to download and install the software to be tested; and controlling the virtual server to perform functional testing on the software to be tested. By means of the solution of the present invention, the utilization rate of hardware resources can be improved, functional testing can be automatically and rapidly performed on all scenarios of software to be tested, and it is not required to keep a test server for each test path.

Description

Method, device and system for software testing

Technical field

The present invention relates to the field of software testing, and in particular, to a method, device and system for software testing based on a cloud environment.

Background technique

Currently, the test path of large-scale software to be tested can reach hundreds or even thousands. The traditional test methods include two types: one is to select several typical scenarios that are commonly used for testing; the other is to deploy multiple test servers for testing.

However, the test coverage of typical scenarios is incomplete and it is easy to miss the test scenario. Through the test conducted by multiple test servers, the hardware cost is very high, and the configuration of each test environment is inconsistent, it is impossible to achieve rapid replication, the environment is difficult to build, and the cost of environmental maintenance is high.

Summary of the invention

The object of the present invention is to provide a method, a device and a system for software testing, which can improve hardware resource utilization, perform functional tests on all scenarios of the test software automatically and quickly, and do not need to reserve one test server for each test path. .

In order to achieve the above object, an embodiment of the present invention provides a software testing method, including:

Obtaining configuration information of a test path of the software to be tested;

Controlling, according to the configuration information, a cloud server to generate a virtual server;

Controlling, by the virtual server, downloading and installing the software to be tested;

Controlling, by the virtual server, functional testing of the software to be tested.

Optionally, the step of controlling a cloud server to generate a virtual server according to the configuration information includes:

Controlling, by the cloud server, a cloud server to download an operating system image corresponding to the configuration information from the mirror server according to the configuration information;

Controlling, by the cloud server, a corresponding virtual server according to the operating system image.

Optionally, before the step of controlling the virtual server to download and install the software to be tested, the method further includes:

Controlling the virtual server to download and complete the third-party application software that the software to be tested depends on from the application software server, and the third-party application software includes a database.

Optionally, when the cloud server is capable of generating multiple virtual servers at the same time,

The step of obtaining configuration information of a test path of the software to be tested includes:

Obtaining configuration information of multiple test paths of the software to be tested;

The step of controlling a cloud server to generate a virtual server according to the configuration information includes:

Controlling, according to the configuration information of the multiple test paths, a cloud server to generate multiple virtual servers.

Optionally, the method for testing the software further includes:

After the functional test is completed, judge whether the test result is normal;

When the judgment result is normal, the cloud server is controlled to delete the virtual server.

The embodiment of the invention further provides a device for software testing, comprising:

Obtaining a module, configured to obtain configuration information of a test path of the software to be tested;

a first control module, configured to control a cloud server to generate a virtual server according to the configuration information;

a second control module, configured to control the virtual server to download and install the software to be tested;

And a third control module, configured to control the virtual server to perform a functional test on the software to be tested.

Optionally, the first control module includes:

The first control sub-module is configured to control, according to the configuration information, a cloud server to download an operating system image corresponding to the configuration information from the mirror server;

The second control submodule is configured to control the cloud server to generate a corresponding virtual server according to the operating system image.

Optionally, the device for testing the software further includes:

The fourth control module is configured to control the virtual server to download and complete the third-party application software that the software to be tested depends on from the application software server, where the third-party application software includes a database.

The obtaining module is configured to obtain configuration information of multiple test paths of the software to be tested;

The first control module is configured to control a cloud server to generate multiple virtual servers according to the configuration information of the multiple test paths.

Optionally, the device for testing the software further includes:

The judging module is set to judge whether the test result is normal after the function test is completed;

The fifth control module is configured to control the cloud server to delete the virtual server if the determination result is normal.

The embodiment of the invention further provides a system for software testing, comprising:

Control server, including the device for software testing described above;

Cloud server, set to manage virtual servers;

An application software server, configured to store third-party application software that is to be tested by the software to be tested, where the third-party application software includes a database;

A mirror server that is set to store various operating system images.

Continuous integration server, set to store software to be tested.

Optionally, the system for testing the software further includes:

And a management server, configured to control the continuous integration server to perform integration and construction of the software to be tested, and trigger the work of the control server.

Optionally, the control server is an ansible (an automated operation and maintenance tool) control server, and the cloud server is an openstack (an open source operating system) cloud server.

The beneficial effects of the embodiments of the present invention are as follows:

The software testing method of the embodiment of the present invention obtains configuration information of a test path of the software to be tested, and controls a cloud server to generate a virtual server according to the configuration information, and then controls the virtual server to download and install the to-be-tested Software, by using the virtual server to perform functional testing on the software to be tested, can improve hardware resource utilization, and automatically and quickly perform functional testing on all scenarios of the testing software, and does not need to reserve one test for each test path. server.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flow chart showing a method of software testing in accordance with an embodiment of the present invention.

FIG. 2 is a schematic structural diagram of an apparatus for software testing according to an embodiment of the present invention.

FIG. 3 is a schematic structural diagram of a system for software testing according to an embodiment of the present invention.

FIG. 4 is a flow chart showing functional testing of a test path of an EMS network management system according to an embodiment of the present invention.

detailed description

The embodiments are described in detail below with reference to the accompanying drawings.

Referring to FIG. 1 , an embodiment of the present invention provides a software testing method, including:

S101: Obtain configuration information of a test path of the software to be tested.

S102: Control a cloud server to generate a virtual server according to the configuration information.

S103: Control the virtual server to download and install the software to be tested;

S104: Control the virtual server to perform functional testing on the test software.

The software testing method of the embodiment of the present invention obtains the configuration information of a test path of the software to be tested, and controls a cloud server to generate a virtual server according to the configuration information, and then controls the virtual server to download and install the software to be tested to utilize the virtual server. Functional testing of the test software can improve hardware resource utilization, automate and quickly test all scenarios of the test software, and do not need to reserve a test server for each test path.

The cloud server is a cloud environment platform and is responsible for managing the entire life cycle of the virtual server to facilitate the generation and deletion of the virtual server. Optionally, in addition to generating and deleting virtual servers, the management of the cloud server includes starting, shutting down, suspending, suspending, adjusting, migrating, and restarting the virtual server, and configuring central processing unit (CPU), memory, and the like. Specifications, dynamic generation of Internet Protocol (IP) addresses, etc. The cloud server can also perform port monitoring on whether the virtual server is started, for example, the Linux operating system listening port 22, the Windows operating system listening window operating system remote management (WinRM) protocol port 5986, and the like.

The software to be tested is generally stored in a Continuous Integration (CI) server, and the CI server needs to provide integrated software to be tested periodically. In the embodiment of the present invention, the virtual server performs a function test on the test software, and uses a common test mode, such as a port test, which is not limited by the embodiment of the present invention, and may be selected according to actual needs.

In order to ensure the accuracy of the generated virtual server, in the embodiment of the present invention, the step of controlling a cloud server to generate a virtual server according to the configuration information includes:

Controlling, according to the configuration information, a cloud server downloading an operating system image corresponding to the configuration information from the mirror server;

Control the cloud server to generate a corresponding virtual server based on the operating system image.

The mirror server is configured to store images of various operating systems, and these operating system images are used as templates for the cloud server to generate virtual servers. Optionally, the image is generally a pure operating system, does not contain applications, but can add some small tools such as file transfer protocol FTP, decompression tools and other commonly used gadgets. In particular, the operating system of the Linux series needs to be configured with Secure Shell (SSH) for secure login. The Windows operating system needs to enable the WinRM protocol to ensure that the virtual server can be controlled after it is created.

In order to ensure that the virtual server downloads and installs the software to be tested, in the optional embodiment of the present invention, before the step of controlling the virtual server to download and install the software to be tested, the method further includes:

The control virtual server downloads and installs the third-party application software that the software to be tested depends on from the application software server, and the third-party application software includes a database.

Optionally, the application software server is configured to store third-party application software that the software to be tested needs to depend on, and the third-party application software is, for example, various types, various versions of the database, various versions of the software development kit JDK, and the like. In detail, when the database is perfected, some instance installation, configuration monitoring, and the like are required.

In practical applications, for large software to be tested, usually multiple test paths are included, and each test path has one configuration information. When the cloud server can generate multiple virtual servers at the same time, when performing functional tests on large-scale software to be tested, multiple virtual servers can be created at the same time and executed simultaneously on multiple test paths.

Based on the foregoing, in the embodiment of the present invention, when the cloud server can generate multiple virtual servers at the same time,

The steps of obtaining configuration information of a test path of the software to be tested include:

According to the configuration information, the steps of controlling a cloud server to generate a virtual server include:

Controlling a cloud server to generate multiple virtual servers according to configuration information of multiple test paths.

In this way, the test efficiency can be effectively improved and time can be saved.

In the embodiment of the present invention, the method for software testing further includes:

When the judgment result is normal, the control cloud server deletes the virtual server.

In this way, deleting the virtual server with normal test results in time is beneficial to recovering resources and ensuring that the cloud server can update the generated virtual server. When the test result is not normal, the corresponding virtual server and test record should be kept for the developer to locate the problem. After the developer locates the repair fault, the test path test can be manually triggered separately to quickly verify the repair result.

For example, a large test software has 1000 test paths, corresponding to 1000 configuration information, and the configured test path pool size is 20, that is, the cloud server can generate 20 virtual servers at a time.

When testing this large-scale software to be tested, firstly, 20 of the 1000 configuration information will be acquired, and then according to the 20 configuration information, the cloud server is controlled to generate 20 virtual servers to perform functions by using the 20 virtual servers respectively. Test; when a virtual server test is successful, the cloud service deletes the virtual server, and then generates a virtual server (for some remaining configuration information), performs functional testing until the 1000 test paths of the software to be tested correspond to 1000 configuration information is all executed; when a virtual server fails, the virtual server is reserved for developers to locate the problem.

Referring to FIG. 2, an embodiment of the present invention further provides a software testing apparatus, which corresponds to the software testing method shown in FIG. 1. The software testing apparatus includes:

The obtaining module 21 is configured to obtain configuration information of a test path of the software to be tested;

The first control module 22 is configured to control a cloud server to generate a virtual server according to the configuration information;

The second control module 23 is configured to control the virtual server to download and install the software to be tested;

The third control module 24 is configured to control the virtual server to perform functional testing on the test software.

The software testing device of the embodiment of the present invention obtains the configuration information of a test path of the software to be tested, and controls a cloud server to generate a virtual server according to the configuration information, and then controls the virtual server to download and install the software to be tested to utilize the virtual server. Functional testing of the test software can improve the utilization of hardware resources, and perform functional tests on all scenarios of the test software automatically and quickly, without having to reserve a test server for each test path.

Optionally, the first control module includes:

Among them, the software testing device also includes:

The fourth control module is configured to control the virtual server to download and install the third-party application software that the software to be tested depends on from the application software server, and the third-party application software includes a database.

Optionally, when the cloud server can generate multiple virtual servers at the same time,

The first control module is configured to control a cloud server to generate multiple virtual servers according to configuration information of the multiple test paths.

And the software testing device also includes:

As shown in FIG. 3, an embodiment of the present invention further provides a software testing system, including:

Control server 31, comprising the above-mentioned software testing device;

The cloud server 32 is configured to manage the virtual server;

The application software server 33 is configured to store third-party application software that the software to be tested depends on, and the third-party application software includes a database;

The mirror server 34 is configured to store various operating system images.

The continuous integration server 35 is configured to store the software to be tested.

Among them, the control server is the backbone of the software test system, playing the role of leading control. Optionally, the control server stores configuration information of the entire test process, including configuration information of the test path of the software to be tested, and a test path pool. The size of the test path pool refers to the number of test paths that the control server can execute concurrently. The size of the test path is less than or equal to the number of virtual servers that the cloud server can generate at the same time.

Optionally, each test path corresponds to a configuration information file playbook (playbook), and the playbook includes configuration information of the test path, for example, Windows 2008 standard R2+64 bit + Oracle (Oracle) 11 standard version + Chinese + scale 2. When the software to be tested needs to expand the test path, it is only necessary to add a playbook to the control server, and set the configuration information of the corresponding test path without adding other configurations. It should be noted that the configuration information of the test path in the embodiment of the present invention includes a set that is not limited to various hardware, software, version, and the like.

In the embodiment of the present invention, the control server may be an ansible control server, and the cloud server may be an openstack cloud server, but the embodiment of the present invention does not limit the other, and other selections may be made according to actual conditions.

In addition, the software testing system of the embodiment of the present invention further includes a management server configured to control the continuous integration server to perform integration and construction of the software to be tested, and automatically trigger the operation of the control server. Optionally, the management server can also monitor the entire test process and visualize the test results. In practice, the management server, for example, chooses to deploy the Jenkins tool (a continuous development tool based on Java development) to perform the above functions.

The method of software testing according to an embodiment of the present invention is described in detail below through an embodiment.

FIG. 4 is a flowchart of performing functional testing on a test path of an EMS network management according to an embodiment of the present invention; wherein, the configuration information of the test path is “Windows 2008 standard R2+64 bit+Oracle11g standard version+Chinese+scale 2 ".

Includes the following steps:

S401: The control server obtains configuration information “Windows2008 standard R2+64 bit+Oracle11g standard version+Chinese+scale 2”;

S402: The cloud server downloads an operating system image of “Windows2008 standard R264 bit” from the mirror server.

S403: The cloud server generates a corresponding virtual server, and starts the virtual server to listen to the WinRM protocol port 5986.

S404: After the virtual server is started, the virtual server downloads the Oracle11g Standard Edition database from the application software server and installs it completely;

S405: The virtual server downloads the network element management system (EMS) network management from the CI server, selects the Chinese version for installation, and selects the installation size 2;

S406: The virtual server performs a function test on the EMS network management; wherein, before the test, the corresponding configuration processing, test data preparation, and the like are performed;

S407: After the function test is completed, the control server determines whether the test result is normal;

S408: If normal, the cloud server deletes the corresponding virtual server in time; if not, keep the corresponding virtual server and test record for the developer to locate the problem.

Industrial Applicability: It can be seen from the above description that the embodiment of the present invention obtains a test path of the software to be tested. Setting information, and controlling a cloud server to generate a virtual server according to the configuration information, and then controlling the virtual server to download and install the software to be tested, so as to perform functional testing on the software to be tested by using the virtual server, which can improve Hardware resource utilization, automated and fast testing of all scenarios of test software, and no need to reserve one test server for each test path.

The above is only an alternative embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It is considered as the scope of protection of the present invention.

Claims

A method of software testing, including:

Obtaining configuration information of a test path of the software to be tested;

Controlling, according to the configuration information, a cloud server to generate a virtual server;

Controlling, by the virtual server, downloading and installing the software to be tested;

Controlling, by the virtual server, functional testing of the software to be tested.
The method of software testing according to claim 1, wherein the step of controlling a cloud server to generate a virtual server according to the configuration information comprises:

Controlling, by the cloud server, a cloud server to download an operating system image corresponding to the configuration information from the mirror server according to the configuration information;

Controlling, by the cloud server, a corresponding virtual server according to the operating system image.
The method of software testing according to claim 1, wherein the step of controlling the virtual server to download and install the software to be tested further comprises:

Controlling the virtual server to download and complete the third-party application software that the software to be tested depends on from the application software server, and the third-party application software includes a database.
The method of software testing according to claim 1, wherein when said cloud server is capable of generating a plurality of virtual servers at the same time,

The step of obtaining configuration information of a test path of the software to be tested includes:

Obtaining configuration information of multiple test paths of the software to be tested;

The step of controlling a cloud server to generate a virtual server according to the configuration information includes:

Controlling, according to the configuration information of the multiple test paths, a cloud server to generate multiple virtual servers.
The method of software testing according to claim 1, further comprising:

After the functional test is completed, judge whether the test result is normal;

When the judgment result is normal, the cloud server is controlled to delete the virtual server.
A device for software testing, comprising:

Obtaining a module, configured to obtain configuration information of a test path of the software to be tested;

a first control module, configured to control a cloud server to generate a virtual server according to the configuration information;

a second control module, configured to control the virtual server to download and install the software to be tested;

And a third control module, configured to control the virtual server to perform a functional test on the software to be tested.
The device for software testing according to claim 6, wherein the first control module comprises:

The first control sub-module is configured to control, according to the configuration information, a cloud server to download an operating system image corresponding to the configuration information from the mirror server;

The second control submodule is configured to control the cloud server to generate a corresponding virtual server according to the operating system image.
The device for software testing according to claim 6, further comprising:

The fourth control module is configured to control the virtual server to download and complete the third-party application software that the software to be tested depends on from the application software server, where the third-party application software includes a database.
The apparatus for software testing according to claim 6, wherein when said cloud server is capable of generating a plurality of virtual servers at the same time,

The obtaining module is configured to obtain configuration information of multiple test paths of the software to be tested;

The first control module is configured to control a cloud server to generate multiple virtual servers according to the configuration information of the multiple test paths.
The device for software testing according to claim 6, further comprising:

The judging module is set to judge whether the test result is normal after the function test is completed;

The fifth control module is configured to control the cloud server to delete the virtual server if the determination result is normal.
A system for software testing, including:

A control server comprising the apparatus for software testing of any of claims 6-10;

Cloud server, set to manage virtual servers;

An application software server, configured to store third-party application software that is to be tested by the software to be tested, where the third-party application software includes a database;

A mirror server that is set to store various operating system images.

Continuous integration server, set to store software to be tested.
The software testing system of claim 11 further comprising:

And a management server, configured to control the continuous integration server to perform integration and construction of the software to be tested, and trigger the work of the control server.
The system for software testing according to claim 11, wherein said control server is an ansible control server, The cloud server is an openstack cloud server.