CN111773660A - A cloud game processing system, method and device - Google Patents

Abstract

The present application provides a cloud game processing system, method and device, wherein the cloud game processing system includes: a client and a cloud game server; the client is configured to submit a game screen sharing request to the cloud game server, The game screen sharing request carries a cloud game identifier and at least one target character identifier; the cloud game server is configured to receive the game screen sharing request submitted by the client, and obtain the cloud game corresponding to the cloud game identifier. The to-be-output video stream identified by at least one target role, and the to-be-output video stream is transmitted to the client; the client is further configured to receive the to-be-output video stream, and configure at least one display window to The to-be-output video streams identified by the at least one target character are respectively displayed.

Description

A cloud game processing system, method and device

technical field

The present application relates to the field of computer technology, and in particular, to a cloud game processing system, method and apparatus, computing device and computer-readable storage medium.

Background technique

Cloud gaming is a game method based on cloud computing. In the running mode of cloud gaming, all games are run on the corresponding server. The server compresses the rendered game screen and transmits it to the terminal that hosts the game through the network. The terminal does not need any high-end processor and graphics card, and only needs basic video decompression capability to obtain the corresponding game screen.

Although the performance requirements of cloud games on the terminal are reduced, which can make the game screen smoother, for some games that require cooperation, such as large-scale team battles, members of the team need to cooperate to complete related tasks. The exchange and sharing of information becomes particularly important, but currently team members usually communicate through text or voice. Considering the limitations of text and language communication, if a better communication method is used, the game screen can be shared in time to The members of the team become the problem that needs to be solved urgently.

SUMMARY OF THE INVENTION

In view of this, embodiments of the present application provide a cloud game processing system, method and apparatus, computing device, and computer-readable storage medium, so as to solve the technical defects existing in the prior art.

According to a first aspect of the embodiments of the present application, a cloud game processing system is provided, including:

Client and cloud game server;

The client is configured to submit a game screen sharing request to the cloud game server, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

The cloud game server is configured to receive the game screen sharing request submitted by the client, obtain the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier, and store the to-be-output video stream. streaming to said client;

The client is further configured to receive the to-be-output video stream, and configure at least one display window to respectively display the to-be-output video stream identified by the at least one target character.

Optionally, the cloud game processing system further includes: a target client;

The cloud game server is further configured to send the game screen sharing request to at least one target client associated with the at least one target character identifier;

The target client is configured to send a confirmation sharing instruction of the game screen to the cloud game server in response to the game screen sharing request;

The cloud game server is further configured to obtain the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier when the confirmation sharing instruction is received, and send all the video streams to be output. The encoded data obtained by encoding the to-be-output video stream is transmitted to the client.

Optionally, the cloud game server is further configured to: acquire the to-be-output video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier, and to perform a video stream on the to-be-output video stream. transmitting the initial encoded data obtained by encoding to the client;

The client is further configured to: receive the initial encoded data and the encoded data, parse the initial encoded data and the encoded data respectively, and generate the first parsing result according to the initial parsing result obtained by parsing and the target parsing result. A display window and a second display window; wherein, the second display window and the first display window are displayed superimposed.

Optionally, the cloud game server is further configured to: acquire the to-be-output video stream of the target character identifier associated with the target client in the cloud game corresponding to the cloud game identifier, and send the to-be-output video stream to the cloud game identifier. The target encoded data obtained by encoding the stream is transmitted to the target client;

The target client is further configured to: receive the target encoded data, and send the target encoded data to the client, so as to respond to the game screen sharing request.

Optionally, the cloud game server is further configured to: acquire the to-be-output video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier, and to perform a video stream on the to-be-output video stream. transmitting the initial encoded data obtained by encoding to the client;

The client is further configured to: receive the initial encoded data and the target encoded data, parse the initial encoded data and the target encoded data respectively, and obtain the initial parsing result and the target parsing result according to the parsing A first display window and a second display window are generated; wherein, the first display window and the second display window are superimposed and displayed, or the first display window and the second display window are displayed side by side.

Optionally, the game characters corresponding to the client and the at least one target client carry the same team identification.

Optionally, the video stream to be output includes picture data and/or audio data of the target character;

The cloud game server is further configured to encode the picture data and/or audio data, obtain corresponding encoded data, and transmit the encoded data to the client.

Optionally, the cloud game server is further configured to: draw the picture data in a preset video memory, generate a picture to be encoded, and encode the picture to be encoded to obtain corresponding picture encoding data; and , and encode the audio data by using an audio encoding function to obtain corresponding audio encoded data.

Optionally, the client is further configured to: receive and decode the picture coded data and the audio coded data, obtain the picture data and the audio data, and play the picture through a display window data and the audio data.

According to a second aspect of the embodiments of the present application, a cloud game processing method is provided, including:

receiving a game screen sharing request submitted by the client, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

Acquiring the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier;

The to-be-output video stream is transmitted to the client.

Optionally, after the step of receiving the game screen sharing request submitted by the client is performed, and before the step of acquiring the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier is performed, the method further includes: :

sending the game screen sharing request to the target client associated with the at least one target character identifier;

In the case of receiving the confirmation sharing instruction returned by at least one target client, the step of acquiring the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier is performed.

Optionally, the game characters corresponding to the client and the at least one target client carry the same team identification.

Optionally, the video stream to be output includes picture data and/or audio data of the target character;

Correspondingly, the transmitting the to-be-output video stream to the client includes:

The picture data and/or audio data are encoded to obtain corresponding encoded data, and the encoded data is transmitted to the client.

Optionally, the encoding of the picture data and/or audio data to obtain corresponding encoded data includes:

Drawing the picture data in a preset display memory, generating a picture to be encoded, and encoding the picture to be encoded to obtain corresponding picture encoding data; and, using an audio encoding function to encode the audio data to obtain the corresponding picture audio encoded data.

According to a third aspect of the embodiments of the present application, a cloud game processing method is provided, including:

sending a game screen sharing request to the cloud game server, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

receiving the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

At least one display window is configured based on the to-be-output video stream, and the at least one display window respectively displays the to-be-output video stream identified by the at least one target character.

Optionally, before the step of configuring at least one display window based on the to-be-output video stream is performed, the method further includes:

receiving the initial video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

Correspondingly, the configuring at least one display window based on the to-be-output video stream includes:

A first display window and a second display window are configured based on the initial video stream and the to-be-output video stream; wherein, the second display window and the first display window are superimposed and displayed.

Optionally, after the step of sending a game screen sharing request to the cloud game server is performed, and before the step of configuring at least one display window based on the to-be-output video stream is performed, the method further includes:

receiving the initial video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

receiving a video stream to be output with at least one target character identifier associated with the at least one target client in the cloud game corresponding to the cloud game identifier returned by at least one target client;

Correspondingly, the configuring at least one display window based on the to-be-output video stream includes:

A first display window and a second display window are configured based on the initial video stream and the to-be-output video stream; wherein, the first display window and the second display window are superimposed and displayed, or the first display window and the The second display windows are displayed side by side.

According to a fourth aspect of the embodiments of the present application, a cloud game processing apparatus is provided, including:

a receiving module, configured to receive a game screen sharing request submitted by a client, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

an acquisition module, configured to acquire the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier;

The transmission module is configured to transmit the to-be-output video stream to the client.

According to a fifth aspect of the embodiments of the present application, a cloud game processing apparatus is provided, including:

a sending module, configured to send a game screen sharing request to the cloud game server, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

a receiving module, configured to receive the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

The configuration module is configured to configure at least one display window based on the to-be-output video stream, and the at least one display window respectively displays the to-be-output video stream identified by the at least one target character.

According to a sixth aspect of the embodiments of the present application, a computing device is provided, including a memory, a processor, and computer instructions stored in the memory and executable on the processor, the processor implementing the instructions when the processor executes the instructions The steps of the cloud game processing method.

According to a seventh aspect of the embodiments of the present application, a computer-readable storage medium is provided, which stores computer instructions, and when the instructions are executed by a processor, implements the steps of the cloud game processing method.

In the embodiment of the present application, the client terminal submits a game screen sharing request to the cloud game server, and receives the to-be-output video stream of the target character returned by the cloud game server, so as to realize the sharing of the game screen between the client and at least one target client. Sharing, in order to share the game screen to the user in a timely manner through this screen sharing method, is conducive to improving the timeliness of information transmission or information interaction, thereby providing users with a better game experience.

Description of drawings

1 is a structural block diagram of a computing device provided by an embodiment of the present application;

2 is a flowchart of a cloud game processing method applied to a cloud game server provided by an embodiment of the present application;

3 is a flowchart of a cloud game processing method applied to a client provided by an embodiment of the present application;

4 is an interaction diagram of a cloud game processing method provided by an embodiment of the present application;

5 is a schematic diagram of a cloud game processing system provided by an embodiment of the present application;

6 is a scene diagram of a cloud game processing process provided by an embodiment of the present application;

7 is a schematic structural diagram of a cloud game processing device configured on a cloud game server according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a cloud game processing apparatus configured on a client according to an embodiment of the present application.

Detailed ways

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

The terminology used in one or more embodiments of the present application is for the purpose of describing a particular embodiment only, and is not intended to limit the one or more embodiments of the present application. As used in one or more embodiments of this application and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used in one or more embodiments of this application refers to and includes any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, etc. may be used in one or more embodiments of the present application to describe various information, such information should not be limited by these terms. These terms are only used to distinguish the same type of information from each other. For example, the first could be termed the second, and similarly the second could be termed the first, without departing from the scope of one or more embodiments of the present application. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determining."

First, terminology related to one or more embodiments of the present invention is explained.

Cloud game: refers to the game mode based on cloud computing. In the operation mode of cloud game, all games are run on the server side, and the rendered game screen is compressed and transmitted to the user through the network. On the client side, the user's game device does not require any high-end processor and graphics card, but only needs basic video decompression capabilities.

Video memory: Also known as the frame buffer, it is used to store rendering data that has been processed or about to be extracted by the graphics card chip. Like a computer's memory, video memory is the component used to store graphics information to be processed.

In this application, a cloud game processing system, method and apparatus, computing device and computer-readable storage medium are provided, which are described in detail in the following embodiments.

FIG. 1 shows a structural block diagram of a computing device 100 according to an embodiment of the present application. Components of the computing device 100 include, but are not limited to, memory 110 and processor 120 . The processor 120 is connected with the memory 110 through the bus 130, and the database 150 is used for saving data.

Computing device 100 also includes access device 140 that enables computing device 100 to communicate via one or more networks 160 . Examples of such networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. Access device 140 may include one or more of any type of network interface (eg, network interface card (NIC)), wired or wireless, such as IEEE 802.11 wireless local area network (WLAN) wireless interface, World Interoperability for Microwave Access ( Wi-MAX) interface, Ethernet interface, Universal Serial Bus (USB) interface, cellular network interface, Bluetooth interface, Near Field Communication (NFC) interface, and the like.

In one embodiment of the present application, the above-described components of the computing device 100 and other components not shown in FIG. 1 may also be connected to each other, eg, via a bus. It should be understood that the structural block diagram of the computing device shown in FIG. 1 is only for the purpose of example, rather than limiting the scope of the present application. Those skilled in the art can add or replace other components as required.

Computing device 100 may be any type of stationary or mobile computing device, including mobile computers or mobile computing devices (eg, tablets, personal digital assistants, laptops, notebook computers, netbooks, etc.), mobile phones (eg, smartphones ), wearable computing devices (eg, smart watches, smart glasses, etc.) or other types of mobile devices, or stationary computing devices such as desktop computers or PCs. Computing device 100 may also be a mobile or stationary server.

The processor 120 may execute the steps in the cloud game processing method shown in FIG. 2 . FIG. 2 shows a flowchart of a cloud game processing method applied to a cloud game server according to an embodiment of the present application, including steps 202 to 206 .

Step 202: Receive a game screen sharing request submitted by the client, where the game screen sharing request carries a cloud game identifier and at least one target character identifier.

Cloud gaming refers to a game method based on cloud computing technology. The game runs on the server, and the client does not need to download, install, or consider the configuration of the client. As long as there is a network, you can play games that require a lot of computing. Clients include personal computers, set-top boxes, mobile terminals, and the like.

The cloud game can be an independent game. The user uses the client to enter the user name and password to log in to the cloud game, communicate with the cloud game server, and then the game operation can be performed; the cloud game can also be subordinate to a game platform, and the user can use the client to log in to the cloud game. Enter the user name and password to log in to the cloud gaming platform, and choose a game among the many games on the cloud gaming platform to play.

A cloud game processing method provided by an embodiment of this specification is applied to a cloud game server. When a user communicates with the cloud game server through a client and plays a game, other users can send a game screen to the cloud game server through their client. Sharing request to watch a user's game screen. Since the cloud server may contain multiple games, and each game contains different game characters, the user can send the cloud game ID when sending the game screen sharing request. and at least one target character identifier, the cloud game server can send a corresponding video stream to the user's client according to the cloud game identifier and the target character identifier.

Specifically, the user can send a request for sharing the game screen of other users (teammates or non-teammates) to the cloud game server when playing a team game with other users, or, when the user is not playing a team game , the game screen sharing request for other users who are playing the game can be sent to the cloud game server, and the embodiment of this specification does not make any limitation here.

If the user plays a team game with other users, one of the client and the at least one target client serves as a team terminal to send a team invitation to the other clients, and the other client confirms the team formation In this case, the team formation is successful, and the game character corresponding to the client and the at least one target client carries the same team ID. After the team game starts, the user can send a message to the cloud game server for the Game screen sharing requests for game characters (teammates or non-teammates).

If the user is not playing the game, the user can determine whether other users are in the game through the status (online, offline or game, etc.) of other users in the friend list or the team list of the game interface, and if so, the user can report to the cloud game The server submits a game screen sharing request for at least one user whose status is in-game.

Optionally, after receiving the game screen sharing request submitted by the client, and before acquiring the to-be-output video stream of the at least one target character ID in the cloud game corresponding to the cloud game ID, the game screen sharing request may also be sent. To the target client, the target client can confirm whether to share the screen, which can be achieved in the following ways:

sending the game screen sharing request to the target client associated with the at least one target character identifier;

In the case of receiving the confirmation sharing instruction returned by at least one target client, the step of acquiring the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier is performed.

Specifically, since the game screen sharing request carries the cloud game identifier and at least one target character identifier, the target client associated with the target character identifier can be located according to the cloud game identifier and the target character identifier, and then the game The screen sharing request is sent to the target client associated with the target character identifier, so that the target client determines whether to share the game screen with the client.

In the embodiment provided in this application, taking a team battle game G as an example, user A uses a computer as a client to play the game, and user A forms a team with users B1, B2, B3, and B4 to play the game. The character ID is character a, and the character IDs of users B1, B2, B3, and B4 are characters b1, b2, b3, and b4, respectively. User A can send a teammate's game screen sharing request to the cloud game server. If the game screen is shared The request contains the identification of the team battle game G, and the target character in the request is identified as character b2, then the cloud game server sends the game screen sharing request to the target client associated with the character b2, so that the control character b2 The user B2 of the user B2 determines whether to share the game screen;

If the confirmation sharing instruction returned by the target client associated with the character b2 is received, the cloud game server acquires the to-be-output video stream of the character b2, and sends the to-be-output video stream to the client.

In the case of receiving the game screen sharing request, the game screen sharing request is sent to the target client, so that the user who controls the target character through the target client determines whether to share the game screen, and the confirmation returned by the target client In the case of sharing instructions, sharing the game screen is conducive to improving the user's service experience, and through the method of game screen sharing, it is conducive to ensuring that the user obtains the game information of other users in a timely manner, so as to improve the user's game experience.

Step 204: Acquire the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier.

Specifically, since the game screen sharing request submitted by the client carries the cloud game ID and the target character ID, after receiving the game screen sharing request, the cloud game server can obtain the target character ID in the cloud game corresponding to the cloud game ID the to-be-output video stream, and transmit the to-be-output video stream to the client.

In specific implementation, as described above, after the cloud game server receives the game screen sharing request submitted by the client, and before acquiring the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier, The game screen sharing request can also be sent to the target client, so that the target client can confirm whether to perform screen sharing. Therefore, in the case of receiving the confirmation sharing instruction returned by the target client, obtain the cloud game ID corresponding to the cloud game ID. The to-be-output video stream identified by the target role, and the to-be-output video stream is transmitted to the client.

Still taking a team battle game G as an example, user A teams up with users B1, B2, B3, and B4 to play a game. In the game, the character ID of user A is character a, and the character IDs of users B1, B2, B3, and B4 are respectively For roles b1, b2, b3, and b4, the game screen sharing request sent by user A to the cloud game server contains the logo of the team battle game G and the target character is identified as role b2, then the cloud game server sends the game screen sharing request to After the target client associated with the character b2 receives the confirmation sharing instruction returned by the target client associated with the character b2, the cloud game server obtains the to-be-output video stream of the character b2, and sends the to-be-output video stream. to the client.

Step 206: Transmit the to-be-output video stream to the client.

Specifically, after acquiring the to-be-output video stream, the to-be-output video stream may be transmitted to the client.

During specific implementation, the cloud game server can encode the video stream to be output, and transmit the encoded data obtained by encoding to the client, where the client decodes the encoded data, and configures the corresponding Display the window to play the game screen through the display window.

Optionally, the video stream to be output contains picture data and/or audio data of the target character; the video stream to be output is transmitted to the client, that is, the picture data and/or audio data are encoded to obtain the corresponding the encoded data, and transmit the encoded data to the client.

Following the above example, in a team battle game G, if user B2 submits the control instruction "Release skill M" to character b2 to control character b2 to release the skill, the cloud server controls the release of character b2 in the cloud game based on the control instruction. Skill M, and at the same time generate data related to releasing skill M, that is, data such as screen effects and sound effects released by skill M.

Further, the picture data and/or audio data are encoded to obtain corresponding encoded data, which can be implemented in the following ways:

Drawing the picture data in a preset display memory, generating a picture to be encoded, and encoding the picture to be encoded to obtain corresponding picture encoding data; and, using an audio encoding function to encode the audio data to obtain the corresponding picture audio encoded data.

Specifically, the video memory is a component used to store the graphics information to be processed. After obtaining the picture data, the obtained picture data of the cloud game is drawn into the preset video memory, and the game picture waiting to be encoded is obtained.

In practical applications, an image encoding function can be used to encode the to-be-encoded picture to obtain corresponding picture-encoded data, that is, the to-be-encoded picture is transmitted to the encoding system, and the to-be-encoded picture is encoded using a graphics card hard-coding technology, Obtain the corresponding picture coding data; among them, hard coding is the software development practice of directly embedding data into the source code of the program or other executable objects; the graphics card hard coding technology is the technology of using hard coding in the graphics card;

In addition, for audio data, an audio encoding function can be used to encode the audio data to obtain the corresponding audio encoded data, that is, the audio data is passed into the encoding system, and the central processing unit is used to encode the audio data to obtain the corresponding audio data. the audio encoded data;

After acquiring the picture encoding data and the audio encoding data, the real-time picture encoding data and the audio encoding data can be encapsulated, and the encapsulated data is transmitted to the client through the network.

In the embodiment of this specification, the cloud game server transmits the to-be-output video stream of the target character and the initial to-be-output video stream of the client's character identification to the client, and the client receives the initial to-be-output video stream and the to-be-output video stream to the client After the video is streamed, a picture-in-picture floating window can be constructed in the created full-screen display window of the client. The video stream to be output is synchronized to the full-screen display window, so that the game screen of the target character is played in the picture-in-picture floating window, and the game screen of the client's character is played in the full-screen display window of the client.

Still taking a team battle game G as an example, the game screen sharing request sent by user A to the cloud game server contains the logo of the team battle game G and the target character logo as character b2, and the cloud game server obtains the to-be-output video stream of character b2, and send the to-be-output video stream to the client, and the cloud game server simultaneously transmits the to-be-output video stream of the character a to the client, and the client plays the game screen of the character a in the full-screen display window, Play the game screen of character b2 in the picture-in-picture floating window.

By playing the game screen of the target character in the picture-in-picture floating window, it will not have a great impact on the user's own game screen, so that the user can watch the live video while using other applications, so that there will be no problem. Improved user experience when using other applications to miss highlights of video footage.

In addition, the cloud game server can transmit the initial to-be-output video stream identified by the client's character to the client, and the target server transmits the to-be-output video stream of the target character to the client;

After receiving the initial to-be-output video stream and the to-be-output video stream, the client can construct a picture-in-picture floating window in the created full-screen display window of the client, and after the picture-in-picture floating window is constructed, The to-be-output video stream of the target character is synchronized to the picture-in-picture floating window, and the initial to-be-output video stream is synchronized to the full-screen display window, so that the game screen of the target character is played in the picture-in-picture floating window, and the full-screen display window of the client Play the game screen of the character of the client; or, since the cloud game server and the target client transmit the initial to-be-output video stream and the to-be-output video stream to the client through different processes, the client can use two The two side-by-side display windows (two monitors, split-screen display) respectively play the game screen of the target character and the game screen of the character of the client.

In practical applications, users can choose any window display mode according to their own needs, and there is no restriction here.

Playing the game screen of the target character in the above way will not have a great impact on the user's own game screen, so that the user can watch the live video while using other applications, so that there will be no problems caused by using other applications. The case of missing the wonderful video screen improves the user experience.

In the embodiment of the present application, the client terminal submits a game screen sharing request to the cloud game server, and receives the to-be-output video stream of the target character returned by the cloud game server, so as to realize the sharing of the game screen between the client and at least one target client. Sharing, in order to share the game screen to the user in a timely manner through this screen sharing method, is beneficial to improve the timeliness of information transmission, thereby providing a better game experience for the user.

The processor 120 may execute the steps in the cloud game processing method shown in FIG. 3 . FIG. 3 shows a flowchart of a cloud game processing method applied to a client according to an embodiment of the present application, including steps 302 to 306 .

Step 302: Send a game screen sharing request to the cloud game server, where the game screen sharing request carries a cloud game identifier and at least one target character identifier.

A cloud game processing method provided by an embodiment of this specification is applied to a client. When a user communicates with a cloud game server through the client and plays games, other users can send game screen sharing to the cloud game server through their client. request to view a user's game screen. Since the cloud server may contain multiple games, and each game contains different game characters, the user can send the cloud game ID and At least one target character identifier, and the cloud game server can send a corresponding video stream to the user's client according to the cloud game identifier and the target character identifier.

Specifically, the user can send a sharing request for the game screen of other teammates to the cloud game server when playing a team game with other users, or send a request to the cloud game server when the user is not playing the game. The game screen sharing requests of other users who are playing games are not limited in this embodiment of the present specification.

If the user plays a team game with other users, one of the client and the at least one target client serves as a team terminal to send a team invitation to the other clients, and the other client confirms the team formation In the case of , the teaming is successful, and the game characters corresponding to the client and the at least one target client carry the same teaming identifier.

Step 304: Receive the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier returned by the cloud game server.

Specifically, since the game screen sharing request carries the cloud game ID and the target character ID, after receiving the game screen sharing request, the cloud game server can obtain the to-be-output video of the target character ID in the cloud game corresponding to the cloud game ID stream, and transmit the to-be-output video stream to the client.

Step 306: Configure at least one display window based on the to-be-output video stream, and the at least one display window respectively displays the to-be-output video stream identified by the at least one target character.

Specifically, the cloud game server can encode the video stream to be output, and transmit the encoded data obtained by encoding to the client, where the client decodes the encoded data, and configures the corresponding display according to the decoding result window to play the game screen through the display window.

Further, before configuring at least one display window based on the to-be-output video stream, an initial video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server may also be received;

Correspondingly, at least one display window is configured based on the video stream to be output, that is, a first display window and a second display window are configured based on the initial video stream and the video stream to be output; wherein, the second display window is the same as the The first display window is superimposed and displayed.

Specifically, if the cloud game server transmits the to-be-output video stream of the target character and the initial to-be-output video stream identified by the client's character to the client, the client receives the initial to-be-output video stream and the to-be-output video stream After that, a picture-in-picture floating window can be constructed in the created full-screen display window of the client. After the picture-in-picture floating window is constructed, the to-be-output video stream of the target character is synchronized to the picture-in-picture floating window, and the initial to-be-outputted video stream is synchronized to the picture-in-picture floating window. The video stream is synchronized to the full-screen display window, so that the game screen of the target character is played in the picture-in-picture floating window, and the game screen of the character of the client is played in the full-screen display window of the client.

Playing the game screen of the target character in the above way will not have a great impact on the user's own game screen, so that the user can watch the live video while using other applications, so that there will be no problems caused by using other applications. The case of missing the wonderful video screen improves the user experience.

In addition, the cloud game server can transmit the initial to-be-output video stream identified by the client's character to the client, and the target server can transmit the to-be-output video stream of the target character to the client.

In specific implementation, after sending a game screen sharing request to the cloud game server, and before configuring at least one display window based on the to-be-output video stream, the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server is received. The initial video stream of the character identifier associated with the terminal; and the to-be-output video stream of the at least one target character identifier associated with the at least one target client in the cloud game corresponding to the cloud game identifier returned by the at least one target client;

Correspondingly, at least one display window is configured based on the video stream to be output, that is, a first display window and a second display window are configured based on the initial video stream and the video stream to be output; wherein, the first display window and The second display window is superimposed and displayed, or the first display window and the second display window are displayed side by side.

Specifically, after receiving the initial to-be-output video stream and the to-be-output video stream, the client can construct a picture-in-picture floating window in the created full-screen display window of the client, and complete the construction of the picture-in-picture floating window. Then, synchronize the to-be-output video stream of the target character to the picture-in-picture floating window, and synchronize the initial to-be-output video stream to the full-screen display window, so that the game screen of the target character is played in the picture-in-picture floating window, and the client's The full-screen display window plays the game screen of the character of the client; or, since the cloud game server and the target client transmit the initial to-be-output video stream and the to-be-output video stream to the client through different processes, the client The game screen of the target character and the game screen of the character of the client can be played respectively through two parallel display windows (two monitors, split-screen display).

Playing the game screen of the target character in the above way will not have a great impact on the user's own game screen, so that the user can watch the live video while using other applications, so that there will be no problems caused by using other applications. The case of missing the wonderful video screen improves the user experience.

In the embodiment of the present application, the client terminal submits a game screen sharing request to the cloud game server, and receives the to-be-output video stream of the target character returned by the cloud game server, so as to realize the sharing of the game screen between the client and at least one target client. Sharing, in order to share the game screen to the user in a timely manner through this screen sharing method, is conducive to improving the timeliness of information transmission, thereby providing a better game experience for the user.

FIG. 4 shows an interaction diagram of a cloud game processing method according to an embodiment of the present application. The cloud game processing method describes the interaction process of a client, a cloud game server and a target client, including steps 402 to 416 .

Step 402, the client submits a game screen sharing request to the cloud game server.

Specifically, the game screen sharing request carries a cloud game identifier and at least one target character identifier.

Step 404, the cloud game server sends the game screen sharing request to the target client.

Specifically, the cloud game server may send a game screen sharing request to at least one target client.

Step 406, the target client sends a confirmation sharing instruction to the cloud game server.

Specifically, the cloud game server sends a game screen sharing request to the target client, so that the target client determines whether to share the game screen to the client, and if it is determined to share, sends a confirmation sharing instruction to the cloud game server.

Step 408: The cloud game server acquires the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier, and encodes the to-be-output video stream to obtain encoded data.

Step 410: The cloud game server acquires the to-be-output video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier, and encodes the to-be-output video stream to obtain initial encoded data.

Step 412, transmitting the encoded data and the initial encoded data to the client.

Step 414, the client parses the initial encoded data and the encoded data respectively.

Step 416, the client configures the first display window and the second display window according to the initial parsing result obtained by parsing and the target parsing result.

Specifically, the second display window is displayed superimposed on the first display window.

In the embodiment of the present application, the game screen is shared to the user in a timely manner through this screen sharing method, which is beneficial to improve the timeliness of information transmission, thereby providing the user with a better game experience.

FIG. 5 shows a schematic diagram of a cloud game processing system according to an embodiment of the present application. The system includes a client 502 and a cloud game server 504 , wherein the client 502 and the cloud game server 504 are connected in communication.

The client 502 is configured to submit a game screen sharing request to the cloud game server 504, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

The cloud game server 504 is configured to receive the game screen sharing request submitted by the client 502, acquire the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier, and store the to-be-to-be-played video stream. the output video stream is transmitted to the client 502;

The client 502 is further configured to receive the to-be-output video stream, and configure at least one display window to respectively display the to-be-output video stream identified by the at least one target character.

Optionally, the cloud game processing system further includes: a target client 506;

The cloud game server 504 is further configured to send the game screen sharing request to at least one target client 506 associated with the at least one target character identifier;

The target client 506 is configured to send a confirmation sharing instruction of the game screen to the cloud game server 504 in response to the game screen sharing request;

The cloud game server 504 is further configured to obtain the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier when the confirmation sharing instruction is received, and to The encoded data obtained by encoding the to-be-output video stream is transmitted to the client 502 .

Optionally, the cloud game server 504 is further configured to: acquire the to-be-output video stream of the character identifier associated with the client 502 in the cloud game corresponding to the cloud game identifier, and to process the to-be-output video stream. transmitting the initial encoded data obtained by encoding the stream to the client 502;

The client 502 is further configured to: receive the initial encoded data and the encoded data, parse the initial encoded data and the encoded data respectively, and generate an initial parsing result and a target parsing result obtained by parsing A first display window and a second display window; wherein, the second display window and the first display window are superimposed and displayed.

Optionally, the cloud game server 504 is further configured to: acquire the to-be-output video stream of the target character identifier associated with the target client 506 in the cloud game corresponding to the cloud game identifier, and to process the to-be-output video stream. The target encoded data obtained by encoding the output video stream is transmitted to the target client 506;

The target client 506 is further configured to: receive the target encoded data, and send the target encoded data to the client 502, so as to respond to the game screen sharing request.

Optionally, the cloud game server 504 is further configured to: obtain the to-be-output video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier, and to process the to-be-output video stream. transmitting the initial encoded data obtained by encoding to the client 502;

The client 502 is further configured to: receive the initial encoded data and the target encoded data, parse the initial encoded data and the target encoded data respectively, and obtain the initial parsing result and target parsing according to the parsing As a result, a first display window and a second display window are generated; wherein, the first display window and the second display window are superimposed and displayed, or the first display window and the second display window are displayed side by side.

Optionally, the game characters corresponding to the client 502 and the at least one target client 506 carry the same team identification.

Optionally, the video stream to be output includes picture data and/or audio data of the target character;

The cloud game server 504 is further configured to encode the picture data and/or audio data, obtain corresponding encoded data, and transmit the encoded data to the client 502 .

Optionally, the cloud game server 504 is further configured to: draw the picture data in a preset video memory, generate a picture to be encoded, and encode the picture to be encoded to obtain corresponding picture encoding data; And, the audio data is encoded by using an audio encoding function to obtain corresponding audio encoded data.

Optionally, the client 502 is further configured to: receive and decode the picture coded data and the audio coded data, obtain the picture data and the audio data, and play the picture through a display window picture data and the audio data.

In the embodiment of the present application, the client terminal submits a game screen sharing request to the cloud game server, and receives the to-be-output video stream of the target character returned by the cloud game server, so as to realize the sharing of the game screen between the client and at least one target client. Sharing, in order to share the game screen to the user in a timely manner through this screen sharing method, is conducive to improving the timeliness of information transmission, thereby providing a better game experience for the user.

A schematic diagram of a scenario of a cloud game processing process according to an embodiment of the present application is shown in FIG. 6 . A user submits a game screen sharing request to a cloud game server through a client, and the cloud game server sends the game sharing request to at least one target client. In the case of receiving the confirmation sharing instruction returned by at least one target client, the cloud game server obtains the to-be-output video stream of the target character, encodes the target character's to-be-output video stream to generate encoded data, and obtains the client's The to-be-output video stream of the game character, encodes the to-be-output video stream of the game character of the client, generates initial encoded data, sends the encoded data and the initial encoded data to the client, and the client interprets the encoded data And the initial encoded data is decoded, and the display window is configured according to the decoding result, the configuration result of the display window is shown in Figure 6, wherein, the window 1 is used to play the game screen of the game character of the client, and the window 2 is used to play the game of the target character. screen to play the game screen to the user through the display window.

Through this screen sharing method, the game screen is shared to the user in time, which is beneficial to improve the timeliness of information transmission, thereby providing the user with a better game experience.

Corresponding to the above method embodiments, the present application also provides an embodiment of a cloud game processing apparatus. FIG. 7 shows a schematic structural diagram of a cloud game processing apparatus configured on a cloud game server according to an embodiment of the present application. As shown in FIG. 7, the apparatus 700 includes:

The receiving module 702 is configured to receive a game screen sharing request submitted by the client, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

The obtaining module 704 is configured to obtain the to-be-output video stream of the at least one target character identification in the cloud game corresponding to the cloud game identification;

The transmission module 706 is configured to transmit the to-be-output video stream to the client.

Optionally, the cloud game processing device further includes:

a sending module, configured to send the game screen sharing request to the target client associated with the at least one target character identifier;

The obtaining module 704 is executed in the case of receiving the confirmation sharing instruction returned by at least one target client.

Optionally, the game characters corresponding to the client and the at least one target client carry the same team identification.

Optionally, the video stream to be output includes picture data and/or audio data of the target character;

Correspondingly, the transmission module 706 is further configured to:

The picture data and/or audio data are encoded to obtain corresponding encoded data, and the encoded data is transmitted to the client.

Optionally, the transmission module 706 includes:

a first encoding submodule, configured to draw the picture data in a preset display memory, generate a to-be-coded picture, and encode the to-be-coded picture to obtain corresponding picture encoded data;

The second encoding submodule is configured to encode the audio data by using an audio encoding function to obtain corresponding audio encoded data.

Corresponding to the above method embodiments, the present application further provides another embodiment of a cloud game processing apparatus. FIG. 8 shows a schematic structural diagram of a cloud game processing apparatus configured on a client according to an embodiment of the present application. As shown in FIG. 8, the apparatus 800 includes:

The sending module 802 is configured to send a game screen sharing request to the cloud game server, where the game screen sharing request carries a cloud game identifier and at least one target character identifier;

A receiving module 804, configured to receive the to-be-output video stream of the at least one target character identifier in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

The configuration module 806 is configured to configure at least one display window based on the to-be-output video stream, and the at least one display window respectively displays the to-be-output video stream identified by the at least one target character.

Optionally, the cloud game processing device further includes:

a first initial video stream receiving module, configured to receive the initial video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

Correspondingly, the configuration module 806 is further configured to:

A first display window and a second display window are configured based on the initial video stream and the to-be-output video stream; wherein, the second display window and the first display window are superimposed and displayed.

Optionally, the cloud game processing device further includes:

a second initial video stream receiving module, configured to receive the initial video stream of the character identifier associated with the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

a to-be-output video stream receiving module, configured to receive a to-be-output video stream of at least one target character identifier associated with the at least one target client in the cloud game corresponding to the cloud game identifier returned by at least one target client;

Correspondingly, the configuration module 806 is further configured to:

A first display window and a second display window are configured based on the initial video stream and the to-be-output video stream; wherein, the first display window and the second display window are superimposed and displayed, or the first display window and the The second display windows are displayed side by side.

An embodiment of the present application further provides a computing device, including a memory, a processor, and computer instructions stored in the memory and executable on the processor, and the processor implements the cloud game processing when the processor executes the instructions steps of the method.

An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions, and when the instructions are executed by a processor, implements the steps of the cloud game processing method as described above.

The above is a schematic solution of a computer-readable storage medium of this embodiment. It should be noted that the technical solution of the storage medium and the technical solution of the above-mentioned cloud game processing method belong to the same concept, and the details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the above-mentioned cloud game processing method. .

The foregoing describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

The computer instructions include computer program code, which may be in source code form, object code form, an executable file, some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable media Electric carrier signals and telecommunication signals are not included.

It should be noted that, for the convenience of description, the foregoing method embodiments are described as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with the present application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily all necessary for the present application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

The preferred embodiments of the present application disclosed above are only provided to help illustrate the present application. Alternative embodiments are not intended to exhaust all details, nor do they limit the invention to only the described embodiments. Obviously, many modifications and variations are possible in light of the content of this application. The present application selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present application, so that those skilled in the art can well understand and utilize the present application. This application is to be limited only by the claims, along with their full scope and equivalents.

Claims (21)

1. A cloud gaming processing system, the system comprising:

a client and a cloud game server;

the client is configured to submit a game picture sharing request to the cloud game server, wherein the game picture sharing request carries cloud game identification and at least one target role identification;

the cloud game server is configured to receive a game picture sharing request submitted by a client, acquire a video stream to be output of the at least one target role identifier in a cloud game corresponding to the cloud game identifier, and transmit the video stream to be output to the client;

the client is further configured to receive the video stream to be output, and configure at least one display window to respectively display the video stream to be output identified by the at least one target role.

2. The cloud gaming processing system of claim 1, further comprising: a target client;

the cloud game server is further configured to send the game picture sharing request to at least one target client associated with the at least one target character identifier;

the target client is configured to send a game screen sharing confirmation instruction to the cloud game server so as to respond to the game screen sharing request;

the cloud game server is further configured to obtain a video stream to be output of the at least one target role identifier in the cloud game corresponding to the cloud game identifier under the condition that the sharing confirmation instruction is received, and transmit encoded data obtained by encoding the video stream to be output to the client.

3. The cloud gaming processing system of claim 2, wherein the cloud gaming server is further configured to: acquiring a video stream to be output of the role identifier associated with the client in the cloud game corresponding to the cloud game identifier, and transmitting initial encoding data obtained by encoding the video stream to be output to the client;

the client further configured to: receiving the initial coding data and the coding data, analyzing the initial coding data and the coding data respectively, and configuring a first display window and a second display window according to an initial analysis result and a target analysis result obtained by analysis; and the second display window is displayed in an overlapping manner with the first display window.

4. The cloud gaming processing system of claim 2, wherein the cloud gaming server is further configured to: acquiring a video stream to be output of a target role identifier associated with the target client in the cloud game corresponding to the cloud game identifier, and transmitting target encoding data obtained by encoding the video stream to be output to the target client;

the target client further configured to: and receiving the target encoding data, and sending the target encoding data to the client to respond to the game picture sharing request.

5. The cloud gaming processing system of claim 4, wherein the cloud gaming server is further configured to: acquiring a video stream to be output of the role identifier associated with the client in the cloud game corresponding to the cloud game identifier, and transmitting initial encoding data obtained by encoding the video stream to be output to the client;

the client further configured to: receiving the initial coding data and the target coding data, analyzing the initial coding data and the target coding data respectively, and generating a first display window and a second display window according to an initial analysis result and a target analysis result obtained by analysis; and the first display window and the second display window are displayed in an overlapping mode, or the first display window and the second display window are displayed in a parallel mode.

6. The cloud game processing system of claim 1, wherein game characters of the client corresponding to the at least one target client carry a same team identification.

7. The cloud game processing system according to any one of claims 1 to 6, wherein the video stream to be output includes picture data and/or audio data of a target character;

the cloud game server is further configured to encode the picture data and/or the audio data, obtain corresponding encoded data, and transmit the encoded data to the client.

8. The cloud gaming processing system of claim 7, wherein the cloud gaming server is further configured to: drawing the picture data in a preset video memory to generate a picture to be coded, and coding the picture to be coded to obtain corresponding picture coded data; and coding the audio data by using an audio coding function to obtain corresponding audio coding data.

9. The cloud gaming processing system of claim 8, wherein the client is further configured to: and receiving and decoding the picture coded data and the audio coded data to obtain the picture data and the audio data, and playing the picture data and the audio data through a display window.

10. A cloud game processing method is applied to a cloud game server side and comprises the following steps:

receiving a game picture sharing request submitted by a client, wherein the game picture sharing request carries cloud game identification and at least one target role identification;

acquiring a video stream to be output of the at least one target role identifier in the cloud game corresponding to the cloud game identifier;

and transmitting the video stream to be output to the client.

11. The cloud game processing method according to claim 10, wherein after the step of receiving the game screen sharing request submitted by the client is executed and before the step of obtaining the video stream to be output of the at least one target character identifier in the cloud game corresponding to the cloud game identifier is executed, the method further comprises:

sending the game picture sharing request to a target client associated with the at least one target role identifier;

and under the condition of receiving a sharing confirmation instruction returned by at least one target client, executing the step of acquiring the video stream to be output of the at least one target role identifier in the cloud game corresponding to the cloud game identifier.

12. The cloud game processing method of claim 10, wherein the game characters corresponding to the client and the at least one target client carry the same team identification.

13. The cloud game processing method according to any one of claims 10 to 12, wherein the video stream to be output includes picture data and/or audio data of a target character;

correspondingly, the transmitting the video stream to be output to the client includes:

and coding the picture data and/or the audio data to obtain corresponding coded data, and transmitting the coded data to the client.

14. The cloud game processing method of claim 13, wherein said encoding the picture data and/or the audio data to obtain corresponding encoded data comprises:

drawing the picture data in a preset video memory to generate a picture to be coded, and coding the picture to be coded to obtain corresponding picture coded data; and coding the audio data by using an audio coding function to obtain corresponding audio coding data.

15. A cloud game processing method is applied to a client and comprises the following steps:

sending a game picture sharing request to a cloud game server, wherein the game picture sharing request carries cloud game identification and at least one target role identification;

receiving a video stream to be output of the at least one target role identifier in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

and configuring at least one display window based on the video stream to be output, wherein the at least one display window respectively displays the video stream to be output of the at least one target role identifier.

16. The cloud game processing method of claim 15, wherein before the step of configuring at least one display window based on the video stream to be output is performed, the method further comprises:

receiving an initial video stream of the role identifier associated with the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

correspondingly, the configuring at least one display window based on the video stream to be output includes:

configuring a first display window and a second display window based on the initial video stream and the video stream to be output; and the second display window is displayed in an overlapping manner with the first display window.

17. The cloud game processing method of claim 15, wherein after the step of sending a game screen sharing request to a cloud game server is performed and before the step of configuring at least one display window based on the video stream to be output is performed, the method further comprises:

receiving an initial video stream of the role identifier associated with the client in the cloud game corresponding to the cloud game identifier returned by the cloud game server;

receiving a video stream to be output of at least one target role identifier associated with at least one target client in a cloud game corresponding to the cloud game identifier returned by at least one target client;

correspondingly, the configuring at least one display window based on the video stream to be output includes:

configuring a first display window and a second display window based on the initial video stream and the video stream to be output; and the first display window and the second display window are displayed in an overlapping mode, or the first display window and the second display window are displayed in a parallel mode.

18. A cloud game processing device is applied to a cloud game server side and comprises:

the game system comprises a receiving module, a processing module and a display module, wherein the receiving module is configured to receive a game picture sharing request submitted by a client, and the game picture sharing request carries cloud game identification and at least one target role identification;

the acquisition module is configured to acquire a video stream to be output of the at least one target role identifier in the cloud game corresponding to the cloud game identifier;

a transmission module configured to transmit the video stream to be output to the client.

19. A cloud game processing device applied to a client comprises:

the game server comprises a sending module, a receiving module and a processing module, wherein the sending module is configured to send a game picture sharing request to a cloud game server, and the game picture sharing request carries cloud game identification and at least one target role identification;

a receiving module configured to receive a video stream to be output of the at least one target character identifier in a cloud game corresponding to the cloud game identifier returned by the cloud game server;

and the configuration module is configured to configure at least one display window based on the video stream to be output, and the at least one display window respectively displays the video stream to be output of the at least one target role identifier.

20. A computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, wherein the processor implements the steps of the method of any one of claims 10-14 or 15-17 when executing the instructions.

21. A computer-readable storage medium storing computer instructions, which when executed by a processor, perform the steps of the method of any one of claims 10-14 or 15-17.

Images