CN116320520A - Model animation rendering method and device, computer storage medium, electronic equipment - Google Patents

Abstract

The disclosure belongs to the technical field of model animation rendering, and relates to a model animation rendering method and device, a computer storage medium and electronic equipment. The method comprises the following steps: obtaining model resource data of a target three-dimensional model, and analyzing a target audio frequency band corresponding to model attributes of the target three-dimensional model from the model resource data; collecting an audio stream corresponding to a target anchor in a live broadcasting room, and analyzing the audio stream to obtain model driving values corresponding to different audio frequency segments; and determining a target driving value corresponding to the target audio frequency band from the model driving values, and rendering model animation corresponding to the target three-dimensional model in the live broadcasting room based on the target driving value and the model resource data. In the method, the model animation is rendered based on the target model driving value and the model resource data, so that the correlation exists between the rendering of the model animation and the sound of the target anchor, the rendering effect of the model animation in the voice live broadcasting room is improved, and the visual experience of audiences is enhanced.

Description

Model animation rendering method and device, computer storage medium, electronic equipment

technical field

The present disclosure relates to the technical field of model animation rendering, and in particular, to a model animation rendering method, a model animation rendering device, a computer-readable storage medium, and electronic equipment.

Background technique

With the development of live broadcast technology, voice live broadcast has become a mainstream live broadcast method. However, in the process of live voice broadcast, the audience's visual experience is often ignored.

In related technologies, specific audio files are usually used to drive the display of animations. However, the animation effects displayed in this way are not related to the host, and the animation effects displayed are poor, which cannot improve the audience's voice awareness. The visual experience in the live broadcast room.

In view of this, there is an urgent need in the art to develop a new method and device for rendering model animation.

It should be noted that the information disclosed in the above background section is only for enhancing the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to those of ordinary skill in the art.

Contents of the invention

The purpose of the present disclosure is to provide a model animation rendering method, a model animation rendering device, a computer-readable storage medium, and an electronic device, so as to overcome at least to a certain extent the problem of poor visual experience of viewers in a voice broadcast room caused by related technologies .

Other features and advantages of the present disclosure will become apparent from the following detailed description, or in part, be learned by practice of the present disclosure.

According to the first aspect of the embodiments of the present invention, there is provided a model animation rendering method, the method comprising: acquiring model resource data of a target 3D model, and parsing out a model corresponding to the target 3D model from the model resource data The target audio frequency band corresponding to the attribute; collect the audio stream corresponding to the target anchor in the live broadcast room, analyze the audio stream to obtain the model driving value corresponding to different audio frequency bands; determine the model driving value corresponding to the described model driving value The target driving value corresponding to the target audio frequency band, based on the target driving value and the model resource data, a model animation corresponding to the target three-dimensional model is rendered in the live broadcast room.

According to the second aspect of the embodiments of the present invention, there is provided a method for generating model resource data, the method comprising: importing a target three-dimensional model, and displaying a configuration interface corresponding to the target three-dimensional model; the configuration interface includes information related to the target three-dimensional model The first configuration area corresponding to the model attribute of the target three-dimensional model and the second configuration area of the target audio frequency band corresponding to the model attribute; in response to the first selection operation acting on the first configuration area, obtain the The model attribute corresponding to the first selection operation; in response to the second selection operation acting on the second configuration area, the target audio frequency band corresponding to the second selection operation is obtained; based on the model attribute and the The target audio frequency band is used to generate model resource data corresponding to the target three-dimensional model.

According to a third aspect of the embodiments of the present invention, there is provided a model animation rendering device, the device comprising: an analysis module configured to acquire model resource data of a target 3D model, and analyze from the model resource data the data related to the model animation The target audio frequency band corresponding to the model attribute of the three-dimensional model; the collection module is configured to collect the audio stream corresponding to the target anchor in the live broadcast room, and analyze the audio stream to obtain the model driving value corresponding to different audio frequency bands; rendering A module configured to determine a target driving value corresponding to the target audio frequency band from the model driving values, and based on the target driving value and the model resource data, render a The model animation corresponding to the target 3D model.

According to a fourth aspect of the embodiments of the present invention, there is provided a device for generating model resource data, the device comprising: an import module configured to import a target 3D model and display a configuration interface corresponding to the target 3D model; The configuration interface includes a first configuration area corresponding to the model attribute of the target three-dimensional model and a second configuration area corresponding to the target audio frequency band corresponding to the model attribute; the first response module is configured to respond to the first configuration area A first selection operation in a configuration area, to obtain the model attribute corresponding to the first selection operation; a second response module configured to respond to a second selection operation acting on the second configuration area, to obtain The target audio frequency band corresponding to the second selection operation; a generating module configured to generate model resource data corresponding to the target three-dimensional model based on the model attribute and the target audio frequency band.

According to a fifth aspect of the embodiments of the present invention, there is provided an electronic device, including: a processor and a memory; wherein, the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the above-mentioned The method of any of the exemplary embodiments.

According to a sixth aspect of the embodiments of the present invention, there is provided a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method in any of the foregoing exemplary embodiments is implemented.

It can be seen from the above technical solutions that the model animation rendering method, model animation rendering device, computer storage medium and electronic equipment in the exemplary embodiments of the present invention have at least the following advantages and positive effects:

In the method and device provided by the exemplary embodiments of the present disclosure, based on the target model driving value and model resource data, the model animation corresponding to the target 3D model is rendered in the live broadcast room, because the target model driving value is the target anchor On the one hand, there is a correlation between the rendered model animation and the voice of the target anchor; on the other hand, the rendered model animation is the animation of the target 3D model, which improves the performance of the voice broadcast room. The rendering effect of model animation enhances the visual experience of the audience.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure. Apparently, the drawings in the following description are only some embodiments of the present disclosure, and those skilled in the art can obtain other drawings according to these drawings without creative efforts.

FIG. 1 schematically shows a schematic flowchart of a model animation rendering method in an embodiment of the present disclosure;

FIG. 2 schematically shows a schematic flow diagram of analyzing an audio stream to obtain model driving values corresponding to different audio frequency bands in a model animation rendering method in an embodiment of the present disclosure;

FIG. 3 schematically shows a flow diagram of dividing an audio stream in the frequency domain to obtain initial amplitude data in a model animation rendering method in an embodiment of the present disclosure;

Fig. 4 schematically shows a schematic flowchart of calculating the target amplitude data in the updated amplitude data queue to obtain the model driving value in the model animation rendering method in the embodiment of the present disclosure;

FIG. 5 schematically shows a schematic flow diagram of rendering a model animation corresponding to a target 3D model in a live broadcast room based on a target driving value and model resource data in a model animation rendering method in an embodiment of the present disclosure;

FIG. 6 schematically shows a schematic flowchart of rendering a model animation corresponding to a target 3D model in a live broadcast room in a model animation rendering method in an embodiment of the present disclosure;

FIG. 7 schematically shows a schematic flowchart of a method for generating model resource data in an embodiment of the present disclosure;

Fig. 8 schematically shows a schematic flow chart of changing model resource data in a method for generating model resource data in an embodiment of the present disclosure;

FIG. 9 schematically shows an apparatus for a model animation rendering method in an embodiment of the present disclosure;

FIG. 10 schematically shows an apparatus for a method for generating model resource data in an embodiment of the present disclosure;

Fig. 11 schematically shows an electronic device in an embodiment of the present disclosure;

Fig. 12 schematically shows a computer-readable storage medium in an embodiment of the present disclosure.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.

The terms "a", "an", "the" and "the" are used in this specification to indicate the existence of one or more elements/components/etc.; the terms "comprising" and "having" are used to indicate an open Included means and means that there may be additional elements/components/etc. in addition to the listed elements/components/etc; the terms "first" and "second" etc. The number of its objects is limited.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities.

Aiming at the problems existing in related technologies, the present disclosure proposes a model animation rendering method. Fig. 1 shows a schematic flow chart of a model animation rendering method. As shown in Fig. 1, the model animation rendering method at least includes the following steps:

Step S110. Obtain model resource data of the target 3D model, and analyze the target audio frequency band corresponding to the model attribute of the target 3D model from the model resource data.

Step S120. Collect the audio stream corresponding to the target anchor in the live broadcast room, and analyze the audio stream to obtain model driving values corresponding to different audio frequency bands.

Step S130. Determine the target driving value corresponding to the target audio frequency band from the model driving values, and render a model animation corresponding to the target 3D model in the live broadcast room based on the target driving value and model resource data.

In the method and device provided by the exemplary embodiments of the present disclosure, based on the target driving value and model resource data, the model animation corresponding to the target 3D model is rendered in the live broadcast room, since the target driving value is the audio stream of the target anchor On the one hand, there is a correlation between the rendered model animation and the voice of the target anchor; on the other hand, the rendered model animation is the animation of the target 3D model, which improves the accuracy of the model animation in the live broadcast room. Rendering effects that enhance the viewer's visual experience.

Each step of the model animation rendering method will be described in detail below.

In step S110, the model resource data of the target three-dimensional model is obtained, and the target audio frequency band corresponding to the model attribute of the target three-dimensional model is analyzed from the model resource data.

In an exemplary embodiment of the present disclosure, the target three-dimensional model is a model that needs to be rendered in a live broadcast room, and the target three-dimensional model is different from a plane model, and is a model with a three-dimensional rendering effect. The target 3D model may be a preset 3D model, or a 3D model that has a one-to-one mapping relationship with the host, which is not specifically limited in this exemplary embodiment.

The model resource data refers to the data necessary for rendering the target 3D model. Specifically, the model resource data may include the target 3D model saved in the graphics language transmission format, and may also include texture files (used to determine the target 3D model) have textures), and can also include animation parameter profiles. Wherein, the animation parameter configuration file includes the model attributes of the target three-dimensional model, and also includes the target audio frequency band that needs to be used when calculating the attribute values of the model attributes.

Based on this, after the model resource data of the target 3D model is obtained, the model resource data can be analyzed, and then the model attributes of the target 3D model included in the model resource data and the attributes required for determining the attribute values of the model attributes can be determined. The target audio frequency band to use.

In this exemplary embodiment, on the one hand, what is acquired is the target 3D model with a stereoscopic rendering effect, which is helpful for subsequent rendering of model animations with better visual effects; on the other hand, parsing the model resource data can obtain the The target audio frequency band corresponding to the model attribute of the target 3D model lays the foundation for subsequent determination of the target driving value to render the model animation corresponding to the target 3D model according to the target driving value and model resource data.

In step S120, the audio stream corresponding to the target host in the live broadcast room is collected, and the audio stream is analyzed to obtain model driving values corresponding to different audio frequency bands.

In an exemplary embodiment of the present disclosure, no matter it is a voice live broadcast or a video live broadcast, the target host will generate voices during the live broadcast, and the terminal can collect these voices to obtain an audio stream corresponding to the target host.

By analyzing the audio stream, it is possible to analyze the change in the intensity of the sound made by the target anchor. Different audio frequency bands correspond to different sound intensities. For example, at this time, it is the target anchor A that makes a sound in the voice live broadcast room, and then, the voice of the target anchor A is collected to obtain the audio stream L-1 corresponding to the target anchor A. By analyzing the audio stream L-1, the sound frequency corresponding to the audio stream L-1 and the frequency amplitude corresponding to the sound frequency can be obtained. Based on this, among these frequency amplitudes, the frequency amplitude values belonging to the treble frequency range, the frequency amplitude values belonging to the middle frequency range and the frequency amplitude values belonging to the low frequency range can be determined.

The model driving values can be obtained by calculating the frequency amplitude values belonging to the high frequency band, the frequency amplitude values belonging to the middle frequency band and the frequency amplitude values belonging to the low frequency band respectively. The model driving value is specifically composed of three values, among which, the first value is the calculation result obtained after calculating the frequency amplitude value belonging to the bass frequency band, and the second value is the calculation result obtained after calculating the frequency amplitude value belonging to the middle audio frequency band. The calculation result obtained after the calculation, the third value belongs to the calculation result obtained after the frequency amplitude value of the treble frequency band is calculated.

In an optional embodiment, FIG. 2 shows a schematic flowchart of analyzing the audio stream in the model animation rendering method to obtain model driving values corresponding to different audio frequency bands. As shown in FIG. 2, the method at least includes the following steps: In step S210, the audio stream is divided into frequency bands to obtain initial amplitude data, which includes initial amplitude values in different audio frequency bands.

Wherein, for example, 30 audio streams are collected per second, and the 30 audio streams are divided into frequency bands according to the time of collection, and 30 initial amplitude data can be successively obtained. Each piece of initial amplitude data includes multiple initial amplitude values in different audio frequency bands. For example, the initial amplitude data can be obtained by performing frequency band division on 30 audio streams collected per second. Specifically, the initial amplitude data may consist of 45 initial amplitudes in different audio frequency bands.

In step S220, the initial amplitude values belonging to the same audio frequency band in the initial amplitude data are calculated to obtain target amplitude data, so as to add the target amplitude data into the amplitude data queue.

Wherein, the initial amplitude data is composed of initial amplitude values in different audio frequency bands, for example, the initial amplitude data includes initial amplitude values in the low audio frequency band, also includes initial amplitude values in the middle The initial amplitude value of the audio band. The average value of the initial amplitude value in the low audio frequency band can be calculated to obtain the value N-1, the average value of the initial amplitude value in the middle audio frequency band can be calculated to obtain the value N-2, and the initial amplitude value in the high audio frequency band can be obtained. The average calculation results in the value N-3. At this time, the target amplitude data is composed of a value N−1, a value N−2, and a value N−3. After the target amplitude data is calculated, the target amplitude data is added to the amplitude data queue.

In step S230, an interpolation process is performed on the target amplitude data in the amplitude data queue to obtain an updated amplitude data queue.

Wherein, after the target amplitude data is added to the amplitude data queue, interpolation processing needs to be performed on the target amplitude data. The reason why the target amplitude data needs to be interpolated is because Z-1 audio streams can usually be obtained per second, and then Z-1 target amplitude data can be added to the amplitude data queue per second. However, in During the subsequent rendering of the model animation corresponding to the target 3D model, the rendering speed is Z-2 frames per second. Since the Z-2 is different from the Z-1, the rendering effect of the model animation cannot be guaranteed.

Based on this, it is necessary to perform interpolation processing on the target amplitude data to ensure that there are Z-2 pieces of target amplitude data per second in the amplitude data queue.

Specifically, the process of interpolating the target amplitude data is as follows: each time a new target amplitude data C-0 is obtained, the target amplitude data C-0 is calculated with the last target amplitude data in the amplitude data queue, to generate target amplitude data C-1. The target amplitude data C-1 and the target amplitude data C-0 are sequentially added to the amplitude data queue to obtain an updated amplitude data queue.

In step S240, calculate the target amplitude data in the updated amplitude data queue to obtain model driving values corresponding to different audio frequency bands.

Wherein, the target amplitude data includes the target amplitude value, and the target amplitude value and its corresponding amplitude threshold are calculated to obtain model driving values corresponding to different audio frequency bands.

In this exemplary embodiment, the audio stream corresponding to the target host is divided into frequency bands to obtain initial amplitude values in different audio frequency bands, and then to obtain model driving values corresponding to different audio frequency bands for subsequent animation of the model to establish the connection between the sound of the target anchor and the rendering of the model, and enhance the audience's visual experience in the live broadcast room; The amplitude data queue meets the requirements of model animation rendering and ensures the effect of model animation rendering.

In an optional embodiment, FIG. 3 shows a schematic flow diagram of dividing the audio stream in the frequency domain in the model animation rendering method to obtain initial amplitude data. As shown in FIG. 3 , the method at least includes the following steps: in step S310 In the method, frequency domain analysis is performed on the audio stream to obtain multiple frequencies corresponding to the audio stream and multiple frequency amplitudes respectively corresponding to the multiple frequencies.

Among them, the usually collected audio stream is an audio stream in the time domain. In order to divide the frequency band of the audio stream, it is necessary to analyze the frequency domain of the audio stream to convert the audio stream from the time domain to the frequency domain, and then obtain the Multiple frequencies corresponding to the audio stream and frequency amplitudes corresponding to the multiple frequencies. Specifically, a fast Fourier transform may be performed on the audio stream to perform frequency domain analysis on the audio stream, or other methods may be used to perform frequency domain analysis on the audio stream, which is not particularly limited in this exemplary embodiment.

In step S320, the multiple frequency amplitudes are divided into frequency bands to obtain initial amplitude data; the initial amplitude data include initial amplitude values in different audio frequency bands.

Wherein, after obtaining multiple frequency amplitudes, the multiple frequency amplitudes can be divided into frequency bands to obtain the initial amplitude value in the bass frequency range, the initial value amplitude value in the middle frequency range and the initial amplitude value in the high frequency range. These initial amplitude values in different audio frequency bands constitute the initial amplitude data.

In this exemplary embodiment, on the one hand, performing frequency domain analysis on the audio stream corresponding to the target anchor will help to obtain multiple frequencies corresponding to the sound of the target anchor and multiple frequency amplitudes corresponding to the frequency; on the other hand , divide multiple frequency amplitudes into frequency bands to obtain initial amplitude data, which makes it possible to obtain the model driving value corresponding to the audio stream of the target anchor according to the initial amplitude data, and establishes the relationship between the model driving value and the sound of the target anchor, Improved the effect of the subsequent rendered model animation corresponding to the target 3D model.

In an optional embodiment, FIG. 4 shows a schematic flow chart of calculating the target amplitude data in the updated amplitude data queue to obtain the model driving value in the model animation rendering method. The target amplitude data includes the target amplitude value, such as As shown in FIG. 4 , the method at least includes the following steps: In step S410 , determining an amplitude threshold corresponding to the target amplitude data in the updated amplitude data queue.

Wherein, the target amplitude data consists of target amplitude values in different audio frequency bands. The amplitude threshold refers to a critical value for defining a target amplitude value.

In step S420, if the target amplitude value in the target amplitude data is greater than or equal to the amplitude threshold, then replace the target amplitude value with the first model driving value.

Wherein, the first model driving value refers to a preset value, specifically, the first model driving value may be 1. For example, the amplitude threshold is 200, and the target amplitude data is [D-1, D-2, D-3]. Since D-1 and D-2 are greater than 200, both D-1 and D-2 are replaced with 1.

In step S430, if the target amplitude value in the target amplitude data is smaller than the amplitude threshold value, the target amplitude value and the amplitude threshold value are calculated to obtain the second model driving value.

Wherein, when the target amplitude value in the target amplitude data is smaller than the amplitude threshold value, the target amplitude value and the amplitude threshold value are divided and calculated to obtain the second model driving value.

For example, since D-3 is less than 200, divide D-3 and 200, if the calculation result is 0.5, replace D-3 with 0.5, and the target amplitude data obtained at this time is [1,1 ,0.5].

In this exemplary embodiment, the model driving value can be obtained by comparing the target amplitude value with the amplitude threshold value, so as to increase the convenience of subsequently calculating the attribute value of the model attribute by using the model driving value.

In step S130, a target driving value corresponding to the target audio frequency band is determined from the model driving values, and a model animation corresponding to the target 3D model is rendered in the live broadcast room based on the target driving value and model resource data.

In an exemplary embodiment of the present disclosure, the model driving value specifically includes three numerical values, which are respectively a driving value corresponding to a bass frequency range, a driving value corresponding to a middle frequency range and a driving value corresponding to a high frequency range. If the target audio frequency band is a high audio frequency band, the driving value corresponding to the high audio frequency band among the model driving values may be determined as the target driving value.

After the target driving value is determined, the target driving value can be used to calculate the attribute value corresponding to the model attribute of the target 3D model, and then based on the obtained calculation result and model resource data, the target 3D model can be rendered in the live broadcast room Corresponding model animation.

It is worth noting that the target 3D model may be composed of multiple model nodes, and each model node has a corresponding model attribute. Specifically, the model attributes include the rotation attribute of the model node, the scaling attribute of the model node, the offset attribute of the model node, the scaling attribute of the texture at the model node, the rotation attribute of the texture at the model node, the offset attribute of the texture at the model node, The self-emitting light intensity attribute of the material at the model node and the transparency attribute of the material at the model node are not specifically limited in this exemplary embodiment.

In an optional embodiment, FIG. 5 shows a schematic flowchart of rendering a model animation corresponding to the target 3D model in the live broadcast room based on the target driving value and model resource data in the model animation rendering method. The model resource data includes The driving value adjustment factor, as shown in Figure 5, the method at least includes the following steps: In step S510, the current attribute value of the model attribute corresponding to the current frame, the driving value adjustment factor, the target driving value and the corresponding to the first frame The first calculation formula between the first attribute values of the model attributes; the difference between the current frame and the first frame is one frame interval.

Wherein, the model resource data also includes a driving value adjustment factor, and the driving value adjustment factor is used to determine the influence degree of the target driving value on the attribute value corresponding to the model attribute.

It is worth noting that every 360-degree rotation will restore the model node and the texture at the model node to their original positions. Therefore, the rotation attribute of the model node and the rotation attribute of the texture at the model node can be divided into L-1 type attributes. Similarly, the offset attribute of the model node and the offset attribute of the texture at the model node also have the above characteristics, therefore, the offset attribute of the model node and the offset attribute of the texture at the model node also belong to the L-1 type attribute.

Other model attributes besides this do not have the above-mentioned characteristics, so they can be classified as the first type of attributes. Whether it belongs to the L-1 type attribute or the first type attribute, the current attribute value can be calculated by determining the first calculation formula.

For example, for the rotation attribute of the model node, the determined first calculation formula is shown as formula (1).

The rotation angle value of the current frame of the model node = the rotation angle value of the first frame of the model node

+drive value adjustment factor x target drive value(1)

Wherein, the rotation angle value of the current frame of the model node is the current attribute value, and the rotation angle value of the first frame of the model node is the first attribute value. Assuming that the model driving value is [1,1,0.5], if the target audio frequency band corresponding to the rotation angle attribute of the model node is a low audio frequency band, then the target driving value in formula (1) is 1.

In step S520, based on the first calculation formula, the driving value adjustment factor, the target driving value and the first property value are calculated to obtain the current property value.

Wherein, after the first calculation formula is determined, the driving value adjustment factor, the target driving value and the first attribute value are substituted into the first calculation formula to calculate the current attribute value of the model attribute corresponding to the current frame.

For example, the determined target driving value is 1, the first attribute value is 30 degrees, and the driving value adjustment factor is a value a. Based on the first calculation formula, the rotation angle value of the model node in the current frame can be calculated as 30+ a.

In step S530, based on the current attribute value and model resource data, a model animation corresponding to the target 3D model is rendered in the live broadcast room.

Wherein, after the current attribute value is determined, a model animation corresponding to the target 3D model is rendered in the live broadcast room according to the current attribute value and model resource data.

For example, the determined current attributes include a rotation angle of 60 in the current frame and a scaling value of 1.2 in the current frame. If the target 3D model is a three-dimensional flower, the model animation rendered in the live broadcast room will be an enlarged three-dimensional flower rotated 60 degrees.

In this exemplary embodiment, based on the first calculation formula, the first attribute value, the target driving value, and the driving adjustment factor are calculated to obtain the current attribute value, so that the model can be rendered in the live broadcast room based on the current attribute value Animations to enhance the visual experience of the audience.

In an optional embodiment, FIG. 6 shows a schematic flowchart of rendering a model animation corresponding to the target 3D model in the live broadcast room in the model animation rendering method. The model resource data includes the first driving value adjustment factor; the model attribute Including the first type of attribute, as shown in Figure 6, the method at least includes the following steps: In step S610, determine the first attribute threshold and the second attribute threshold corresponding to the first type of attribute, determine the first attribute threshold and the second attribute threshold Threshold difference between attribute thresholds.

Wherein, for the first type of attribute, its attribute value must be within a preset range. The upper limit of the preset range is the first attribute threshold, and the lower limit of the preset range is the second attribute threshold. The threshold difference is a calculation result obtained after calculating the difference between the first attribute threshold and the second attribute threshold.

In step S620, determine the first attribute threshold, the target driving value, the threshold difference, the first current attribute value of the first type attribute corresponding to the current frame, the second attribute value of the first type attribute corresponding to the second frame, and The second calculation formula between the first driving value adjustment factors; the difference between the current frame and the second frame is one frame interval.

Wherein, when calculating the first type of attribute, the calculation formula used is the second calculation formula. For example, if the first type of attribute is the scaling attribute of the model node, then the second calculation formula is determined as shown in formula (2).

The scaling value of the current frame of the model node = the minimum scaling value of the model node + the scaling range of the model node × (the target driving value × the first driving value adjustment factor + (the scaling value of the model node in the previous frame - the minimum scaling value of the model node )/Zoom range of the model node×(1-

First drive value adjustment factor))(2)

Wherein, the zoom value of the current frame of the model node is the first current attribute value, the minimum zoom value of the model node is the second attribute threshold, and the zoom range of the model node is the threshold difference.

In step S630, based on the second calculation formula, the first property threshold, the target driving value, the threshold difference, the second property value and the first driving value adjustment factor are calculated to obtain the first current property value.

Wherein, the first current attribute value can be obtained by calculating the first attribute threshold, the target driving value, the threshold difference, the second attribute value and the first driving value adjustment factor according to the second calculation formula.

In step S640, based on the first current attribute value and model resource data, a model animation corresponding to the target 3D model is rendered in the live broadcast room.

Wherein, after the first current attribute value is calculated, a model animation corresponding to the target three-dimensional model is rendered in the live broadcast room according to the first current attribute value.

In this exemplary embodiment, the first current attribute value is calculated based on the second calculation formula, so that the model animation is rendered in the live broadcast room based on the first current attribute value, so as to improve the visual experience of the audience.

In this exemplary embodiment, based on the driving value of the target model and the model resource data, the model animation corresponding to the target 3D model is rendered in the live broadcast room. Since the driving value of the target model is obtained by analyzing the audio stream of the target anchor, Furthermore, on the one hand, there is a correlation between the rendered model animation and the voice of the target anchor; on the other hand, the rendered model animation is the animation of the target 3D model, which improves the rendering effect of the model animation in the live voice room and enhances the viewer's visual experience.

Aiming at the problems existing in related technologies, the present disclosure proposes a method for generating model resource data. Fig. 7 shows a schematic flowchart of a method for generating model resource data. As shown in Fig. 7, the method for generating model resource data includes at least the following steps:

Step S710. Import the target 3D model, and display the configuration interface corresponding to the target 3D model; the configuration interface includes a first configuration area corresponding to the model attribute of the target 3D model and a second configuration area corresponding to the target audio frequency band corresponding to the model attribute.

Step S720. Obtain the model attribute corresponding to the first selection operation in response to the first selection operation in the first configuration area.

Step S730. Obtain the target audio frequency band corresponding to the second selection operation in response to the second selection operation in the second configuration area.

In step S740. Based on the model attributes and the target audio frequency band, generate model resource data corresponding to the target three-dimensional model.

In the method and device provided by the exemplary embodiments of the present disclosure, the configuration interface corresponding to the target three-dimensional model is displayed, and there is a first configuration area corresponding to the model attribute and a second configuration area corresponding to the target audio frequency band in the configuration interface. Configuration area, where the target audio frequency band corresponds to the model properties, which makes it no longer dependent on the designer when the model animation needs to be adjusted, but can adjust the rendering of the model animation by performing corresponding configurations in the configuration interface Effect, which increases the convenience and flexibility of adjusting the rendering effect of model animation.

Each step of the method for generating model resource data will be described in detail below.

In step S710, the target three-dimensional model is imported, and a configuration interface corresponding to the target three-dimensional model is displayed; the configuration interface includes a first configuration area corresponding to the model attribute of the target three-dimensional model and a second configuration of the target audio frequency band corresponding to the model attribute area.

Wherein, by importing the target 3D model, a configuration interface may be displayed in the terminal, and the configuration interface is used to configure model attributes corresponding to the target 3D model and target audio frequency bands corresponding to the model attributes.

It is worth noting that there is a first configuration area for configuring model properties in the configuration interface, and a second configuration area for configuring target audio frequency bands corresponding to the model properties in the configuration interface.

In step S720, in response to the first selection operation acting on the first configuration area, the model attribute corresponding to the first selection operation is obtained.

Wherein, the first selection operation is the operation of selecting the model attribute to be configured. The first selection operation may be a click operation, a double-click operation, a long press operation, or any kind of touch operation. This exemplary implementation There is no special limitation for this example.

After the first selection operation is performed in the first configuration area, the model attribute corresponding to the first selection operation will be obtained, for example, when the model attribute of the rotation angle of the model node K is clicked in the first configuration area , the model attribute of the rotation angle of the model node K will be obtained.

In step S730, in response to the second selection operation acting on the second configuration area, the target audio frequency band corresponding to the second selection operation is obtained.

Wherein, when the second selection operation is performed in the second configuration area, a target audio frequency band will be obtained. For example, when the high audio frequency band is clicked in the second configuration area, the obtained target audio frequency band is the high audio frequency band. At this time, the relationship between the high audio frequency band and the model attribute of the rotation angle of the model node K There is a corresponding relationship.

In step S740, model resource data corresponding to the target 3D model is generated based on the model attributes and the target audio frequency band.

Wherein, after the model attribute and the target audio frequency band are determined, model resource data corresponding to the target 3D model can be generated, so as to render the target 3D model in the live broadcast room according to the model resource data.

In an optional embodiment, FIG. 8 shows a schematic flowchart of changing model resource data in the method for generating model resource data. As shown in FIG. 8 , the method at least includes the following steps: The first change operation in the configuration area obtains the change model attribute corresponding to the first change operation.

Wherein, the first modification operation refers to an operation of modifying the selected model attribute. When the first modification operation is performed in the first configuration area, the model attribute corresponding to the first modification operation is the modified model attribute.

In step S820, in response to the second modification operation acting on the second configuration area, a modification target audio frequency band corresponding to the second modification operation is obtained.

Among them, changes can be made to the model properties, as well as to the target audio frequency band. When the second modification operation is performed in the second configuration area, the target audio frequency band corresponding to the second modification operation can be obtained as the modification target audio frequency band.

In step S830, the model resource data is changed based on changing the model attribute and changing the target audio frequency band.

Among them, the model resource data is changed according to changing the model properties and changing the target audio frequency band.

For example, if a click operation is performed in the second configuration area, at this time, the target audio frequency band corresponding to the click operation is changed to the low audio frequency band, then based on the model attribute of the rotation angle of the model node K and the low audio frequency band, the Model resource data changes.

In this exemplary embodiment, a configuration interface corresponding to the target three-dimensional model is displayed, and there is a first configuration area corresponding to the model attribute and a second configuration area corresponding to the target audio frequency band in the configuration interface, wherein the target audio The frequency band corresponds to the model attribute, which makes it no longer dependent on the designer when the model animation needs to be adjusted, but through the corresponding configuration in the configuration interface, the rendering effect of the model animation can be adjusted, and the adjustment model animation is added. Convenience and flexibility of rendering effects.

The model animation rendering method in the embodiment of the present disclosure will be described in detail below in conjunction with an application scenario.

Obtain the model resource data corresponding to the target 3D model of "three-dimensional ball", and analyze the model resource data to obtain the model attribute S-1 and model attribute S-2 in the target 3D model, and also obtain the model attribute S The target audio frequency band corresponding to -1 (specifically, the low audio frequency band) and the target audio frequency band corresponding to the model attribute S-2 (ie, the middle audio frequency band).

Collect the audio stream corresponding to the anchor G in the live broadcast room, and analyze the audio stream to obtain the model driving value [1,0.2,0.5], where 1 corresponds to the low audio frequency band, 0.2 corresponds to the middle audio frequency band, and 0.5 corresponds to the high audio frequency band corresponding to the frequency band.

Since the target audio frequency band is the middle audio frequency band, the determined target driving value is 0.2. Based on the target driving value of 0.2 and the model resource data, the model animation corresponding to the "stereo ball" is rendered in the live broadcast room.

In this application scenario, based on the driving value of the target model and the model resource data, the model animation corresponding to the target 3D model is rendered in the live broadcast room. Since the driving value of the target model is obtained by analyzing the audio stream of the target anchor, further On the one hand, there is a correlation between the rendered model animation and the voice of the target anchor; on the other hand, the rendered model animation is the animation of the target 3D model, which improves the rendering effect of the model animation in the live voice room and enhances the audience visual experience. Each step of the model animation rendering method will be described in detail below.

In addition, in an exemplary embodiment of the present disclosure, a model animation rendering device is also provided. FIG. 9 shows a schematic structural diagram of a model animation rendering device. As shown in FIG. 9 , the model animation rendering device 900 may include: an analysis module 910 , a collection module 920 and a rendering module 930 . in:

The analysis module 910 is configured to obtain the model resource data of the target three-dimensional model, and parses out the target audio frequency band corresponding to the model attribute of the target three-dimensional model from the model resource data; the acquisition module 920 is configured to acquire the target audio frequency band in the live broadcast room The audio stream corresponding to the anchor, analyze the audio stream to obtain the model driving value corresponding to different audio frequency bands; the rendering module 930 is configured to determine the target driving value corresponding to the target audio frequency band from the model driving value, based on the target driving value As well as model resource data, the model animation corresponding to the target 3D model is rendered in the live broadcast room.

In an exemplary embodiment of the present disclosure, a device for generating model resource data is also provided. FIG. 10 shows a schematic structural diagram of a model resource data generation device. As shown in FIG. 10 , the model resource data generation device 1000 may include: an import module 1010 , a first response module 1020 , a second response module 1030 and a generation module 1040 . in:

The import module 1010 is configured to import the target three-dimensional model, and display a configuration interface corresponding to the target three-dimensional model; the configuration interface includes a first configuration area corresponding to the model attribute of the target three-dimensional model and a first configuration area corresponding to the target audio frequency band corresponding to the model attribute. Two configuration areas; the first response module 1020 is configured to respond to the first selection operation acting on the first configuration area, and obtain the model attribute corresponding to the first selection operation; the second response module 1030 is configured to respond to the first selection operation The second selection operation in the second configuration area obtains the target audio frequency band corresponding to the second selection operation; the generating module 1040 is configured to generate model resource data corresponding to the target 3D model based on the model attribute and the target audio frequency band.

The specific details of the model animation rendering apparatus 900 and the model resource data generating apparatus 1000 have been described in detail in the corresponding methods, so details are not repeated here.

It should be noted that although several modules or units of the model animation rendering device 900 and the model resource data generating device 1000 are mentioned in the above detailed description, this division is not mandatory. Actually, according to the embodiment of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided to be embodied by a plurality of modules or units.

In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

An electronic device 1100 according to such an embodiment of the present invention is described below with reference to FIG. 11 . The electronic device 1100 shown in FIG. 11 is only an example, and should not limit the functions and scope of use of this embodiment of the present invention.

As shown in FIG. 11 , electronic device 1100 takes the form of a general-purpose computing device. The components of the electronic device 1100 may include, but are not limited to: at least one processing unit 1110, at least one storage unit 1120, a bus 1130 connecting different system components (including the storage unit 1120 and the processing unit 1110), and a display unit 1140.

Wherein, the storage unit stores program codes, and the program codes can be executed by the processing unit 1110, so that the processing unit 1110 executes various exemplary methods according to the present invention described in the above "Exemplary Methods" section of this specification. Example steps.

The storage unit 1120 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 1121 and/or a cache storage unit 1122 , and may further include a read-only storage unit (ROM) 1123 .

Storage unit 1120 may also include a program/utility tool 1124 having a set (at least one) of program modules 1125, such program modules 1125 including but not limited to: an operating system, one or more application programs, other program modules, and program data, Each or some combination of these examples may contain the realities of network environments.

Bus 1130 may represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local area using any of a variety of bus structures. bus.

The electronic device 1100 can also communicate with one or more external devices 1170 (such as keyboards, pointing devices, Bluetooth devices, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device 1100, and/or communicate with Any device (eg, router, modem, etc.) that enables the electronic device 1100 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 1150 . Moreover, the electronic device 1100 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and/or a public network such as the Internet) through the network adapter 1160 . As shown, the network adapter 1160 communicates with other modules of the electronic device 1100 through the bus 1130 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with electronic device 1100, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.

Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described here can be implemented by software, or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of software products, and the software products can be stored in a non-volatile storage medium (which can be CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to make a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiment of the present disclosure.

In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium on which a program product capable of implementing the above-mentioned method in this specification is stored. In some possible embodiments, various aspects of the present invention can also be implemented in the form of a program product, which includes program code, and when the program product is run on a terminal device, the program code is used to make the The terminal device executes the steps according to various exemplary embodiments of the present invention described in the "Exemplary Method" section above in this specification.

As shown in FIG. 12 , a program product 1200 for realizing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disc read-only memory (CD-ROM) and include program codes, and can be used in terminal equipment, For example running on a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, apparatus or device.

The program product may reside on any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

A computer readable signal medium may include a data signal carrying readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.

Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming languages. Programming language - such as "C" or a similar programming language. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server to execute. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (for example, using an Internet service provider). business to connect via the Internet).

Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with the true scope and spirit of the disclosure indicated by the appended claims.

Claims (12)

1. A method of model animation rendering, the method comprising:

obtaining model resource data of a target three-dimensional model, and analyzing a target audio frequency band corresponding to model attributes of the target three-dimensional model from the model resource data;

collecting an audio stream corresponding to a target anchor in a live broadcasting room, and analyzing the audio stream to obtain model driving values corresponding to different audio frequency segments;

and determining a target driving value corresponding to the target audio frequency band from the model driving values, and rendering model animation corresponding to the target three-dimensional model in the live broadcasting room based on the target driving value and the model resource data.

2. The method of claim 1, wherein the analyzing the audio stream to obtain model driving values corresponding to different audio frequency segments comprises:

performing frequency band division on the audio stream to obtain initial amplitude data; the initial amplitude data comprises initial amplitude values in different audio frequency bands;

calculating the initial amplitude values belonging to the same audio frequency band in the initial amplitude data to obtain target amplitude data, and adding the target amplitude data into an amplitude data queue;

performing interpolation processing on the target amplitude data in the amplitude data queue to obtain an updated amplitude data queue;

and calculating the target amplitude data in the updated amplitude data queue to obtain model driving values corresponding to the different audio frequency bands.

3. The method for rendering the model animation according to claim 2, wherein the performing frequency band division on the audio stream to obtain initial amplitude data comprises:

performing frequency domain analysis on the audio stream to obtain a plurality of frequencies corresponding to the audio stream and a plurality of frequency amplitudes corresponding to the frequencies respectively;

Performing frequency band division on the plurality of frequency amplitudes to obtain initial amplitude data; the initial amplitude data includes initial amplitude values at different audio frequency bands.

4. A model animation rendering method as claimed in claim 3, wherein the target amplitude data comprises a target amplitude value;

the calculating the target amplitude data in the updated amplitude data queue to obtain model driving values corresponding to the different audio frequency bands includes:

determining an amplitude threshold corresponding to the target amplitude data in the updated amplitude data queue;

if the target amplitude value in the target amplitude data is greater than or equal to the amplitude threshold value, replacing the target amplitude value with a first model driving value;

and if the target amplitude value in the target amplitude data is smaller than the amplitude threshold value, calculating the target amplitude value and the amplitude threshold value to obtain a second model driving value.

5. The model animation rendering method of claim 1, wherein the model resource data includes a driving value adjustment factor;

rendering a model animation corresponding to the target three-dimensional model in the live broadcast room based on the target driving value and the model resource data, wherein the model animation comprises the following steps:

Determining a first calculation formula among a current attribute value of the model attribute corresponding to the current frame, the driving value adjustment factor, a target driving value and a first attribute value of the model attribute corresponding to a first frame; a frame interval is different between the current frame and the first frame;

calculating the driving value adjustment factor, the target driving value and the first attribute value based on the first calculation formula to obtain the current attribute value;

and rendering a model animation corresponding to the target three-dimensional model in the live broadcasting room based on the current attribute value and the model resource data.

6. The model animation rendering method of claim 5, wherein the driving value adjustment factor further comprises a first driving value adjustment factor; the model attributes include a first type of attribute;

the method further comprises the steps of:

determining a first attribute threshold value and a second attribute threshold value corresponding to the first type attribute, and determining a threshold difference between the first attribute threshold value and the second attribute threshold value;

determining a second calculation formula among the first attribute threshold value, the target drive value, the threshold difference, a first current attribute value of the first type attribute corresponding to a current frame, a second attribute value of the first type attribute corresponding to a second frame and the first drive value adjustment factor; the current frame and the second frame differ by one frame interval;

Calculating the first attribute threshold value, the target driving value, the threshold difference, the second attribute value and the first driving value adjustment factor based on the second calculation formula to obtain the first current attribute value;

and rendering a model animation corresponding to the target three-dimensional model in the live broadcasting room based on the first current attribute value and the model resource data.

7. A method for generating model resource data, the method comprising:

importing a target three-dimensional model, and displaying a configuration interface corresponding to the target three-dimensional model; the configuration interface comprises a first configuration area corresponding to the model attribute of the target three-dimensional model and a second configuration area corresponding to the model attribute of the target audio frequency band;

responding to a first selection operation acted on the first configuration area, and obtaining the model attribute corresponding to the first selection operation;

responding to a second selection operation acted in the second configuration area, and obtaining the target audio frequency band corresponding to the second selection operation;

and generating model resource data corresponding to the target three-dimensional model based on the model attribute and the target audio frequency band.

8. The model resource data generation method according to claim 7, characterized in that the method further comprises:

responding to a first change operation acted in the first configuration area, and obtaining a change model attribute corresponding to the first change operation; or (b)

Responding to a second changing operation acted in the second configuration area to obtain a changing target audio frequency band corresponding to the second changing operation;

and modifying the model resource data based on the modification model attribute and the modification target audio frequency band.

9. A model animation rendering device, comprising:

the analysis module is configured to acquire model resource data of a target three-dimensional model, and analyze a target audio frequency band corresponding to a model attribute of the three-dimensional model from the model resource data;

the acquisition module is configured to acquire an audio stream corresponding to a target anchor in a live broadcasting room, and analyze the audio stream to obtain model driving values corresponding to different audio frequency segments;

and the rendering module is configured to determine a target driving value corresponding to the target audio frequency band from the model driving values, and render model animation corresponding to the target three-dimensional model in the live broadcasting room based on the target driving value and the model resource data.

10. A model resource data generating apparatus, comprising:

the system comprises an importing module, a configuration interface and a display module, wherein the importing module is configured to import a target three-dimensional model and display a configuration interface corresponding to the target three-dimensional model; the configuration interface comprises a first configuration area corresponding to the model attribute of the target three-dimensional model and a second configuration area corresponding to the model attribute of the target audio frequency band;

a first response module configured to respond to a first selection operation acting in the first configuration area, and obtain the model attribute corresponding to the first selection operation;

a second response module configured to respond to a second selection operation acting in the second configuration area, and obtain the target audio frequency band corresponding to the second selection operation;

and the generation module is configured to generate model resource data corresponding to the target three-dimensional model based on the model attribute and the target audio frequency band.

11. An electronic device, comprising:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the method of any of claims 1-10 via execution of the executable instructions.

12. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the method of any of claims 1-10.

Images