+

WO2017186015A1 - Procédé et dispositif de doublage de supports numériques audiovisuels - Google Patents

Procédé et dispositif de doublage de supports numériques audiovisuels Download PDF

Info

Publication number
WO2017186015A1
WO2017186015A1 PCT/CN2017/080790 CN2017080790W WO2017186015A1 WO 2017186015 A1 WO2017186015 A1 WO 2017186015A1 CN 2017080790 W CN2017080790 W CN 2017080790W WO 2017186015 A1 WO2017186015 A1 WO 2017186015A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
view control
digital media
length
audiovisual digital
Prior art date
Application number
PCT/CN2017/080790
Other languages
English (en)
Chinese (zh)
Inventor
陈军宏
张培养
Original Assignee
厦门幻世网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 厦门幻世网络科技有限公司 filed Critical 厦门幻世网络科技有限公司
Publication of WO2017186015A1 publication Critical patent/WO2017186015A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing

Definitions

  • the present application relates to the field of multimedia technologies, and in particular, to a method and apparatus for dubbing audiovisual digital media.
  • the information presentation on the network is also increasingly rich.
  • many users prefer audio-visual digital media.
  • Relatively dynamic information presents information.
  • the audiovisual digital media may include video, animation, and the like.
  • the content of the audiovisual digital media can be enriched by adding dubbing to the audiovisual digital media.
  • the user is not satisfied with the existing dubbing effect, for example, the video and audio are not well matched, etc., the dubbing in the audiovisual digital media cannot be adjusted.
  • the embodiment of the present invention provides a method and a device for dubbing audiovisual digital media, which are used to solve the problem of poor convenience in audio recording of audiovisual digital media in the prior art, and reduce user experience.
  • the audio view control is moved to adjust the mating relationship according to the position move instruction.
  • An audio import module for importing an audio in the editing interface
  • An audio view control module configured to generate an audio view control for representing the audio according to the imported audio, and display the audio view control in the editing interface, where a position of the audio view control reflects The relationship between the audio and the audiovisual digital media;
  • an audio adjustment module configured to: when receiving a position move instruction for the audio view control, move the audio view control to adjust the mating relationship according to the position move instruction.
  • the embodiment of the present application can visualize the audio used for dubbing the audiovisual digital media into an audio view control by using at least one of the foregoing technical solutions, and the user can adjust the audiovisual digital media by moving the audio view control by, for example, dragging.
  • the cooperation relationship with the audio can improve the convenience of dubbing the audiovisual digital media and improve the user experience, and therefore, the problems in the prior art can be partially or completely solved.
  • FIG. 1 is a schematic flowchart of a method for dubbing audiovisual digital media according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of an editing interface in an actual application scenario according to an embodiment of the present disclosure
  • FIG. 3 is a partial schematic diagram of an editing interface according to an embodiment of the present application.
  • FIG. 4 is a partial schematic diagram of another editing interface provided by an embodiment of the present application.
  • FIG. 5 is a partial schematic diagram of still another editing interface according to an embodiment of the present application.
  • FIG. 6 is a partial schematic diagram of still another editing interface according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of adjusting a coordination relationship between audiovisual digital media and audio according to an embodiment of the present disclosure
  • FIG. 8 is a schematic diagram of another coordination relationship between audiovisual digital media and audio according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic diagram of another coordination relationship between audiovisual digital media and audio according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic diagram of adjusting a matching relationship between audiovisual digital media and audio according to an embodiment of the present disclosure
  • FIG. 11 is a schematic structural diagram of an apparatus for dubbing audiovisual digital media according to an embodiment of the present application.
  • FIG. 1 is a schematic flowchart diagram of a method for dubbing audiovisual digital media according to an embodiment of the present disclosure, where the audiovisual digital media may be video or animation.
  • the audiovisual digital media itself may not include audio, and the audiovisual digital media may be dubbed by the method; the audiovisual digital media itself may also contain audio, and the audiovisualization may be performed by the method.
  • Digital media adds new audio, or if the audio contained in the audiovisual digital media itself can be separated, the audio contained in the audiovisual digital media itself can also be adjusted by this method, etc., and the enumerated operations can belong to The audio-visual digital media is dubbed as described in this application.
  • the execution subject of the flow in FIG. 1 may be an audio and video related device.
  • the device may specifically be: a personal computer, a large and medium-sized computer, a computer cluster, a mobile phone, a tablet computer, a smart watch, a car mobile station, and the like.
  • the enumerated devices are merely examples of the execution subject and do not constitute a limitation on the execution subject.
  • the process in Figure 1 can include the following steps:
  • the editing interface may be an operation interface used when dubbing audiovisual digital media.
  • the other interface switches to the editing interface. After switching, the audiovisual digital media is already available in the editing interface, and then the audio is imported in the editing interface.
  • the audio may be audio recorded by a user, or may be a soundtrack downloaded from the Internet or audio selected from an audio library, etc., and the source and specific content of the audio in the present application. Not limited.
  • the one audio may refer to a piece of audio that is continuous in time.
  • the steps in FIG. 1 can be performed for each piece of audio.
  • the following mainly describes the scheme of the present application by taking an audio of the audiovisual digital medium as an example.
  • S102 Generate an audio view control for representing the audio according to the imported audio, and display the audio view control in the editing interface, where the position of the audio view control reflects the audio and the audiovisual The relationship between digital media.
  • the imported audio can be converted into a Visualized audio view control.
  • the present application does not limit the display shape of the audio view control.
  • the audio view control can generally be displayed as a rectangle. Of course, it can also be displayed as a graphic other than a rectangle depending on the specific business situation.
  • an audio view control for representing the audio may be generated according to data of the imported audio; or an audio format conversion may be performed on the imported audio, and the representation data may be generated according to the converted data. Audio view control for audio.
  • the format of the imported audio can be converted to a Pulse Code Modulation (PCM) format at a certain sampling rate, and the value of each sample point of the converted audio can be read and normalized, and the value can be converted.
  • PCM Pulse Code Modulation
  • the amplitude of each sample point for the view ie, waveform).
  • the cooperation relationship between the audio and the audiovisual digital media can indicate how the audio and the audiovisual digital media cooperate with each other in the playing time during synchronization, that is, the time axis and audiovisual of the audio. How does the timeline of digital media work together? Specifically, in synchronous playback, is the audio-visual digital media first broadcasted, or is the audio first broadcasted, or the audio-visual digital and audio simultaneously broadcast; when not simultaneously broadcast, how long does the first broadcast party play? After that, the other party starts broadcasting again; when the playback ends after the broadcast; and so on. It should be noted that the synchronous play means that the audio and the audio-visual digital media are played together according to a certain cooperation relationship, and they can be broadcasted at the same time or at different times.
  • the position of the audio view control can be used to intuitively reflect the cooperation relationship between the audio and the audiovisual digital media.
  • a play time progress bar such as an audiovisual digital media or an audiovisual digital media view control for representing the audiovisual digital media may also be displayed in the editing interface.
  • the audio view control may be Aligning to different portions of the play time progress bar, or aligning to different portions of the audiovisual digital media view control, the alignment relationship that can be determined by the position of the audio view control can be directly mapped to the mating relationship Or indirect mapping, the location of the audio view control The cooperation relationship can be reflected.
  • the position movement instruction may be sent by the user by dragging the operation of the audio view control, wherein, for the touch screen device, the user may directly move the audio view control by means of a finger drag, for the non-touch screen Device, the user can move the audio view control by clicking and dragging with the mouse.
  • the location move command can also be sent by the user by clicking on a predetermined control.
  • a predetermined control For example, suppose that there are two predetermined controls, a "left shift” button control and a "right shift” button control, the user can send a left shift position movement instruction for the audio view control by clicking the "left shift” button control to make the audio
  • the view control is accordingly shifted left by a preset unit distance; similarly, the user can move the audio view control to the right by a predetermined unit distance by clicking the "Shift Right” button control.
  • the audio view control when the user drags, when the audio view control is moved, the audio view control can be completely moved according to the user's drag track.
  • the audio view control may not be moved completely according to the user's drag track, for example, when it is movable.
  • the audio view control can be moved on the audio track only according to the component direction of the user's drag track on the audio track.
  • the audio view control is visible, it is convenient for the user to drag the audio view control relatively freely according to his own idea, and when the position of the audio view control changes, the cooperation relationship changes accordingly, thereby realizing The adjustment of the relationship between audio and audiovisual digital media.
  • the audio used for dubbing the audiovisual digital media can be visualized as an audio view control, and the user can move the audio view control by means such as dragging to adjust the cooperation relationship between the audiovisual digital media and the audio. Therefore, the convenience in dubbing audio-visual digital media can be improved, and the user experience can be improved, and therefore, problems in the prior art can be partially or completely solved.
  • the embodiments of the present application further provide some specific implementation manners of the foregoing methods, and an extended solution, which will be described below.
  • step S101 before generating the audio view control for indicating the audio, performing: receiving the audiovisual digital media, turning on a control instruction of the audio editing mode; according to the control instruction Opening an audio editing mode for the audiovisual digital media and displaying the editing interface.
  • the user can send the control of turning on the audio editing mode by performing corresponding hardware operations on the touch screen (for example, physical buttons on the edge of the touch screen, etc.) or software (for example, an application installed in the touch device). instruction.
  • the imported audio can be synchronously played from the current playback position of the audiovisual digital media, or from the beginning of the audiovisual digital media. Play synchronously in a matching manner.
  • the editing interface may include:
  • the audio track can be used to limit the movable range of the audio view control.
  • the audio view control is moved to adjust the cooperation relationship according to the position movement instruction, which may specifically include:
  • the position movement instruction moves the audio view control on the audio track to adjust the mating relationship.
  • the audio track itself may have a time axis, which may be visualized into the audio track itself, in which case the length of the audio track may characterize the length of time of the time axis,
  • the following examples are all based on this case.
  • the mating relationship can indicate how the time axis of the audio and the time axis of the audiovisual digital medium match when the audio and audiovisual digital media are played simultaneously.
  • the audio view control also has the timeline of the audio accordingly.
  • the timeline of the audio is: in the timeline of the audio track, the audio view control falls on the portion of the audio track.
  • the time axis of the audiovisual digital media can be aligned or fully aligned with the portion of the audio track; alternatively, the time axis of the audiovisual digital media can be the audio track itself.
  • the embodiment of the present application is mainly based on the former case.
  • the audio view control moves on the audio track
  • the position changes the time axis of the audio is aligned with the time axis of the audiovisual digital media.
  • the ground changes, so that the interaction between the audio and the audiovisual digital media can be adjusted by moving the audio view control, and during the adjustment process, the user can visually see the time axis of the audio, which is convenient for the user to operate.
  • This section mainly explains the relationship between the timeline of the audiovisual digital media and the audio track, and combines the previous paragraph to explain why the audio and audiovisual digital media can be adjusted by moving the audio view control on the audio track. The relationship of cooperation.
  • the time axis of the audiovisual digital media can be aligned or fully aligned with the audio track
  • a temporal alignment For time alignment, for example, "the time axis of the audiovisual digital media can be aligned or fully aligned with the audio track" as described above is a temporal alignment.
  • the specific meaning is: the duration of the two (that is, the length of the time axis) is equal, and the start time of the time axis of the two is the same Knot
  • the beam moment is also the same.
  • the specific meaning is: the length of the two (the length here is the distance unit, not the time unit, for example, the length of the two is 20 The centimeters, etc. are equal, and the starting positions of the two are vertically aligned, and the ending positions are also vertically aligned.
  • the editing interface may further include:
  • An audiovisual digital media playing interface for playing the content of the audiovisual digital media
  • the audiovisual digital media playing time progress bar wherein the audiovisual digital media playing time progress bar may further have a corresponding playing indicator for indicating the playing time progress.
  • the audio-visual digital media playback time progress bar can be regarded as the visualization of the time axis of the audio-visual digital media.
  • the user can intuitively see the time axis of the audio-visual digital media, combining Based on the audio track and the time axis of the audio, the user can intuitively and accurately adjust the coordination relationship between the audio and the audiovisual digital media.
  • the above includes the contents included in the editing interface and a brief introduction.
  • the content included in the editing interface may not be limited to the enumerated content, and in the actual application, the editing interface may not completely include the enumerated content, for example, may not include the audiovisual digital media playing interface, and the like.
  • the embodiment of the present application does not limit the layout and style of the content in the editing interface, and the matching relationship between the audio and the audiovisual digital media can be adjusted through the editing interface.
  • the embodiment of the present application provides a schematic diagram of an editing interface in an actual application scenario, as an example of the editing interface described in this application, as shown in FIG. 2 .
  • the editing interface includes a window 10, a window 20, an audio view control 21, an audio track 22, an audiovisual digital media playback time progress bar 23 (hereinafter simply referred to as a time progress bar 23), and a play indicator 24.
  • the window 10 is an area for playing audio-visual digital media
  • the window 20 is an operation area for adjusting audio, audio-visual digital media playback, and matching relationship.
  • the frequency view control 21, the audio track 22, and the time progress bar 23 are all disposed in the window 20.
  • the audio track 22 can be displayed in the editing interface.
  • the audio imported in step S101 can be loaded, the audio data can be read, and the visualized audio view control 21 can be generated according to the audio. And displayed on the audio track 22.
  • the time progress bar 23 is a reflection of the progress of the audiovisual digital media playback, and can also be used to control the progress of the audiovisual digital media playback.
  • the time progress bar 23 is further provided with a play indicator 24, and the specific shape of the play indicator 24 can also select other graphics depending on the specific business situation.
  • the initial position of the play indicator 24 can be selected according to the specific business situation.
  • the progress controller can be separated on the basis of the time progress bar 23. In this case, the time progress bar 23 can only reflect the progress of the audiovisual digital media playback, and is not responsible for controlling the audiovisual digital media playback. Progress, the progress controller is responsible for controlling the progress of audiovisual digital media playback.
  • the time progress bar 23 and the play indicator 24 are disposed in the window 20.
  • the time progress bar 23 and the play indicator 24 may be disposed in the window 10, and the like.
  • the time progress bar 23 and the play indicator 24 may be resident on the screen (always displayed in the editing interface), or may be in a hidden state at first, and may be displayed in the editing interface after triggering an event in a certain operation process, and may be Certain conditions (for example, after a certain period of time) are hidden again.
  • the editing interface in FIG. 2 is only an example, and the layout and style of the content can be changed.
  • the size and orientation of the window 10 and the window 20 can be adjusted according to actual business conditions, and the like.
  • the audio and the audiovisual digital media when the audio and the audiovisual digital media are synchronously played, all of the audio may be played, or only a part of the audio may be played. In the latter case, it is equivalent to using only a part of the audio for audiovisualization.
  • Digital media dubbing can reduce the amount of work required for users to edit audio. In order to achieve the functions corresponding to these two situations, it can be divided on the audio track. The area, as well as the portion for the audio view control to fall on different areas, correspondingly play the audio portion corresponding to each part in different ways.
  • the audio track may include an effective loading area and an adjustment area, the effective loading area is a continuous area, and the adjustment area is disposed at both ends of the effective loading area, in this case, for the step S103.
  • the moving the audio view control to adjust the mate relationship according to the position movement instruction may include: moving the audio view control according to the position movement instruction, where the audio view control falls within the valid loading Portions of the area will cooperate with the audiovisual digital media playback, and portions of the audio view control that fall within the adjustment area will not play.
  • the effective loading area and the adjustment area may not be displayed, only the effective loading area is displayed, and the adjustment area is hidden.
  • the audio view control can be moved on the audio track, that is, the length of the movable range of the audio view control is the length of the audio track.
  • the length of the audiovisual digital media playback time progress bar, the audio track, and the audio view control may be mutually adapted.
  • the lengths indicated by the lengths of the persons can also be adapted to each other. Although the lengths and durations belong to different dimensions, the numerical values can be correspondingly proportional to each other.
  • the ratio of the unit length of the audio track to the length of the unit length of the audiovisual digital media playing time progress bar and the length of the audiovisual digital media playing time progress bar may be used as a predetermined reference standard. Determining a range of values for the length and/or length of the above three suitable for the actual application scenario.
  • the ratio of the unit length of the audio track to the length indicated by the unit length of the audio-visual digital media playing time progress bar is y
  • the length of the valid loading area and the audiovisual number is the ratio of the length of the media play time progress bar x.
  • d is the length of the effective loading area
  • d 1 is the length of the adjustment area set at one end of the effective loading area
  • d 2 is set to the effective The length of the adjustment area at the other end of the loading area.
  • the length of its effective loading area is the same as the length of the audiovisual digital media playing time progress bar.
  • 3 is a partial schematic diagram of an editing interface according to an embodiment of the present application, specifically, part of the editing interface in FIG. 2 in the case where the length of the effective loading area is the same as the length of the viewing period of the audiovisual digital media playing time. schematic diagram.
  • c is the length of the audio view control 21
  • b is the length of the time progress bar 23
  • d is the length of the effective loading area M of the audio track 22
  • d 1 is the adjustment area N 1 of one end of the audio track 22.
  • the length, d 2 is the length of the adjustment area N 2 at the other end of the audio track 22, and the reference numerals in Fig. 3 are also used in the subsequent figures of Fig. 3, and will not be described later.
  • d b
  • the length of the audio track 22 is: the effective loading area M
  • the effective loading area M and the time progress bar 23 are not only end-aligned in terms of duration, but also end-aligned in terms of length.
  • This condition is to make the effective loading area M and the time progress bar 23 both end aligned in terms of duration, so that the technical effect can be achieved: if the duration of the audio is not greater than the duration of the audiovisual digital medium, the audio view control 21 can be Moving within the effective loading area M allows the audio to be aligned to any contiguous portion of the audiovisual digital medium that is equal in duration to the audio.
  • the range of values of d 1 and d 2 can be made as large as possible to provide a wider adjustment range for the user, but in FIG. 3, when d 1 and / or d 2 is greater than the length c of the audio view control 21 itself, it is easy to appear that the audio view control 21 is completely out of the effective loading area M, which is disadvantageous to the user operation, therefore, the condition can be set. among them,
  • FIG. 4 is a partial schematic diagram of another editing interface according to an embodiment of the present application, specifically, the duration of the audiovisual digital media is 6 minutes, and the duration of the audio is 1 minute.
  • the same portions in FIG. 4 and subsequent drawings as those in the foregoing drawings will not be described again, and for FIG. 4, due to When the audio view control 21 is generated, the length of the audio view control 21 can be set to That is, the length of the audio view control 21 is the length of the time progress bar 23.
  • FIG. 5 is a partial schematic diagram of still another editing interface according to an embodiment of the present application, where the duration of the audiovisual digital media is 10 minutes, and the duration of the audio is 5 minutes. Then for Figure 5, due to When the audio view control 21 is generated, the length of the audio view control 21 can be set to That is, the length of the audio view control 21 is the length of the time progress bar 24.
  • the length of the effective loading area M is different from the length of the time progress bar 23, specifically, At this time, the effective loading area M and the time progress bar 23 are still aligned in terms of duration, but are not aligned in terms of length.
  • FIG. 6 is a partial schematic diagram of still another editing interface according to an embodiment of the present disclosure, specifically The case where the audiovisual digital medium has a duration of 6 minutes and the duration of the audio is 1 minute is taken as an example.
  • the length of the audio view control 21 can be set to That is, the length of the audio view control 21 is the length of the time progress bar 24.
  • y ⁇ 1 is generally caused, because in the case of y ⁇ 1, in the case of y ⁇ 1, it is equivalent to amplifying the audio track 22, which is advantageous for the user for the audio track 22
  • the audio view control 21 on the screen performs a finer drag operation, thereby improving the fineness of the adjustment of the coordination relationship between the audio and the audiovisual digital media.
  • the method may include: An audio view control that represents the audio and that satisfies the following conditions is generated:
  • a is the length of the audio track, that is, the length of the effective loading area and the length of the adjustment area; b is the length of the play time progress bar, and c is the length of the audio view control.
  • the length of the audio view control, the audio track, the audiovisual digital media play time progress bar, etc. are analyzed and described above. The following is an analysis of the playback of audio and audiovisual digital media.
  • step S103 when the audio view control is moved according to the position movement instruction, the real-time operation may also be performed: An image in the audiovisual digital media corresponding to the location of the audio view control on the audio track is displayed. Specifically, the image can be displayed by using an audiovisual digital media playing interface in the editing interface. Through the real-time displayed image, the user can conveniently align the audio with the image in the audiovisual digital media, thereby improving the accuracy of the user adjusting the cooperation relationship.
  • synchronous playback of audio and audiovisual digital media has been mentioned many times in the foregoing, and synchronous playback may be performed automatically or based on an operation of manual playback by a user.
  • Simultaneous broadcast The playback can be started after the audio view control is generated and displayed; in the moving process of step S103, the synchronous playback can be paused; after the moving process of step S103 is finished, the synchronized playback can be started again.
  • the audiovisual digital media play time progress bar includes a play indicator for indicating the play time progress
  • the audio view control is displayed in the edit interface, Starting at a position of the play indicator, synchronously playing the audiovisual digital medium and the audio according to the cooperation relationship; when the moving process starts, suspending the synchronous play; when the moving process At the end, the audiovisual digital media and the audio are played synchronously according to the adjusted cooperation relationship.
  • the synchronized playing of the audiovisual digital media and the audio according to the adjusted cooperation relationship may specifically include:
  • the play indicator is adjusted to a time on the play time progress bar corresponding to the position where the audio view control is located, and according to the adjusted cooperation relationship, after the adjustment The position of the play indicator begins, and the audiovisual digital media and the audio are played synchronously (for this case, the play indicator moves correspondingly with the movement of the audio view control); or,
  • the user sends a position move instruction for the audio view control by dragging the audio view control with the finger, then the audiovisual number is displayed when the user's finger presses the audio view control The media and audio can be paused. At this time, the user can drag the audio view control on the audio track. When the user's finger leaves the audio view control, the audiovisual digital media and audio can be played from the position of the play indicator.
  • FIG. 7 is a schematic diagram of adjusting the coordination relationship between audiovisual digital media and audio according to an embodiment of the present application.
  • the duration of the audiovisual digital media shown in FIG. 5 is 10 minutes, and the duration of the audio is 5 minutes, For example.
  • the position of the audio view control 21 is indicated by a broken line, at the position A, the play indicator 24 is at the position C; after the user drags, the position of the audio view control 21 is indicated by a solid line, at the position B. The position of the play indicator 24 is at position C. At this time, the position of the play indicator 24 is still at the position before the user drags the audio view control 21, so when the user's finger leaves the audio view control 21, the audiovisual digital media starts playing from the position of the play indicator 24, and plays.
  • the play indicator 24 moves from the position C to the position D, only the corresponding portion of the audiovisual digital medium is played without playing the audio (because the start time of the audio has not yet arrived); when the play indicator 24 is moved to the position At time D, the corresponding portion of the audiovisual digital media and audio is simultaneously played; when the play indicator 24 is moved to the position E, the audio is played and the corresponding portion of the audiovisual digital media is played until the audiovisual digital media is played. It can be seen that during the course of the segment, the play indicator 24 does not move with the movement of the audio view control 21.
  • the play indicator 24 moves correspondingly with the movement of the audio view control 21.
  • the position of the audio view control 21 is indicated by a broken line, at the position A, the play indicator 24 is at the position C; after the user drags, the position of the audio view control 21 is indicated by a solid line, Position B, the play indicator 24 moves to position D accordingly. Therefore, when the user's finger leaves the audio view control 21, the audiovisual digital media starts playing from the position D of the play indicator 24, and also starts playing audio; when the play indicator 24 moves to the position E, the audio is played and continues. Play audiovisual digital media Corresponding part until the audiovisual digital media is played.
  • the audio track may include an effective loading area and an adjustment area.
  • the audio view control may partially fall into the adjustment area, and the following is an example for synchronous playback of the audiovisual digital media and audio in this case.
  • FIG. 8 is a schematic diagram of adjusting another relationship between audiovisual digital media and audio according to an embodiment of the present disclosure.
  • the duration of the audiovisual digital media shown in FIG. 5 is 10 minutes, and the duration of the audio. For 5 minutes, For example.
  • the position of the audio view control 21 is indicated by a broken line, which is at position A; after the user drags, the position of the audio view control 21 is indicated by a solid line, at position B.
  • the position of the play indicator 24 is not limited herein, and the position before the drag can be maintained, or can be moved along with the audio view control 21.
  • the Z portion of the audio view control 21 falls in the adjustment area N 2 of the audio track 22, and when the play indicator 24 is moved to correspond to the position B where the audio view control 21 is located, the audiovisual number is simultaneously played.
  • the audio is played synchronously with the audiovisual digital media until the audiovisual digital media is played, and the audio portion corresponding to the Z portion of the audio view control 21 is not played.
  • FIG. 9 is a schematic diagram of adjusting the matching relationship between the audiovisual digital media and the audio provided by the embodiment of the present application, specifically, the duration of the audiovisual digital media shown in FIG. 5 is 10 minutes. The duration of the audio is 5 minutes. For example.
  • the portion in order to facilitate the user to identify the portion of the audio view control that falls within the adjustment area, the portion may be displayed differently from the portion of the audio view control that falls within the effective loading area.
  • the portion falling on the adjustment area and the portion falling on the effective loading area may be displayed with different transparency or different brightness or different colors, or may be displayed separately, or
  • the adjustment area for the audio track is labeled with a label, and so on.
  • the length of the valid loading area is greater than the length of the time progress bar.
  • the audio track can be moved correspondingly to meet the current moving direction of the audio view control, so that during the process of moving the audio view control, the audio view control can be in the middle of the editing interface relatively close to the middle, and try not to be edited. The edge position in the interface.
  • the case where the duration of the audio is not greater than the duration of the audio-visual digital medium is taken as an example, and the solution of the present application is described. In practical applications, the duration of the audio is greater than the duration of the audio-visual digital medium. In the case of this application, the solution of the present application is equally applicable.
  • the position of the audio view control 21 is indicated by a dotted line. After the user drags, the position of the audio view control 21 is indicated by a solid line. It should be noted that, actually, the audio view after dragging The control 21 is still located on the audio track 22, but for ease of viewing, the dragged audio view control 21 is not shown on the audio track 22, but is moved vertically downward from the audio track 22, indicating that it is before the drag. Below the audio view control 21. The audio portion of the portion of the audio view control 21 that falls within the adjustment areas N 1 , N 2 may not be played during the simultaneous playback of the audio and the audiovisual digital media, both before and after the drag.
  • the embodiment of the present application further provides a corresponding device for dubbing audiovisual digital media, as shown in FIG. 11 .
  • FIG. 11 is a schematic structural diagram of an apparatus for dubbing an audiovisual digital medium according to an embodiment of the present disclosure, where the apparatus includes:
  • the audio importing module 1101 is configured to import an audio in the editing interface
  • the audio view control module 1102 is configured to generate an audio view control for representing the audio according to the imported audio, and display the audio view control in the editing interface, where the position of the audio view control reflects Coordinating relationship between the audio and the audiovisual digital media;
  • the audio adjustment module 1103 is configured to: when receiving a position move instruction for the audio view control, move the audio view control to adjust the mating relationship according to the position move instruction.
  • the device further includes:
  • the editing mode opening module 1104 is configured to: before the audio view control module 1102 generates an audio view control for indicating the audio, receive the audiovisual digital media, and start a control instruction of the audio editing mode; according to the control instruction, The audiovisual digital medium turns on an audio editing mode and displays the editing interface.
  • the editing interface further includes:
  • An audio track the audio view control being located on the audio track, the audio track including an effective loading area and an adjustment area;
  • An audiovisual digital media playing interface for playing the content of the audiovisual digital media
  • the audio adjustment module 1103 is specifically configured to: move the audio view control on the audio track according to the position movement instruction to adjust the mating relationship.
  • the effective loading area is a continuous area
  • the adjustment area is disposed in the
  • the audio adjustment module 1103 is specifically configured to: move the audio view control according to the position movement instruction, where a portion of the audio view control falling in the effective loading area will cooperate with the audiovisual number Media playback, the portion of the audio view control that falls within the adjustment area will not play.
  • the ratio of the unit length of the audio track to the duration represented by the unit length of the audiovisual digital media playing time progress bar is y
  • the length of the valid loading area and the audiovisualization is the ratio of the duration of the audio to the duration of the audiovisual digital medium, the audio track satisfying the following conditions:
  • d is the length of the effective loading area
  • d 1 is the length of the adjustment area set at one end of the effective loading area
  • d 2 is set to the effective The length of the adjustment area at the other end of the loading area.
  • the audio view control module 1102 is specifically configured to: generate an audio view control for representing the audio and satisfying the following conditions:
  • a is the length of the audio track, that is, the length of the effective loading area and the length of the adjustment area; b is the length of the play time progress bar, and c is the length of the audio view control.
  • the play time progress bar includes a play indicator for indicating the play time progress
  • the device also includes:
  • a playing module 1105 after the audio view control module displays the audio view control in the editing interface, starting from a position of the play indicator, according to the cooperation relationship, the audiovisual number And playing the audio synchronously; and when the moving process starts, suspending the synchronous play; when the moving process ends, according to the adjusted cooperation relationship, the audiovisual digital media and the The audio is played synchronously.
  • the playing module 1105 is specifically configured to: when the moving process ends, adjust the play indicator to a time on the play time progress bar corresponding to a location where the audio view control is located, and according to And the adjusted matching relationship starts from the position of the adjusted play indicator to synchronously play the audiovisual digital medium and the audio.
  • the playing module 1105 is further configured to: when the audio adjustment control moves the audio view control according to the position moving instruction, display the position of the audio view control on the audio track in real time. Corresponding images in the audiovisual digital media.
  • the location movement instruction is sent by a user dragging the audio view control
  • the audio adjustment module 1103 is specifically configured to: the audio view control is dragged on the audio track according to the drag operation corresponding to the position movement instruction.
  • the audiovisual digital media is video and/or animation.
  • the device in Figure 11 can be specifically located on an audiovisual related device.
  • the device provided by the present application is in one-to-one correspondence with the method provided by the present application. Therefore, the device also has similar beneficial technical effects as the method, since the beneficial technical effects of the method have been described in detail above. Therefore, the beneficial technical effects of the device will not be described again here.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

L'invention concerne un procédé et un dispositif de doublage de supports numériques audiovisuels, destinés à être utilisés dans la résolution du problème de l'état de la technique de mauvaise expérience de l'utilisateur en raison d'une faible commodité dans le doublage de supports numériques audiovisuels. Le procédé comprend les étapes suivantes : introduction d'un contenu audio dans une interface d'édition; génération, conformément au contenu audio introduit, d'une commande de vue de contenu audio utilisée pour indiquer le contenu audio et affichage de la commande de vue de contenu audio dans l'interface d'édition, la position de la commande de vue de contenu audio reflétant une relation d'appariement entre le contenu audio et le support numérique audiovisuel; et lorsqu'une instruction de mouvement de position pour la commande de vue de contenu audio est reçue, déplacement de la commande de vue de contenu audio conformément à l'instruction de mouvement de position de façon à ajuster la relation d'appariement.
PCT/CN2017/080790 2016-04-26 2017-04-17 Procédé et dispositif de doublage de supports numériques audiovisuels WO2017186015A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610264135.8A CN105827997A (zh) 2016-04-26 2016-04-26 一种为视听化数字媒体配音的方法及装置
CN201610264135.8 2016-04-26

Publications (1)

Publication Number Publication Date
WO2017186015A1 true WO2017186015A1 (fr) 2017-11-02

Family

ID=56527423

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/080790 WO2017186015A1 (fr) 2016-04-26 2017-04-17 Procédé et dispositif de doublage de supports numériques audiovisuels

Country Status (2)

Country Link
CN (1) CN105827997A (fr)
WO (1) WO2017186015A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IT201800007842A1 (it) * 2018-08-03 2020-02-03 Sdi Media Italia Srl Metodo e apparato per evidenziare graficamente discrepanze in tracce audio associate a un contenuto audiovisivo
WO2020238186A1 (fr) * 2019-05-24 2020-12-03 珠海格力电器股份有限公司 Procédé et dispositif de lecture d'informations vocales, et support d'enregistrement
CN112911400A (zh) * 2021-01-18 2021-06-04 惠州Tcl移动通信有限公司 视频播放控制方法、装置、存储介质及移动终端

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105827997A (zh) * 2016-04-26 2016-08-03 厦门幻世网络科技有限公司 一种为视听化数字媒体配音的方法及装置
CN106293347B (zh) * 2016-08-16 2019-11-12 广东小天才科技有限公司 一种人机交互的学习方法及装置、用户终端
CN107026986B (zh) * 2017-03-30 2019-11-29 维沃移动通信有限公司 一种视频背景音乐的处理方法及移动终端
CN108024073B (zh) 2017-11-30 2020-09-04 广州市百果园信息技术有限公司 视频编辑方法、装置及智能移动终端
CN108682436B (zh) * 2018-05-11 2020-06-23 北京海天瑞声科技股份有限公司 语音对齐方法及装置
CN110781349A (zh) * 2018-07-30 2020-02-11 优视科技有限公司 用于短视频生成的方法、设备、客户端装置及电子设备
CN109407944A (zh) * 2018-09-29 2019-03-01 传线网络科技（上海）有限公司 多媒体资源播放调节方法及装置
CN109587543B (zh) * 2018-12-27 2021-04-02 秒针信息技术有限公司 音频同步方法和装置及存储介质
CN113038014A (zh) * 2021-03-17 2021-06-25 北京字跳网络技术有限公司 应用程序的视频处理方法和电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060156374A1 (en) * 2003-02-14 2006-07-13 Hu Carl C Automatic synchronization of audio and video based media services of media content
CN101640057A (zh) * 2009-05-31 2010-02-03 北京中星微电子有限公司 一种音视频匹配方法及装置
CN101984490A (zh) * 2010-11-23 2011-03-09 亿览在线网络技术（北京）有限公司 一种逐字同步的歌词文件的生成方法及系统
CN103106908A (zh) * 2011-11-11 2013-05-15 鸿富锦精密工业（深圳）有限公司 音频播放装置及控制音频播放装置操作的方法
CN104754178A (zh) * 2013-12-31 2015-07-01 广州励丰文化科技股份有限公司 音频控制方法
CN105827997A (zh) * 2016-04-26 2016-08-03 厦门幻世网络科技有限公司 一种为视听化数字媒体配音的方法及装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7769819B2 (en) * 2005-04-20 2010-08-03 Videoegg, Inc. Video editing with timeline representations
EP1899850B1 (fr) * 2005-05-23 2013-02-27 Open Text S.A. Environnement multimedia evolutif reparti
US7623755B2 (en) * 2006-08-17 2009-11-24 Adobe Systems Incorporated Techniques for positioning audio and video clips
CN101201737A (zh) * 2006-12-11 2008-06-18 陈健全 加快文本和语音匹配速度的基于选项的可编辑的控件
CN101345790A (zh) * 2007-07-09 2009-01-14 上海基信通讯技术有限公司 在手机上对音频文件进行编辑的方法
CN101477824A (zh) * 2009-02-10 2009-07-08 北京百纳威尔科技有限公司 在移动终端上编辑音频文件的方法和移动终端
CN101847079A (zh) * 2010-04-30 2010-09-29 中兴通讯股份有限公司 调整控件按钮布局的方法和装置
CN102638658A (zh) * 2012-03-01 2012-08-15 盛乐信息技术（上海）有限公司 音视频编辑方法及系统
CN104394331A (zh) * 2014-12-05 2015-03-04 厦门美图之家科技有限公司 一种画面视频中添加匹配音效的视频处理方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060156374A1 (en) * 2003-02-14 2006-07-13 Hu Carl C Automatic synchronization of audio and video based media services of media content
CN101640057A (zh) * 2009-05-31 2010-02-03 北京中星微电子有限公司 一种音视频匹配方法及装置
CN101984490A (zh) * 2010-11-23 2011-03-09 亿览在线网络技术（北京）有限公司 一种逐字同步的歌词文件的生成方法及系统
CN103106908A (zh) * 2011-11-11 2013-05-15 鸿富锦精密工业（深圳）有限公司 音频播放装置及控制音频播放装置操作的方法
CN104754178A (zh) * 2013-12-31 2015-07-01 广州励丰文化科技股份有限公司 音频控制方法
CN105827997A (zh) * 2016-04-26 2016-08-03 厦门幻世网络科技有限公司 一种为视听化数字媒体配音的方法及装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IT201800007842A1 (it) * 2018-08-03 2020-02-03 Sdi Media Italia Srl Metodo e apparato per evidenziare graficamente discrepanze in tracce audio associate a un contenuto audiovisivo
WO2020238186A1 (fr) * 2019-05-24 2020-12-03 珠海格力电器股份有限公司 Procédé et dispositif de lecture d'informations vocales, et support d'enregistrement
CN112911400A (zh) * 2021-01-18 2021-06-04 惠州Tcl移动通信有限公司 视频播放控制方法、装置、存储介质及移动终端
CN112911400B (zh) * 2021-01-18 2023-08-22 深圳市超然健康科技有限公司 视频播放控制方法、装置、存储介质及移动终端

Also Published As

Publication number Publication date
CN105827997A (zh) 2016-08-03

Similar Documents

Publication Publication Date Title
WO2017186015A1 (fr) Procédé et dispositif de doublage de supports numériques audiovisuels
US9420394B2 (en) Panning presets
US10224012B2 (en) Dynamic music authoring
US9524753B2 (en) Teleprompter tool for voice-over tool
WO2020077856A1 (fr) Procédé et appareil de photographie de vidéo, dispositif électronique et support d'informations lisible par ordinateur
WO2020077854A1 (fr) Procédé et dispositif de génération de vidéo, dispositif électronique et support d'enregistrement informatique
WO2020077855A1 (fr) Procédé et appareil de photographie vidéo, dispositif électronique et support d'informations lisible par ordinateur
RU2470353C2 (ru) Синхронизация событий показа слайдов с аудио
RU2447482C2 (ru) Пользовательский интерфейс состояния медиа данных
US9997196B2 (en) Retiming media presentations
US20140115470A1 (en) User interface for audio editing
US8332757B1 (en) Visualizing and adjusting parameters of clips in a timeline
US10622021B2 (en) Method and system for video editing
US20160111128A1 (en) Creating composition of content captured using plurality of electronic devices
US11837259B2 (en) Interface for indicating video editing decisions
US20150199350A1 (en) Method and system for providing linked video and slides from a presentation
US11894020B2 (en) Interface for setting speed and direction of video playback
US20170206055A1 (en) Realtime audio effects control
CN112783398A (zh) 显示控制与交互控制方法、设备、系统及存储介质
US12063431B1 (en) Systems and methods for presenting multiple views of videos
US12206930B2 (en) Video editing using transcript text stylization and layout
US20240397138A1 (en) Video production method and device, apparatus, and storage medium
US20240233769A1 (en) Multitrack effect visualization and interaction for text-based video editing
WO2022001437A1 (fr) Procédé et appareil de commande de lecture de fichier multimédia, équipement terminal et support d'enregistrement
JP5860575B1 (ja) 音声録音プログラム、音声録音端末装置、及び音声録音システム

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17788667

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27.02.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17788667

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载