+

CN116647735A - Barrage data processing method, barrage data processing device, electronic equipment, medium and program product - Google Patents

Barrage data processing method, barrage data processing device, electronic equipment, medium and program product Download PDF

Info

Publication number
CN116647735A
CN116647735A CN202210143836.1A CN202210143836A CN116647735A CN 116647735 A CN116647735 A CN 116647735A CN 202210143836 A CN202210143836 A CN 202210143836A CN 116647735 A CN116647735 A CN 116647735A
Authority
CN
China
Prior art keywords
data
multimedia
barrage
bullet screen
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210143836.1A
Other languages
Chinese (zh)
Inventor
李依斌
康凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202210143836.1A priority Critical patent/CN116647735A/en
Publication of CN116647735A publication Critical patent/CN116647735A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4888Data services, e.g. news ticker for displaying teletext characters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application discloses a barrage data processing method, device, electronic equipment, medium and program product, which are applied to the technical field of clouds. The method comprises the following steps: and displaying a multimedia playing interface, wherein the multimedia playing interface plays multimedia data, at least one barrage data is displayed on the multimedia data played by the multimedia playing interface, and according to triggering operation on target barrage data in the at least one barrage data, the multimedia playing interface carries out associated display on multimedia interaction data indicated by the multimedia data and barrage types of the target barrage data. By adopting the embodiment of the application, the richness of bullet screen effect presentation can be improved. The embodiment of the application can be applied to various scenes such as cloud technology, artificial intelligence, intelligent traffic, auxiliary driving and the like.

Description

Barrage data processing method, barrage data processing device, electronic equipment, medium and program product
Technical Field
The present application relates to the field of cloud technologies, and in particular, to a barrage data processing method, device, electronic equipment, medium, and program product.
Background
With the development of the internet, there is a certain need to improve the user experience on multimedia playing, and many existing multimedia applications are provided with a barrage function, so that the entertainment of watching can be increased by sending the barrage. At present, users can generally improve the interest of the users in barrage experience by setting the advanced barrages with irregular display forms by themselves. However, the bullet screen effect of this mode is simpler to present, and the interactivity with the played multimedia data is insufficient, so that better viewing experience cannot be brought to the user. Therefore, how to improve the richness of the bullet screen effect presentation is a urgent problem to be solved.
Disclosure of Invention
The embodiment of the application provides a barrage data processing method, device, electronic equipment, medium and program product, which can improve the richness of barrage effect presentation and the interactivity between barrage data and multimedia data.
In one aspect, an embodiment of the present application provides a barrage data processing method, where the method includes:
displaying a multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface;
and according to the triggering operation of the target barrage data in the at least one barrage data, carrying out associated display on the multimedia data and the multimedia interaction data indicated by the barrage type of the target barrage data on the multimedia playing interface.
In one aspect, an embodiment of the present application provides a barrage data processing apparatus, including:
the display module is used for displaying the multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface;
and the processing module is used for carrying out associated display on the multimedia data and the multimedia interaction data indicated by the barrage type of the target barrage data on the multimedia playing interface according to the triggering operation of the target barrage data in the at least one barrage data.
In one aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, where the memory is configured to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to perform some or all of the steps in the above method.
In one aspect, embodiments of the present application provide a computer readable storage medium storing a computer program comprising program instructions for performing part or all of the steps of the above method when executed by a processor.
Accordingly, according to one aspect of the present application, there is provided a computer program product or computer program comprising program instructions stored in a computer readable storage medium. The processor of the computer device reads the program instructions from the computer-readable storage medium, and the processor executes the program instructions, so that the computer device performs the bullet screen data processing method provided above.
In the embodiment of the application, a multimedia playing interface can be displayed, the multimedia playing interface plays multimedia data, at least one barrage data is displayed on the multimedia data, and according to the triggering operation for the target barrage data in the at least one barrage data, the multimedia interactive data indicated by the multimedia data and the barrage type of the target barrage data are associated and displayed on the multimedia playing interface. By the method, the multimedia interaction data presenting different barrage interaction effects can be obtained according to different barrage types, and the multimedia data and the multimedia interaction data are displayed in a correlated mode so as to improve the richness and interactivity of the barrages, and better interestingness and watching experience can be brought to users.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an application architecture according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of a barrage data processing method according to an embodiment of the present application;
fig. 3a is a schematic view of a scene of bullet screen effect presentation according to an embodiment of the present application;
fig. 3b is a schematic view of a scene of bullet screen effect presentation according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of a barrage data processing method according to an embodiment of the present application;
FIG. 5a is a schematic view of a scene showing bullet screen data according to an embodiment of the present application;
FIG. 5b is a schematic diagram of a scene showing bullet screen data according to an embodiment of the present application;
FIG. 5c is a schematic diagram of a scene showing bullet screen data according to an embodiment of the present application;
FIG. 5d is a schematic diagram of a scene showing bullet screen data according to an embodiment of the present application;
Fig. 5e is a schematic view of a scene showing bullet screen data according to an embodiment of the present application;
FIG. 6a is a schematic view of a scene of an interactive display based on a high energy barrage type according to an embodiment of the present application;
FIG. 6b is a schematic view of a scene of an interactive display based on a high energy barrage type according to an embodiment of the present application;
fig. 7a is a schematic view of a scene of an interactive display based on a protective barrage type according to an embodiment of the present application;
fig. 7b is a schematic view of a scene of an interactive display based on a protective barrage type according to an embodiment of the present application;
FIG. 8a is a schematic view of a scene of an interactive display based on an animated barrage type according to an embodiment of the present application;
FIG. 8b is a schematic view of a scene of an interactive display based on an animated barrage type according to an embodiment of the present application;
FIG. 8c is a schematic view of a scene of an interactive display based on an animated barrage type according to an embodiment of the present application;
FIG. 9a is a schematic view of a scene of an interactive display based on a synthetic barrage type according to an embodiment of the present application;
FIG. 9b is a schematic view of a scene of an interactive display based on a synthetic barrage type according to an embodiment of the present application;
FIG. 10a is a schematic diagram of an interaction flow of bullet screen data processing according to an embodiment of the present application;
FIG. 10b is a schematic diagram of an interaction flow of bullet screen data processing according to an embodiment of the present application;
FIG. 10c is a schematic diagram of an interaction flow of bullet screen data processing according to an embodiment of the present application;
FIG. 11 is a schematic diagram of a barrage data processing apparatus according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.
The bullet screen data processing method provided by the embodiment of the application is implemented in the electronic equipment, and the electronic equipment can be a server or a terminal. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs (Content Delivery Network, content delivery networks), basic cloud computing services such as big data and artificial intelligent platforms, and the like. The terminal may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch smart voice interaction device, a smart home appliance, a vehicle-mounted terminal, an aircraft, and the like. The embodiment of the application can be applied to various scenes, including but not limited to cloud technology, artificial intelligence, intelligent transportation, auxiliary driving and the like.
The embodiment of the application relates to the technical field of artificial intelligence, in particular to a theory, a method, a technology and an application system which simulate, extend and expand human intelligence by using a digital computer or a machine controlled by the digital computer, sense environment, acquire knowledge and acquire an optimal result by using the knowledge. In other words, artificial intelligence is an integrated technology of computer science that attempts to understand the essence of intelligence and to produce a new intelligent machine that can react in a similar way to human intelligence. Artificial intelligence, i.e. research on design principles and implementation methods of various intelligent machines, enables the machines to have functions of sensing, reasoning and decision. For example, the artificial intelligence technology can be utilized to mark the segment plot of the multimedia data in the technical scheme of the application.
The embodiment of the application relates to the technical field related to cloud technology, such as the technical field of cloud storage (cloud storage), wherein cloud storage is a new concept which extends and develops in the concept of cloud computing, a distributed cloud storage system (hereinafter referred to as a storage system for short) refers to a storage system which integrates a large number of storage devices (storage devices are also called storage nodes) of different types in a network through application software or application interfaces to work cooperatively and provides data storage and service access functions together. According to the technical scheme, the multimedia interaction data and/or the fragment plot library which need to be associated and displayed can be stored in the cloud storage system.
In some embodiments, please refer to fig. 1, fig. 1 is a schematic diagram of an application architecture according to an embodiment of the present application, through which the barrage data processing method according to the present application may be executed. As shown in fig. 1, the system may include an electronic device and a background server of a play application to which the multimedia play interface belongs; the electronic device displays a multimedia playing interface, acquires multimedia data (such as video data, audio cartoon data and the like) to be played and at least one barrage data to be displayed from a background server, plays the multimedia data on the multimedia playing interface and displays the at least one barrage data, and when the user A clicks the target barrage data, the electronic device can determine multimedia interaction data indicated by the barrage type of the clicked target barrage data, or the electronic device acquires corresponding multimedia interaction data from the background server, and performs associated display on the multimedia data and the multimedia interaction data in the multimedia playing interface watched by the user A so as to realize barrage effect presentation corresponding to the clicked target barrage data.
It should be understood that fig. 1 is merely exemplary to represent possible application architectures of the technical solution of the present application, and is not limited to specific architectures of the technical solution of the present application, that is, the technical solution of the present application may also provide other application architectures.
Optionally, in some embodiments, the electronic device may execute the barrage data processing method according to actual service requirements to improve richness of barrage effect presentation. The technical scheme of the application can be applied to bullet screen scenes of any multimedia data, namely, the electronic equipment can obtain the multimedia interaction data indicated by the triggered target bullet screen data when playing the multimedia data, and the multimedia data and the multimedia interaction data are associated and displayed on a multimedia playing interface. For example, the technical scheme of the application can be applied to a barrage scene of video data, the barrage type of the triggered target barrage data is an animation barrage type, the indicated multimedia interaction data can be a preset interaction animation, and the associated display of the multimedia data and the multimedia interaction data can be the display of the interaction animation on the played video data, so that the interest of a user in barrage experience is improved.
Optionally, the data related to the present application, such as multimedia interaction data, segment plot library, etc., may be stored in a database, or may be stored in a blockchain, such as by a blockchain distributed system, which is not limited by the present application.
It can be understood that the above scenario is merely an example, and does not constitute a limitation on the application scenario of the technical solution provided by the embodiment of the present application, and the technical solution of the present application may also be applied to other scenarios. For example, as one of ordinary skill in the art can know, with the evolution of the system architecture and the appearance of new service scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.
Based on the above description, the embodiments of the present application provide a barrage data processing method, which may be performed by the above-mentioned electronic device. Referring to fig. 2, fig. 2 is a flow chart of a barrage data processing method according to an embodiment of the application. As shown in fig. 2, the flow of the barrage data processing method according to the embodiment of the present application may include the following steps:
s201, displaying a multimedia playing interface.
The multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface.
In some embodiments, the multimedia data may be media data in any multimedia scene, for example, may be media data in a video playing scene, such as video data, etc., that is, a picture and a sound in the video data may be played on the multimedia playing interface; the method can also be media data in an image playing scene, such as sound cartoon data, and the like, namely, the images and the sound in the sound cartoon data can be played on a multimedia playing interface; the media data in the text playing scene, such as audio novel data, can be played on the multimedia playing interface, such as text and sound in the audio novel data, and the specific type of the multimedia data is not limited. And the multimedia playing interface has a bullet screen transmitting function, when a user watches the multimedia data played on the multimedia playing interface, the content of the bullet screen which is required to be transmitted can be input through the bullet screen transmitting function, and the electronic equipment obtains the bullet screen data according to the input content of the user and displays the bullet screen data on the played multimedia data.
In some embodiments, the multimedia playing interface may be a video playing interface for playing video, an image playing interface for playing image (such as a cartoon playing interface), and so on. The multimedia playing interface may be an interface in a playing application (such as a video application and a cartoon application), and the user may log in the playing application through a registered user account, click multimedia data in the playing application to play the corresponding multimedia data, so as to trigger the electronic device to display the multimedia playing interface, and play the multimedia data in the displayed multimedia playing interface.
S202, according to triggering operation of target barrage data in at least one barrage data, the multimedia data and multimedia interaction data indicated by barrage type of the target barrage data are displayed in a correlated mode on a multimedia playing interface.
In some embodiments, the at least one bullet screen data displayed may include normal bullet screen data for displaying user input content, and special bullet screen data for displaying user input content, having a touch characteristic and corresponding to a special bullet screen type, where the special bullet screen data has a corresponding bullet screen type, one characteristic bullet screen data corresponds to one bullet screen type, and bullet screen types corresponding to different characteristic bullet screen data may be different. When a user executes triggering operation on target barrage data in the displayed special barrage data, the electronic equipment acquires corresponding multimedia interaction data according to the barrage type of the triggered target barrage data, and performs associated display on the multimedia data and the multimedia interaction data on a multimedia playing interface corresponding to the user. The triggering operation may be a click operation (single click, double click), a long press operation, a sliding operation, etc., which is not limited herein.
In some embodiments, the multimedia interaction data may characterize the process of viewing interactions between the user and the multimedia data, the form of the multimedia interaction data being determined by the particular bullet screen type and the particular scene of the multimedia data. The multimedia data in different scenes may exist in one or more bullet screen types; and the bullet screen types of the multimedia data in different scenes can be the same or different; and the specific determination modes of the multimedia interaction data corresponding to different bullet screen types can be the same or different; and the specific determination modes of the corresponding multimedia interaction data can be the same or different under the multimedia data of different scenes of the same bullet screen type. The specific determination mode of the multimedia interaction data can be set by related service personnel (such as a developer of a playing application to which the multimedia playing interface belongs) according to experience values.
In some embodiments, the multimedia interaction data may be data related to the multimedia data, such as obtained by performing a bullet screen type-indicated multimedia setting adjustment on a to-be-adjusted multimedia segment in the multimedia data, or may be obtained by performing a bullet screen type-indicated data processing on the multimedia data; and the data to be displayed on the multimedia data, such as animation, image, text and the like, displayed on the multimedia data.
In some embodiments, the electronic device may display the multimedia interaction data and the multimedia data in an associated manner, which may include displaying the multimedia interaction data on the multimedia data being played, or directly replacing a part of the multimedia fragments in the multimedia data being played with the multimedia interaction data, and playing the multimedia interaction data, and after the multimedia interaction data is played, continuing to play the multimedia data according to the termination progress point of the replaced multimedia fragments.
Thus, the process of interactive display may include, but is not limited to:
(1) When the multimedia interaction data is obtained after the multimedia setting adjustment is carried out on the multimedia fragments to be adjusted in the multimedia data, replacing the multimedia fragments to be adjusted with the multimedia interaction data, and playing the multimedia interaction data, and after the playing is finished, continuing to play the multimedia data according to the progress position of the end point progress point of the multimedia fragments to be adjusted in the multimedia data; the multimedia segment to be adjusted can be obtained based on the current progress position of the multimedia data when the triggering operation is executed, namely, the multimedia segment to be adjusted can be obtained according to the current progress position and the interaction time indicated by the triggered target barrage data; for example, if the multimedia data is video data, the current progress position is that the video data is played to 1:00, and the interaction time is 30s, the multimedia segment to be adjusted may be a video segment with a playing progress of 1:00-1:30 in the video data; the interaction time may be a default setting time corresponding to a bullet screen type of the target bullet screen data, or may be a time set by a user who transmits the target bullet screen data.
(2) When the multimedia interaction data is obtained by processing the data indicated by the bullet screen type of the multimedia data, the multimedia interaction data can be obtained by displaying the processed data on the multimedia data currently played by the multimedia playing interface, and the multimedia interaction data is stored in the electronic equipment.
(3) When the multimedia interaction data is the data to be displayed on the multimedia data, the multimedia interaction data can be displayed on the multimedia data currently played on the multimedia playing interface. The specific content of the above-mentioned associated display of the multimedia data and the multimedia interaction data may be referred to the related description of the following embodiments.
It can be understood that the target barrage data triggered by the user can be barrage data sent by the user, or can be barrage data sent by other users watching the video data.
For example, as shown in fig. 3a to 3b, fig. 3a to 3b are schematic views of a scene of bullet screen effect presentation according to an embodiment of the present application; the method comprises the steps that a multimedia playing interface is displayed on electronic equipment of a user, video data are played on the multimedia playing interface, at least one barrage data are displayed on the video data, the at least one barrage data comprise common barrage data and special barrage data, barrage data added with special marks are set to be special barrage data (double underlines are set here), the special barrage data have touch characteristics and have corresponding barrage types, the user can realize corresponding barrage effect display by triggering the special barrage data, when the user executes triggering operation on target barrage data in the special barrage data, the electronic equipment determines multimedia interaction data according to the barrage types of the target barrage data, and the multimedia interaction data and the video data are displayed in a correlated mode on the multimedia playing interface, as shown in fig. 3 a; if the multimedia interactive data determined based on the bullet screen type of the target bullet screen data is the target animation to be displayed on the multimedia data, the corresponding target animation may be started to be displayed at the current playing progress point of the video data when the trigger operation is performed, as shown in fig. 3 b.
In the embodiment of the application, the electronic equipment can display the multimedia playing interface, and according to the triggering operation aiming at the target barrage data in at least one barrage data, the multimedia interactive data indicated by the barrage type of the multimedia data and the target barrage data are associated and displayed on the multimedia playing interface. By the method, the multimedia interaction data presenting different barrage interaction effects can be obtained according to different barrage types, and the multimedia data and the multimedia interaction data are displayed in a correlated mode so as to improve the richness and interactivity of the barrages, and better interestingness and watching experience can be brought to users.
Referring to fig. 4, fig. 4 is a flowchart of a barrage data processing method according to an embodiment of the application, where the method may be performed by the above-mentioned electronic device. As shown in fig. 4, the flow of the bullet screen data processing method in the embodiment of the present application may include the following steps:
s401, displaying a multimedia playing interface. The specific implementation manner of step S401 may be referred to the related description of the above embodiments, which is not repeated herein.
S402, displaying a barrage input interface according to barrage input operation triggered on the multimedia playing interface.
In some embodiments, the electronic device may generate and display at least one bullet screen data based on a bullet screen transmission operation of the user while playing the multimedia data at the multimedia playing interface. The electronic equipment can display a barrage input interface according to barrage input operation triggered on the multimedia playing interface, at least one barrage type control can be displayed on the barrage input interface, and a user can select the barrage type of barrage data to be sent through the barrage type control. The bullet screen input interface is used for inputting bullet screen data which a user wants to send, and can be displayed on the electronic equipment in an interface skip mode, namely, after bullet screen input operation is triggered, the bullet screen input interface is skipped from the current multimedia playing interface, when the user sends the bullet screen on the bullet screen input interface or closes the bullet screen input interface, the bullet screen input interface is skipped to the multimedia playing interface, and the bullet screen input interface can also be displayed on the multimedia playing interface in a floating window floating layer mode.
In one possible implementation, the bullet screen input interface displayed by the electronic device may directly include bullet screen type controls corresponding to all bullet screen types; the bullet screen type control to be displayed on the bullet screen input interface can be determined according to the current playing progress point and/or the data input by the user, and the bullet screen type control can be specifically: determining at least one multimedia fragment contained in the multimedia data and a fragment plot corresponding to each transition multimedia fragment meeting a preset plot rule in the at least one multimedia fragment, and displaying a bullet screen input interface based on the transition multimedia fragment contained in the multimedia data and a play progress point when bullet screen input operation is triggered.
In some embodiments, the determining, by the electronic device, at least one multimedia segment included in the multimedia data and a segment scenario corresponding to each transition multimedia segment of the at least one multimedia segment that satisfies the preset scenario rule may specifically be: acquiring a preset segment plot library, wherein the segment plot library can comprise at least one segment plot, setting corresponding bullet screen type controls for each segment plot in the segment plot library, and one segment plot can correspond to one bullet screen type and one bullet screen type control; and segmenting the multimedia data to obtain at least one multimedia segment contained in the multimedia data, wherein the lengths of different multimedia segments can be the same or different, determining at least one transition multimedia segment from the at least one multimedia segment, and setting corresponding segment episodes for each transition multimedia segment according to a segment episode library so as to realize episode marking of the multimedia data. One transition multimedia clip may correspond to one or more clip episodes.
The segment plot library can be determined by related service personnel according to specific types and experience values of the multimedia data, and different segment plots can exist for different multimedia data. For example, when the multimedia data is video data, the corresponding clip scenario may include a high-energy scenario, a body-protecting scenario, and the like; when the multimedia data is cartoon data, the corresponding clip scenario may include a climax scenario, a conclusion scenario, etc. Alternatively, a training set (may include a plurality of sample multimedia data, a segment scenario corresponding to a sample multimedia segment in each sample multimedia data, and a scenario rule corresponding to each segment scenario) may be created in advance by the electronic device and/or the background server, and training of a scenario mark may be performed based on the training set, and after training is completed, the scenario mark of the multimedia data may be implemented.
In some embodiments, the specific manner of processing the multimedia data in a segmentation manner may be determined by the specific type of the multimedia data, for example, when the multimedia data is video data, a multimedia segment may be divided every 3 minutes, etc.; if the multimedia data is novel data, each paragraph may be divided into a multimedia segment, or each chapter may be divided into a multimedia segment, etc.; if the multimedia data is cartoon data, each chapter can be divided into one multimedia segment, or each N (N is a positive integer) sub-image can be divided into one multimedia segment, etc.; there is no limitation in this regard.
In some embodiments, determining at least one transition multimedia segment from at least one multimedia segment may specifically be determining a scenario rule corresponding to each segment scenario, and determining at least one transition multimedia segment from the at least one multimedia segment that meets any scenario rule; when a certain multimedia clip satisfies a plurality of episode rules, the multimedia clip may correspond to a plurality of clip episodes. The scenario rules can be set by related business personnel according to specific types and specific segment scenarios of the multimedia data, the segment scenarios are different, and corresponding scenario rules can be different. For example, when the multimedia data is video data and the episode is a high-energy episode, the corresponding episode rule may be that a fight picture appears in the multimedia episode or a main character appears; when the segment plot is a body-protecting plot, the corresponding plot rule can be a horror picture, a thrill picture and the like in the multimedia segment.
In some embodiments, the electronic device performs display of the barrage input interface based on the transition multimedia segment included in the multimedia data and the play progress point when triggering the barrage input operation, specifically may display the barrage input interface including the barrage type control of the corresponding segment plot if the multimedia segment to which the play progress point belongs is the transition multimedia segment provided with the corresponding segment plot; if the multimedia segment to which the playing progress point belongs is not a transition multimedia segment provided with a corresponding segment plot, displaying a bullet screen input interface which does not contain any bullet screen type control; specifically, the electronic device may display a first barrage input interface according to a barrage input operation triggered on the multimedia playing interface, where the first barrage input interface includes a first barrage type control, the first barrage type control is a barrage type control indicated by a segment plot corresponding to a target multimedia segment in the multimedia data, the target multimedia segment is any one of at least one multimedia segment, and the target multimedia segment is a segment played in the multimedia playing interface when the barrage input operation is triggered; or the electronic equipment displays a second barrage input interface according to barrage input operation triggered on the multimedia playing interface, wherein the second barrage input interface does not comprise barrage type controls corresponding to any segment plot. The barrage input operation may be a touch operation on the barrage input field, or a voice indication operation sent for the barrage, and the like, which is not limited herein.
S403, based on the bullet screen type control and the input data on the bullet screen input interface, bullet screen data of the bullet screen type indicated by the bullet screen type control are displayed on the multimedia playing interface.
The bullet screen input interface comprises the first bullet screen input interface and the second bullet screen input interface, and special bullet screen data can be sent to the first bullet screen input interface and the second bullet screen input interface.
In some embodiments, the specific barrage data displayed by the electronic device based on the first barrage input interface may specifically be barrage data of a barrage type indicated by the first barrage type control, displayed on the multimedia playing interface according to the data input in the barrage input interface if the control state of the first barrage type control in the first barrage input interface is an on state. The content displayed by the barrage data includes entered data, which may include text, characters, expressions, etc. And the number of the first barrage type controls can be one or more, and when the first barrage input interface is triggered and displayed, the target multimedia clip played by the multimedia playing interface corresponds to a plurality of clip episodes, and the first barrage type controls are barrage type controls corresponding to the plurality of clip episodes.
Optionally, when the plurality of first bullet screen type controls are multiple, one or more of the first bullet screen type controls can be opened, that is, the user can trigger one or more of the first bullet screen type controls at the same time, and when the plurality of first bullet screen type controls are triggered, bullet screen data of a bullet screen type indicated by each of the triggered plurality of first bullet screen type controls can be respectively generated and displayed based on the input target data. Optionally, the control state of the first barrage type control may be an automatically opened state when the first barrage input interface is displayed, or may be a closed state first, and then be an opened state after a trigger operation of a user.
In some embodiments, the electronic device may specifically acquire the target data recorded in the second bullet screen recording interface based on the special bullet screen data displayed in the second bullet screen recording interface, where the target data includes text data, and if the text data includes a scenario keyword associated with a target segment scenario in at least one segment scenario, then a second bullet screen type control corresponding to the target segment scenario is displayed in the second bullet screen recording interface, and bullet screen data of a bullet screen type indicated by the second bullet screen type control is displayed in the multimedia playing interface according to the second bullet screen type control and the target data.
The displaying, according to the second bullet screen type control and the target data, bullet screen data of the bullet screen type indicated by the second bullet screen type control on the multimedia playing interface may specifically be displaying, according to the target data entered on the bullet screen entry interface, bullet screen data of the bullet screen type indicated by the second bullet screen type control on the multimedia playing interface if the control state of the second bullet screen type control in the second bullet screen entry interface is an on state. The content displayed by the barrage data includes entered target data, which may include text, characters, expressions, etc. Optionally, the control state of the second barrage type control may be automatically in an open state when displayed in the second barrage input interface, or may be in a closed state first, and then in an open state after a trigger operation of a user.
Therefore, the electronic device can acquire the latest input target data on the barrage input interface, identify keywords of text data included in the target data, and determine the target segment plot and the second barrage type control corresponding to the target segment plot if keywords belonging to plot keywords associated with any segment plot are identified. It may be understood that if the entered target data includes keywords associated with the target episode, it indicates that the user may want to send special bullet screen data for the bullet screen type indicated by the second bullet screen type control corresponding to the target episode.
The scenario keywords associated with different scenario sections can be the same or different, and can be specifically set by related business personnel according to experience values; for example, scenario keywords associated with high-energy scenarios may include "front high-energy," "high-energy pre-warning," and so forth. And the target segment plot may be one or more, and when the text data includes plot keywords associated with a plurality of segment plots, the plurality of segment plots are all taken as the target segment plot; or when the keywords included in the text data belong to the scenario keywords associated with the plurality of segment scenarios, taking the plurality of segment scenarios as target segment scenarios; when the target segment plot is multiple, the corresponding second bullet screen type controls can also be multiple, namely the multiple second bullet screen type controls are displayed in the bullet screen input interface. Optionally, when the second barrage type control is multiple, one or more controls may be opened, that is, the user may trigger one or more second barrage type controls, and when the multiple controls are triggered, barrage data of the barrage type indicated by each control in the triggered multiple controls may be generated and displayed respectively based on the input target data.
In some embodiments, the manner in which the electronic device displays the barrage data of the barrage type indicated by the first barrage type control on the multimedia playing interface and the barrage data of the barrage type indicated by the second barrage type control on the multimedia playing interface is the same, that is, a special identifier matched with the opened barrage type control is added to the input data so as to obtain barrage data to be displayed, and a trigger control is generated for the barrage data to be displayed so that the barrage data to be displayed has a touch characteristic. The special identifier can be set by a user or related business personnel, and the special identifiers corresponding to different barrage type controls can be the same or different.
For example, as shown in fig. 5a to 5e, fig. 5a to 5e are schematic views of a scene showing bullet screen data according to an embodiment of the present application; wherein:
(1) As shown in fig. 5a, according to a barrage input operation triggered on a multimedia playing interface, if a multimedia clip played during triggering is provided with a corresponding clip scenario, displaying a first barrage input interface, where the first barrage input interface displays a first barrage type control of the corresponding clip scenario, and the displayed first barrage type control may be one or more;
(2) As shown in fig. 5b, the first bullet screen type control is in an open state by triggering operation on the first bullet screen type control, and data recorded in the first bullet screen recording interface are acquired; when the number of the first barrage type controls (barrage type controls A at the moment) in the opening state is 1, barrage data are generated and displayed according to the recorded data and special identifications corresponding to the barrage type controls A (the special identifications are set as barrage type A corresponding to the barrage type controls A marked at the upper right corner); as shown in fig. 5c, when the number of the first bullet screen type controls (set as bullet screen type controls a and bullet screen type controls B at this time) in the open state is 2, bullet screen data a is generated and displayed according to the input data and the special identifier corresponding to the bullet screen type control a (set as the special identifier that the bullet screen type corresponding to the bullet screen type control a is marked on the upper right corner), and bullet screen data B is generated and displayed according to the input data and the special identifier corresponding to the bullet screen type control B (set as the special identifier that the bullet screen type corresponding to the bullet screen type control B is marked on the upper right corner);
(3) Alternatively, based on fig. 5c, when the bullet screen type control a and the bullet screen type control B are opened, the opened control corresponds to one bullet screen input frame, the bullet screen content displayed by the bullet screen data a and the bullet screen content displayed by the bullet screen data B are the same, and the bullet screen content displayed by the bullet screen data a and the bullet screen content displayed by the bullet screen data B are both data recorded by the bullet screen input frame; when a plurality of controls are opened, a barrage input frame is allocated to each control, namely when a second control or more than a second control is opened, a barrage input frame is generated and displayed for the newly-added opening control, namely in the barrage input interface, when only the barrage type control A is in an opening state, the barrage input frame at the moment is the barrage input frame corresponding to the barrage type control A, when the barrage type control B is newly opened, a barrage input frame is newly added to the barrage input interface, the newly-added barrage input frame is the barrage input frame corresponding to the barrage type control B, and a user can simultaneously send barrage data corresponding to the two types of controls through a 'one-key sending' control in the barrage input interface, or respectively send barrage data corresponding to the two types of controls through the sending controls on the barrage input frame;
(4) As shown in fig. 5e, according to the barrage input operation triggered on the multimedia playing interface, if the multimedia clip played during triggering is not provided with a corresponding clip scenario, displaying a second barrage input interface, where the second barrage input interface does not display any barrage type control, acquiring the target data input in the second barrage input interface (may be acquired at regular time (e.g. once every 0.1 s) or may be acquired when detecting that the data in the second barrage input interface changes), and if the text data in the input target data contains a scenario keyword associated with the target clip scenario, setting the target data as "front high energy XXX". . . The text data is 'front high-energy XXX', and the scenario keywords associated with the high-energy scenario are 'front high-energy', so that a high-energy bullet screen type control corresponding to the high-energy scenario is displayed on the second bullet screen input interface at the moment; when the text data contains scenario keywords associated with a plurality of fragment scenarios, bullet screen type controls corresponding to the plurality of fragment scenarios are displayed;
(5) When the high-energy barrage type control is in an open state and barrage sending operation is triggered, corresponding barrage data are generated and displayed according to the obtained target data and the special mark corresponding to the high-energy barrage type control.
It can be appreciated that when the displayed bullet screen type controls are in a closed state or any bullet screen type control is not displayed, the bullet screen data generated and displayed based on the data entered by the bullet screen entry interface is ordinary bullet screen data. Before the bullet screen input interface is displayed, the electronic equipment or the background server can analyze the content of the multimedia data to finish the plot mark of the multimedia data, the bullet screen input interface containing the corresponding bullet screen type control can be displayed at the plot mark in the process of playing the multimedia data, the corresponding special bullet screen data can be generated and displayed based on the operation in the bullet screen input interface, keyword recognition can be carried out through the acquired input target data at any time except the plot mark, after the plot keywords are obtained through recognition, the corresponding bullet screen type control can be displayed, the corresponding special bullet screen data can be generated and displayed based on the operation in the bullet screen input interface, and different bullet screen effects can be presented by the different special bullet screen data.
S404, according to the triggering operation of the target barrage data in at least one barrage data, the multimedia data and the multimedia interaction data indicated by the barrage type of the target barrage data are displayed in a correlated manner on the multimedia playing interface.
In some embodiments, when a user clicks on target barrage data in special barrage data, the electronic device may determine multimedia interaction data with barrage effects according to barrage types of the target barrage data, and perform associated display on the multimedia data and the multimedia interaction data, so as to improve interactivity and interactivity of the user to the multimedia data and improve visual experience presented to the user through the barrage, so that when the user views the multimedia data, the user can view different barrage effects by clicking on the special barrage data or sending the special barrage data, and can obtain a larger achievement sense and satisfaction sense, thereby improving viewing participation and viewing experience, so as to promote promotion of viewing duration, and pull up large disc data (including viewing duration, user liveness, user retention and the like) watched by the user.
In some embodiments, the bullet screen type of the target bullet screen data may be one or more, and may be determined based on the particular type of multimedia data. Optionally, when the multimedia data is video data, the bullet screen type indicated by the target bullet screen data may include a high-energy bullet screen type, and a playing progress bar that may include the video data in the multimedia playing interface; the electronic device performs associated display on the multimedia playing interface on the multimedia data and the multimedia interaction data indicated by the bullet screen type of the target bullet screen data, specifically, may obtain a first video clip from the video data according to a first playing duration of the video data in the playing progress bar when the triggering operation for the target bullet screen data is executed, where a playing start position of the first video clip is a playing position indicated by the first playing duration; and adjusting the video playing setting of the first video segment to be the high-energy playing setting corresponding to the high-energy bullet screen type, determining the first video segment with the high-energy playing setting as multimedia interaction data, and carrying out associated display on the video data and the first video segment with the high-energy playing setting.
For example, the clip scenario corresponding to the first video clip at this time is set as the high-energy scenario. Wherein the high-energy scenario may be some scenarios including special pictures such as a fight picture, a main character departure picture, etc., and since the user will want to better focus on the current playing piece when watching the high-energy scenario, the high-energy playing setting may enable the effect to be achieved when playing the first video piece, i.e. the high-energy playing setting may include at least one of the following settings: setting up the playing volume of the first video segment, and setting up the transparency of bullet screen data displayed on the first video segment; optionally, the method may further include setting up enhancement of brightness of a playing screen of the first video segment, or setting up enhancement of sharpness of the first video segment, etc.
The above setting for increasing the playing volume may be increasing to XX times (e.g. 1.5 times) the current playing volume or increasing to the target volume (in this case, if the playing volume is already greater than or equal to the target volume to be adjusted when playing the video data, the adjustment may not be performed), and the specific mode is not limited herein; and the setting for improving the transparency may be to XX times (e.g., 1.5 times) the current transparency or to the target transparency (in this case, if the transparency is already greater than or equal to the target transparency to be adjusted when the video data is played, the adjustment may not be performed), and the specific manner is not limited here; and the setting for increasing the brightness of the playing picture may be increasing XX times (e.g. 1.5 times) the brightness of the current picture or increasing XX times the target brightness (in this case, if the brightness of the current picture is already greater than or equal to the target brightness to be adjusted when playing the video data, the adjustment may not be performed), where the specific mode is not limited; and the setting for increasing the definition may be increasing the definition by one picture level (for example, if the current definition is 720P, the definition may be increased to 1080P) or increasing the definition to a target picture level (in this case, if the picture level is already greater than or equal to the target picture level to be adjusted when the video data is played, the adjustment may not be performed), or the like. Alternatively, the high-energy play setting may also include other setting manners, which are not limited herein.
In some embodiments, the electronic device may specifically obtain the interaction time indicated by the target barrage data from the video data according to a first playing duration of the video data in the playing progress bar when the trigger operation for the target barrage data is performed, determine a first playing progress interval according to a playing progress point corresponding to the first playing duration in the video data (i.e. a playing position in the video data) and the interaction time, and determine the first video data corresponding to the first playing progress interval in the video data as the first video segment, i.e. the first video data is part of the video data in the video data.
Optionally, the interaction time may be set by default by related service personnel, or may be set by the user when the high-energy barrage data is sent, that is, the first control for setting the interaction time may be displayed when the high-energy barrage type control is in an on state. In addition, the display time of the high-energy barrage data on the multimedia playing interface can be set by default by related business personnel, or can be set by a user, namely, a second control for setting the display time is displayed when the high-energy barrage type control is in an open state. Alternatively, the first control and the second control may be different controls or the same control.
In some embodiments, the electronic device performs the associated display on the video data and the first video clip having the high-energy playing setting, which may specifically be playing the first video clip having the high-energy playing setting, and after the playing is completed, continuing to play the video data from the playing end position of the first video clip, so as to implement the associated display.
For example, as shown in fig. 6 a-6 b, fig. 6 a-6 b are schematic views of a scene based on interactive display of a high-energy barrage type according to an embodiment of the present application; wherein:
(1) The displayed barrage input interface comprises a high-energy barrage type control corresponding to the high-energy barrage type, and the displayed barrage input interface can be as follows:
(a) If the high-energy barrage type control is in the open state, the barrage input interface at this time may be as shown in (1) in fig. 6a, where the interaction time and the display time are both default settings;
(b) Alternatively, the barrage input interface at this time may be as shown in (2) in fig. 6a, where the interaction time indicated by the high-energy barrage data may be set by the user, and the display time corresponding to the high-energy barrage data is set by default;
(c) Alternatively, the barrage input interface at this time may be set by default as shown in (3) in fig. 6a, where the interaction time indicated by the high-energy barrage data is set by default, and the display time corresponding to the high-energy barrage data may be set by the user;
(d) Or, as shown in (4) in fig. 6a, the bullet screen input interface at this time may be set by the user, where the interaction time and the corresponding display time indicated by the high-energy bullet screen data are both set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are the same control, and the interaction time and the display time can be set by the control at the same time, that is, the interaction time and the display time of one high-energy bullet screen data are the same at this time;
(e) Or, as shown in (5) in fig. 6a, the bullet screen input interface at this time may be set by the user, where the interaction time and the corresponding display time indicated by the high-energy bullet screen data are both set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are not the same control, that is, the interaction time and the display time of one high-energy bullet screen data may be set separately at this time;
(2) As shown in fig. 6b, when the high-energy barrage data is triggered, the first playing duration of the video data in the playing progress bar is 1:00, that is, the video picture corresponding to 1:00 in the video data is played in the multimedia playing interface, a playing progress interval is determined according to the interaction time (set to 30 s) and the first playing time of the triggered high-energy barrage data, and a first video segment is obtained according to the playing progress interval, that is, the first video segment is a part of the video data between 1:00 and 1:30, and the playing setting adjustment is performed on the first video segment based on the high-energy playing setting to obtain the first video segment with the high-energy playing setting; and after the first video clip with the high-energy playing setting is played, continuing to play the video data based on the playing termination position of the first video clip, namely starting to play the video data from 1:30 in the playing progress bar, namely playing the video picture corresponding to 1:30 in the video data in the multimedia playing interface.
In some embodiments, when the multimedia data is video data, the bullet screen type indicated by the target bullet screen data may include a protection bullet screen type, and a playing progress bar that may include the video data in the multimedia playing interface; the electronic device may specifically perform the associated display on the multimedia playing interface on the multimedia data and the multimedia interaction data indicated by the bullet screen type of the target bullet screen data, where the second video clip is obtained from the video data according to a second playing duration of the video data in the playing progress bar when the trigger operation for the target bullet screen data is performed, and a playing start position of the second video clip is a playing position indicated by the second playing duration; and adjusting the video playing setting of the second video segment to be the protection playing setting corresponding to the protection bullet screen type, determining the second video segment with the protection playing setting as multimedia interaction data, and carrying out associated display on the video data and the second video segment with the protection playing setting.
For example, the clip scenario corresponding to the second video clip at this time is set as the guard scenario. The guard playing setting may make the situation avoided as much as possible when playing the second video clip, and the guard playing setting may include at least one of the following settings: setting the playing volume of the second video clip to be reduced, and setting the definition of the second video clip to be reduced; optionally, setting the brightness of the playing picture of the second video clip to be reduced may be further included.
The setting for reducing the playing volume may be reducing to XX times (e.g. 1.5 times) the current playing volume or reducing to the target volume (in this case, if the playing volume is already less than or equal to the target volume to be adjusted when playing the video data, the adjustment may not be performed), and the specific manner is not limited herein; and the definition-lowering setting may be lowering the current definition by one picture level or lowering the current definition to a target picture level (in which case the adjustment may not be performed if the picture level is already less than or equal to the target picture level to be adjusted when the video data is played), without limitation to the specific manner herein; and the setting of decreasing the brightness of the playing picture may be XX times (e.g., 1.5 times) the brightness of the current picture or XX times the target brightness (in this case, if the brightness of the current picture is already less than or equal to the target brightness to be adjusted when the video data is played, the adjustment may not be performed), and the specific manner is not limited here. Optionally, the guard play setting may also include other setting manners, which are not limited herein.
In some embodiments, the electronic device may specifically obtain the second video segment from the video data according to the second playing duration of the video data in the playing progress bar when the triggering operation for the target barrage data is performed, obtain the interaction time indicated by the target barrage data, determine the second playing progress interval according to the playing progress point corresponding to the second playing duration in the video data (i.e. the playing position in the video data) and the interaction time, and determine the second video data corresponding to the second playing progress interval in the video data as the second video segment, i.e. the second video data is part of the video data in the video data.
Optionally, the interaction time may be set by default by related service personnel, or may be set by a user when the protection barrage data is sent, that is, the first control for setting the interaction time may be displayed when the protection barrage type control is in an open state. In addition, the display time of the protective barrage data on the multimedia playing interface can be set by default by related service personnel, or can be set by a user, namely, a second control for setting the display time is displayed when the protective barrage type control is in an open state. Alternatively, the first control and the second control may be different controls or the same control.
In some embodiments, the electronic device performs the associated display on the video data and the second video clip with the protection playing setting, which may specifically be playing the second video clip with the protection playing setting, and after the playing is completed, continuing to play the video data from the playing end position of the second video clip, so as to implement the associated display.
For example, as shown in fig. 7 a-7 b, fig. 7 a-7 b are schematic views of a scene based on interactive display of a protective bullet screen type according to an embodiment of the present application; wherein:
(1) The displayed barrage input interface comprises a protective barrage type control corresponding to the protective barrage type, and the displayed barrage input interface can be as follows:
(a) If the protective bullet screen type control is in the open state, the bullet screen input interface at this time may be shown in (1) in fig. 7a, where the interaction time and the display time are both default settings;
(b) Alternatively, the bullet screen input interface at this time may be as shown in (2) in fig. 7a, where the interaction time indicated by the guard bullet screen data may be set by the user, and the display time corresponding to the guard bullet screen data is set by default;
(c) Alternatively, the bullet screen input interface at this time may be as shown in (3) in fig. 7a, where the interaction time indicated by the guard bullet screen data is a default setting, and the display time corresponding to the guard bullet screen data may be set by the user;
(d) Or, as shown in (4) in fig. 7a, the bullet screen input interface at this time may be set by the user, where the interaction time and the corresponding display time indicated by the protection bullet screen data are both set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are the same control, and the interaction time and the display time may be set by the control at the same time, that is, the interaction time and the display time of one protection bullet screen data are the same at this time;
(e) Or, as shown in (5) in fig. 7a, the bullet screen input interface at this time may be set by the user, where the interaction time and the corresponding display time indicated by the protection bullet screen data are both set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are not the same control, that is, the interaction time and the display time of one protection bullet screen data may be set separately at this time;
(2) As shown in fig. 7b, when video data is played in the multimedia playing interface and the protective body barrage data is triggered, the second playing duration of the video data in the playing progress bar is 2:00, that is, the video picture corresponding to 2:00 in the video data is played in the multimedia playing interface, a playing progress interval is determined according to the interaction time (set to 30 s) and the second playing time of the triggered protective body barrage data, a second video segment is obtained according to the playing progress interval, that is, the second video segment is a part of video data between 2:00 and 2:30, and the playing setting adjustment is performed on the second video segment based on the protective body playing setting, so as to obtain a second video segment with the protective body playing setting; and after the second video clip with the protection playing setting is played, continuing to play the video data based on the playing termination position of the second video clip, namely starting to play the video data from 2:30 in the playing progress bar, namely playing the video picture corresponding to 2:30 in the video data in the multimedia playing interface.
In some embodiments, the bullet screen type indicated by the target bullet screen data may include an animated bullet screen type; the electronic device performs association display on the multimedia playing interface on the multimedia data and the multimedia interaction data indicated by the bullet screen type of the target bullet screen data, specifically, the interactive animation corresponding to the animation bullet screen type is obtained, the interactive animation is used as the multimedia interaction data, and the interactive animation is displayed on the multimedia data played on the multimedia playing interface; for example, when the corresponding interactive animation represents the finishing animation, the corresponding clip scenario is assumed to be the finishing scenario. Alternatively, the interactive animation may include a sprinkling animation, a cartoon character dancing animation, and the like, and the specific type of the interactive animation is not limited herein. And according to different interactive animations, the corresponding animation bullet screen types can be one or more, different segment plots can correspond to different animation bullet screen types, for example, when the segment plot is a finishing plot, the corresponding bullet screen type can be a first animation bullet screen type, and the interactive animation corresponding to the first animation bullet screen type is a sprinkling animation, and can also be called a finishing bullet screen type corresponding to the finishing animation; when the clip scenario is a wedding scenario, the corresponding bullet screen type can be a second animation bullet screen type, and the interactive animation corresponding to the second animation bullet screen type is a cartoon character dancing animation, which can also be called as a wedding bullet screen type corresponding to the wedding animation; etc. Without limitation, may be set by the relevant business personnel or the user.
In some embodiments, the interactive animation acquired by the electronic device may be set by default by related service personnel, or may be set by a user, that is, may be that an animation control for selecting the interactive animation is displayed when the animation bullet screen type control is in an open state; and optionally, the display time of the interactive animation can be set by default for related business personnel, or can be set by a user when the animation bullet screen data is sent, or can be set by the user when the animation bullet screen type control is in an open state. In addition, the display time of the animation bullet screen data on the multimedia playing interface can be set by default by related business personnel, or can be set by a user, namely, a display time control for setting the display time can be displayed when the animation bullet screen type control is in an on state. Optionally, the presentation time control and the display time control may be different controls or the same control.
In some embodiments, the electronic device may specifically perform the associated display of the multimedia data and the interactive animation (multimedia interactive data) by determining a playing position of the multimedia data when performing the triggering operation for the target barrage data, and starting to display the interactive animation from the playing position; alternatively, the multimedia data may be played all the time when the interactive animation is displayed, or the multimedia data may be stopped when the interactive animation is displayed, and the multimedia data may be played continuously from a pause position after the interactive animation is displayed, so as to realize the associated display.
For example, as shown in fig. 8a to 8c, fig. 8a to 8c are schematic views of a scene based on an interactive display of an animation bullet screen type according to an embodiment of the present application; wherein:
(1) The displayed barrage input interface contains an animation barrage type control corresponding to the animation barrage type, and the displayed barrage input interface can be as follows:
(a) If the animation bullet screen type control is in the open state, the bullet screen input interface at this time can be shown as (1) in fig. 8a, and the interactive animation, the display time and the display time are all default settings;
(b) Or, any one or more of the interactive animation, the display time and the display time are set by default, and the rest are set by a user, wherein the interactive animation can be set by the user, and the display time are set by default as shown in (2) in fig. 8 a;
(c) Alternatively, the bullet screen entry interface at this time may be as shown in (3) of fig. 8a, where the interactive animation and the presentation time are default settings, and the display time may be set by the user;
(d) Alternatively, the bullet screen entry interface at this time may be as shown in (4) in fig. 8a, where the interactive animation and the presentation time may be set by the user, and the display time is set by default; etc.;
(2) Setting the multimedia data played in the multimedia playing interface as video data, wherein the video data has a playing progress bar, when the animation bullet screen data is triggered, the playing position in the playing progress bar of the video data is 3:00, namely, the video picture corresponding to 3:00 in the video data is played in the multimedia playing interface at the moment, according to the display time (set as 30 s) of the triggered animation bullet screen data, the corresponding interactive animation is displayed from 3:00 in the playing progress bar, wherein the video data can be paused and after the interactive animation is displayed, the video data can be continuously played based on the pause position, namely, the video picture corresponding to 3:00 in the video data is played in the multimedia playing interface at the moment, and the video data is played from 3:00 in the playing progress bar, as shown in fig. 8 b; or, when the interactive animation is displayed, the video data is always played, that is, when the interactive animation is completely played, the current playing position is 3:30 of the playing progress bar, that is, the video picture corresponding to 3:30 of the video data is played in the multimedia playing interface at this time, as shown in fig. 8 c.
In some embodiments, the multimedia playing interface belongs to an interface in the playing application corresponding to the target; the bullet screen type indicated by the target bullet screen data may include a composite bullet screen type; the electronic device may specifically obtain a target data frame displayed on the multimedia playing interface when executing trigger data for the target barrage data, where the target data frame refers to any one of at least one data frame included in the multimedia data, obtain associated object data of the target object, perform data synthesis on the associated object data and the target data frame to obtain synthetic data, determine the synthetic data as multimedia interaction data, and display the synthetic data on the multimedia data played on the multimedia playing interface; for example, when the corresponding composite data at this time represents the group photo data, the corresponding clip scenario is assumed to be the group photo scenario; the composite data obtained by associating the object data can improve the commemorative meaning and interest watched by the user.
The target object may be a user to whom the electronic device belongs, and the playing application may be an application obtained by the user through a registered user account. And the associated object data may be an avatar, a name, etc. of the logged-in user account, or may also be data uploaded by the user, such as a picture, a text, etc., where the associated object data is not limited. It will be appreciated that in the specific embodiment of the present application, related data such as user account numbers and the like are related to user information, and when the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required to be obtained, and the collection, use and processing of related data is required to comply with related laws and regulations and standards of related countries and regions.
In some embodiments, the target data frame may refer to an intercepted frame of the content currently displayed in the multimedia playing interface by the electronic device when the triggering operation for the target barrage data is performed, and the intercepted frame is taken as the target data frame. The multimedia data includes a plurality of pictures that can be taken. When the multimedia data is video data, the target data frame is the video picture intercepted in the played video, and when the multimedia data is cartoon, the target data frame is the image picture intercepted in the played cartoon.
In some embodiments, the electronic device performs a data synthesis process on the associated object data and the target data frame, which may be to add the associated object data to a specified display area on the target data frame (e.g., the right-hand bottom corner, the right-hand center, etc. of the target data frame).
In some embodiments, the electronic device may specifically determine a play frame of the multimedia data when performing the triggering operation for the target barrage data, where the play frame may be understood as a target data frame, and display the composite data in a target area (e.g. lower right corner, etc.) on the play frame, and optionally, after displaying the composite data to a specified display time (e.g. 1 s), remove the composite data and save the composite data, and continue playing the multimedia data; and optionally, when the composite data is displayed, an operation control related to the composite data can be generated, and after the triggering operation on the composite data is detected, the operation control is displayed on the played multimedia data in a floating layer of a floating window so as to realize the associated display. The trigger control may be a click operation, a long-press operation, a sliding operation, or the like for the synthesized data. And the operation controls may include delete controls, save controls, data frame edit controls (e.g., crop, add border), and so forth.
For example, as shown in fig. 9 a-9 b, fig. 9 a-9 b are schematic views of a scene of an interactive display based on a synthetic barrage type according to an embodiment of the present application; wherein:
(1) The displayed barrage entry interface contains a synthetic barrage type control corresponding to the synthetic barrage type, and the displayed barrage entry interface may be as follows:
(a) If the composite barrage type control is in the open state, the barrage input interface at this time may be as shown in (1) in fig. 9a, where the associated object data and the display area are both default settings;
(b) Alternatively, the barrage input interface at this time may be set by the user, the display area is set by default, the associated object data selected by the user may be one or more, when the associated object data selected by the user is a picture, the picture to be synthesized may be uploaded by the user, and when the associated object data selected by the user is a text, the text to be synthesized may be input by the user by himself, as shown in (3) in fig. 9 a;
(c) Alternatively, the barrage entry interface at this time may be as shown in (4) of fig. 9a, where both the associated object data and the display area may be set by the user;
(d) Alternatively, the barrage entry interface at this time may be as shown in (5) of fig. 9a, where the associated object data is a default setting, and the display area may be set by the user;
(2) As shown in fig. 9b, the multimedia data played in the multimedia playing interface is set as video data, the video data has a playing progress bar, and when the composite barrage data is triggered, the playing position in the playing progress bar of the video data is 4:00, namely, the video picture corresponding to 4:00 in the video data is played in the multimedia playing interface at this time, the current video picture is intercepted to be used as a target data frame, the associated object data (set as a user head portrait) is obtained, the data synthesis processing is performed on the associated object data and the target data frame to obtain composite data (namely, the user head portrait is added at the upper right corner of the intercepted target data frame), and the composite data is displayed on the current video data picture of the multimedia playing interface; and displaying a floating layer of the corresponding floating window by long-pressing the synthesized data, wherein an operation control of the synthesized data is displayed on the floating layer of the floating window.
It will be appreciated that the various bullet screen types described above are only enumerated, and not all of them are listed here, and that other bullet screen types and other ways of displaying multimedia data and multimedia interaction data in association are possible according to actual service requirements. And the electronic equipment can determine the multimedia interaction data or the electronic equipment can send the triggered target barrage data to the background server, and the background server determines the multimedia interaction data.
For example, referring to fig. 10a to 10c, fig. 10a to 10c are schematic views of an interaction flow of bullet screen data processing according to an embodiment of the present application; wherein:
(1) As shown in fig. 10a and fig. 10b (here, it is assumed that the contents in the arc-shaped solid line block diagrams in fig. 10a and fig. 10b are executed by the background server, and the contents in the square-shaped solid line block diagrams are executed by the electronic device (front end)), the background server acquires multimedia data and a segment plot library, and plot marks the multimedia data to obtain transition multimedia segments meeting plot rules in the multimedia data and sets corresponding segment plots for each transition multimedia segment;
(2) The method comprises the steps that electronic equipment obtains multimedia data and segment plots correspondingly arranged in the multimedia data, plays the multimedia data on a multimedia playing interface, and according to triggered barrage input operation, if a segment of a playing progress point belongs to a transitional multimedia segment with segment plot marks during triggering, namely a marked segment plot, the electronic equipment displays a first barrage input interface, and the first barrage input interface displays a first barrage type control corresponding to the marked segment plot;
(3) According to triggered barrage input operation, if the segment to which the playing progress point belongs does not belong to the transition multimedia segment with the segment plot mark during triggering, namely, the segment plot without the mark is displayed by the electronic equipment, a second barrage input interface is displayed by the electronic equipment, and barrage type controls corresponding to any segment plot are not displayed by the second barrage input interface;
(4) Based on the step (3), the electronic device acquires the target data recorded in the second barrage recording interface and sends the target data to the background server, the background server acquires text data from the target data and carries out keyword recognition on the text data, and if the text data contains scenario keywords related to the scenario of the target fragment, the electronic device displays a second barrage type control corresponding to the scenario of the target fragment on the second barrage recording interface;
(5) Based on the above (2)/(4), if the user selects to send the common barrage (i.e. does not open any first barrage type control/second barrage type control), the electronic device generates and displays common barrage data according to the data recorded in the first barrage recording interface/second barrage recording interface, wherein the barrage content displayed by the common barrage data comprises the recorded data;
(6) Based on the above (2)/(4), if the user selects to send a special barrage (i.e. opens any first barrage type control/second barrage type control), the electronic device generates and displays special barrage data according to the data input in the first barrage input interface/second barrage input interface and the first barrage type control/second barrage type control in the open state, wherein the barrage content displayed by the special barrage data comprises the input data and the corresponding added special mark;
(7) When the bullet screen type control in the open state is a control corresponding to the synthesized bullet screen type, the user configures synthesized bullet screen data (such as selecting a specific type of related object data) and clicks the bullet screen sending control, and then the synthesized bullet screen data generated by the electronic equipment is displayed in a rolling way on the multimedia data in the multimedia playing interface;
(8) When the bullet screen type control in the open state is a control corresponding to the animation bullet screen type (such as the ending bullet screen type corresponding to the ending animation), the user configures the animation bullet screen data (such as selecting the type of the interactive animation) and clicks the bullet screen sending control, and then the animation bullet screen data generated by the electronic equipment is scrolled and displayed on the multimedia data in the multimedia playing interface;
(9) When the bullet screen type control in the open state is a control corresponding to the bullet screen type of the protection body, the user configures the bullet screen data of the protection body (such as selecting interaction time and display time) and clicks the bullet screen sending control, and the bullet screen data of the protection body generated by the electronic equipment is displayed in a rolling way on the multimedia data in the multimedia playing interface;
(10) When the bullet screen type control in the open state is a control corresponding to the high-energy bullet screen type, the user configures the high-energy bullet screen data (such as selecting interaction time and display time) and clicks the bullet screen sending control, and then the high-energy bullet screen data generated by the electronic equipment is displayed in a rolling way on the multimedia data in the multimedia playing interface;
(11) The electronic equipment sends the triggered target barrage data to a background server, the background server determines multimedia interaction data, and the electronic equipment carries out interactive display on the multimedia data and the multimedia interaction data;
(12) Based on the above (11), when the bullet screen type of the target bullet screen data is a composite bullet screen type, the multimedia interaction data is composite data obtained by performing data synthesis processing on the associated object data and the intercepted target data frame, and the electronic device can display and store the composite data on the multimedia data played by the multimedia playing interface;
(13) Based on the above (11), when the bullet screen type of the target bullet screen data is an animation bullet screen type (e.g., a finishing bullet screen type), the multimedia interactive data is a corresponding interactive animation (finishing animation), and the electronic device displays the finishing animation on the multimedia data played on the multimedia playing interface;
(14) Based on the above (11), when the bullet screen type of the target bullet screen data is a high-energy bullet screen type, the multimedia interaction data may be a first multimedia segment (e.g., the multimedia data is video data and the first multimedia segment is a first video segment) with the play volume being increased and the transparency of the bullet screen data being increased, and the electronic device displays the first multimedia segment and the multimedia data after the adjustment play on the multimedia playing interface in an associated manner;
(15) Based on the above (11), when the bullet screen type of the target bullet screen data is the protective bullet screen type, the multimedia interaction data may be a second multimedia segment (for example, the multimedia data is video data, the second multimedia segment is a second video segment) with a play volume being reduced and a definition being reduced, and the electronic device displays the second multimedia segment and the multimedia data after the adjustment play setting in association on the multimedia play interface;
wherein steps (1) - (6) correspond to fig. 10a, and steps (7) - (15) correspond to fig. 10b;
and based on the above (1), if the multimedia data is video data, the plot marking of the multimedia data may specifically be: creating a training set in advance, performing scenario marking training based on the training set to realize content analysis and marking of the segment scenarios of the video data, for example, the video data is segmented to obtain at least one multimedia segment, and scenario recognition is performed on the at least one multimedia segment to complete segment scenario marking of the video data; the segment plot tagging process may be as shown in fig. 10c, namely:
(1) performing picture identification on at least one multimedia segment, if at least one multimedia segment has a candidate multimedia segment of a picture associated with a guard plot, such as a horror picture, a thrill picture and the like, determining the candidate multimedia segment as a transition multimedia segment, and setting a corresponding segment plot (i.e., a guard plot) for the transition multimedia segment;
(2) If at least one multimedia segment has a candidate multimedia segment of a picture related to a high-energy plot, such as a fight picture, a main character related picture, etc., the candidate multimedia segment is determined as a transition multimedia segment, and a corresponding segment plot (i.e., a high-energy plot) is set for the transition multimedia segment; the main character association screen may include any one of the following: obtaining the prime information in the video data according to the video information source of the video data (such as video information associated with the video data), and/or carrying out face recognition on the characters appearing in the video data to obtain the characters with the largest occurrence number, determining the main characters according to the prime information and the characters with the largest occurrence number, carrying out face recognition on at least one multimedia segment, determining the pictures of the main characters appearing as main character associated pictures, or carrying out picture recognition on at least one multimedia segment, and determining the pictures of some special actions (such as running and the like) of the main characters as main character associated pictures;
(3) if at least one multimedia segment has a candidate multimedia segment in which a picture associated with a group photo episode appears, such as a landscape picture, a main character co-framed picture, etc., the candidate multimedia segment is determined to be a transition multimedia segment, and a corresponding segment episode (i.e., group photo episode) is set for the transition multimedia segment; the main character co-frame may be: after determining that the main characters are a plurality of, carrying out face recognition on at least one multimedia fragment, and determining that the main characters are the same-frame picture if pictures of the plurality of main characters are all present;
(4) If a candidate multimedia segment of a picture associated with the ending scenario exists in at least one multimedia segment, if the video playing time of the video data is obtained according to the video information source of the video data, and the multimedia segment is determined to be the video ending segment according to the video playing time, the candidate multimedia segment is determined to be a transition multimedia segment, and a corresponding segment scenario (namely the ending scenario) is set for the transition multimedia segment; or if at least one of the multimedia segments has a candidate multimedia segment in which a picture associated with a preset episode (e.g., wedding episode) appears, for example, the at least one multimedia segment is subjected to picture recognition, and a wedding picture appears, the candidate multimedia segment is determined as a transition multimedia segment, and a corresponding segment episode (i.e., wedding episode) is set for the transition multimedia segment.
In the embodiment of the application, the electronic equipment can display a multimedia playing interface, the barrage input interface is displayed according to barrage input operation triggered on the multimedia playing interface, barrage data of barrage type indicated by the barrage type control is displayed on the multimedia playing interface based on barrage type control and input data on the barrage input interface, and the multimedia interaction data indicated by the barrage type of the multimedia data and the target barrage data is associated and displayed on the multimedia playing interface according to triggering operation aiming at the target barrage data in at least one barrage data. Through the method, the barrage data with the interaction function can be obtained and displayed through the barrage type selected in the barrage input interface and the input data, the multimedia interaction data presenting different barrage interaction effects can be obtained according to different barrage types, and the multimedia data and the multimedia interaction data are displayed in an associated mode so as to improve the richness and interactivity of the barrages, and better interestingness and watching experience can be brought to users.
The foregoing details of the method of embodiments of the present application are provided for the purpose of better implementing the foregoing aspects of embodiments of the present application, and accordingly, the following provides an apparatus of embodiments of the present application.
Referring to fig. 11, fig. 11 is a schematic structural diagram of a barrage data processing apparatus according to the present application; the barrage data processing apparatus may be for example a computer program (including program code) running in an electronic device, for example the barrage data processing apparatus may be an application program (e.g. a program capable of barrage data processing) in an electronic device. It should be noted that, the barrage data processing apparatus shown in fig. 11 is used to perform some or all of the steps in the methods of the embodiments shown in fig. 2 and 4 of the present application. The bullet screen data processing apparatus 1100 may include: a display module 1101 and a processing module 1102. Wherein:
a display module 1101, configured to display a multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface;
and the processing module 1102 is configured to perform associated display on the multimedia playing interface of the multimedia data and the multimedia interaction data indicated by the bullet screen type of the target bullet screen data according to the triggering operation for the target bullet screen data in the at least one bullet screen data.
In some embodiments, the display module 1101 is further to:
obtaining a fragment plot library; the segment plot library comprises at least one segment plot;
setting corresponding bullet screen type controls for each segment plot in the segment plot library;
the display module 1101 is further configured to:
segmenting the multimedia data to obtain at least one multimedia segment contained in the multimedia data;
at least one transition multimedia segment is determined from the at least one multimedia segment, and corresponding segment plots are set for each transition multimedia segment according to the segment plot library.
In some embodiments, the display module 1101 is further to:
displaying a first barrage input interface according to barrage input operation triggered on the multimedia playing interface; the first barrage input interface comprises a first barrage type control, wherein the first barrage type control refers to a barrage type control indicated by a segment plot corresponding to a target multimedia segment in multimedia data, the target multimedia segment is any one of at least one multimedia segment, and the target multimedia segment refers to a segment played in a multimedia playing interface when barrage input operation is triggered;
and if the control state of the first barrage type control in the first barrage input interface is an opening state, displaying barrage data of the barrage type indicated by the first barrage type control on the multimedia playing interface according to the data input in the barrage input interface.
In some embodiments, the display module 1101 is further to:
displaying a second barrage input interface according to barrage input operation triggered on the multimedia playing interface;
acquiring target data recorded in a second barrage recording interface; the target data comprises text data;
if the text data contains at least one scenario keyword associated with the target fragment scenario in the fragment scenario, displaying a second barrage type control corresponding to the target fragment scenario on a second barrage input interface;
and displaying the barrage data of the barrage type indicated by the second barrage type control on the multimedia playing interface based on the second barrage type control and the target data.
In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes a high-energy bullet screen type; the multimedia playing interface comprises a playing progress bar of video data;
the processing module 1102 is specifically configured to, when performing associated display on the multimedia playing interface of the multimedia interaction data indicated by the bullet screen type of the multimedia data and the target bullet screen data:
acquiring a first video clip from video data according to a first playing duration of the video data in a playing progress bar when a triggering operation for target barrage data is executed; the play start position of the first video clip refers to a play position indicated by a first play duration;
Adjusting the video playing setting of the first video clip to be a high-energy playing setting corresponding to the high-energy bullet screen type;
determining a first video clip with a high-energy play setting as multimedia interaction data;
performing associated display on the video data and a first video clip with high-energy playing settings;
wherein the high-energy play setting comprises at least one of the following settings: and setting up the playing volume of the first video segment and the transparency of the barrage data displayed on the first video segment.
In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes a protection bullet screen type; the multimedia playing interface comprises a playing progress bar of video data;
the processing module 1102 is specifically configured to, when performing associated display on the multimedia playing interface of the multimedia interaction data indicated by the bullet screen type of the multimedia data and the target bullet screen data:
acquiring a second video clip from the video data according to a second playing duration of the video data in the playing progress bar when the triggering operation for the target barrage data is executed; the play start position of the second video clip is a play position indicated by the second play duration;
Adjusting the video playing setting of the second video clip to be a protection playing setting corresponding to the protection barrage type;
determining a second video clip with a guard play setting as multimedia interaction data;
performing associated display on the video data and a second video clip with a protection playing setting;
wherein the guard play setting includes at least one of the following: and reducing the playing volume of the second video clip and reducing the definition of the second video clip.
In some embodiments, the bullet screen type indicated by the target bullet screen data includes an animated bullet screen type;
the processing module 1102 is specifically configured to, when performing associated display on the multimedia playing interface of the multimedia interaction data indicated by the bullet screen type of the multimedia data and the target bullet screen data:
acquiring an interactive animation corresponding to the animation bullet screen type, and taking the interactive animation as multimedia interactive data;
and displaying the interactive animation on the multimedia data played by the multimedia playing interface.
In some embodiments, the multimedia playing interface belongs to an interface in a playing application of the target object; the bullet screen types comprise synthetic bullet screen types;
The processing module 1102 is specifically configured to, when performing associated display on the multimedia playing interface of the multimedia interaction data indicated by the bullet screen type of the multimedia data and the target bullet screen data:
acquiring a target data frame displayed by a multimedia playing interface when triggering operation aiming at target barrage data is executed; the target data frame refers to any one of at least one data frame included in the multimedia data;
acquiring associated object data of a target object;
carrying out data synthesis processing on the associated object data and the target data frame to obtain synthesized data;
and determining the composite data as multimedia interaction data, and displaying the composite data on the multimedia data played by the multimedia playing interface.
According to one embodiment of the present application, each unit in the barrage data processing apparatus shown in fig. 11 may be separately or completely combined into one or several other units, or some unit(s) thereof may be further split into a plurality of units with smaller functions, which may achieve the same operation without affecting the achievement of the technical effects of the embodiment of the present application. The above units are divided based on logic functions, and in practical applications, the functions of one unit may be implemented by a plurality of units, or the functions of a plurality of units may be implemented by one unit. In other embodiments of the application, the barrage data processing apparatus may also include other elements, and in actual practice, these functions may be facilitated by other elements and may be cooperatively implemented by a plurality of elements. According to another embodiment of the present application, a barrage data processing apparatus as shown in fig. 11 may be constructed by running a computer program (including program code) capable of executing the steps involved in the respective methods as shown in fig. 2 and 4 on a general-purpose computing device such as a computer including a processing element such as a Central Processing Unit (CPU), a random access storage medium (RAM), a read only storage medium (ROM), and the like, and a storage element, and implementing the barrage data processing method of the embodiment of the present application. The computer program may be recorded on, for example, a computer-readable recording medium, and loaded into and run in the above-described electronic device through the computer-readable recording medium.
In the embodiment of the application, the display module displays a multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface; and the processing module performs associated display on the multimedia data and the multimedia interaction data indicated by the barrage type of the target barrage data on the multimedia playing interface according to the triggering operation of the target barrage data in the at least one barrage data. Through implementing the device, the multimedia interaction data for presenting different barrage interaction effects can be obtained according to different barrage types, and the multimedia data and the multimedia interaction data are displayed in a correlated manner so as to improve the richness and interactivity of the barrage, and better interestingness and watching experience can be brought to users.
Referring to fig. 12, fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 12, the electronic apparatus 1200 includes: a processor 1201, a communication interface 1202, and a computer readable storage medium 1203. Wherein the processor 1201, the communication interface 1202, and the computer readable storage medium 1203 may be connected by a bus or other means. Wherein the communication interface 1202 is for receiving and transmitting data. The computer readable storage medium 1203 may be stored in a memory of the electronic device, the computer readable storage medium 1203 is for storing a computer program comprising program instructions, and the processor 1201 is for executing the program instructions stored by the computer readable storage medium 1203. The processor 1201 (or CPU (Central Processing Unit, central processing unit)) is a computing core and a control core of the electronic device, which are adapted to implement one or more instructions, in particular to load and execute one or more instructions to implement a corresponding method flow or a corresponding function.
The embodiment of the application also provides a computer readable storage medium (Memory), which is a Memory device in the electronic device and is used for storing programs and data. It is understood that the computer readable storage medium herein may include both built-in storage media in an electronic device and extended storage media supported by the electronic device. The computer readable storage medium provides a memory space that stores a processing system of the electronic device. Also stored in this memory space are one or more instructions, which may be one or more computer programs (including program code), adapted to be loaded and executed by the processor 1201. Note that the computer readable storage medium can be either a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory; alternatively, it may be at least one computer-readable storage medium located remotely from the aforementioned processor.
In one embodiment, the computer-readable storage medium has one or more instructions stored therein; loading and executing by the processor 1201 one or more instructions stored in a computer-readable storage medium to implement the corresponding steps in the document processing method embodiments described above; in particular implementations, one or more instructions in a computer-readable storage medium are loaded by the processor 1201 and perform the steps of: displaying a multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface;
And according to the triggering operation of the target barrage data in the at least one barrage data, carrying out associated display on the multimedia data and the multimedia interaction data indicated by the barrage type of the target barrage data on the multimedia playing interface.
In some embodiments, one or more instructions in the computer-readable storage medium are loaded by the processor 1201 and when executed, are further configured to perform the steps of:
obtaining a fragment plot library; the segment plot library comprises at least one segment plot;
setting corresponding bullet screen type controls for each segment plot in the segment plot library;
one or more instructions in the computer-readable storage medium are loaded by the processor 1201 and when executed, are also configured to perform the steps of:
segmenting the multimedia data to obtain at least one multimedia segment contained in the multimedia data;
at least one transition multimedia segment is determined from the at least one multimedia segment, and corresponding segment plots are set for each transition multimedia segment according to the segment plot library.
In some embodiments, one or more instructions in the computer-readable storage medium are loaded by the processor 1201 and when executed, are further configured to perform the steps of:
Displaying a first barrage input interface according to barrage input operation triggered on the multimedia playing interface; the first barrage input interface comprises a first barrage type control, wherein the first barrage type control refers to a barrage type control indicated by a segment plot corresponding to a target multimedia segment in multimedia data, the target multimedia segment is any one of at least one multimedia segment, and the target multimedia segment refers to a segment played in a multimedia playing interface when barrage input operation is triggered;
and if the control state of the first barrage type control in the first barrage input interface is an opening state, displaying barrage data of the barrage type indicated by the first barrage type control on the multimedia playing interface according to the data input in the barrage input interface.
In some embodiments, one or more instructions in the computer-readable storage medium are loaded by the processor 1201 and when executed, are further configured to perform the steps of:
displaying a second barrage input interface according to barrage input operation triggered on the multimedia playing interface;
acquiring target data recorded in a second barrage recording interface; the target data comprises text data;
If the text data contains at least one scenario keyword associated with the target fragment scenario in the fragment scenario, displaying a second barrage type control corresponding to the target fragment scenario on a second barrage input interface;
and displaying the barrage data of the barrage type indicated by the second barrage type control on the multimedia playing interface based on the second barrage type control and the target data.
In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes a high-energy bullet screen type; the multimedia playing interface comprises a playing progress bar of video data;
one or more instructions in the computer-readable storage medium are loaded by the processor 1201 and, when executed, perform the steps of:
acquiring a first video clip from video data according to a first playing duration of the video data in a playing progress bar when a triggering operation for target barrage data is executed; the play start position of the first video clip refers to a play position indicated by a first play duration;
Adjusting the video playing setting of the first video clip to be a high-energy playing setting corresponding to the high-energy bullet screen type;
determining a first video clip with a high-energy play setting as multimedia interaction data;
performing associated display on the video data and a first video clip with high-energy playing settings;
wherein the high-energy play setting comprises at least one of the following settings: and setting up the playing volume of the first video segment and the transparency of the barrage data displayed on the first video segment.
In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes a protection bullet screen type; the multimedia playing interface comprises a playing progress bar of video data;
one or more instructions in the computer-readable storage medium are loaded by the processor 1201 and, when executed, perform the steps of:
acquiring a second video clip from the video data according to a second playing duration of the video data in the playing progress bar when the triggering operation for the target barrage data is executed; the play start position of the second video clip is a play position indicated by the second play duration;
Adjusting the video playing setting of the second video clip to be a protection playing setting corresponding to the protection barrage type;
determining a second video clip with a guard play setting as multimedia interaction data;
performing associated display on the video data and a second video clip with a protection playing setting;
wherein the guard play setting includes at least one of the following: and reducing the playing volume of the second video clip and reducing the definition of the second video clip.
In some embodiments, the bullet screen type indicated by the target bullet screen data includes an animated bullet screen type;
one or more instructions in the computer-readable storage medium are loaded by the processor 1201 and, when executed, perform the steps of:
acquiring an interactive animation corresponding to the animation bullet screen type, and taking the interactive animation as multimedia interactive data;
and displaying the interactive animation on the multimedia data played by the multimedia playing interface.
In some embodiments, the multimedia playing interface belongs to an interface in a playing application of the target object; the bullet screen types comprise synthetic bullet screen types;
One or more instructions in the computer-readable storage medium are loaded by the processor 1201 and, when executed, perform the steps of:
acquiring a target data frame displayed by a multimedia playing interface when triggering operation aiming at target barrage data is executed; the target data frame refers to any one of at least one data frame included in the multimedia data;
acquiring associated object data of a target object;
carrying out data synthesis processing on the associated object data and the target data frame to obtain synthesized data;
and determining the composite data as multimedia interaction data, and displaying the composite data on the multimedia data played by the multimedia playing interface.
In an embodiment of the present application, the processor 1201 may display a multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface; and according to the triggering operation of the target barrage data in the at least one barrage data, carrying out associated display on the multimedia data and the multimedia interaction data indicated by the barrage type of the target barrage data on the multimedia playing interface. Through implementing the scheme, the multimedia interaction data for presenting different barrage interaction effects can be obtained according to different barrage types, and the multimedia data and the multimedia interaction data are displayed in a correlated manner so as to improve the richness and interactivity of the barrages, and better interestingness and watching experience can be brought to users.
Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions so that the electronic device performs the bullet screen data processing method described above.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable devices. The computer instructions may be stored in or transmitted across a computer-readable storage medium. The computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). Computer readable storage media can be any available media that can be accessed by a computer or data storage devices, such as servers, data centers, etc., that contain an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy Disk, a hard Disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (12)

1. A barrage data processing method, the method comprising:
displaying a multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface;
and according to the triggering operation of the target barrage data in the at least one barrage data, carrying out associated display on the multimedia interaction data indicated by the multimedia data and the barrage type of the target barrage data on the multimedia playing interface.
2. The method according to claim 1, wherein the method further comprises:
obtaining a fragment plot library; the segment plot library comprises at least one segment plot;
setting corresponding barrage type controls for each segment plot in the segment plot library;
The method further comprises the steps of:
segmenting the multimedia data to obtain at least one multimedia segment contained in the multimedia data;
and determining at least one transition multimedia fragment from the at least one multimedia fragment, and setting a corresponding fragment scenario for each transition multimedia fragment according to the fragment scenario library.
3. The method according to claim 2, wherein the method further comprises:
displaying a first barrage input interface according to barrage input operation triggered on the multimedia playing interface; the first bullet screen input interface comprises a first bullet screen type control, wherein the first bullet screen type control refers to a bullet screen type control indicated by a segment plot corresponding to a target multimedia segment in the multimedia data, the target multimedia segment is any one of the at least one multimedia segment, and the target multimedia segment refers to a segment played in the multimedia play interface when the bullet screen input operation is triggered;
and if the control state of the first barrage type control in the first barrage input interface is an opening state, displaying barrage data of the barrage type indicated by the first barrage type control on the multimedia playing interface according to the data input in the barrage input interface.
4. The method according to claim 2, wherein the method further comprises:
displaying a second barrage input interface according to barrage input operation triggered on the multimedia playing interface;
acquiring target data recorded in the second barrage recording interface; the target data comprises text data;
if the text data contains the scenario keywords associated with the target fragment scenario in the at least one fragment scenario, displaying a second barrage type control corresponding to the target fragment scenario on the second barrage input interface;
and displaying the barrage data of the barrage type indicated by the second barrage type control on the multimedia playing interface based on the second barrage type control and the target data.
5. The method of claim 1, wherein the multimedia data is video data and the bullet screen type indicated by the target bullet screen data comprises a high energy bullet screen type; the multimedia playing interface comprises a playing progress bar of the video data;
the performing, on the multimedia playing interface, associated display of the multimedia data and multimedia interaction data indicated by a barrage type of the target barrage data, including:
Acquiring a first video clip from the video data according to a first playing duration of the video data in the playing progress bar when a triggering operation for the target barrage data is executed; the play start position of the first video clip is a play position indicated by the first play duration;
adjusting the video playing setting of the first video clip to be a high-energy playing setting corresponding to the high-energy barrage type;
determining the first video clip with the high-energy play setting as the multimedia interaction data;
performing associated display on the video data and the first video clip with the high-energy playing setting;
wherein the high energy play setting comprises at least one of the following: and setting the playing volume of the first video segment in an increasing way and setting the transparency of bullet screen data displayed on the first video segment in an increasing way.
6. The method of claim 1, wherein the multimedia data is video data and the bullet screen type indicated by the target bullet screen data comprises a guard bullet screen type; the multimedia playing interface comprises a playing progress bar of the video data;
The performing, on the multimedia playing interface, associated display of the multimedia data and multimedia interaction data indicated by a barrage type of the target barrage data, including:
acquiring a second video clip from the video data according to a second playing duration of the video data in the playing progress bar when the triggering operation for the target barrage data is executed; the play start position of the second video clip is a play position indicated by the second play duration;
adjusting the video playing setting of the second video clip to be a protection playing setting corresponding to the protection barrage type;
determining the second video segment with the guard play setting as the multimedia interaction data;
performing associated display on the video data and the second video clip with the protection body playing setting;
wherein the guard play setting includes at least one of the following: and reducing the playing volume of the second video segment and reducing the definition of the second video segment.
7. The method of claim 1, wherein the bullet screen type indicated by the target bullet screen data comprises an animated bullet screen type;
The performing, on the multimedia playing interface, associated display of the multimedia data and multimedia interaction data indicated by a barrage type of the target barrage data, including:
acquiring an interactive animation corresponding to the animation bullet screen type, and taking the interactive animation as the multimedia interactive data;
and displaying the interactive animation on the multimedia data played by the multimedia playing interface.
8. The method of claim 1, wherein the multimedia playing interface belongs to an interface in a playing application of a target object; the bullet screen types comprise synthetic bullet screen types;
the performing, on the multimedia playing interface, associated display of the multimedia data and multimedia interaction data indicated by a barrage type of the target barrage data, including:
acquiring a target data frame displayed by the multimedia playing interface when triggering operation aiming at the target barrage data is executed; the target data frame refers to any one of at least one data frame contained in the multimedia data;
acquiring associated object data of the target object;
carrying out data synthesis processing on the associated object data and the target data frame to obtain synthesized data;
And determining the synthesized data as the multimedia interaction data, and displaying the synthesized data on the multimedia data played by the multimedia playing interface.
9. A barrage data processing apparatus, the apparatus comprising:
the display module is used for displaying the multimedia playing interface; the multimedia playing interface plays multimedia data, and at least one barrage data is displayed on the multimedia data played by the multimedia playing interface;
and the processing module is used for carrying out associated display on the multimedia data and the multimedia interaction data indicated by the barrage type of the target barrage data on the multimedia playing interface according to the triggering operation of the target barrage data in the at least one barrage data.
10. An electronic device comprising a processor and a memory, wherein the memory is configured to store a computer program comprising program instructions, the processor being configured to invoke the program instructions to perform the method of any of claims 1-8.
11. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of any of claims 1-8.
12. A computer program product comprising computer instructions which, when executed by a processor, implement the method of any of claims 1-8.
CN202210143836.1A 2022-02-16 2022-02-16 Barrage data processing method, barrage data processing device, electronic equipment, medium and program product Pending CN116647735A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210143836.1A CN116647735A (en) 2022-02-16 2022-02-16 Barrage data processing method, barrage data processing device, electronic equipment, medium and program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210143836.1A CN116647735A (en) 2022-02-16 2022-02-16 Barrage data processing method, barrage data processing device, electronic equipment, medium and program product

Publications (1)

Publication Number Publication Date
CN116647735A true CN116647735A (en) 2023-08-25

Family

ID=87642276

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210143836.1A Pending CN116647735A (en) 2022-02-16 2022-02-16 Barrage data processing method, barrage data processing device, electronic equipment, medium and program product

Country Status (1)

Country Link
CN (1) CN116647735A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118972658A (en) * 2024-08-20 2024-11-15 北京达佳互联信息技术有限公司 Bullet screen display method, device, equipment and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118972658A (en) * 2024-08-20 2024-11-15 北京达佳互联信息技术有限公司 Bullet screen display method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
US9253511B2 (en) Systems and methods for performing multi-modal video datastream segmentation
CN111277910B (en) Bullet screen display method, device, electronic device and storage medium
CN110493653B (en) Barrage play control method, device, equipment and storage medium
US11343595B2 (en) User interface elements for content selection in media narrative presentation
CN106658200A (en) Live video sharing and obtaining methods and devices, and terminal equipment thereof
US12015813B2 (en) Methods, systems, and media for indicating viewership of a video
CN110475140B (en) Bullet screen data processing method and device, computer readable storage medium and computer equipment
CN102236890A (en) Generating a combined image from multiple images
US11388561B2 (en) Providing a summary of media content to a communication device
KR20120078730A (en) Linking disparate content sources
US20190052936A1 (en) Methods, systems, and media for providing media guidance
KR20140113435A (en) Intuitive image-based program guide for controlling display device such as a television
CN112507163A (en) Duration prediction model training method, recommendation method, device, equipment and medium
CN112752132A (en) Cartoon picture bullet screen display method and device, medium and electronic equipment
CN116647735A (en) Barrage data processing method, barrage data processing device, electronic equipment, medium and program product
KR20190131544A (en) Server device, and computer program used for it
KR102615377B1 (en) Method of providing a service to experience broadcasting
CN118042186A (en) Method, apparatus, electronic device and computer readable medium for providing video cover
CN117789068A (en) Video processing method, device, electronic equipment and storage medium
HK40083060A (en) Search processing method, apparatus, device, medium and program product
CN114125541A (en) Video playing method, video playing device, electronic equipment, storage medium and program product
CN117714728A (en) Information generation method, device, electronic equipment and storage medium
CN114125534A (en) Video playing method, video playing device, electronic equipment, storage medium and program product
CN116095381A (en) Data processing method, device, computer equipment and readable storage medium
CN114125540A (en) Video playback method, device, electronic device, storage medium and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载