+

WO2017045590A1 - Procédé et système d'échange d'informations multimédia - Google Patents

Procédé et système d'échange d'informations multimédia Download PDF

Info

Publication number
WO2017045590A1
WO2017045590A1 PCT/CN2016/098910 CN2016098910W WO2017045590A1 WO 2017045590 A1 WO2017045590 A1 WO 2017045590A1 CN 2016098910 W CN2016098910 W CN 2016098910W WO 2017045590 A1 WO2017045590 A1 WO 2017045590A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia
information
interaction
terminal
cloud server
Prior art date
Application number
PCT/CN2016/098910
Other languages
English (en)
Chinese (zh)
Inventor
孙晓辰
Original Assignee
北京合盒互动科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京合盒互动科技有限公司 filed Critical 北京合盒互动科技有限公司
Publication of WO2017045590A1 publication Critical patent/WO2017045590A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25875—Management of end-user data involving end-user authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/141—Setup of application sessions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2408—Monitoring of the upstream path of the transmission network, e.g. client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand

Definitions

  • the present invention relates to the field of Internet communication technologies, and in particular, to a multimedia information interaction method and system.
  • the mp4 (MPEG-4) player is a multimedia terminal that allows users to play multimedia information such as music or video through an mp4 player.
  • the multimedia terminal When the user needs to play a certain multimedia information, the multimedia terminal obtains the stored multimedia information locally, or obtains the multimedia information that needs to be played from the server, and then plays the obtained multimedia information, and the user can listen to the played multimedia information by listening. , or visually watch the multimedia information played.
  • the multimedia information played above is generally an existing audio and video work, and the user may prefer to interact with related actors such as actors or singers corresponding to the audio and video works while enjoying the audio and video works, but in the prior art There is no way to achieve this interaction.
  • an object of the embodiments of the present invention is to provide a multimedia information interaction method and system, which realizes interaction between a first user and a second user related to audio and video works, and improves audio and video information enjoyed by the first user. Attention.
  • an embodiment of the present invention provides a multimedia information interaction method, where the method includes:
  • the cloud server receives the on-demand message sent by the multimedia terminal, where the on-demand message includes the terminal information of the multimedia terminal and the multimedia related information corresponding to the currently played multimedia information;
  • the cloud server sends an interaction message to the mobile terminal corresponding to the multimedia related information according to the multimedia related information included in the on-demand message;
  • the cloud server sends the interactive multimedia information to the multimedia terminal, so that the multimedia terminal plays the interactive multimedia information.
  • the embodiment of the present invention provides the first possible implementation manner of the foregoing first aspect, wherein the method further includes:
  • the cloud server receives an interaction threshold sent by the mobile terminal corresponding to the second user, where the interaction threshold includes one or more of a demand quantity threshold, an on-demand location threshold, and an on-demand area threshold;
  • the cloud server stores the interaction threshold in the second user information corresponding to the second user in the cloud server.
  • the embodiment of the present invention provides the second possible implementation manner of the foregoing first aspect, wherein the cloud server sends according to the multimedia related information included in the on-demand message.
  • the mobile terminal corresponding to the multimedia related information includes:
  • the cloud server collects on-demand information according to the received on-demand message sent by the multimedia terminal, where the on-demand quantity information includes the total number of on-demand times, the number of on-demand times corresponding to each on-demand place, and the number of on-demand times corresponding to each on-demand area;
  • the cloud server When it is determined that the interaction threshold is reached, the cloud server sends an interaction message to the mobile terminal corresponding to the second user according to the second user information, where the interaction message includes the multimedia related information.
  • the embodiment of the present invention provides a third possible implementation manner of the foregoing first aspect, the method further includes:
  • the cloud server receives an interactive push message sent by the mobile terminal of the second user, where the interactive push message includes interactive multimedia information and a target interaction area;
  • the cloud server separately sends the interactive multimedia information to each multimedia terminal according to the terminal information of each multimedia terminal.
  • an embodiment of the present invention provides a multimedia information interaction method, where the method includes:
  • the multimedia terminal When the multimedia terminal detects that the first user triggers to play a certain multimedia information, the multimedia terminal sends an on-demand message to the cloud server, where the on-demand message includes terminal information of the multimedia terminal and multimedia related information corresponding to the multimedia information;
  • the multimedia terminal plays the interactive multimedia information.
  • the embodiment of the present invention provides the first possible implementation manner of the foregoing second aspect, wherein the interactive multimedia information includes one or more of audio, video, text, and a picture;
  • the multimedia terminal plays the interactive multimedia information, including:
  • the multimedia terminal mixes the currently played multimedia information with the audio included in the interactive multimedia information, and plays the audio data after the mixing processing;
  • the multimedia information is displayed in a picture-in-picture manner, and the video, text, and picture included in the interactive multimedia information are displayed in a screen of the currently played multimedia information.
  • an embodiment of the present invention provides a multimedia information interaction method, where the method includes:
  • the mobile terminal receives an interactive message sent by the cloud server, where the interactive message includes multimedia related information;
  • the mobile terminal When the mobile terminal detects the accepting interaction response triggered by the second user, the mobile terminal sends an interactive response message to the cloud server, where the interactive response message includes an interactive multimedia message. And causing the cloud server to send the interactive multimedia information to the multimedia terminal that is playing the multimedia information corresponding to the multimedia related information.
  • the embodiment of the present invention provides the first possible implementation manner of the foregoing third aspect, where the method further includes:
  • the mobile terminal sends an interaction threshold to the cloud server, where the interaction threshold includes one or more of a demand quantity threshold, an on-demand location threshold, and an on-demand area threshold, so that the cloud server stores the interaction threshold in the
  • the second user information corresponding to the second user in the cloud server;
  • the mobile terminal sends an interactive push message to the cloud server, where the interactive push message includes interactive multimedia information and a target interaction area, so that the cloud server sends the interactive multimedia information to each of the target interactive area coverage Multimedia terminals.
  • an embodiment of the present invention provides a multimedia information interaction system, where the system includes: a cloud server, a mobile terminal, and a multimedia terminal;
  • the multimedia terminal is configured to send an on-demand message to the cloud server when detecting that the first user triggers playing a multimedia information, where the on-demand message includes terminal information of the multimedia terminal and multimedia related corresponding to the multimedia information.
  • the cloud server is configured to receive an on-demand message sent by the multimedia terminal, and send an interaction message to the mobile terminal corresponding to the multimedia related information according to the multimedia related information included in the on-demand message; and receive the interaction returned by the mobile terminal a response message; when the interactive response message includes interactive multimedia information, transmitting the interactive multimedia information to the multimedia terminal;
  • the mobile terminal is configured to receive an interaction message sent by the cloud server, where the interaction message includes the multimedia related information; when detecting an acceptance interaction response triggered by the second user, sending an interaction response message to the cloud server .
  • the embodiment of the present invention provides the first possible implementation manner of the foregoing fourth aspect, wherein the cloud server is further configured to receive an interaction threshold sent by the mobile terminal, where the interaction threshold includes on-demand One or more of a quantity threshold, an on-demand location threshold, and an on-demand area threshold; the interaction threshold is stored in the second user information corresponding to the second user in the cloud server.
  • the cloud server receives the on-demand message sent by the multimedia terminal, and sends an interactive message to the mobile terminal corresponding to the multimedia related information according to the multimedia related information included in the on-demand message, and receives the interactive response returned by the mobile terminal.
  • the invention sends an interactive message to the mobile terminal of the second user according to the on-demand condition of the multimedia terminal, and realizes the interaction between the multimedia terminal of the first user and the mobile terminal of the second user, thereby realizing the first user and the audio and video works.
  • the interaction between the related second users improves the attention of the first user to the audio and video information that is enjoyed.
  • FIG. 1A is a signaling interaction diagram of a multimedia information interaction provided by Embodiment 1 of the present invention.
  • FIG. 1B is a schematic diagram of signaling interaction of another multimedia information interaction provided by Embodiment 1 of the present invention.
  • FIG. 2 is a schematic structural diagram of a multimedia information interaction system according to Embodiment 2 of the present invention.
  • the present invention provides a multimedia information interaction.
  • Method and system Description will be made below by way of examples.
  • the embodiment of the invention provides a multimedia information interaction method.
  • the mobile terminal mentioned in the embodiment of the present invention is a mobile terminal such as a mobile phone or a tablet computer of these related persons. For the convenience of description, these related persons are collectively referred to as a second user in the embodiment of the present invention.
  • the network architecture of the embodiment of the present invention includes a mobile terminal of the second user, a cloud server, and a multimedia terminal of the first user, and the cloud server includes a cloud database.
  • the first user is an ordinary user who watches audio and video works, such as viewers, fans or fans.
  • the interaction between the multimedia terminal and the mobile terminal of the second user corresponding to the audio and video work is realized by the method provided by the embodiment of the present invention, thereby realizing the user and the audio and video.
  • the actors, singers, or directors of the work interact with each other.
  • the method includes the following steps:
  • Step 101 The mobile terminal sends an interaction threshold to the cloud server, where the interaction threshold includes one or more of a demand quantity threshold, an on-demand location threshold, and an on-demand area threshold.
  • the second user before using the mobile terminal to implement interaction with the multimedia terminal of the first user, the second user first downloads and installs an APP (Application, Application) that supports multimedia information interaction, and logs in to the cloud server through the APP.
  • the cloud server verifies its registration information, and the registration information includes at least the second user information of the second user.
  • the cloud server verifies that the APP user matches its identity, the cloud user information is stored in the second user information database of the cloud database.
  • the second user information includes a terminal identifier of the mobile terminal corresponding to the second user, an ID (Identification) of the second user, a name, a contact information, and audio and video work information of the participating user.
  • the interaction with the multimedia terminal of the first user may be implemented by the mobile terminal.
  • the above audio and video works include the name, version, release date, original singer, lyric composition, main cast members and location.
  • the interaction threshold may be a threshold for all works of the second user, or may be a threshold for a single work of the second user.
  • the interaction threshold may be any combination of the on-demand volume threshold, the on-demand location threshold, and the on-demand area threshold.
  • the on-demand amount threshold is an upper limit value of the number of multimedia terminals of the work of the second user on demand.
  • the on-demand venue threshold is an upper limit value of the number of multimedia terminals on which a second user's work is ordered on a certain place.
  • the on-demand area threshold is an upper limit value of the number of multimedia terminals on which the second user's work is clicked in a certain area.
  • the on-demand amount threshold is an upper limit value of the number of multimedia terminals of the audio and video work of the second user on demand.
  • the on-demand location threshold is an upper limit value of the number of multimedia terminals of an audio and video work of the second user on a certain place.
  • the on-demand area threshold is an upper limit value of the number of multimedia terminals of an audiovisual work of the second user on a certain area.
  • the interaction threshold when the interaction threshold is the on-demand threshold, the upper limit of the number of multimedia terminals on which an audio and video work is requested may be set to 100 or 200; when the interaction threshold is an on-demand threshold, the second user may set one or For a plurality of fixed places, for example, the upper limit of the total number of multimedia terminals for setting an audio and video work in the A place and the B place is 50 or 100; when the interaction threshold is an on-demand area threshold, the second user can set one or For a plurality of cities, for example, the upper limit of the total number of multimedia terminals for setting an audio and video work in the C city is 100 or 200, or the upper limit of the total number corresponding to the C city and the B city is 300 or 400.
  • the APP supporting the multimedia information interaction installed in the mobile terminal of the second user provides the second user with the function of setting the interaction threshold.
  • the second user sets the interaction threshold by using the mobile terminal, and the mobile terminal acquires the interaction threshold set by the second user, and sends the interaction threshold and the terminal identifier of the mobile terminal to the cloud server.
  • Step 102 The cloud server receives the interaction threshold sent by the mobile terminal corresponding to the second user, and stores the interaction threshold in the second user information corresponding to the second user in the cloud server.
  • the cloud server receives the interaction threshold sent by the mobile terminal corresponding to the second user, and receives the terminal identifier of the mobile terminal, and determines, according to the terminal identifier of the mobile terminal, the second user information database of the cloud server to include the terminal identifier.
  • the second user information stores the received interaction threshold into the determined second user information.
  • the cloud database further stores content information of the audio and video works and terminal information of the multimedia terminal.
  • audio and video works include but are not limited to songs, film and television dramas, advertisements, short sentences, stage plays, cross talks and sketches.
  • the content information of audio and video works is the data of audio and video works.
  • the terminal information of the multimedia terminal includes terminal identifiers and location information of the multimedia terminal.
  • the location information of the multimedia terminal may be the city and the location where the multimedia terminal is located. For example, the city where the multimedia terminal is located may be Beijing, and the location where the multimedia terminal is located may be KTV (Karaoke Television, Karaoke) and the like.
  • the interaction between the mobile terminal of the second user and the multimedia terminal of the first user may be implemented by the operations of the following steps 103-108.
  • Step 103 When the multimedia terminal detects that the first user triggers playing a certain multimedia information, the multimedia terminal sends an on-demand message to the cloud server, where the on-demand message includes the terminal information of the multimedia terminal and the multimedia related information corresponding to the multimedia information;
  • the multimedia terminal is a terminal having an audio and video playback function, such as a KTV play terminal or a mobile phone or a computer equipped with an audio and video playback application.
  • the multimedia terminal detects the playback operation triggered by the play button, and the multimedia terminal acquires the multimedia name and version of the multimedia information selected by the first user.
  • the information, and the terminal information such as the terminal identifier and the location information of the multimedia terminal are obtained, and the obtained terminal information and the multimedia related information are combined into an on-demand message, and the on-demand message is sent to the cloud server.
  • the multimedia related information may further include a release date of the multimedia information, an original singer, a lyric composition, a main cast member, and a shooting location.
  • the on-demand message is sent to the cloud server according to the foregoing manner.
  • Step 104 The cloud server receives the on-demand message sent by the multimedia terminal, and collects the on-demand information corresponding to the multimedia related information according to the on-demand message.
  • the above-mentioned on-demand information includes the total number of on-demand, the number of on-demand corresponding to each on-demand location, and the number of on-demand corresponding to each on-demand area.
  • the cloud server receives the on-demand message sent by the multiple multimedia terminals, and the cloud server collects the on-demand information corresponding to the multimedia related information according to the terminal information and the multimedia related information carried in the received plurality of on-demand messages.
  • the cloud server when the cloud server collects the on-demand information corresponding to the multimedia related information, the cloud server performs statistics based on the multimedia information and the second user respectively.
  • the cloud server When the statistics are based on the multimedia information, the cloud server counts the total number of on-demand times of the same multimedia information according to the multimedia related information carried in the on-demand message, and counts the number of on-demand broadcasts of the same multimedia information in the same on-demand place according to the terminal information carried in the on-demand message. The number of on-demand broadcasts of the same multimedia information in the same area.
  • the cloud server determines, according to the multimedia related information carried by the on-demand message, the second user corresponding to the multimedia related information from the cloud server, and counts the total number of on-demand times of the work of the same second user, and according to the on-demand
  • the terminal information carried by the message counts the number of on-demand broadcasts of the same second user's work in the same on-demand place and the number of on-demand broadcasts of the same second user's work in the same area.
  • Step 105 The cloud server sends an interaction message to the mobile terminal corresponding to the multimedia related information according to the statistical on-demand information.
  • the cloud server checks the interaction threshold in the second user information corresponding to the multimedia information according to the statistics of the on-demand information of the multimedia information, and determines whether the on-demand information of the multimedia information reaches the interaction threshold of the second user.
  • the cloud server further checks the interaction threshold in the second user information of the second user according to the on-demand information of the second user, and determines whether the on-demand information of the second user reaches the interaction threshold of the second user.
  • the cloud server obtains the terminal identifier of the second user information of the second user from the cloud database, and sends an interaction message to the mobile terminal corresponding to the second user according to the terminal identifier, where the interaction message includes Multimedia related information.
  • the interaction message may include multimedia related information of the multimedia information reaching the interaction threshold and prompt information for prompting to reach the interaction threshold.
  • the interaction message may include a list of on-demand works and prompt information for prompting to reach an interaction threshold, and the second-user work is included in the list of on-demand works.
  • Step 106 The mobile terminal receives the interaction message sent by the cloud server, and when detecting the acceptance interaction response triggered by the second user, sends an interaction response message to the cloud server, where the interaction response message includes the interactive multimedia information;
  • the mobile terminal After receiving the interactive message sent by the cloud server, the mobile terminal displays the interactive message and provides a button for the second user to accept and reject the interaction. After the second user sees the interactive message, if the decision is made to interact with the first user, the button for accepting the interaction is clicked, and if it is decided not to interact with the first user, the button for rejecting the interaction is clicked.
  • the mobile terminal monitors the button that accepts the interaction and rejects the interaction in real time.
  • the button that accepts the interaction is detected, it is determined that the second user triggers the acceptance of the interactive response, and the interaction mode selected by the second user is obtained, and the interaction mode includes a single audio.
  • the mobile terminal When the interaction mode is a single audio interaction, the mobile terminal records the audio data of the second user through a recording device such as a microphone, or acquires the pre-stored audio data of the second user, and sends an interactive response message to the cloud server, where the interaction response message is sent. Carry recorded or acquired audio data.
  • the mobile terminal When the interaction mode is a single video interaction, the mobile terminal records the video data of the second user through the camera, or obtains the pre-stored video data of the second user, and sends an interactive response message to the cloud server, where the interactive response message carries the recording or Acquired video data.
  • the mobile terminal When the interaction mode is audio and video interaction, the mobile terminal records the audio data of the second user through a recording device such as a microphone, and simultaneously records the video data of the second user through the camera, and combines the audio data and the video data of the second user into audio and video data. Or acquiring the pre-stored audio and video data of the second user, sending an interactive response message to the cloud server, and carrying the recorded audio and video data in the interactive response message.
  • a recording device such as a microphone
  • the mobile terminal receives the text data input by the second user, or acquires the pre-stored text data of the second user, and sends an interaction response message to the cloud server, where the text data is carried in the interaction response message.
  • the mobile terminal When the interactive mode is a picture interaction, the mobile terminal receives the picture input by the second user, or obtains a pre-stored picture of the second user, sends an interactive response message to the cloud server, and carries the picture in the interactive response message.
  • the mobile terminal determines that the second user triggers the rejection interaction response, and the mobile terminal sends a rejection message to the cloud server, and the cloud server does not go to the cloud server after receiving the rejection message.
  • a user's terminal sends any message to end the operation.
  • the mobile terminal does not send any message to the cloud server.
  • the cloud server does not receive the feedback of the mobile terminal after the preset time exceeds the preset time, it determines that the mobile terminal rejects the interaction, and does not send any message to the terminal of the first user, and ends the operation. .
  • Step 107 The cloud server receives the interactive response message returned by the mobile terminal, and sends the interactive multimedia information to the multimedia terminal when the interactive response message includes the interactive multimedia information.
  • the cloud server when the multimedia terminal sends the on-demand message to the cloud server, the cloud server records the terminal identifier of the multimedia terminal, the corresponding multimedia related information, and the terminal identifier of the mobile terminal corresponding to the multimedia related information.
  • the cloud server receives the interactive response message returned by the mobile terminal, and the interactive response message includes the interactive multimedia information
  • the cloud server determines the multimedia terminal that needs to interact according to the terminal identifier of the mobile terminal, and sends the interactive multimedia information to the determined multimedia information. Multimedia terminal.
  • Step 108 The multimedia terminal receives the interactive multimedia information sent by the cloud server, and plays the interactive multimedia information.
  • the multimedia terminal mixes the interactive multimedia information with the audio that is playing the multimedia information, and then plays the mixed audio data through the audio device.
  • the interactive multimedia information includes a video, a text, and a picture
  • the multimedia terminal displays the video text and the picture included in the interactive multimedia information in the picture of the currently played multimedia information in a picture-in-picture display manner.
  • the interaction between the multimedia terminal of the first user and the mobile terminal of the second user is implemented according to the operation of the above steps 101-108 according to the situation that the multimedia terminal requests the multimedia information.
  • the mobile terminal of the second user actively pushes the interactive push message for interaction by the operation of the following steps S1 - S3 to implement the mobile terminal of the second user and the multimedia terminal of the first user. Interaction between.
  • the mobile terminal sends an interactive push message to the cloud server, where the interactive push message includes the interactive multimedia information and the target interaction area;
  • the second user can select to send an interactive push message to the multimedia terminal of a certain target area on the APP that supports the multimedia information interaction installed by the mobile terminal.
  • the interactive target area may be a multimedia terminal of a designated city, a multimedia terminal of a designated place, and a multimedia terminal of a designated place of a designated city.
  • one or more cities may be selected by an APP supporting multimedia information interaction, or one or more places may be selected, and the selected city or place is determined as an interactive target area.
  • the mobile terminal sends an interactive push message to the cloud server, and carries the interactive multimedia information and the interactive target area in the interactive push message.
  • the cloud server receives the interactive push message sent by the mobile terminal of the second user, and sends the interactive multimedia information included in the interactive push message to each multimedia terminal covered by the target interaction area according to the target interaction area included in the interactive push message;
  • the cloud server determines the multimedia terminal located in the city or the location from the terminal information of the multimedia terminal stored in the cloud database according to the city or location included in the target interaction area.
  • the cloud server separately transmits the interactive multimedia information to each of the determined multimedia terminals according to the determined terminal information of each multimedia terminal.
  • the multimedia terminal receives the interactive multimedia information sent by the cloud server, and plays the interactive multimedia information.
  • the first user may also collect the audio of the first user through the microphone of the multimedia terminal, or collect the video of the first user through the camera of the multimedia terminal, and the multimedia terminal uploads the audio or video of the first user to the cloud.
  • the server, the cloud server transmits the audio or video of the first user to the mobile terminal, and the second user plays the audio or video of the first user through the mobile terminal.
  • the cloud server receives the on-demand message sent by the multimedia terminal, and sends an interactive message to the mobile terminal corresponding to the multimedia related information according to the multimedia related information included in the on-demand message, and receives the interactive response message returned by the mobile terminal;
  • interactive multimedia information is included, interactive multimedia information is transmitted to the multimedia terminal.
  • the invention is based on the point of the multimedia terminal In the broadcast situation, the interaction message is sent to the mobile terminal of the second user, and the interaction between the multimedia terminal of the first user and the mobile terminal of the second user is implemented, thereby realizing the second user of the first user related to the audio and video work. The interaction between the first user improves the attention of the first user to the audio and video information that is enjoyed.
  • an embodiment of the present invention provides a multimedia information interaction system, where the system includes: a cloud server 1, a mobile terminal 2, and a multimedia terminal 3;
  • the multimedia terminal 3 is configured to send an on-demand message to the cloud server 1 when detecting that the user triggers playing a multimedia message, and the on-demand message includes the terminal information of the multimedia terminal 3 and the multimedia related information corresponding to the multimedia information; and receiving the multimedia information of the cloud server 1
  • Corresponding mobile terminal 2 responds to interactive multimedia information returned during interaction; plays interactive multimedia information;
  • the multimedia terminal 3 is a terminal having an audio and video playback function, such as a KTV play terminal or a mobile phone or a computer equipped with an audio and video playback application.
  • the multimedia terminal 3 detects the play operation triggered by the play button, and at this time, the multimedia terminal 3 acquires the work name of the multimedia information selected by the first user and The multimedia information related to the version, and the terminal information such as the terminal identifier and the location information of the multimedia terminal 3 are obtained, and the obtained terminal information and the multimedia related information are combined into an on-demand message, and the on-demand message is sent to the cloud server 1.
  • the multimedia related information may also include the release date of the multimedia information, the original singer, the lyric composition, the main cast member and the shooting location.
  • the on-demand message is sent to the cloud server 1 in the above manner.
  • the multimedia terminal 3 mixes the interactive multimedia information with the audio that is playing the multimedia information, and then plays the mixed audio data through the audio device.
  • the interactive multimedia information includes a video, a text, and a picture
  • the multimedia terminal 3 displays the video text and the picture included in the interactive multimedia information in the picture of the currently played multimedia information in a picture-in-picture display manner.
  • the interaction between the multimedia terminal of the first user and the mobile terminal of the second user is implemented according to the method provided by the foregoing Embodiment 1 according to the situation that the multimedia terminal requests the multimedia information.
  • the cloud server 1 is configured to receive the on-demand message sent by the multimedia terminal 3, and send the interaction message to the mobile terminal 2 corresponding to the multimedia related information according to the multimedia related information included in the on-demand message; receive the interactive response message returned by the mobile terminal 2; When the message includes interactive multimedia information, the interactive multimedia information is sent to the multimedia terminal 3;
  • the cloud server 1 receives the on-demand message sent by the plurality of multimedia terminals, and the cloud server 1 collects the on-demand information corresponding to the multimedia related information according to the terminal information and the multimedia related information carried in the received plurality of on-demand messages.
  • the above-mentioned on-demand information includes the total number of on-demand, the number of on-demand corresponding to each on-demand location, and the number of on-demand corresponding to each on-demand area.
  • the cloud server 1 When the multimedia terminal 3 sends the on-demand message to the cloud server 1, the cloud server 1 records the terminal identifier of the multimedia terminal, its corresponding multimedia related information, and the terminal identifier of the mobile terminal 2 corresponding to the multimedia related information.
  • the cloud server 1 receives the interactive response message returned by the mobile terminal 2, and the interactive response message includes the interactive multimedia information, the cloud server 1 determines the multimedia terminal that needs to interact according to the terminal identifier of the mobile terminal, and sends the interactive multimedia information to the The determined multimedia terminal 3.
  • the cloud server 1 when the cloud server 1 collects the on-demand information corresponding to the multimedia related information, the cloud server 1 performs statistics based on the multimedia information and the second user respectively.
  • the cloud server 1 When the statistic is performed based on the multimedia information, the cloud server 1 counts the total number of times of on-demand broadcasting of the same multimedia information according to the multimedia related information carried in the on-demand message, and counts the number of on-demand broadcasts of the same multimedia information in the same on-demand place according to the terminal information carried in the on-demand message. And the number of on-demand broadcasts of the same multimedia information in the same area.
  • the cloud server 1 determines, according to the multimedia related information carried in the on-demand message, the second user corresponding to the multimedia related information from the cloud server 1, and counts the total number of times of the on-demand works of the same second user, and According to the terminal information carried by the on-demand message, Counting the number of on-demand broadcasts of the same second user's work in the same on-demand place and the number of on-demand broadcasts of the same second user's work in the same area.
  • the cloud server 1 checks the interaction threshold in the second user information corresponding to the multimedia information according to the statistics of the on-demand information of the multimedia information, and determines whether the on-demand information of the multimedia information reaches the interaction threshold of the second user.
  • the cloud server 1 further checks the interaction threshold in the second user information of the second user according to the on-demand information of the second user, and determines whether the on-demand information of the second user reaches the interaction threshold of the second user.
  • the cloud server 1 obtains the terminal identifier of the second user information of the second user from the cloud database, and sends an interaction message to the mobile terminal 2 corresponding to the second user according to the terminal identifier, the interaction
  • the message includes multimedia related information.
  • the interaction message may include multimedia related information of the multimedia information reaching the interaction threshold and prompt information for prompting to reach the interaction threshold.
  • the interaction message may include a list of on-demand works and prompt information for prompting to reach an interaction threshold, and the second-user work is included in the list of on-demand works.
  • the cloud server 2 further receives the interactive push and send sent by the mobile terminal of the second user, and sends the interactive multimedia information included in the interactive push message to each multimedia terminal covered by the target interactive area according to the target interaction area included in the interactive push message.
  • the cloud server 1 determines the multimedia terminal 3 located in the above-mentioned city or place from the terminal information of the multimedia terminal stored in the cloud database according to the city or place included in the target interaction area.
  • the cloud server 1 separately transmits the interactive multimedia information to each of the determined multimedia terminals 3 according to the determined terminal information of each multimedia terminal 3.
  • the first user may also collect the audio of the first user through the microphone of the multimedia terminal 3, or collect the video of the first user through the camera of the multimedia terminal 3, and the multimedia terminal 3 will audio or video of the first user.
  • the cloud server 1 transmits the first audio or video to the mobile terminal 2, and the second user plays the audio or video of the first user through the mobile terminal 2.
  • the mobile terminal 2 is configured to receive an interactive message sent by the cloud server 1, and the interactive message includes multimedia related information.
  • the interactive response message is sent to the cloud server 1.
  • the mobile terminal 2 is a mobile terminal such as a mobile phone or a tablet computer of the second user.
  • the second user Before using the mobile terminal 2 to interact with the multimedia terminal 3 of the first user, the second user first downloads and installs an APP that supports multimedia information interaction, and logs in to the cloud server 1 through the APP, and sends the registration information to the cloud server 1, the cloud.
  • the server 1 verifies its registration information, and the registration information includes at least the second user information of the second user.
  • the cloud server 1 verifies that the APP user matches its identity, the cloud server 1 stores the second user information in the second user information database of the cloud database.
  • the second user information includes the terminal identifier of the mobile terminal 1 corresponding to the second user, the ID of the second user, the name, the contact information, and the audio and video work information of the participating user.
  • the above audio and video works include the name, version, release date, original singer, lyric composition, main cast members and location.
  • the mobile terminal 2 After receiving the interactive message sent by the cloud server 1, the mobile terminal 2 displays the interactive message and provides a button for the second user to accept and reject the interaction. After the second user sees the interactive message, if the decision is made to interact with the first user, the button for accepting the interaction is clicked, and if it is decided not to interact with the first user, the button for rejecting the interaction is clicked.
  • the mobile terminal 2 performs real-time monitoring on the button that accepts the interaction and rejects the interaction. When it is detected that the button accepting the interaction is clicked, it is determined that the second user triggers the acceptance of the interactive response to obtain the second user selection.
  • the interactive method of interaction includes a single audio interaction, a single video interaction, audio and video interaction, text interaction or image interaction.
  • the mobile terminal 2 When the interactive mode is a single audio interaction, the mobile terminal 2 records the audio data of the second user through a recording device such as a microphone, or acquires the pre-stored audio data of the second user, and sends an interactive response message to the cloud server 1 in the interactive response.
  • the message carries recorded or acquired audio data.
  • the mobile terminal When the interaction mode is a single video interaction, the mobile terminal records the video data of the second user through the camera, or acquires the pre-stored video data of the second user, and sends an interactive response message to the cloud server 1 in the interaction response message. Carry recorded or acquired video data.
  • the mobile terminal 2 When the interaction mode is audio and video interaction, the mobile terminal 2 records the audio data of the second user through a recording device such as a microphone, and simultaneously records the video data of the second user through the camera, and combines the audio data and the video data of the second user into audio and video.
  • the data, or the pre-stored audio and video data of the second user sends an interactive response message to the cloud server 1, and carries the recorded audio and video data in the interactive response message.
  • the mobile terminal 2 receives the text data input by the second user, or acquires the pre-stored text data of the second user, and sends an interactive response message to the cloud server 1 to carry the text in the interactive response message. data.
  • the mobile terminal 2 receives the picture input by the second user, or acquires a pre-stored picture of the second user, and sends an interactive response message to the cloud server 1 to carry the picture in the interactive response message.
  • the mobile terminal 2 determines that the second user triggers the rejection interaction response, and the mobile terminal 2 sends a rejection message to the cloud server 1, and the cloud server 1 receives the rejection message. , does not send any message to the terminal of the first user, ends the operation. Alternatively, the mobile terminal 2 does not send any message to the cloud server 1.
  • the cloud server 1 does not receive the feedback of the mobile terminal 2 after exceeding the preset time, it determines that the mobile terminal 2 rejects the interaction, and does not send the terminal 2 to the first user. Send any message to end the operation.
  • the cloud server 1 is further configured to receive an interaction threshold sent by the mobile terminal 2, where the interaction threshold includes one or more of a demand quantity threshold, an on-demand location threshold, and an on-demand area threshold; and the interaction threshold is stored in the cloud server 1 Corresponding second user information.
  • the cloud server 1 receives the interaction threshold sent by the mobile terminal 2 corresponding to the second user, and also receives the terminal identifier of the mobile terminal 2, and determines from the second user information database of the cloud server 1 according to the terminal identifier of the mobile terminal 2.
  • the second user information including the identifier of the terminal stores the received interaction threshold into the determined second user information.
  • the content information of the audio and video works and the terminal information of the multimedia terminal 3 are also stored in the cloud database.
  • audio and video works include but are not limited to songs, film and television dramas, advertisements, short sentences, stage plays, cross talks and sketches.
  • the content information of audio and video works is the data of audio and video works.
  • the terminal information of the multimedia terminal 3 includes the terminal identifier and location information of the multimedia terminal.
  • the location information of the multimedia terminal 3 may be the city and the location where the multimedia terminal 3 is located. For example, the city where the multimedia terminal 3 is located may be Beijing, and the location where the multimedia terminal 3 is located may be KTV (Karaoke Television, Karaoke) or the like.
  • the cloud server 1 After the interaction threshold corresponding to the second user is set by the method provided in the foregoing embodiment 1, the cloud server 1 performs multimedia information between the mobile terminal 2 of the second user and the multimedia terminal 3 of the first user according to the method provided in Embodiment 1. Interaction.
  • the cloud server receives the on-demand message sent by the multimedia terminal, and sends an interactive message to the mobile terminal corresponding to the multimedia related information according to the multimedia related information included in the on-demand message, and receives the interactive response message returned by the mobile terminal;
  • the message includes interactive multimedia information
  • the interactive multimedia information is sent to the multimedia terminal.
  • the invention sends an interactive message to the mobile terminal of the second user according to the on-demand condition of the multimedia terminal, and realizes the interaction between the multimedia terminal of the first user and the mobile terminal of the second user, thereby realizing the first user and the audio and video works.
  • the interaction between the related second users improves the attention of the first user to the audio and video information that is enjoyed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Security & Cryptography (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un procédé et un système d'échange d'informations multimédia. Un serveur en nuage reçoit un message à la demande envoyé par un terminal multimédia ; selon des informations multimédia pertinentes comprises dans le message à la demande, envoyer un message d'interaction à un terminal mobile correspondant aux informations multimédia pertinentes, et recevoir un message de réponse d'interaction renvoyé par le terminal mobile ; si le message de réponse d'interaction comprend des informations multimédia d'interaction, alors envoyer les informations multimédia d'interaction au terminal multimédia. Dans la présente invention, un message d'interaction est envoyé, selon la situation à la demande d'un terminal multimédia d'un premier utilisateur, à un terminal multimédia d'un second utilisateur ; ainsi, une interaction est obtenue entre le terminal multimédia du premier utilisateur et le terminal mobile du second utilisateur, permettant ainsi d'obtenir une interaction entre le premier utilisateur et le second utilisateur associée à un travail audio/vidéo, augmentant l'attention portée par le premier utilisateur sur les informations audio/vidéo.
PCT/CN2016/098910 2015-09-15 2016-09-13 Procédé et système d'échange d'informations multimédia WO2017045590A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510587680.6A CN105451039B (zh) 2015-09-15 2015-09-15 一种多媒体信息交互方法及系统
CN201510587680.6 2015-09-15

Publications (1)

Publication Number Publication Date
WO2017045590A1 true WO2017045590A1 (fr) 2017-03-23

Family

ID=55560757

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/098910 WO2017045590A1 (fr) 2015-09-15 2016-09-13 Procédé et système d'échange d'informations multimédia

Country Status (2)

Country Link
CN (1) CN105451039B (fr)
WO (1) WO2017045590A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111327943A (zh) * 2019-07-17 2020-06-23 杭州海康威视系统技术有限公司 信息管理方法及装置、系统、计算机设备、存储介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105451039B (zh) * 2015-09-15 2019-05-24 北京合盒互动科技有限公司 一种多媒体信息交互方法及系统
CN108182602A (zh) * 2018-01-03 2018-06-19 陈顺宝 一种户外多媒体信息移动展示系统
CN110493231B (zh) * 2019-08-21 2022-06-24 广州视源电子科技股份有限公司 信息传输的方法、装置和系统
CN112153476B (zh) * 2020-09-22 2022-07-22 游艺星际(北京)科技有限公司 交互数据处理方法和装置、服务器、存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7120924B1 (en) * 2000-02-29 2006-10-10 Goldpocket Interactive, Inc. Method and apparatus for receiving a hyperlinked television broadcast
CN103813183A (zh) * 2012-11-09 2014-05-21 腾讯科技（深圳）有限公司 多媒体节目的播放方法及播放系统
CN103905846A (zh) * 2012-12-25 2014-07-02 中国电信股份有限公司 基于iptv的内容推送方法与服务器
CN104618345A (zh) * 2015-01-05 2015-05-13 广州酷狗计算机科技有限公司 一种获取多媒体信息的方法和装置
CN105451039A (zh) * 2015-09-15 2016-03-30 北京合盒互动科技有限公司 一种多媒体信息交互方法及系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101369859B (zh) * 2008-09-25 2010-08-18 中兴通讯股份有限公司 一种手机电视电子业务指南信息的获取方法和系统
CN103607607A (zh) * 2013-11-14 2014-02-26 四川长虹电器股份有限公司 基于家庭智能设备的多屏协同系统及其实现方法
CN103957467B (zh) * 2014-04-11 2018-02-02 北京智谷睿拓技术服务有限公司 交互方法及用户设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7120924B1 (en) * 2000-02-29 2006-10-10 Goldpocket Interactive, Inc. Method and apparatus for receiving a hyperlinked television broadcast
CN103813183A (zh) * 2012-11-09 2014-05-21 腾讯科技（深圳）有限公司 多媒体节目的播放方法及播放系统
CN103905846A (zh) * 2012-12-25 2014-07-02 中国电信股份有限公司 基于iptv的内容推送方法与服务器
CN104618345A (zh) * 2015-01-05 2015-05-13 广州酷狗计算机科技有限公司 一种获取多媒体信息的方法和装置
CN105451039A (zh) * 2015-09-15 2016-03-30 北京合盒互动科技有限公司 一种多媒体信息交互方法及系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111327943A (zh) * 2019-07-17 2020-06-23 杭州海康威视系统技术有限公司 信息管理方法及装置、系统、计算机设备、存储介质

Also Published As

Publication number Publication date
CN105451039A (zh) 2016-03-30
CN105451039B (zh) 2019-05-24

Similar Documents

Publication Publication Date Title
US11778138B2 (en) System and methods providing supplemental content to internet-enabled devices synchronized with rendering of first content
US11330316B2 (en) Media streaming
US11082747B2 (en) Method and apparatus for managing personal content
US8051130B2 (en) Methods and apparatus for creating, combining, distributing and reproducing program content for groups of participating users
US8774172B2 (en) System for providing secondary content relating to a VoIp audio session
US9426530B2 (en) Methods and apparatus for creating, combining, distributing and reproducing program content for groups of participating users
WO2017088621A1 (fr) Procédé pour réaliser une diffusion de réseau et serveur
US20170134783A1 (en) High quality video sharing systems
US20140063259A1 (en) Method and system for video production
WO2017045590A1 (fr) Procédé et système d'échange d'informations multimédia
US11272246B2 (en) System and method for management and delivery of secondary syndicated companion content of discovered primary digital media presentations
JP2009505291A (ja) 電子メッセージを配信する方法および装置
US9197920B2 (en) Shared media experience distribution and playback
KR102163695B1 (ko) 인터넷을 통한 실시간 참여형 스트리밍 서비스 제공 방법 및 그 장치
JP2019169935A (ja) 消費者志向型マルチカメラ撮影映像の選択視聴サービスシステム
CN108668140B (zh) 音视频交互状态同步方法及装置
US20140280780A1 (en) System, method and apparatus for content eavesdropping
US20150150040A1 (en) Interactive audio/video broadcast system, method for operating the same and user device for operation in the interactive audio/video broadcast system
CN105100858A (zh) 视频播放系统和方法
JP7465186B2 (ja) ライブ配信システム
WO2013179364A1 (fr) Dispositif d'affichage d'informations de programme, dispositif de délivrance en sortie d'informations de programme, et procédé d'affichage d'informations de programme
JP5306560B1 (ja) 番組情報表示装置、番組情報出力装置および番組情報表示方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16845704

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16845704

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载