WO2011150845A1

WO2011150845A1 - Mehtod, device and system for verifying integrity of streaming media contents

Info

Publication number: WO2011150845A1
Application number: PCT/CN2011/075054
Authority: WO
Inventors: 朱俊华
Original assignee: 华为技术有限公司
Priority date: 2010-11-01
Filing date: 2011-05-31
Publication date: 2011-12-08
Also published as: CN102137089B; CN102137089A

Abstract

A method for verifying the integrity of streaming media contents includes: reading, by a streaming media server, the N-th fragment of a source streaming media file, wherein the fragment comprises M data blocks; taking the M-th data block of the fragment as the M-th data block of the N-th fragment of a later streaming media file; beginning from the M-th data block of the N-th fragment of the later streaming media file, calculating verification information for the m-th data block of the N-th fragment of the later streaming media file; by adding the verification information for the m-th data block to the (m-1)-th data block of the N-th fragment of the source streaming media file, generating the (m-1)'-th data block; taking the (m-1)'-th data block as the (m-1)-th data block of the N-th fragment of the later streaming media file; continuing until completing the construction of the first data block of the N-th fragment of the later streaming media file, wherein m is from M to 2; constructing independent verification information for each data block of the N-th fragment of the later streaming media file, and individually storing the independent verification information.

Description

Method, device and system for streaming media content integrity

This application claims priority to Chinese Patent Application No. 201010528198.2, entitled "Method, Equipment and System for Verifying the Integrity of Streaming Media Content", filed on November 1, 2010, the entire contents of which are hereby incorporated by reference. Combined in this application. Technical field

The present invention relates to the field of communications technologies, and in particular, to a method, device, and system for verifying the integrity of streaming media content. Background technique

Streaming media refers to media formats that are streamed on the Internet. Service providers can provide video playback services to users through streaming media, such as IPTV (Internet Protocol Television) services. At present, the means for releasing the video playing service may adopt a node-assisted distribution scheme, that is, the streaming media server of the service provider can send the streaming media content to the user, and the user can also send the saved streaming media content to other users in the Internet. The user receives or sends the video play file through the terminal device provided by the service provider. Usually, the terminal device is a set top box.

In order to ensure that the streaming media content received by the terminal device is correct, the terminal device needs to perform integrity verification on the received streaming media content. In order to enable service operators to provide fast and smooth video playback services, terminal devices must be able to guarantee continuous verification of streaming media content integrity.

At present, the method adopted by the service provider is: The streaming media server divides the streaming media content into a plurality of data blocks, and uses the tree chain based on the Merkle tree to construct the verification information of the data block, and all the data blocks are carried based on the network transmission. The authentication information of the Merkle tree's tree chain is constructed. The terminal device uses the Merkle tree-based tree chain to verify the integrity of the received data block according to the verification information carried by the data block.

The foregoing process of verifying the content integrity of the streaming media may also be used in a working scenario of real-time integrity verification, such as a P2P file system, or a P2P flow, for continuous data streams or streaming media that are end-to-end (P2P, Peer To Peer). Media system.

In the research and practice of the prior art, the inventors of the present invention found that with high-definition multimedia The popularity of physical devices, the capacity of high-definition streaming media content is large, because the maximum length of data blocks that can be transmitted in the network is fixed, the number of data blocks obtained by HD streaming media content is large, resulting in the construction of these data blocks. The Merkle tree is so deep that the length of the validation information for each block of data based on the tree chain of the Merkle tree is large. Therefore, in this case, when the streaming media content is transmitted over the network, all the data blocks must carry large-capacity verification information constructed based on the tree chain of the Merkle tree, which may cause the transmission cost of the downloaded content of the terminal device to be large. . Summary of the invention

Embodiments of the present invention provide a method and device for verifying the integrity of streaming media content.

A method for verifying integrity of streaming media content, comprising: a streaming media server reading an Nth fragment of a source streaming media file, the fragment comprising M data blocks; and an Mth data block of the fragment As the Mth data block of the Nth fragment of the back stream media file, starting from the Mth data block of the Nth fragment of the post stream media file, calculating the Nth of the post stream media file The verification information of the mth data block of the fragment is generated by adding the verification information of the mth data block to the m-1th data block of the Nth slice of the source streaming media file to generate the mth number a data block, the m-th data block is used as the m-1th data block of the Nth slice of the post-streaming media file, until the Nth slice of the post-streaming media file is constructed One data block, m from M to 2; constructs independent verification information for each data block of the Nth slice in the post-streaming file, and separately stores the independent verification information.

A method for verifying integrity of a streaming media content, comprising: transmitting, by a terminal device, a first request message, where the first request message is used to request independent verification information of a first data block of a slice of the received downstream media file, The slice includes K data blocks; receiving independent verification information of the first data block; verifying the integrity of the first data block according to the independent verification information of the first data block, when the first data block is When complete, starting from the first data block, extracting the verification information of the k+1th data block of the slice from the kth data block that has been verified as complete, according to the k+1th The verification information of the data block verifies the integrity of the k+1th data block of the slice until the integrity of the Kth data block of the slice is verified, k is from 1 to K-1; Before the integrity of the Kth data block of the fragment, when the verification information of the Tth data block is missing, T is any integer from 2 to K, and sends a second request message, the second request message Independent verification information for requesting the Tth data block, receiving Independent verification information T blocks of data, according to the independent verification information verifying the T first data blocks of the T The integrity of the data block.

A streaming media server, comprising: a read fragmentation unit, configured to read an Rth slice of a source streaming media file, the slice includes Z data blocks; and the constructed streaming media file unit is used to The Zth data block of the fragment is used as the Zth data block of the Rth slice of the back stream media file, starting from the Zth data block of the Rth slice of the post stream media file, The verification information of the zth data block of the Rth slice of the subsequent streaming media file is added to the z-1th of the Rth slice of the source streaming media file by adding the verification information of the zth data block The data block generates a third data block, and the third data block is used as the z-1th data block of the Rth slice of the post-streaming media file until the post-streaming media is constructed. The first data block of the Rth slice of the file, z from Z to 2; constructs an independent verification information element for constructing independent verification information for each data block of the Rth slice in the post-streaming file And separately storing the independent verification information.

A terminal device, comprising: a sending request message unit, configured to send a third request message, where the third request message is used to request independent verification information of a first data block of a slice of the received downstream media file, The segmentation includes S data blocks;

Receiving a verification information unit, configured to receive independent verification information of the first data block;

a verification integrity unit, configured to verify the integrity of the first data block according to the independent verification information of the first data block, when the first data block is complete, starting from the first data block, Verifying that the verification information of the s+1th data block of the fragment is extracted from the complete sth data block, and verifying the s+ of the fragment according to the verification information of the s+1th data block. The integrity of 1 data block, until the integrity of the Sth data block of the slice is verified, s from 1 to S-1;

Before verifying the integrity of the Sth data block of the fragment, when the verification information of the Gth data block is missing, G is any integer from 2 to S, and sending a fourth request message, where the The four request messages are used to request independent verification information of the Gth data block, receive independent verification information of the Gth data block, and verify the integrity of the Gth data block according to the independent verification information of the Gth data block.

A system for verifying the integrity of streaming media content includes: the streaming media server and the terminal device. In the embodiment of the present invention, the streaming media server processes the source streaming media file to obtain a post-streaming media file, where the data block in the post-streaming media file carries the verification information of the next data block, and the streaming media server further constructs the post-streaming media file. Independent verification information for each of the data blocks in each, and these independent verification letters The information is saved separately. Therefore, the embodiment of the present invention can ensure that all data blocks in the downloaded media file downloaded by the terminal device can be continuously verified, and the transmission overhead required for the terminal device to download the streaming media file is small. DRAWINGS

1 is a schematic flow chart of Embodiment 1 of a method for verifying the integrity of streaming media content in an embodiment of the present invention;

2 is a schematic diagram of a Merkle tree in an embodiment of the present invention;

3 is a schematic flow chart of Embodiment 2 of a method for verifying the integrity of streaming media content in an embodiment of the present invention;

4 is a schematic flow chart of Embodiment 3 of a method for verifying the integrity of streaming media content in an embodiment of the present invention;

5 is a schematic diagram of a logical structure of a fourth embodiment of a streaming media server according to an embodiment of the present invention; FIG. 6 is a schematic structural diagram of a fifth embodiment of a terminal device according to an embodiment of the present invention; A logical structure diagram of Embodiment 6 of a system for verifying the integrity of streaming media content. detailed description

The embodiment of the invention provides a method for verifying the integrity of the content of the streaming media. The embodiment of the invention further provides a corresponding device and system. The details are described below separately. Embodiment 1 Referring to FIG. 1 , an embodiment of a method for verifying integrity of streaming media content in an embodiment of the present invention includes:

101. Read the source streaming media file.

In the streaming media system, the streaming media content exists in the form of a file. When a new source streaming media file is added to the service provider's streaming media server, the streaming media server divides the source streaming media file into a series of Fragmentation, each fragment includes a certain number of data blocks, wherein the data block is the smallest unit of network transmission, the ordering of the fragments and the ordering of all the data blocks are arranged in order from the front to the back according to the playing order of the streaming media content. The streaming media server needs to process the source streaming media file in units of fragments to generate a post-streaming media file. When the streaming media content is published, the streaming media server is a post-release streaming media. The file, wherein the serial number of the fragment of the post-streaming media file corresponds to the serial number of the fragment of the source streaming media file.

In this embodiment, the process of processing the source streaming media file by the streaming media server is described by taking the Nth fragment of the source streaming media file as an example, where the Nth fragment includes M data blocks.

102. Constructing a streaming media file;

The streaming media server reads the Nth fragment of the source streaming media file, where the Nth fragment includes M data blocks, and the identifiers of the M data blocks are B _N , ₁ B _N , ₂ , .. . , B _N , M, the process of constructing the Nth slice of the stream media file is as follows: The remaining fragments of the source stream file except the first slice are processed in the same way as the Nth slice:

1. The last data block B _N , _{M is} used as the last data block of the Nth slice of the post-stream media file, that is, the Mth data block of the Nth slice of the post-stream media file;

2. The hash summary algorithm (for example, MD5, SHA-1) has low computational overhead and high security. In this embodiment, in order to reduce the verification overhead, the streaming media server uses a hash digest algorithm to calculate the data block. verify message.

The data block B _N , M calls the hash summary function h ( ), obtains the hash value h ( B _N , M ), and then adds the hash value h ( B _N , Μ ) to the end of the data block Β _Ν , _Μ4 , The data block B ' _N , _M _ _{l is} used as the M-1th data block of the Nth slice of the post-streaming media file, and then the hash digest function h ( ) is generated to generate the data block B' _N . after the end of the Xi value h (BN, Mi), the hash value h (BN, MI) added to the data block B _N, constituting a data block B _'N, M_ _2, the data block B' _N, M_ ₂ as The M-2th data block of the Nth slice of the streaming media file continues the above operation until the first data block of the Nth slice of the streaming media file is constructed. After all the fragments of the source streaming media file are processed, the streaming media server obtains a post-streaming media file, and the data blocks of each fragment of the subsequent streaming media file are connected to each other in a hash chain.

Since the distribution of the streaming media content is performed by the node-assisted distribution scheme, the streaming media server saves the backup of all the fragments of the streaming media file, and stores the fragments in each terminal device in the streaming media system for request playback. The terminal device downloads the streaming media content. In this embodiment, the streaming media server also stores the corresponding relationship between the scatter-segmented shards and the terminal device that holds the shards in a directory server, and the directory server may be Streaming media server, can also be another a separate server, the terminal device requesting to play the streaming media content may obtain a list of addresses of the terminal devices having a better state of a certain fragment from the directory server, and sequentially request the other terminal device to download the fragment according to the address list. During the download process, if the other terminal device cannot provide the fragment, the terminal device requests the streaming server to provide the fragment.

Further, in order to improve the speed at which the terminal device downloads the streaming media content, the terminal device may draw a buffer of a certain capacity in its own memory, and download multiple fragments of the streaming media file in parallel, so that the terminal device is downloaded in succession. Parallelism, the terminal device can also verify these parallel downloaded fragments in parallel. For example, the process of constructing the Nth fragment of the post-streaming media file by the streaming server is as an example, and the process further includes:

3. When the first data block of the Nth fragment of the streaming media file is constructed, the streaming server calls the hash digest function to generate the first data block of the Nth fragment of the streaming media file. The hash value is added to the first data block of the shard that is consecutively located before the Nth shard in the post-streaming file, and the hash value is added to the Nth of the post-streaming file. - in the first data block of the 1 slice, in the first data block of the N-2th slice, ..., and in the first data block of the NX slice, wherein the X value is in accordance with The size of the buffer that the terminal device draws in its own memory.

103. Construct independent verification information of the streaming media file.

Because the hash chain is not applicable to the scenario where the data block of the post-streaming media file is randomly lost, in order to enable the service provider to provide fast and smooth video playing services, the terminal device must be able to absolutely verify the integrity of the streaming media content, so the terminal device It is necessary to be able to obtain independent verification information for all data blocks of the post-streaming media file. In this embodiment, the streaming media server uses a Merkle tree-based tree chain to construct independent verification information for each data block in the post-streaming media file. The specific process is as follows:

All the shards of the post-streaming media file construct a Merkle tree. Assuming that the post-streaming media file has two shards, each shard has four data blocks. The process of constructing the Merkle tree is as follows: Each leaf of the Merkle tree The node D _s , _t is composed of a hash value of a data block B _s , _t , that is, D _s , _t =h ( B _s , _t ), where s is the sequence number of the slice, and t is the data block at the The sequence numbers in the _s slices, D _s , _t are arranged in the Merkle tree in the right-to-left order from the hash value of the last data block of the last slice of the post-streaming file. In the lowest layer, that is to say the structure of the Merkle tree is from the second slice At the beginning of the last data block, the hash values of all the child nodes under each parent node of the Merkle tree are concatenated together and then hashed to obtain their parent nodes, which is determined by the following formula.

D _s , b~s. ch ( D _s , b~s. ( b+cl ) /2, D _s , ( b+c+1 ) /2~s, c )

Where D _s , _b represents the leaf node corresponding to the bth data block of the sth slice; D _s , c represents the leaf node corresponding to the cth data block of the sth slice; D _s , _b ~ _s , _c represents the parent node of the leaf node corresponding to the data block between the bth data block and the cth data block of the sth slice.

For example, D _{L 4} =h ( D _L !^, 2 , D _L 3-1 , 4 ), this process continues until it is obtained

The root node of the Merkle tree is h _ra . _t , then h _ra to the root node. _t digitally sign and obtain the digital signature information sign ( h _ro . _t ) of the root node. The Merkle tree should be a binary balanced tree. If the Merkle tree is unbalanced, the balanced binary tree balancing algorithm is called to rebalance the Merkle tree. The Merkle tree constructed according to all the shards of the post media file is shown in Figure 2.

After constructing the Merkle tree, the streaming server adds the complete information of the data block on the verification path of the Merkle tree to the data block as the verification information of the data block, and the verification path is composed of one node on each layer of the tree. These nodes are from the sibling node on the leaf path to the next layer node of the root node. For data block ₃ , its verification information is: sign ( h _r .. _t ), D ₂ , ^ _2A , Di, _w , ₂ , ₄ , and the sequence number 3 of the data block and the sequence number 1 of the fragment containing the data block. The independent verification information of a data block includes: a digital signature information sign (h _ra . _t ) of the root node, and a brother of each layer node (except the root node) corresponding to the leaf node to the root node corresponding to the data block The node, and the sequence number of the data block, and the sequence number of the fragment containing the data block.

If a single Merkle tree is used, the size of the complete information of the verification path of a block in the post-streaming file may exceed the capacity of the largest data structure that the network can transmit. To prevent this from happening, the independent verification information of the data block of the post-stream media file can be constructed into multiple Merkle trees, and the length of the complete information of the verification path of each Merkle tree is limited to the length of the largest data block.

Still suppose that the post-streaming media file has two shards, each shard has four data blocks, and the current processing to the data block B ₂ , ₁ traverses the current Merkle tree, and finds a hash value h ( B ₂ , ) The position of the leaf node D ₂ , ₁ in the ^^^6 tree, that is, the leftmost end of the current Merkle tree. If you insert the leaf node D ₂ ,! After the leaf node D ₂ , the size of the complete information of the verification path to the root node has exceeded the capacity of the largest data structure that the network can transmit, then the leaf node D ₂ , the Merkle tree, and the leaf are saved. Node D ₂ , as the first leaf node of the newly created Merkle tree, creates a new Merkle tree.

The independent verification information of all the data blocks in the post-streaming media file is separately saved. In this embodiment, the independent verification information of all the data blocks in the post-streaming media file may be saved in the verification server, and the verification server may be the streaming media server. , or it can be another separate server.

In this embodiment, the streaming media server processes the source streaming media file to obtain a post-streaming media file, where the data block in the post-streaming media file carries the verification information of the next data block, and the streaming media server also constructs the post-streaming media file. The independent verification information of each of the data blocks is saved separately. Therefore, this embodiment can ensure that all the data blocks in the post-streaming media file downloaded by the terminal device can be continuously verified and the terminal device is downloaded. The transmission overhead required for streaming media files is small, and the verification information of the first data block of the fragment is signed with a digital signature, effectively eliminating the possibility that the verification information of the first data block is forged, and ensuring adoption. The reliability of the verification information of the subsequent data blocks of the fragment constructed by the hash chain. The first embodiment describes a method for verifying the integrity of the streaming media content from the perspective of the streaming media server. The method for verifying the integrity of the streaming media content will be described from the perspective of the terminal device.

Embodiment 2 Referring to FIG. 3, an embodiment of the present invention further provides another embodiment of a method for verifying integrity of a streaming media content, including:

301. Send a first request message.

When the terminal device needs to play a certain streaming media content, the terminal device starts to request the download of the downstream media file including the streaming media content. In essence, the terminal device is a fragment of the downloaded streaming media file. In this embodiment, the terminal device sequentially requests downloading from the first fragment of the post-streaming media file, but the time required for each fragment to be sent from the sender to the terminal device to receive the entire process may be due to network or the like. The difference is that the verification of the shard by the terminal device does not necessarily start with the first shard.

When the terminal device downloads a certain fragment, the terminal device may first request, from the directory server, a set of terminal devices that can provide the fragment, and the directory server returns a state with a better state according to the state of the terminal device that owns the fragment. The address list of the group terminal device, the terminal device sequentially selects a terminal device from the address list according to the address list returned by the directory server, and sends the fragment download request until the terminal device responds, if no terminal device can provide the fragment , the terminal device will request the flow The media server provides the shard. After the downloading starts, the terminal device performs streaming content integrity verification on the received fragment from the first data block of the fragment, and since the received fragment does not carry the verification information of the first data block of the fragment, In this embodiment, the terminal device sends a first request message to the verification server, where the first request message is used to request the verification information of the first data block received by the terminal device.

302. Receive independent verification information of the first data block.

The terminal device receives the independent verification information of the first data block from the verification server. In this embodiment, the independent verification information of all the data blocks of the post-stream media file saved by the verification server is adopted in the embodiment 1 shown in FIG. The same Merkle tree-based tree chain construction.

303. Verify the first data block.

In this embodiment, it is still assumed that the post-streaming media file has two shards, each of which has four data blocks, and the Merkle tree constructed according to all the shards of the post-media file is as shown in FIG. 2, and the first sub-segment The independent verification information of the first data block of the slice is: sign ( h _rt , D ₂ , ι.2, ₄ , ₃ ~i, ₄ , D _{L 2 )} . The verification process of the first data block by the terminal device is as follows:

1. Verify the integrity of the sign ( h _root ) carried by the first data block by the same method of digitally signing the root node of the Merkle tree. If the verification result is that sign ( h _root ) is complete, perform the following verification. The step of streaming media content integrity of the first data block;

2. Using a hash algorithm to generate a hash value of the first data block;

3. Use the hash algorithm to calculate the parent node on the Merkle tree, ie _w , ₂ =h ( D ₁ Di, 2 ), D'i, ι~ι, 4— h ( D'i, ₂ , Di, ₃ ~i, 4 ), h' _root =h ( D 4 , D ₂ , i~ ₂ , 4 );

4, the h _{_r} h _'r t with a data block carried by the first digital signature sign (h _root) of. . _t for comparison. If they are the same, the first data block is complete.

304. Verify other data blocks.

When the first data block is verified to be complete, the verification information of the second data block of the same slice is extracted from the first data block, that is, the true hash value of the second data block, the terminal device The received second data block is calculated by using a hash digest algorithm, and the calculated hash value is compared with the real hash value. If they are the same, the second data block is complete. When the second data block is verified to be complete, the verification of the third data block of the same slice is extracted from the second data block. The information, that is, the true hash value of the third data block, the terminal device uses the hash digest algorithm to calculate the received third data block, and compares the calculated hash value with the actual hash value, if The same, the third data block is complete. Continue to verify subsequent blocks of the same slice until the last block of the same slice is verified.

Due to various reasons such as network packet loss and out-of-order, before the last data block of the fragment is completed, the terminal device will verify that the verification information of the data block is missing when verifying the integrity of a data block. Therefore, the terminal device requests independent verification information of the data block from the verification server, and uses the independent verification information of the data block sent by the verification server to verify the integrity of the data block. This process and the process of verifying the first data block in step 203 can be performed. The same is true, and the difference is that when the terminal device receives the independent verification information of the data block from the verification server, the data block is extracted on the Merkle tree according to the independent verification information of the data block. The verification path, stepwise constructing the nodes on the verification path along the verification path, and when constructing to a node, if the content of the node with the same sequence number that was saved when verifying the integrity of other data blocks is the same, the configuration verification is stopped. The remaining nodes on the path, save the constructed node, the verification result is that the data block is finished of. Examples are as follows:

It is still assumed that the post-streaming media file has two shards, each shard has four data blocks, and the Merkle tree constructed according to all the shards of the post media file is as shown in FIG. 2. If the second data block of the first fragment is lost, and the integrity of the third data block of the first fragment needs to be verified, the terminal device requests the third data block of the first fragment from the verification server. The independent verification information, according to the independent verification information of the data block, extracts the verification path of the data block on the Merkle tree, and gradually constructs the node on the verification path along the verification path, because the first one of the first fragment is verified. In the case of a data block, when the first data block of the first fragment is complete, the constructed node D'L w (D , ₄ ) is the node W of the Merkle tree as shown in FIG. 2 (DL). The true value of _w , ₄ ), so as long as the hash value of the node of the same sequence number generated during the process of verifying the third data block of the first slice is the same as the constructed node W, the first one can be judged The third data block of the slice is complete. When the third data block of the first slice is complete, the terminal device extracts the first branch from the third data block of the first slice. The fourth block of the slice, continue to verify the fourth of the first slice Data block, until the complete integrity of the last data block of the first slice of the verification.

For each shard, the terminal device sets a counter for the corrupted data block with a preset value of 0. When verifying that a data block is broken, its processing flow is as follows:

1. The terminal device adds 1 to the counter of the damaged data block and discards the data block;

2. If the data block is indispensable, the terminal device requests the terminal device or the streaming server that provides the fragment to download the data block.

3. If the counter of the damaged data block exceeds a preset threshold, the fragment is judged to be broken. The terminal device will request to download the fragment to other terminal devices or streaming servers that can provide the fragment.

Further, in order to improve the speed of the streaming media file after the terminal device downloads, the terminal device may allocate a buffer of a certain capacity in its own memory, and download multiple fragments of the streaming media file in parallel, so that the terminal device fragment is considered. The parallelism of the download, the terminal device can also carry out the risk identification of these parallel downloaded segments in parallel, specifically:

Assuming that the backstream media file has 4 shards, after the first data block of the first shard is verified to be complete after being verified in step 203, the terminal device except the first data block from the first shard Extracting the verification information of the second data block of the first fragment, and extracting the verification information of the first data block of the subsequent three fragments from the first data block of the first fragment, if the terminal device has already Start to download all the fragments in parallel, so the terminal device can verify the integrity of the second data block of the first fragment and the first data block of the subsequent three fragments in parallel until the parallel insurance completes all the fragments. Integrity.

In this embodiment, the terminal device extracts the first data block of the fragment from the verification server by using the independent verification information of all the data blocks stored in the verification server, without the verification information of all the data blocks being missing. Verification information, and then continuous integrity verification of subsequent data blocks. If the verification information of a certain data block is missing, the independent verification information of the data block is extracted from the verification server, and the subsequent data blocks can be continuously performed. Integrity verification, so in this embodiment, the terminal device can continuously perform integrity verification on all received data blocks, effectively eliminating the possibility of leaking damaged data blocks. The video player service provided by the service operator allows the user to pass the video cassette recorder (Video

The Cassette Recorder (VCR) operation jumps forward or backwards into the watched video, which causes the next played data block not necessarily to be buffered and verified by the data block. The following will operate the VCR on the terminal device. The process of verifying the integrity of the data block in the scenario is described in detail. Embodiment 3 Referring to FIG. 4, an embodiment of the present invention further provides another embodiment of a method for verifying integrity of a streaming media content, including:

401. Receive an indication message of the user.

When the user wants to jump forward or backward in the video provided by the service provider, the user can perform these operations through the VCR operation button on the remote controller. The terminal device receives the indication message of the user, and the terminal device can learn from the indication message that the data block to be played by the user specified by the VCR operation is known.

402. Determine a location of a data block to be played;

The terminal device determines, according to the received indication message, the location of the data block to be played in all the data blocks in the post-streaming media file. In this embodiment, the post-streaming media file has two fragments, and the first fragment has eight fragments. Data blocks. The terminal device determines, according to the received indication message, the location of the data block to be played in all the data blocks in the backstream media file as the third data block of the first fragment.

403, determine whether the data block to be played has been buffered, if not, then perform step 404 and step 405, and if so, proceed to step 406;

After determining that the data block to be played is the third data block of the first slice, the terminal device determines whether the third data block of the first slice has been buffered.

404. Download a slice that includes a data block to be played;

If the data block to be played is not buffered, the terminal device downloads the fragment containing the data block, that is, the terminal device downloads a slice. In this embodiment, the terminal device does not have the data block to be played. In the case of buffering, downloading the fragment containing the data block to be played instead of downloading the data block to be played and the subsequent data block of this data block is because in the streaming media system, the post-streaming media file is released. The node-assisted distribution scheme, therefore, it is more convenient to request to download a slice than to request the download of the data block to be played and the subsequent data block of this data block.

405. Verify the integrity of the data block and subsequent data blocks to be played;

Although the data block to be played is not buffered, in order to improve the smoothness of the video broadcast service of the service provider, the terminal device does not start streaming the content from the first data block containing the slice of the data block to be played. Sexual verification, but request independent verification information of the data block to be played (the third data block of the first fragment) from the verification server, and receive independent verification information of the data block to be played from the verification server, according to Independent verification information of the played data block verifies the data to be played Block integrity, when the data block to be played is complete, that is, the third data block of the first fragment is complete, the terminal device extracts the fourth data block of the first fragment The verification information, when the fourth data block of the first fragment is complete, extracts the verification information of the fifth data block of the first fragment, and the terminal device continues to operate until the verification is completed. For the verification information of the eighth data block of a slice, refer to the second embodiment shown in FIG. 3 for a more detailed verification process.

406, determining whether the data block to be played has passed the integrity verification, and if so, executing step 407, if not, executing step 408;

If the data block to be played has been buffered, the terminal device determines whether the data block to be played has passed the integrity verification, and if so, plays the data block to be played, and if not, the terminal device re-downloads to be played. The data block, the terminal device performs integrity verification on the data block to be played according to the verification information of the data block to be played extracted from the previous data block of the data block to be played, and the verification process is more detailed. Embodiment 2 shown in FIG.

It should be noted that the user can also jump forward or backward continuously through the VCR operation, or jump forward and then jump backwards, etc. The operation of the terminal device is similar to the above process. I won't go into details.

407. Play a data block to be played;

The terminal device starts playing the video according to the VCR operation.

408. Re-download and verify the integrity of the data block to be played.

In this embodiment, when the user views the video through the VCR operation, the terminal device uses the independent verification information provided by the verification server to verify the data block to be played, in the case that the data block to be played is not buffered, In the case where the played data block is buffered, the verification information of the data block to be played extracted from the previous data block of the data block to be played is subjected to integrity verification on the data block to be played, and therefore, In this embodiment, the terminal device can perform integrity verification of the data block in the VCR operation scenario. The following describes the streaming media server in the embodiment of the present invention. Referring to FIG. 5, an embodiment 4 of the streaming media server in the embodiment of the present invention includes:

The read fragment unit 501 is configured to read the Rth slice of the source streaming media file, where the Rth slice includes Z data blocks; The post-construction media file unit 502 is configured to calculate the Z-th data block of the Rth slice as the Z-th data block of the Rth slice of the R-stream file, and calculate the verification information of the Z-th data block. Adding the verification information of the Zth data block to the Z-1th data block to generate the Ζ-Γ data block, and using the Ζ-Γ data block as the Zth of the Rth slice of the post-streaming media file - 1 data block, then calculate the verification information of the Ζ-Γ data block, add the verification information of the Ζ-Γ data block to the Z-2 data block to generate the Z-2'th data block, The Z-2th data block is used as the Z-2th data block of the Rth slice of the post-streaming media file, and the above operation is continued until the first R of the R-slice of the streaming media file is constructed. The data block is configured to construct an independent verification information unit 503 for constructing independent verification information of each data block in the post-streaming media file, and separately storing the independent verification information of each data block in the post-streaming media file. Specifically, the configuration independent verification information unit 503 may use the Merkle tree-based tree chain to construct independent verification information of each data block of the Rth slice in the stream media file.

In order to improve the speed at which the terminal device downloads the streaming media content, the terminal device can draw a buffer of a certain capacity in its own memory, and download multiple fragments of the streaming media file in parallel, thus considering the parallelism of the terminal device fragment downloading. Further, the constructed streaming media file unit 502 is further configured to: when constructing the first data block of the Rth slice of the streaming media file, calculate the first of the Rth fragments of the streaming media file The verification information of the data block, the verification information of the first data block of the Rth slice of the post-stream media file is added to the first one of the plurality of consecutive segments located in front of the Rth slice in the post-stream media file In the data block, specifically, the constructed media file unit 502 can determine the number of fragments that are consecutively located before the Rth slice according to the size of the buffer of the terminal device.

The terminal device in this embodiment may be the same as the terminal device in the fifth embodiment shown in FIG. 6. The following describes the terminal device in the embodiment of the present invention. Referring to FIG. 6, an embodiment 5 of the terminal device in the embodiment of the present invention includes:

The sending request message unit 601 is configured to send a third request message, where the third request message is used to request independent verification information of the first data block of the current fragment of the received post-streaming media file, and the fragment includes S data block;

The receiving verification information unit 602 is configured to receive, after the sending request message unit 601 sends the third request message, the independent verification information of the first data block of the fragment;

a verification integrity unit 603, configured to verify the first one according to the independent verification information of the first data block The integrity of the data block, when the first data block is complete, starting from the first data block, extracting the s+1th data block of the slice from the sth data block that has been verified as complete Verification information, verifying the integrity of the s+1th data block of the slice according to the verification information of the s+1th data block, until the integrity of the Sth data block of the slice is verified, s from 1 Up to S-1, before verifying the integrity of the Sth data block of the fragment, when the verification information of the Gth data block is missing, G is any integer from 2 to S, and sends a fourth request message. The fourth request message is used to request independent verification information of the Gth data block, receive independent verification information of the Gth data block, and verify the integrity of the Gth data block according to the independent verification information of the Gth data block.

Further, the verification integrity unit 603 may include a verification subunit 604, and the verification subunit 604 is configured to receive independent verification information of the Gth data block, and extract the Gth data block according to the independent verification information of the Gth data block. The verification path on the Merkle tree, stepwise constructing the nodes on the verification path along the verification path of the Gth data block on the Merkle tree, when constructing to a node, if it is verifying the integrity of other data blocks If the contents of the saved nodes of the same sequence number are the same, then the remaining nodes on the verification path are stopped, and the constructed nodes are saved, and the Gth data block is complete.

In order to improve the speed at which the terminal device downloads the streaming media content, the terminal device can draw a buffer of a certain capacity in its own memory, and download multiple fragments of the streaming media file in parallel, thus considering the parallelism of the terminal device fragment downloading. Further, the verification integrity unit 603 is further configured to: when the first data block is complete, extract the first data block of the i slices consecutively located after the current slice from the first data block. Verification information, verifying the integrity of the first data block of the i slices in parallel according to the verification information of the first data block of the i slices, and including the fragment of the complete first data block in the i slices The same verification method is used together with the current slice to verify the integrity of the remaining data blocks in parallel.

In order to enable the terminal device to perform the streaming content integrity verification of the data block in the VCR operation scenario, the terminal device further includes:

The receiving indication message unit 605 is configured to receive an indication message of the user, where the indication message is used to specify a data block to be played by the VCR operation;

The VCR executing unit 606 is configured to determine, according to the indication message received by the indication message unit 605, the position of the data block to be played in all the data blocks in the post-streaming media file; determine whether the data block to be played has been buffered, if The data block to be played is not buffered, according to the data block to be played back. The location in all the data blocks in the streaming media file downloads the fragment containing the data block to be played, and the sending request message unit 601 requests the independent verification information of the data block to be played, and receives the independent verification of the data block to be played. Information, verifying the integrity of the data block to be played according to the independent verification information of the data block to be played; if the data block to be played has been buffered, it is determined whether the data block to be played has passed the integrity verification, if , playing the data block to be played, if not, re-downloading the data block to be played, according to the verification information of the data block to be played extracted from the previous data block of the data block to be played. The data block to be played is subjected to integrity verification. The system for verifying the integrity of the streaming media content in the embodiment of the present invention is described below. Referring to FIG. 7, an embodiment 6 of the system for integrity of streaming media content in the embodiment of the present invention includes:

The streaming media server 701 and the terminal device 702, it should be noted that the streaming media server 701 in this embodiment may be the same as the streaming media server shown in FIG. 5, and the terminal device 702 in this embodiment may be the same as the foregoing FIG. The terminal devices are the same, and those skilled in the art can understand that all or part of the various methods of the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a In a computer readable storage medium, the storage medium may include: a ROM, a RAM, a magnetic disk or an optical disk, and the like.

The method, device and system for verifying the integrity of the streaming media content provided by the embodiments of the present invention are described in detail. The principles and implementation manners of the present invention are described in the specific examples. The description of the above embodiments is only used. To help understand the method of the present invention and its core ideas; at the same time, for those of ordinary skill in the art, in accordance with the idea of the present invention, there will be changes in the specific embodiments and applications, and in summary, the present specification The content should not be construed as limiting the invention.

Claims

Rights request

A method for verifying integrity of a streaming media content, comprising:

The streaming media server reads the Nth fragment of the source streaming media file, the fragment includes M data blocks; and the Mth data block of the fragment is used as the Nth fragment of the post-streaming media file. M data blocks, starting from the Mth data block of the Nth slice of the post-streaming media file, calculating verification information of the mth data block of the Nth slice of the post-streaming media file, Adding the verification information of the mth data block to the m-1th data block of the Nth slice of the source streaming media file to generate the mth-th data block, and using the m-th data block as the The m-1th data block of the Nth slice of the subsequent streaming media file, until the first data block of the Nth slice of the subsequent streaming media file is constructed, m is from M to 2;

The independent verification information of each data block of the Nth slice in the post-streaming media file is constructed, and the independent verification information is separately stored.

The method according to claim 1, wherein the independent verification information of each data block of the Nth slice in the back stream media file is configured as follows:

The Merkle tree-based tree chain is used to construct independent verification information for each data block of the Nth slice in the post-streaming media file.

The method according to claim 1 or 2, further comprising:

When the first data block of the Nth fragment of the post-streaming media file is constructed, the verification information of the first data block of the Nth fragment of the post-streaming media file is calculated, and the back stream is The verification information of the first data block of the Nth slice of the media file is added to the first data block of the plurality of consecutive segments located in front of the Nth slice in the subsequent streaming media file.

4. The method of claim 3, wherein

The number of shards that are consecutively located before the Nth shard is determined by the size of the buffer of the terminal device.

5. A method for verifying integrity of a streaming media content, comprising:

The terminal device sends a first request message, where the first request message is used to request independent verification information of the first data block of the slice of the received downstream media file, where the fragment includes K data blocks;

Receiving independent verification information of the first data block;

Verifying the integrity of the first data block according to the independent verification information of the first data block, when the first When a data block is complete, starting from the first data block, extracting the verification information of the k+1th data block of the slice from the kth data block that has been verified as complete, according to the The verification information of the k+1 data blocks verifies the integrity of the k+1th data block of the slice until the integrity of the Kth data block of the slice is verified, k is from 1 to K-1 ;

Before verifying the integrity of the Kth data block of the fragment, when the verification information of the Tth data block is missing, T is any integer from 2 to K, and sending a second request message, the The second request message is used to request independent verification information of the Tth data block, receive independent verification information of the Tth data block, and verify the integrity of the Tth data block according to the independent verification information of the Tth data block.

The method according to claim 5, wherein the independent verification information of the data block of the back stream media file is constructed by using a Merkle tree-based tree chain, and receives independent verification information of the Tth data block. Verifying the integrity of the Tth data block according to the independent verification information of the Tth data block, specifically:

Receiving independent verification information of the Tth data block;

Extracting, according to the independent verification information of the Tth data block, a verification path of the Tth data block on the Merkle tree, and gradually constructing a node on the verification path along the verification path, when constructing to a certain node If the content of the node with the same sequence number that was saved when verifying the integrity of other data blocks is the same, then the remaining nodes on the verification path are stopped, and the constructed node is saved, and the Tth data block is complete.

The method according to claim 5 or 6, further comprising:

When the first data block is complete, the verification information of the first data block of the j fragments consecutively located after the fragment is extracted from the first data block, according to the j fragments The verification information of the first data block verifies the integrity of the first data block of the j fragments in parallel, and includes the fragment of the complete first data block in the j fragments and the front of the j fragments The shards together use the same verification method to verify the integrity of the remaining data blocks in parallel.

8. The method according to claim 7, further comprising:

Receiving an indication message of the user, where the indication message is used to specify a data block to be played by the VCR operation of the video cassette recorder;

Determining, according to the indication message, all the data blocks to be played in the post-streaming media file According to the location in the block;

Determining whether the data block to be played has been buffered, and if the data block to be played is not buffered, downloading the location of all the data blocks in the post-streaming file according to the data block to be played contains the content to be played. Fragmentation of the data block, requesting independent verification information of the data block to be played, receiving independent verification information of the data block to be played, verifying that the data will be played according to the independent verification information of the data block to be played. The integrity of the data block;

If the data block to be played has been buffered, it is judged whether the data block to be played has passed the integrity verification, and if so, the data block to be played is played, and if not, the data block to be played is re-downloaded, according to The verification information of the data block to be played extracted from the previous data block of the data block to be played is subjected to integrity verification on the data block to be played.

9. A streaming media server, comprising:

Reading a fragmentation unit, configured to read an Rth fragment of the source streaming media file, where the fragment includes Z data blocks;

Constructing a post-streaming file unit, configured to use the Zth data block of the slice as the Zth data block of the Rth slice of the post-streaming media file, from the Rth sub-stream of the post-streaming media file Starting with the Zth data block of the slice, calculating verification information of the zth data block of the Rth slice of the poststream media file, by adding verification information of the zth data block to the source streaming media file The Z-1th data block of the Rth slice generates the z-1th data block, and the ζ-Γ data block is used as the z-1th of the Rth slice of the post-streaming file. Data block until the first data block of the Rth slice of the stream media file is constructed, z from Z to 2;

Constructing an independent verification information unit, configured to construct independent verification information of each data block of the Rth slice in the post-streaming media file, and separately storing the independent verification information.

10. The streaming server according to claim 9, wherein:

The constructing independent verification information unit constructs independent verification information of each data block of the Rth slice in the post-stream media file by using a Merkle tree-based tree chain.

11. The streaming server according to claim 9 or 10, characterized in that

The post-construction streaming media file unit is further configured to: when constructing the first data block of the Rth fragment of the post-streaming media file, calculate the first of the Rth fragments of the post-streaming media file Data block Verifying information, adding verification information of the first data block of the Rth slice of the post-streaming file to the first of the plurality of consecutively located R-slices in the post-streaming file In the data block.

The streaming media server according to claim 11, wherein the constructed media file unit determines the number of fragments that are consecutively located before the Rth slice according to the size of the buffer of the terminal device.

13. A terminal device, comprising:

And a sending request message unit, configured to send a third request message, where the third request message is used to request independent verification information of the first data block of the slice of the received downstream media file, where the fragment includes S data Piece;

a verification integrity unit, configured to verify the integrity of the first data block according to the independent verification information of the first data block, when the first data block is complete, starting from the first data block, Verifying that the verification information of the s+1th data block of the fragment is extracted from the complete sth data block, and verifying the s+ of the fragment according to the verification information of the s+1th data block. The integrity of one data block, until the integrity of the Sth data block of the slice is verified, s from 1 to S-1;

Before verifying the integrity of the Sth data block of the slice, when the verification information of the Gth data block is missing, G is any integer from 2 to S, and the send request message unit is also used to send the first a fourth request message, the fourth request message is used to request independent verification information of the Gth data block, and the received verification information unit is further configured to receive independent verification information of the Gth data block, and perform independent verification according to the Gth data block. The information verifies the integrity of the Gth data block.

14. The terminal device according to claim 13, wherein

The verification integrity unit is specifically configured to receive the independent verification information of the Gth data block, and extract the verification path of the Gth data block on the Merkle tree according to the independent verification information of the Gth data block. The verification path gradually constructs a node on the verification path, and when constructing to a node, if the content of the node of the same serial number that has been saved when verifying the integrity of other data blocks is the same, stopping the construction of the verification The remaining nodes on the path, save the constructed nodes, the Gth data block is complete.

The terminal device according to claim 13 or 14, wherein

The verification integrity unit is further configured to: when the first data block is complete, extract, from the first data block, the verification of the first data block of the i slices consecutively after the fragment Information, verifying the integrity of the first data block of the i fragments in parallel according to the verification information of the first data block of the i fragments, and including the complete first data block in the i fragments The shards are used in parallel with the shards preceding the i shards to verify the integrity of the remaining data blocks in parallel using the same verification method.

The terminal device according to claim 15, further comprising:

Receiving an indication message unit, configured to receive an indication message of a user, where the indication message is used to specify a data block to be played by a VCR operation;

a VCR execution unit, configured to determine, according to the indication message, a position of a data block to be played in all data blocks in the post-streaming file; determine whether a data block to be played has been buffered, if it is to be played The data block is not buffered, and the fragment containing the data block to be played is downloaded according to the position of the data block to be played in all the data blocks in the post-streaming file, and the request is sent by the sending request message unit. Independent verification information of the data block, receiving independent verification information of the data block to be played, verifying the integrity of the data block to be played according to the independent verification information of the data block to be played; if the data to be played The block has been buffered to determine whether the data block to be played has passed the integrity verification. If so, the data block to be played will be played. If not, the data block to be played will be re-downloaded, according to the data to be played. The verification information of the data block to be played back extracted from the previous data block of the block performs integrity verification on the data block to be played.

17. A system for verifying the integrity of streaming media content, comprising:

A streaming media server according to any one of claims 9 to 12 and a terminal device according to any one of claims 13 to 16.