US20160330484A9 - Method and System for Determining a Quality Value of a Video Stream - Google Patents
Method and System for Determining a Quality Value of a Video Stream Download PDFInfo
- Publication number
- US20160330484A9 US20160330484A9 US14/551,869 US201414551869A US2016330484A9 US 20160330484 A9 US20160330484 A9 US 20160330484A9 US 201414551869 A US201414551869 A US 201414551869A US 2016330484 A9 US2016330484 A9 US 2016330484A9
- Authority
- US
- United States
- Prior art keywords
- video stream
- intra coded
- frame
- data packet
- data packets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title description 28
- 238000007430 reference method Methods 0.000 description 7
- 239000003550 marker Substances 0.000 description 6
- 238000001303 quality assessment method Methods 0.000 description 6
- 230000032258 transport Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000006866 deterioration Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 241000246169 Genista Species 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
- H04N19/66—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience involving data partitioning, i.e. separation of data into packets or partitions according to importance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0823—Errors, e.g. transmission errors
- H04L43/0829—Packet loss
- H04L43/0835—One way packet loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/521—Processing of motion vectors for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
Definitions
- the invention relates to a method, system and computer readable medium for determining a quality value of a video stream.
- the methods for video quality assessment include subjective methods and objective methods.
- the subjective methods typically involve human assessors, who grade or score video quality based on their subjective feelings, and use the grades or scores obtained in such a subjective way for video quality assessment.
- the objective methods do not involve human assessors and assess the video quality only by using information obtained from the video sequences.
- the objective video quality assessment methods can be further classified into full-reference methods, reduced-reference methods, and no-reference methods.
- Full reference models are available on the market and, for example, include Perceptual Evaluation of Video Quality by OPTICOM, Optimacy tool from Genista Corporation and products from Psytechnics Ltd and National Telecommunications and Information Administration.
- Both the full-reference methods and the reduced-reference methods need reference information about the original video (i.e. the video actually transmitted from the transmitting side) to conduct the video quality assessment and thus cannot be used for real-time in-service video quality assessment.
- the no-reference methods do not require the reference information of the original video. Instead, the no-reference methods make observations only on decoded video (i.e. the video that has been received and decoded on the receiving side) and estimate the video quality using only the observed information on the decoded video.
- the first one is coding and compression of video sources and the second one is data packet loss during transmission, i.e. during the streaming of the video content.
- Another source of video quality decline may be so called packet jitter.
- packet loss metric In an IP network, deterioration in perceived video quality is typically caused by data packet loss. Most packet losses result from congestions in network nodes as more and more packets are dropped off by routers in IP networks when congestion occurs and the severity increases. In case of a wireless communication network, poor radio conditions may cause packet loss. The effect of packet loss is a major problem for real-time video transmission (streaming video). The measurement of the video quality decline caused by packet loss during transmission is referred to as packet loss metric.
- the streamed video is typically coded and compressed by using codecs such as, for example, H.263, MPEG-4, H.264 and VC-1, that utilize temporal predictive coding to improve coding efficiency.
- codecs such as, for example, H.263, MPEG-4, H.264 and VC-1
- Three types of frames are then commonly used: a) intra frames (I-frames) that do not use temporal prediction and serves as a video refresh frame, b) predictive frames (P-frames) and c) bi-predictive frames (B-frames) that are predicted from one or more reference frames.
- I-frames and P-frames usually act as reference frames, and if a part of a reference frame is lost an error resulting from the loss tends to propagate in time until the next I-frame (or P-frame) refreshes the video.
- a number of prior methods for calculating video deterioration due to packet loss have been proposed, of which one is based on estimating a number of lost macro-blocks for each frame type of a video stream.
- Another technique extracts spatial distortion of each image in a video stream using differences between corresponding regions of two adjacent frames in the video sequence. The spatial distortion is weighted based on temporal activities of the video, and the video quality is measured by detecting the spatial distortions of all images in the sequence.
- a method for determining a quality value of a video stream transmitted to a media player comprises the steps of, for a measuring interval of the video stream: identifying at least two lost data packets of the video stream; identifying intra coded frames of the video stream; determining which of the intra coded frames that have a maintained image quality, based on estimating if a lost data packet is associated with an intra coded frame; estimating a distance between each one of the lost data packets and a next respective, subsequent intra coded frame having a maintained image quality; and generating the quality value, based on the distances.
- the quality value is determined for a measuring interval that can be set as a parameter.
- the measuring interval may be a time interval, or a number of sequential data packets or a number of sequential picture frames of the video stream.
- “Lost data packets” also includes any data packet that is not necessarily lost per se but contains information that is corrupt to such an extent that the information of the data packet may not be fully retrieved.
- an intra coded frame is, in this context, a frame which is used as a reference frame for other frames, which means that the video is a compressed video that comprises some picture frames that require the prior decoding of some other picture frame(s) in order to be decoded.
- data forming the picture frames are contained in data packets of the video stream.
- the distance between a lost packet and an intra frame may be given by a time value, or by a number of data packets or by a number of picture frames. This is quite advantageous in that the required calculations for the distance determining are quite fast and straightforward, which means that little computational effort is required by a computer device that performs the method.
- a frame that has a “maintained image quality” is a frame for which no information have been lost during transport.
- the generating of the quality value may comprise weighting of the distances, which is quite advantageous in that the video quality experienced by a user may not always be linear with the distance from a corrupt data packet to an intra coded frame.
- weighting By using weighting, less computational effort is needed in comparison with known technologies, as weighting is a quick operation and allows for a generation of a more subjectively reliable quality value.
- the weighting of a long distance of the distances may be higher than the weighting of a shorter distance of the distances, which produces a more reliable quality value as a user often registers low video quality only after some time, i.e. when the distance from the lost data packet to the intra coded frame is long.
- the long distance and the shorter distance may be estimated for a common intra coded frame, which is particularly relevant since the intra coded frame refreshes the video image.
- the weighting of an estimated distance of a lost data packet associated with an intra coded frame may be relatively higher than the weighting of an estimated distance of a lost data packet associated with a predicted image frame of the video stream, which gives a more reliable quality value since an error in an intra coded frame propagates to the next intra coded frame with a maintained image quality. This weighting is also useful since intra coded frames are added when there is a scene change, and a quality loss in a scene changing intra coded frame will cause the error to be very visible.
- the weighting of distances of two data packets associated with a common image frame may be higher than the weighting of distances of two data packets associated with different image frames, which give a more reliable quality value since many lost data packets for the same image frame significantly reduces the subjectively experienced video quality.
- the data packets may be defined by a real-time transport protocol comprising a marker bit, and an image frame of the video stream may be identified as an intra coded frame in dependence of a marker bit value of a data packet of the image frame, which provides for a computationally efficient image identification process.
- An image frame of the video stream may be identified as an intra coded frame in dependence of if an image size of the image frame is a factor larger than an image size of an average image frame, which, from a computational point of view, increases the efficiency of the method.
- the generating of the quality value may be based on a data packet loss rate.
- data packet loss rate is the relation between the number of lost data packets and the total number of transmitted data packets (during the measure interval).
- a system for determining a quality value of a video stream transmitted to a media player.
- the system is configured to, for a measuring interval of the video stream: identify at least two lost data packets of the video stream; identify intra coded frames of the video stream; determine which of the intra coded frames that have a maintained image quality, based on estimating if a lost data packet is associated with an intra coded frame; estimate a distance between each one of the lost data packets and a next respective, subsequent intra coded frame having a maintained image quality; and generate the quality value, based on the distances.
- a computer readable medium having stored thereon a computer program having software instructions which when run on a computer cause the computer to, for a measuring interval of a video stream, perform the steps of: identifying at least two lost data packets of the video stream; identifying intra coded frames of the video stream; determining which of the intra coded frames that have a maintained image quality, based on estimating if a lost data packet is associated with an intra coded frame; estimating a distance between each one of the lost data packets and a next respective, subsequent intra coded frame having a maintained image quality; and generating the quality value, based on the distances.
- the inventive system and computer readable medium may comprise, be configured to execute and/or having stored software instructions for performing any of the features described above in association with the inventive method, and has the corresponding advantages.
- FIG. 1 illustrates a system implementing the invention
- FIG. 2 is a schematic view of a media player
- FIG. 3 is a schematic view of a video stream
- FIG. 4 is a flow diagram of an embodiment of the inventive method.
- a system implementing the invention comprises a media (video) content server 112 that is connected to a database 113 on which media content such as compressed video is stored.
- the media content server 112 is, via a network 111 , connected to a number of media players such as a TV 114 , a mobile phone 115 and a personal computer 116 or any other electronic device capable of receiving and playing streaming video.
- the media content server 112 is configured to send a compressed video stream via the network 111 to the media players 114 , 115 , 116 which in turn are configured to receive and decode the video stream such that a video content of the stream may be played by the media players 114 , 115 , 116 .
- Sending, receiving and decoding are here done in a conventional manner and all involved devices implements a suitable, known network protocol that supports streaming video.
- FIG. 2 illustrates a media player 211 that is connected (not shown) to the media content server 112 via the network 111 .
- the media player 211 comprises a processor 212 which is connected to a computer readable medium 213 , here in the form of a non-volatile memory such as a hard disk, ROM (Read-Only Memory) and a flash memory, having stored thereon a computer program 214 .
- the computer program 214 comprises software instructions which when run on the media player causes the media player 211 to make the method steps described below.
- a communications interface 215 is also connected to the processor 212 for providing communication with the media content server 112 via the network 111 .
- the media player 211 also comprises means and software instructions (not shown) for receiving and decoding the video stream and subsequently play the video content of the video stream.
- the media content server 112 and media players 114 , 115 , 116 , 211 mutually communicate and operate in a conventional, known manner.
- the devices may implement the “RTP Transport Protocol for Real-Time Applications” in accordance with the Request for Comment no. 3550 (RFC 3550).
- RRC 3550 Request for Comment no. 3550
- MPEG2-TS and MPEG4-TS transport protocols
- the video stream transports video that is compressed by a compression codec (encode-decode scheme) such as H.263, MPEG-4, H.264 and VC-1.
- a compression codec encode-decode scheme
- H.263, MPEG-4, H.264 and VC-1 This means that a picture frame of the video stream is compressed using different algorithms in dependence of what compression codec is used.
- I-frames Intra coded frames
- P-frames Predicted frames
- B-frames Bi-directional predicted frames
- I-frames are the least compressible but don't require other video frames to decode.
- P-frames can use data from previous frames to decompress and are more compressible than I-frames
- B-frames can use both previous and forward frames for data reference to get an even higher amount of data compression.
- intra coded frame e.g. the I-frame
- predicted image frame e.g. the P-frame or the B-frame
- a portion of the video stream S is illustrated, which portion is defined by a measuring interval ⁇ T of the video stream S.
- the measure interval ⁇ T is in turn defined by a start time and a stop time and the video stream S then comprises all data packets received by the media player between the start time and the stop time. It is also possible to define the measure interval ⁇ T by a number of subsequent data packets or by a number of subsequent picture frames of the video stream S.
- the measure interval ⁇ T of the video stream comprises, in this example, 16 data packets 1 - 16 .
- These packets 1 - 16 contains data in the form of 12 picture frames I 1 , P 1 , P 2 , 12 , P 3 , P 4 , 13 , P 5 , P 6 , I 4 , P 7 and P 8 .
- an intra coded frame I 1 , I 2 , I 3 , I 4 is contained in two data packets while a predicted frame P 1 , P 2 , P 3 , P 4 , P 5 , P 6 , P 7 , P 8 is contained in one data packet.
- the data packets 1 - 16 are distributed over the measure interval ⁇ T and since the data forming the frames are contained in the data packets the frames are also distributed over the measure interval ⁇ T. Data packets that are lost during the streaming process, in this example the packets 3 , 4 , 7 , 8 , 9 , are illustrated with dashed lines.
- Each data packet contains information about a) its sequence number i in the video stream, b) an image frame number j (derived from time stamp) the packet belongs to, and c) if the data packet is the last packet of an image frame.
- a so called marker bit value (M-bit value) of a data packet indicates whether the data packet is the last packet of a frame. It may also be that the marker bit value indicates whether the data packet is the first packet of a frame, depending on what transport format is used.
- the stream sequence number of the first data packet 1 is i
- the stream sequence number of the second data packet 2 is i+1 and so on.
- Data packets 1 and 2 each have a same image frame number j since they belong to the same image frame while data packet 3 has, or more specifically had since the packet 3 was lost, a frame number of j+1 since it belong to the next frame.
- Data packet 1 has an M-value of “0” indicating it is not the last packet for the frame I 1
- data packet 2 has an M-value of “1” indicating it is the last data packet of the frame I 1 .
- the data packets comprise (or should have comprised if the packet was not lost) the following information:
- the image frame number and the marker bit of the previous and following packets can be used to determine to which frame the lost packet belongs.
- packet number 9 was lost, and looking at packet 8 and packet 10 both packets have the marker bit set to “1”, which means that packet 8 and 10 are the last packets of their frames.
- the lost packet 9 thus belong to image frame number j+6 and by looking at the number of packets and the aggregated size we can estimate it to be an intra coded frame.
- the image frame number j of a data packet is calculated by using the timestamp value of the data packet and by using the coded frame-rate (picture clock frequency).
- SeqNo 1+(TimeStamp SeqNo ⁇ StartTime)/frameTime
- TimeStamp is located in the RTP header for each data packet and is the time when the packet (or rather the decoded frame that the packet belong to) should be played in the media player.
- FrameRate (or picture clock frequency) is the number of frames per second that the source material is sampled with, and depends on the used codec.
- distances between data packets may be defined, typically by a difference in the data packet sequence numbers.
- Distances between image frames are defined by the difference between the sequence numbers of the last data packets of the image frames, while a distance between a data packet and an image frame is defined by the data packet sequence number and the sequence number of the last data packet of the image frame.
- the inventive method is illustrated and comprises a first step 42 , which comprises identification of lost data packets 3 , 4 , 7 , 8 , 9 of the video stream S, which is done by investigating which data packet sequence numbers are missing, where a missing sequence number means a missing data packet.
- a second step 43 is performed and comprises identification of intra coded frames I 1 , I 2 , I 3 , I 4 of the video stream S is performed. This is done by comparing data bit-size of packets belonging to a target image frame with data-bit size of all packets belonging to image frames surrounding the target image frame. If the target image frame is more than or equal to x times larger than the mean of the surrounding frames the target frame is considered to be an intra coded image frame.
- a suitable value of x is for a standard H.264 baseline stream typically 2.5. For a lost data packet a mean data packet size is used.
- bit-sizes of all packets with same image frame number (timestamp) belonging to the target frame are added. If a sequence number is missing a packet is lost.
- the total size of packets belonging to a frame then represents the image frame size.
- a third step 44 determined which of the intra coded frames I 1 , I 2 , I 4 that have a maintained image quality, which is done by estimating 45 if a lost data packet 9 is associated with an intra coded frame I 3 .
- the sequence numbers of data packets having the same image frame number are sequential, no data packet is missing and the frame has a maintained image quality.
- a fourth step 46 comprises estimation of a distance D 1 , D 2 , D 3 , D 4 , D 5 between a lost data packet 3 , 4 , 7 , 8 , 9 and a next subsequent intra coded frame I 2 , I 4 having a maintained image quality is done according to the definition of distances above.
- quality value Q is generated based on the distances D 1 , D 2 , D 3 , D 4 , D 5 .
- This is an objective quality value which may be interpreted by a subjective evaluation done by users watching the video, such that different quality values have corresponding different perceived video quality values.
- the quality value may be calculated by weighting the distances, for better reflecting the perceived video quality.
- this kind of weighting is done particularly for distances that refer to the same intra coded frame having a maintained image quality.
- the weighting may also include weighting the distance D 5 belonging to the intra coded frame I 3 higher than the weighting of the distance D 3 belonging to the predicted image frame P 3 , e.g. by multiplying the D 5 value with a factor y prior the summarization of distances, or prior to inserting the distance values in the exponential formula.
- the quality value may also depend on the data packet loss rate which per se is determined in a manner common within the art. For example, the loss rate may then be multiplied with the sum of the distances when determining the quality value.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
- The invention relates to a method, system and computer readable medium for determining a quality value of a video stream.
- Today new radio networks have enabled more bitrate-heavy services such as streamed multimedia (video) content and mobile TV. At the same time TV over Internet Protocol (IP) has become a popular service in fixed communication networks. Along with this development there has been a growing emphasis on real-time assessment of video quality for this kind of visual communication services. The methods for video quality assessment include subjective methods and objective methods. The subjective methods typically involve human assessors, who grade or score video quality based on their subjective feelings, and use the grades or scores obtained in such a subjective way for video quality assessment. The objective methods, on the other hand, do not involve human assessors and assess the video quality only by using information obtained from the video sequences.
- The objective video quality assessment methods can be further classified into full-reference methods, reduced-reference methods, and no-reference methods. Full reference models are available on the market and, for example, include Perceptual Evaluation of Video Quality by OPTICOM, Optimacy tool from Genista Corporation and products from Psytechnics Ltd and National Telecommunications and Information Administration.
- Both the full-reference methods and the reduced-reference methods need reference information about the original video (i.e. the video actually transmitted from the transmitting side) to conduct the video quality assessment and thus cannot be used for real-time in-service video quality assessment. On the other hand, the no-reference methods do not require the reference information of the original video. Instead, the no-reference methods make observations only on decoded video (i.e. the video that has been received and decoded on the receiving side) and estimate the video quality using only the observed information on the decoded video.
- For a no-reference video quality assessment, two major sources of video quality decline should be taken into consideration. The first one is coding and compression of video sources and the second one is data packet loss during transmission, i.e. during the streaming of the video content. Another source of video quality decline may be so called packet jitter.
- In an IP network, deterioration in perceived video quality is typically caused by data packet loss. Most packet losses result from congestions in network nodes as more and more packets are dropped off by routers in IP networks when congestion occurs and the severity increases. In case of a wireless communication network, poor radio conditions may cause packet loss. The effect of packet loss is a major problem for real-time video transmission (streaming video). The measurement of the video quality decline caused by packet loss during transmission is referred to as packet loss metric.
- The streamed video is typically coded and compressed by using codecs such as, for example, H.263, MPEG-4, H.264 and VC-1, that utilize temporal predictive coding to improve coding efficiency. Three types of frames are then commonly used: a) intra frames (I-frames) that do not use temporal prediction and serves as a video refresh frame, b) predictive frames (P-frames) and c) bi-predictive frames (B-frames) that are predicted from one or more reference frames. Here, I-frames and P-frames usually act as reference frames, and if a part of a reference frame is lost an error resulting from the loss tends to propagate in time until the next I-frame (or P-frame) refreshes the video.
- A number of prior methods for calculating video deterioration due to packet loss have been proposed, of which one is based on estimating a number of lost macro-blocks for each frame type of a video stream. Another technique extracts spatial distortion of each image in a video stream using differences between corresponding regions of two adjacent frames in the video sequence. The spatial distortion is weighted based on temporal activities of the video, and the video quality is measured by detecting the spatial distortions of all images in the sequence.
- However, the aforementioned methods for calculating video deterioration needs to process all the blocks in the image frames, which means that those methods are very computational intensive and are not optimal for use in many real time video transmissions applications.
- In view of the foregoing, it is an object of the invention to provide an improvement of the above techniques and prior art. More particularly, it is an object to provide a parametric (no-reference) method for estimating quality of streaming video, which method requires little computational effort.
- Hence a method is provided for determining a quality value of a video stream transmitted to a media player. The method comprises the steps of, for a measuring interval of the video stream: identifying at least two lost data packets of the video stream; identifying intra coded frames of the video stream; determining which of the intra coded frames that have a maintained image quality, based on estimating if a lost data packet is associated with an intra coded frame; estimating a distance between each one of the lost data packets and a next respective, subsequent intra coded frame having a maintained image quality; and generating the quality value, based on the distances.
- In further detail, the quality value is determined for a measuring interval that can be set as a parameter. For example, the measuring interval may be a time interval, or a number of sequential data packets or a number of sequential picture frames of the video stream. “Lost data packets” also includes any data packet that is not necessarily lost per se but contains information that is corrupt to such an extent that the information of the data packet may not be fully retrieved.
- It should also be noted that an intra coded frame is, in this context, a frame which is used as a reference frame for other frames, which means that the video is a compressed video that comprises some picture frames that require the prior decoding of some other picture frame(s) in order to be decoded. As known within the art, data forming the picture frames are contained in data packets of the video stream.
- Since data packets and frames of the video stream are sequential and since it is possible to tie a data packet to a video frame, the distance between a lost packet and an intra frame may be given by a time value, or by a number of data packets or by a number of picture frames. This is quite advantageous in that the required calculations for the distance determining are quite fast and straightforward, which means that little computational effort is required by a computer device that performs the method.
- Here, a frame that has a “maintained image quality” is a frame for which no information have been lost during transport.
- The generating of the quality value may comprise weighting of the distances, which is quite advantageous in that the video quality experienced by a user may not always be linear with the distance from a corrupt data packet to an intra coded frame. By using weighting, less computational effort is needed in comparison with known technologies, as weighting is a quick operation and allows for a generation of a more subjectively reliable quality value.
- The weighting of a long distance of the distances may be higher than the weighting of a shorter distance of the distances, which produces a more reliable quality value as a user often registers low video quality only after some time, i.e. when the distance from the lost data packet to the intra coded frame is long.
- The long distance and the shorter distance may be estimated for a common intra coded frame, which is particularly relevant since the intra coded frame refreshes the video image.
- The weighting of an estimated distance of a lost data packet associated with an intra coded frame may be relatively higher than the weighting of an estimated distance of a lost data packet associated with a predicted image frame of the video stream, which gives a more reliable quality value since an error in an intra coded frame propagates to the next intra coded frame with a maintained image quality. This weighting is also useful since intra coded frames are added when there is a scene change, and a quality loss in a scene changing intra coded frame will cause the error to be very visible.
- The weighting of distances of two data packets associated with a common image frame may be higher than the weighting of distances of two data packets associated with different image frames, which give a more reliable quality value since many lost data packets for the same image frame significantly reduces the subjectively experienced video quality.
- The data packets may be defined by a real-time transport protocol comprising a marker bit, and an image frame of the video stream may be identified as an intra coded frame in dependence of a marker bit value of a data packet of the image frame, which provides for a computationally efficient image identification process.
- An image frame of the video stream may be identified as an intra coded frame in dependence of if an image size of the image frame is a factor larger than an image size of an average image frame, which, from a computational point of view, increases the efficiency of the method.
- The generating of the quality value may be based on a data packet loss rate. Typically data packet loss rate is the relation between the number of lost data packets and the total number of transmitted data packets (during the measure interval).
- According to another aspect of the invention, a system is provided for determining a quality value of a video stream transmitted to a media player. The system is configured to, for a measuring interval of the video stream: identify at least two lost data packets of the video stream; identify intra coded frames of the video stream; determine which of the intra coded frames that have a maintained image quality, based on estimating if a lost data packet is associated with an intra coded frame; estimate a distance between each one of the lost data packets and a next respective, subsequent intra coded frame having a maintained image quality; and generate the quality value, based on the distances.
- According to yet another aspect of the invention, a computer readable medium is provided, having stored thereon a computer program having software instructions which when run on a computer cause the computer to, for a measuring interval of a video stream, perform the steps of: identifying at least two lost data packets of the video stream; identifying intra coded frames of the video stream; determining which of the intra coded frames that have a maintained image quality, based on estimating if a lost data packet is associated with an intra coded frame; estimating a distance between each one of the lost data packets and a next respective, subsequent intra coded frame having a maintained image quality; and generating the quality value, based on the distances.
- The inventive system and computer readable medium may comprise, be configured to execute and/or having stored software instructions for performing any of the features described above in association with the inventive method, and has the corresponding advantages.
- Embodiments of the invention will now be described, by way of example, with reference to the accompanying schematic drawings, in which
-
FIG. 1 illustrates a system implementing the invention, -
FIG. 2 is a schematic view of a media player, -
FIG. 3 is a schematic view of a video stream, and -
FIG. 4 is a flow diagram of an embodiment of the inventive method. - With reference to
FIG. 1 a system implementing the invention is illustrated and comprises a media (video)content server 112 that is connected to adatabase 113 on which media content such as compressed video is stored. Themedia content server 112 is, via anetwork 111, connected to a number of media players such as aTV 114, amobile phone 115 and apersonal computer 116 or any other electronic device capable of receiving and playing streaming video. Themedia content server 112 is configured to send a compressed video stream via thenetwork 111 to themedia players media players - Sending, receiving and decoding are here done in a conventional manner and all involved devices implements a suitable, known network protocol that supports streaming video.
- In further detail,
FIG. 2 illustrates amedia player 211 that is connected (not shown) to themedia content server 112 via thenetwork 111. Themedia player 211 comprises aprocessor 212 which is connected to a computerreadable medium 213, here in the form of a non-volatile memory such as a hard disk, ROM (Read-Only Memory) and a flash memory, having stored thereon acomputer program 214. Thecomputer program 214 comprises software instructions which when run on the media player causes themedia player 211 to make the method steps described below. Acommunications interface 215 is also connected to theprocessor 212 for providing communication with themedia content server 112 via thenetwork 111. - The
media player 211 also comprises means and software instructions (not shown) for receiving and decoding the video stream and subsequently play the video content of the video stream. - As mentioned, the
media content server 112 andmedia players - As described, the video stream transports video that is compressed by a compression codec (encode-decode scheme) such as H.263, MPEG-4, H.264 and VC-1. This means that a picture frame of the video stream is compressed using different algorithms in dependence of what compression codec is used.
- As a result, the different algorithms for video frames gives different picture types or frame types of the video stream, and three major picture types are used, i.e. I-frames (Intra coded frames), P-frames (Predicted frames) and B-frames (Bi-directional predicted frames). As known within the art, I-frames are the least compressible but don't require other video frames to decode. P-frames can use data from previous frames to decompress and are more compressible than I-frames, while B-frames can use both previous and forward frames for data reference to get an even higher amount of data compression. Of course, it is sufficient to have only one type of intra coded frame (e.g. the I-frame) and one type of predicted image frame (e.g. the P-frame or the B-frame).
- With reference to
FIG. 3 a portion of the video stream S is illustrated, which portion is defined by a measuring interval ΔT of the video stream S. The measure interval ΔT is in turn defined by a start time and a stop time and the video stream S then comprises all data packets received by the media player between the start time and the stop time. It is also possible to define the measure interval ΔT by a number of subsequent data packets or by a number of subsequent picture frames of the video stream S. - In any case, the measure interval ΔT of the video stream comprises, in this example, 16 data packets 1-16. These packets 1-16 contains data in the form of 12 picture frames I1, P1, P2, 12, P3, P4, 13, P5, P6, I4, P7 and P8. Here, an intra coded frame I1, I2, I3, I4 is contained in two data packets while a predicted frame P1, P2, P3, P4, P5, P6, P7, P8 is contained in one data packet. This is due to the fact that an intra code frame typically is much larger than a predicted frame, in terms of the amount of data needed for creating the frames. The data packets 1-16 are distributed over the measure interval ΔT and since the data forming the frames are contained in the data packets the frames are also distributed over the measure interval ΔT. Data packets that are lost during the streaming process, in this example the
packets - Each data packet contains information about a) its sequence number i in the video stream, b) an image frame number j (derived from time stamp) the packet belongs to, and c) if the data packet is the last packet of an image frame. Typically, a so called marker bit value (M-bit value) of a data packet indicates whether the data packet is the last packet of a frame. It may also be that the marker bit value indicates whether the data packet is the first packet of a frame, depending on what transport format is used.
- Accordingly, in this example, the stream sequence number of the
first data packet 1 is i, the stream sequence number of thesecond data packet 2 is i+1 and so on.Data packets data packet 3 has, or more specifically had since thepacket 3 was lost, a frame number of j+1 since it belong to the next frame.Data packet 1 has an M-value of “0” indicating it is not the last packet for the frame I1, whiledata packet 2 has an M-value of “1” indicating it is the last data packet of the frame I1. To summarize, the data packets comprise (or should have comprised if the packet was not lost) the following information: -
Sequence no. Image frame Data packet (SeqNo) no. M-bit value Size in bytes 1 i j 0 1200 2 i + 1 j 1 705 3 i + 2 j + 1 1 356 4 i + 3 j + 2 1 122 5 i + 4 j + 3 0 1200 6 i + 5 j + 3 1 467 7 i + 6 j + 4 1 502 8 i + 7 j + 5 1 301 9 i + 8 j + 6 0 1200 10 i + 9 j + 6 1 722 11 i + 10 j + 7 1 202 12 i + 11 j + 8 1 392 13 i + 12 j + 9 0 1200 14 i + 13 j + 9 1 456 15 i + 14 j + 10 1 188 16 i + 15 j + 11 1 376 - In the table above illustrating data packet sizes in bytes are included, and it is possible to use these packet sizes when estimating which type of image frame a packet belongs to, since a data packet with a relatively larger packet size more likely belongs to an intra coded frame.
- If the sequence of packet sequence number indicates that a packet has been lost (a sequence gap), the image frame number and the marker bit of the previous and following packets can be used to determine to which frame the lost packet belongs. In this example packet number 9 was lost, and looking at packet 8 and
packet 10 both packets have the marker bit set to “1”, which means thatpacket 8 and 10 are the last packets of their frames. The lost packet 9 thus belong to image frame number j+6 and by looking at the number of packets and the aggregated size we can estimate it to be an intra coded frame. - The image frame number j of a data packet is calculated by using the timestamp value of the data packet and by using the coded frame-rate (picture clock frequency). In more detail:
-
Image frame no.SeqNo=1+(TimeStampSeqNo−StartTime)/frameTime, - where frameTime=1/frameRate, one is added since the first frame sequence number should be 1, and StartTime is the TimeStamp of the first data packet (StartTime=TimeStamp1).
- In this example TimeStamp is located in the RTP header for each data packet and is the time when the packet (or rather the decoded frame that the packet belong to) should be played in the media player.
- FrameRate (or picture clock frequency) is the number of frames per second that the source material is sampled with, and depends on the used codec.
- As the data packets are distributed over an interval, distances between data packets may be defined, typically by a difference in the data packet sequence numbers. Distances between image frames are defined by the difference between the sequence numbers of the last data packets of the image frames, while a distance between a data packet and an image frame is defined by the data packet sequence number and the sequence number of the last data packet of the image frame.
- With reference to
FIG. 4 , the inventive method is illustrated and comprises afirst step 42, which comprises identification of lostdata packets - Next a
second step 43 is performed and comprises identification of intra coded frames I1, I2, I3, I4 of the video stream S is performed. This is done by comparing data bit-size of packets belonging to a target image frame with data-bit size of all packets belonging to image frames surrounding the target image frame. If the target image frame is more than or equal to x times larger than the mean of the surrounding frames the target frame is considered to be an intra coded image frame. A suitable value of x is for a standard H.264 baseline stream typically 2.5. For a lost data packet a mean data packet size is used. - To determine data bit-size of packets belonging to a target frame, bit-sizes of all packets with same image frame number (timestamp) belonging to the target frame are added. If a sequence number is missing a packet is lost. The total size of packets belonging to a frame then represents the image frame size.
- Thereafter it is in a
third step 44 determined which of the intra coded frames I1, I2, I4 that have a maintained image quality, which is done by estimating 45 if a lost data packet 9 is associated with an intra coded frame I3. In further detail, if the sequence numbers of data packets having the same image frame number are sequential, no data packet is missing and the frame has a maintained image quality. - A
fourth step 46 comprises estimation of a distance D1, D2, D3, D4, D5 between a lostdata packet - Finally, in a
fifth step 47 quality value Q is generated based on the distances D1, D2, D3, D4, D5. In its most simple form the quality value Q is the sum of the distances, which in this example means that Q may be D1+D2+D3+D4+D5=3+2+7+6+5=23. This is an objective quality value which may be interpreted by a subjective evaluation done by users watching the video, such that different quality values have corresponding different perceived video quality values. - The quality value may be calculated by weighting the distances, for better reflecting the perceived video quality. One method of weighting includes weighting of a long distance D1 higher than a shorter distance D2, e.g. by using an exponential formula such as Q=eD1+eD2+ . . . . However, in practice more advanced exponential formulas may be used. For a better quality value this kind of weighting is done particularly for distances that refer to the same intra coded frame having a maintained image quality.
- The weighting may also include weighting the distance D5 belonging to the intra coded frame I3 higher than the weighting of the distance D3 belonging to the predicted image frame P3, e.g. by multiplying the D5 value with a factor y prior the summarization of distances, or prior to inserting the distance values in the exponential formula.
- Moreover, the quality value may also depend on the data packet loss rate which per se is determined in a manner common within the art. For example, the loss rate may then be multiplied with the sum of the distances when determining the quality value.
- Although various embodiments of the invention have been described and shown, the invention is not restricted thereto, but may also be embodied in other ways within the scope of the subject-matter defined in the following claims. In particular, the invention may be implemented by using other methods for determining which data packet belongs to which image frame.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/551,869 US9723329B2 (en) | 2008-11-04 | 2014-11-24 | Method and system for determining a quality value of a video stream |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/127,285 US8923411B2 (en) | 2008-11-04 | 2008-11-04 | Method and system for determining a quality value of a video stream |
PCT/EP2008/064959 WO2010051834A1 (en) | 2008-11-04 | 2008-11-04 | Method and system for determining a quality value of a video stream |
US14/551,869 US9723329B2 (en) | 2008-11-04 | 2014-11-24 | Method and system for determining a quality value of a video stream |
Related Parent Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/127,285 Continuation US8923411B2 (en) | 2008-11-04 | 2008-11-04 | Method and system for determining a quality value of a video stream |
PCT/EP2008/064959 Continuation WO2010051834A1 (en) | 2008-11-04 | 2008-11-04 | Method and system for determining a quality value of a video stream |
US13127285 Continuation | 2011-05-03 |
Publications (3)
Publication Number | Publication Date |
---|---|
US20150215649A1 US20150215649A1 (en) | 2015-07-30 |
US20160330484A9 true US20160330484A9 (en) | 2016-11-10 |
US9723329B2 US9723329B2 (en) | 2017-08-01 |
Family
ID=40810500
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/127,285 Active 2030-10-16 US8923411B2 (en) | 2008-11-04 | 2008-11-04 | Method and system for determining a quality value of a video stream |
US14/551,869 Active 2029-06-27 US9723329B2 (en) | 2008-11-04 | 2014-11-24 | Method and system for determining a quality value of a video stream |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/127,285 Active 2030-10-16 US8923411B2 (en) | 2008-11-04 | 2008-11-04 | Method and system for determining a quality value of a video stream |
Country Status (10)
Country | Link |
---|---|
US (2) | US8923411B2 (en) |
EP (3) | EP2876881B1 (en) |
JP (1) | JP5427238B2 (en) |
AR (1) | AR075552A1 (en) |
CA (1) | CA2742716C (en) |
DK (1) | DK2347599T3 (en) |
ES (2) | ES2536411T3 (en) |
HU (1) | HUE025532T2 (en) |
PL (2) | PL3122043T3 (en) |
WO (1) | WO2010051834A1 (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DK2649807T3 (en) | 2010-12-10 | 2018-06-18 | Deutsche Telekom Ag | Method and apparatus for assessing the quality of a video signal during encoding and transmission of the video signal |
US20120297433A1 (en) * | 2011-05-18 | 2012-11-22 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and arrangement for supporting quality estimation of streamed video |
CN103634698B (en) | 2012-08-21 | 2014-12-03 | 华为技术有限公司 | Methods for detecting frame type and frame size of video stream and apparatus |
CN105052107B (en) * | 2013-01-15 | 2019-04-12 | 华为技术有限公司 | Media content Adaptive Transmission is carried out using quality information |
US10284612B2 (en) | 2013-04-19 | 2019-05-07 | Futurewei Technologies, Inc. | Media quality information signaling in dynamic adaptive video streaming over hypertext transfer protocol |
CN111212279B (en) * | 2018-11-21 | 2021-06-29 | 华为技术有限公司 | Video quality assessment method and device |
EP3829170A1 (en) * | 2019-11-29 | 2021-06-02 | Axis AB | Encoding and transmitting image frames of a video stream |
CN111953612B (en) * | 2020-07-21 | 2024-02-23 | 西安万像电子科技有限公司 | Data transmission control method and device |
US11380117B1 (en) * | 2020-12-23 | 2022-07-05 | Abbyy Development Inc. | Zero-footprint image capture by mobile device |
CN113191286B (en) * | 2021-05-08 | 2023-04-25 | 重庆紫光华山智安科技有限公司 | Image data quality detection and optimization method, system, equipment and medium |
CN115776601B (en) * | 2022-11-15 | 2024-08-23 | 深圳艾灵网络有限公司 | Video streaming information evaluation method, device, equipment and storage medium |
CN116886871B (en) * | 2023-07-26 | 2024-02-20 | 浙江安易信科技有限公司 | Network data information management method, system and computer storage medium |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7539130B2 (en) * | 2000-03-28 | 2009-05-26 | Nokia Corporation | Method and system for transmitting and receiving packets |
US7418037B1 (en) * | 2002-07-15 | 2008-08-26 | Apple Inc. | Method of performing rate control for a compression system |
WO2004043074A1 (en) | 2002-11-04 | 2004-05-21 | Tandberg Telecom As | Inter-network and inter-protocol video conference privacy method, apparatus and computer program product |
JP4327674B2 (en) * | 2004-07-21 | 2009-09-09 | 日本電信電話株式会社 | Video quality control method and video quality control system |
JP4377357B2 (en) | 2005-07-07 | 2009-12-02 | 日本電信電話株式会社 | Video quality estimation apparatus and video quality estimation method |
US9113147B2 (en) * | 2005-09-27 | 2015-08-18 | Qualcomm Incorporated | Scalability techniques based on content information |
US8839325B2 (en) | 2007-02-14 | 2014-09-16 | At&T Intellectual Property I, L.P. | System and method of managing video content quality |
US8630346B2 (en) * | 2007-02-20 | 2014-01-14 | Samsung Electronics Co., Ltd | System and method for introducing virtual zero motion vector candidates in areas of a video sequence involving overlays |
-
2008
- 2008-11-04 PL PL16177498T patent/PL3122043T3/en unknown
- 2008-11-04 ES ES08875275.3T patent/ES2536411T3/en active Active
- 2008-11-04 US US13/127,285 patent/US8923411B2/en active Active
- 2008-11-04 CA CA2742716A patent/CA2742716C/en active Active
- 2008-11-04 EP EP15150924.7A patent/EP2876881B1/en active Active
- 2008-11-04 HU HUE08875275A patent/HUE025532T2/en unknown
- 2008-11-04 JP JP2011533548A patent/JP5427238B2/en active Active
- 2008-11-04 DK DK08875275.3T patent/DK2347599T3/en active
- 2008-11-04 ES ES15150924.7T patent/ES2592811T3/en active Active
- 2008-11-04 PL PL08875275T patent/PL2347599T3/en unknown
- 2008-11-04 EP EP08875275.3A patent/EP2347599B1/en active Active
- 2008-11-04 EP EP16177498.9A patent/EP3122043B1/en active Active
- 2008-11-04 WO PCT/EP2008/064959 patent/WO2010051834A1/en active Application Filing
-
2009
- 2009-11-04 AR ARP090104266A patent/AR075552A1/en active IP Right Grant
-
2014
- 2014-11-24 US US14/551,869 patent/US9723329B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
ES2536411T3 (en) | 2015-05-25 |
EP2347599A1 (en) | 2011-07-27 |
DK2347599T3 (en) | 2015-05-11 |
JP2012507892A (en) | 2012-03-29 |
PL2347599T3 (en) | 2015-07-31 |
EP3122043B1 (en) | 2018-01-17 |
US20110211629A1 (en) | 2011-09-01 |
JP5427238B2 (en) | 2014-02-26 |
EP2347599B1 (en) | 2015-02-25 |
ES2592811T3 (en) | 2016-12-01 |
EP3122043A1 (en) | 2017-01-25 |
PL3122043T3 (en) | 2018-07-31 |
EP2876881A1 (en) | 2015-05-27 |
WO2010051834A1 (en) | 2010-05-14 |
CA2742716A1 (en) | 2010-05-14 |
EP2876881B1 (en) | 2016-07-06 |
US8923411B2 (en) | 2014-12-30 |
AR075552A1 (en) | 2011-04-20 |
US9723329B2 (en) | 2017-08-01 |
CA2742716C (en) | 2016-08-23 |
US20150215649A1 (en) | 2015-07-30 |
HUE025532T2 (en) | 2016-05-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9723329B2 (en) | Method and system for determining a quality value of a video stream | |
JP6104301B2 (en) | Video quality estimation technology | |
CN102959976B (en) | The method and apparatus of assessment video flow quality | |
US7873727B2 (en) | System and method for evaluating streaming multimedia quality | |
JP5172440B2 (en) | Video quality estimation apparatus, method and program | |
JP4802209B2 (en) | Video quality estimation method, apparatus and program | |
JP4787210B2 (en) | Video quality estimation method, apparatus, and program | |
JP4914400B2 (en) | Quality estimation method, quality estimation system, user terminal, quality management terminal and program | |
JP4861371B2 (en) | Video quality estimation apparatus, method, and program | |
JP4787303B2 (en) | Video quality estimation apparatus, method, and program | |
JP5405915B2 (en) | Video quality estimation apparatus, video quality estimation method, and video quality estimation apparatus control program | |
JP5394991B2 (en) | Video frame type estimation adjustment coefficient calculation method, apparatus, and program | |
JP2009194609A (en) | Video quality estimation apparatus, method, and program | |
JP6061778B2 (en) | Video quality evaluation apparatus, video quality evaluation method and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: TELEFONAKTIEBOLAGET L M ERICSSON (PUBL), SWEDEN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GUSTAFSSON, JOERGEN;LINDEGREN, DAVID;PETTERSSON, MARTIN;REEL/FRAME:034525/0279 Effective date: 20081216 |
|
AS | Assignment |
Owner name: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), SWEDEN Free format text: CHANGE OF NAME;ASSIGNOR:TELEFONAKTIEBOLAGET L M ERICSSON (PUBL);REEL/FRAME:042285/0890 Effective date: 20151119 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |