+

WO1999067942A1 - Appareil et procede de traitement de signaux, decodeur de signaux et procede associe - Google Patents

Appareil et procede de traitement de signaux, decodeur de signaux et procede associe Download PDF

Info

Publication number
WO1999067942A1
WO1999067942A1 PCT/JP1999/003328 JP9903328W WO9967942A1 WO 1999067942 A1 WO1999067942 A1 WO 1999067942A1 JP 9903328 W JP9903328 W JP 9903328W WO 9967942 A1 WO9967942 A1 WO 9967942A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
additional information
information
input signal
additional
Prior art date
Application number
PCT/JP1999/003328
Other languages
English (en)
Japanese (ja)
Inventor
Nobuyoshi Miyahara
Yoichi Yagasaki
Kazuhisa Hosaka
Original Assignee
Sony Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP10175202A external-priority patent/JP2000013764A/ja
Priority claimed from JP10191087A external-priority patent/JP2000013768A/ja
Application filed by Sony Corporation filed Critical Sony Corporation
Publication of WO1999067942A1 publication Critical patent/WO1999067942A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0021—Image watermarking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32154—Transform domain methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32154—Transform domain methods
    • H04N1/32165—Transform domain methods using cosine transforms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32267—Methods relating to embedding, encoding, decoding, detection or retrieval operations combined with processing of the image
    • H04N1/32277—Compression
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2201/00—General purpose image data processing
    • G06T2201/005—Image watermarking
    • G06T2201/0052—Embedding of the watermark in the frequency domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/3233—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of authentication information, e.g. digital signature, watermark

Definitions

  • the present invention is an input signal, for example with respect to image data such as a specific still image or a moving image sequence, for example, with such as copyright information
  • the present invention relates to a signal processing device and method for adding pertinent information and detecting and using the accompanying information during reproduction, and a signal decoding device and method for decoding an input signal to which the accompanying information is added.
  • Scenery technology There is a technology that adds information associated with a specific image sequence (still image or moving image sequence) to the image data and detects and uses the accompanying information during playback. A typical example is the addition of copyright information.
  • the copyright holder must first copy the copyright information to the image in order to claim that right. It must be added in the evening.
  • copyright information if copyright information that should render the image data undisplayable is detected in the processing procedure of the image playback device or playback method, the image data is displayed. It will be possible to take countermeasures such as not taking action. Attachment or detection of the above-mentioned copyright information is often used at present to prevent illegal copying of video tapes. Recently, there are many shops that rent video tapes, but if many users enjoy illegally copying video tapes borrowed from the store at low prices, those who hold copyrights of the video tapes and video tapes The damage to stores that rent rentals is enormous.
  • the first method is to add the image data to the auxiliary part.
  • auxiliary information of the image data is recorded at the upper part of the screen (auxiliary part) which is not substantially displayed on the display screen.
  • the second method is to add it to the main part of the image data (the part that is actually displayed). This is a particular feature, as shown in Figure 2. This is to add a fixed power mark (Water Mark) to the whole or part of the image to the extent that it cannot be visually perceived.
  • a fixed power mark Water Mark
  • an area having the same size as the area of the watermark pattern is set on the image to be added.
  • the set area and the watermark pattern are overlapped and illuminated, and the value a is added to the pixel corresponding to the plus symbol, and the value b is subtracted from the pixel corresponding to the minus symbol.
  • Both a and b can be set to arbitrary values, but they should be kept constant throughout the war.
  • this padding is performed.
  • the pixel values 101 and 99 are formed by the embedding operation.
  • an area having the same size as the area of the short-time mark pattern is set on the image to be detected. This Is used as the evaluation value.
  • the evaluation value when the additional information is added becomes (4n) 2 (the same as the number of pixels included in the area), and FIG. As shown, the evaluation value is 0 when no additional information is added.
  • the evaluation value will always be almost 0 when the accompanying information is not added. Therefore, when the evaluation value exceeds a certain threshold value, it can be determined that additional information has been added.
  • the above procedure makes it possible to add binary information (1 bit) indicating whether or not additional information has been added. If more information is to be added, 2 k (k bits) information can be added by processing the entire image into k regions and performing the above operations.
  • the war evening mark pattern for example, a pattern generated using an M sequence can be used.
  • the M-sequence longest code sequence
  • the code correlation is 1 at the origin, and in other cases it is inversely proportional to the code length It is.
  • the warrior mark pattern may be generated by a method other than the M-sequence.
  • Figure 7 shows the configuration of the encoder.
  • the accompanying information f is added as a warrior mark pattern in a warrior mark (pattern) adder 71.
  • the image data to which the accompanying information f has been added is input to the encoder 72, and high-efficiency encoding is performed to generate an encoded bit sequence.
  • the motion compensator 144 has a built-in frame memory,
  • the pixel value at each position of the current frame to be predicted is predicted from the image that has already been encoded and is obtained by decoding it and stored in the built-in frame memory.
  • the predicted value I '[i, j, t] of the pixel value I [i, j, t] at the position of the frame input at time t is represented by the motion vector ⁇ ,, and the cell corresponding to that position. Is determined using the following equation.
  • [i, j, t] (I [i ,, j ,, t-T] + I [i, + l, j ,, tT] + I [i ,, j, + l, t-T] + I [i, + l, j, + l, t-T]) / 4
  • i and j are represented by the following equations.
  • T represents the difference between the time when the currently predicted image I is input and the time when the image stored in the frame memory is input
  • I [i, , J ,, tT] I [i, + 1, j ,, tT], I [i ,, j, + l, tT], I [i, + l, j '+ l, t-T]
  • Int (x) represents the largest integer value that does not exceed X.
  • the subtractor 1442 performs motion compensation based on the motion vector V supplied from the motion compensator 144 from the value of the pixel currently to be coded supplied from the frame memory 141.
  • the calculated predicted value is subtracted and output to a DCT (Descrete Cosine Transform) unit 144.
  • the DCT unit 144 is a (Descrete Cosine Transform) unit composed of the difference values input from the subtractor 144, and performs two-dimensional DCT processing on the block of 8 pixels x 8 pixels composed of the difference values. .
  • the quantizer 1 4 5 has an appropriate value for the DCT coefficient c input from the DCT 1 Using the step size q, quantization processing is performed according to the following equation.
  • the inverse quantizer 147 performs inverse quantization as shown in the following equation using the step size Q at the same position as the step size used in the quantizer 144.
  • the data that has been inversely quantized by the inverse quantizer 147 is input to the IDCT unit 148 and subjected to inverse DCT processing to restore the pixel value difference value.
  • the difference value output from the IDCT unit 148 is added to the predicted value output from the motion compensator 143 by the adder 149, and becomes the original pixel value data. It is stored in the built-in frame memory.
  • the digitized image data is input to a warrior mark adder 71, and a warrior mark is added according to the accompanying information f.
  • the image data to which the night mark is added by the word mark adder 71 is supplied to the frame memory 141, and is stored in frame units.
  • the motion vector detector 150 detects a motion vector V of the image data stored in the frame memory 144.
  • the motion compensator 1 4 3 uses the reference frame stored in the built-in frame memory.
  • the motion compensation is performed on the image data of the image data, and the predicted pixel data is generated and supplied to the subtractor 144.
  • the subtracter 144 subtracts the predicted image data supplied from the motion compensator 144 from the image data supplied from the frame memory 144, and supplies the subtraction result to the DCT 144. .
  • the DCT unit 144 converts the image data of the input difference value into DCT coefficients.
  • the quantizer 145 quantizes the DCT coefficient supplied from the DCT unit 144 and outputs it to the variable length encoder 146.
  • the variable-length encoder 146 converts the input quantized data into a variable-length code, and transmits it as a code bit string to a transmission path (not shown) or supplies it to a recording medium for recording.
  • the quantized data output from the quantizer 145 is inversely quantized by the inverse quantizer 147 and supplied to the IDCT 148.
  • the 10 ⁇ filter 148 performs IDCT processing on the input DCT coefficient, and outputs an image of the original difference value.
  • the image data of this difference value is added to the predicted image data read out from the motion compensator 144 by the adder 149, and restored to the original image data, and restored to the original image data. This is stored in the built-in frame memory of the unit 144.
  • the variable-length encoder 146 also converts the motion vector V supplied from the motion vector detector 150 into a variable-length code and outputs it.
  • INTER coding for coding the difference from the predicted value as described above is performed. However, if the difference between the value of the pixel currently to be coded and the predicted value calculated by the motion compensator 144 is large, the intra-picture coding is performed to prevent the coding bit amount from increasing. (INTRA coding) may be performed. In other words, for each pixel value in the block, the DCT unit 14 4 and the pixel value is coded.
  • Figure 9 shows the configuration of the decoder.
  • the input coded bit string is restored to image data in the decoder 81.
  • the auxiliary information f is detected by the war mark detector 82.
  • FIG. 10 shows a more detailed configuration example of the decoder 81.
  • the inverse variable-length encoder 161 of the decoder 81 performs inverse variable-length encoding (variable-length decoding) on the input code bit sequence and decodes it.
  • the image data (DCT coefficients) are output to the inverse quantizer 162, and the decoded motion vector V is output to the motion compensator 1665.
  • the inverse quantizer 16 2 inverse quantizes the input DCT coefficient and outputs the result to the IDCT device 16 3.
  • the IDCT unit 163 performs IDCT processing on the input, inversely quantized DCT coefficients, restores the original difference value to the image data, and outputs the result to the adder 164. I have.
  • the motion compensator 165 performs motion compensation on the image data stored in the built-in frame memory based on the motion vector V supplied from the inverse variable-length coder 161 to obtain a predicted image. Is generated and output to the adder 164.
  • the adder 1664 is configured to add the difference value supplied from the I0 ⁇ cable 163 to the predicted image, restore the original frame image, and output the restored frame image.
  • the output of the adder 164 is supplied to and stored in a frame memory incorporated in the motion compensator 165, and is also supplied to the watermark detector 82.
  • the watermark detector 82 detects and outputs the accompanying information f from the input image data, and outputs the original image data.
  • the inverse variable length encoder 1 6 1 The input code bit string is subjected to inverse variable length encoding processing, and the decoded DCT coefficients are output to the inverse quantizer 162.
  • the inverse quantizer 16 2 inversely quantizes the input DCT coefficient and outputs the result to the IDCT unit 16 3.
  • the IDCT unit 163 performs IDCT processing on the input DCT coefficients, and outputs the original difference image data.
  • the motion compensator 165 uses the motion vector V supplied from the inverse variable length encoder 161 for the already restored image data stored in the built-in frame memory based on the motion vector V. After performing motion compensation, a predicted image is generated and output to the adder 164.
  • the adder 164 adds the image data of the difference value supplied from the IDCT unit 163 to the predicted image data, and restores the original image data.
  • the original image data is supplied to and stored in the frame memory of the motion compensator 165 for generating the next predicted image.
  • the image data output from the adder 164 is supplied to the watermark marker detector 82, and the watermark is detected.
  • the configurations of the Waryu mark adder 71 and the Waryu mark detector 82 are shown in Figs. 11 and 12, respectively.
  • FIG. 11 shows the configuration of the watermark adder 71.
  • the input image data and accompanying information f are passed to the accompanying information adder 111.
  • the incidental information adder 111 first sets the pixel position p to be added to the target image area.
  • Mark pattern collation controller Hand over to 1 1 2 The pixel position p may be, for example, a one-dimensional position expression that indicates the position in the scanning order starting from the upper left position of the image.
  • the warner mark pattern matching controller 112 refers to the symbol of the warner mark pattern stored in the warner mark pattern holding memory 113, and obtains the obtained symbol S. Pass to the additional information adder 1 1 1 1 Using the passed symbol S, the additional information adder 1 11 1 adds a warp mark pattern to the pixel to be added.
  • FIG. 13 shows a series of processing performed by the warrior mark adder 71.
  • step S 14 predetermined values are set to the additional levels a and b of the short mark.
  • step S142 an area of the same size as that of the warp mark pattern is set on the pixel to which the additional information is to be added, and each pixel in the area is compared with the warp mark pattern. I do.
  • step S144 the symbol of the war evening mark is determined, and if the symbol of the corresponding war evening mark is positive, a is added to the pixel in step S144. If the symbol of the war symbol corresponding to the pixel is negative, b is subtracted from the pixel in step S145. This process is repeated until it is determined in step S146 that all pixels in the target area have been processed.
  • FIG. 12 shows the configuration of the blue mark detector 82.
  • the input image data is passed to the evaluation value calculator 132.
  • the evaluation value calculator 1332 passes the pixel position p of the evaluation target to the warp mark pattern collation controller 131.
  • This pixel position p is, for example, It is a one-dimensional position expression that indicates the position in the scanning order starting from the position of.
  • the watermark pattern matching controller 13 1 refers to the symbol of the watermark pattern stored in the memory pattern holding memory 13 3 based on the pixel position p, and evaluates the obtained symbol S.
  • Pass to value calculator 1 3 2 The evaluation value calculator 13 2 calculates the evaluation value using the passed symbol S.
  • the calculated evaluation value is subjected to threshold processing by the evaluation value comparator 134, and the accompanying information f is output.
  • the input image data is output through the image converter 135 as it is or after being subjected to predetermined processing or processing.
  • FIG. 14 shows a series of processes performed by the war mark detector 22.
  • step S1661 the evaluation value sum is initialized and the threshold value th is set.
  • step S162 an area having the same size as that of the watermark pattern is set, and each pixel in the area is compared with the watermark pattern. If it is determined in step S166 that the symbol of the corresponding watermark symbol is positive, the pixel value is added to the evaluation value sum in step S166. If the symbol of the warp mark of that pixel is negative, the pixel value is subtracted from the evaluation value sum in step S165. This processing is repeated in step S166 until it is determined that the processing has been performed for all the pixels in the target area.
  • step S166 the evaluation value sum is compared with the threshold value th. If sum> th, it is considered that additional information has been added, and in step S168, the additional information is added. Turn f on. If not, the accompanying information f is turned off in step S169.
  • the output image data and the attached information f are passed to an image display unit (not shown).
  • the image display unit displays the image as it is when the accompanying information f is on, but does not display the image, for example, does not display the main area of the image when the accompanying information f is off. Perform processing or processing such as scrambling the image (displaying the received image data randomly).
  • an image converter 135 shown in the watermark detector 82 of FIG. 12 may be provided to add or process such image data according to the accompanying information f. .
  • the first method of adding the additional information to the auxiliary part of the image data if the auxiliary part to which the additional information is added is ignored, it is difficult to prevent problems such as illegal copying in advance. For example, if a digitally recorded image is read into a commercially available personal computer, and only the main part is cut out and copied, ignoring the auxiliary part, the image quality will be the same as before copying. Will be the same. In this case, the meaning of adding the auxiliary information to the auxiliary part is completely lost.
  • the second method of adding the accompanying information to the main part of the image data the attached information does not disappear and disappear, for example, by the copy procedure shown in the first method. However, when various kinds of signal processing such as noise reduction filtering are performed on image data, the additional information component added may be attenuated and may not be extracted.
  • the area where the additional information is added is only a part of the entire image sequence, it is extremely difficult to add multiple pieces of information. For example, if the entire image is divided into k regions and the accompanying information is added, the area of the war evening mark pattern for each region is further narrowed according to the number of the regions, and the accompanying information is almost undetectable. It is possible. Note that these problems described above become particularly remarkable in a moving image sequence.
  • the accompanying information is used for illegal copy prevention or generation management, for example, even if an illegal act such as not rewriting the added attached information is performed, the inconsistency of the accompanying information caused by that act There was no way to prevent it.
  • accompanying information such as watermarks while suppressing signal deterioration such as image quality deterioration, and to configure a method for adding and detecting new accompanying information.
  • a signal processing device and a signal processing method that can be used for prevention of illegal copying and generation management.
  • the present invention provides a signal decoding device and method capable of detecting accompanying information without significantly affecting original image data.
  • a signal processing device is a signal processing device for embedding additional information in an input signal, wherein the position where the input signal is decoded and the additional information is added is determined by a variable length portion and a fixed length portion. Additional position detecting means for detecting the position within the combined range, and additional information adding means for adding the additional information to the position detected by the additional position detecting means are provided.
  • a signal processing method is a signal processing method for embedding incidental information in an input signal.
  • An additional information adding step of adding the additional information is a signal processing method for embedding incidental information in an input signal.
  • a signal processing device is a signal processing device that embeds incidental information in an input signal, wherein the additional position for decoding the input signal and detecting a position to add the incidental information within a range of a variable length portion.
  • a detecting unit; and an additional information adding unit that receives the information on the position detected by the additional position detecting unit and the input signal, and adds the additional information to the position.
  • a signal processing method is a signal processing method for embedding incidental information in an input signal, wherein the additional position is obtained by decoding the input signal and detecting a position to add the incidental information within a range of a variable length portion.
  • a signal decoding device is a signal decoding device for decoding an input signal in which incidental information is embedded.
  • the signal decoding device decodes the input signal and determines a position where the additional information is added to a variable length portion and a fixed length portion.
  • an additional information extracting means for extracting the additional information based on the position information on the position detected by the additional position detecting means.
  • a signal decoding method is a signal decoding method for decoding a signal in which incidental information is embedded, wherein the input signal is decoded, and a position where the incidental information is added is a variable length portion and a fixed length portion. And an additional information extracting step of extracting the additional information based on the position information on the position detected in the additional position detection step.
  • a signal decoding device is a signal decoding device for decoding an input signal in which incidental information is embedded. The signal decoding device decodes the input signal and detects a position where the incidental information is added within a range of a variable length portion.
  • An additional position detecting means, and additional information extracting means for receiving the position information on the position detected by the additional position detecting means and the input signal and extracting the accompanying information.
  • a signal decoding method is a signal decoding method for decoding an input signal in which incidental information is embedded as a watermark, wherein the input signal is decoded, and a position where the incidental information is added is set to a variable length portion.
  • the signal processing device is a signal processing device that embeds incidental information in an input signal, by performing a necessary modification on a signal before quantization to change a value after quantization. It has an additional information adding means for adding the additional information, and an encoding means for performing encoding including quantization on an output signal from the additional information adding means.
  • a signal necessary for changing a value after quantization is applied to a signal before quantization. It has an additional information adding step of adding the additional information, and an encoding step of performing encoding including quantization on an output signal from the additional information adding step.
  • a signal processing device is a signal processing device for embedding incidental information in an input signal, wherein the value within the range of a block consisting of a plurality of data of the input signal is corrected so that the representative value within the block range becomes regular.
  • additional information adding means for adding the additional information.
  • a signal processing method is a signal processing method for embedding incidental information in an input signal, wherein a value in a block range consisting of a plurality of data of the input signal is corrected to have regularity in a representative value in a block range. Accordingly, an additional information adding step of adding the additional information is provided.
  • FIG. 1 is a diagram for explaining a recording position of auxiliary information on a video tape.
  • FIG. 2 is a diagram for explaining the war marks.
  • FIG. 3 is a diagram illustrating an example of a pattern of a short-lived mark.
  • FIG. 4 is a diagram illustrating an operation of adding a war mark.
  • FIG. 5 is a diagram for explaining evaluation values when a war mark is added.
  • FIG. 6 is a diagram for explaining evaluation values when no war mark is added.
  • FIG. 7 is a block diagram showing a configuration of a conventional encoder.
  • FIG. 8 is a block diagram showing a configuration of a conventional encoder inside an encoder.
  • FIG. 9 is a block diagram showing a configuration of a conventional decoder.
  • FIG. 10 is a block diagram showing a configuration of a decoder inside a conventional decoder.
  • FIG. 11 is a block diagram showing a configuration of a conventional watermark adder.
  • FIG. 12 is a block diagram showing a configuration of a conventional blue mark detector.
  • FIG. 13 is a flowchart for explaining the operation of the watermark adder shown in FIG. 11 above.
  • FIG. 14 is a flowchart for explaining the operation of the watermark detector shown in FIG. 12 above.
  • FIG. 15 is a block diagram showing a configuration of an image signal processing device according to an embodiment of the image signal processing device and method of the present invention.
  • FIG. 16 is a detailed block diagram of the watermark adder constituting the image signal processing device.
  • FIG. 17 is a flowchart for explaining the operation of the watermark adder shown in FIG. 16 above.
  • FIG. 18 is a block diagram showing a detailed configuration of the watermark adder in the earlier application.
  • FIG. 19 is a flowchart for explaining the operation of the watermark adder in the earlier application shown in FIG.
  • FIG. 20 is a diagram for explaining a process of rewriting a fixed-length encoded portion.
  • FIG. 21 is a diagram for explaining the structure of G0P.
  • FIG. 22 is a diagram for explaining the structure of a macroblock.
  • FIG. 23 is a diagram illustrating encoding of a DC component of a DCT coefficient.
  • FIG. 24 is a block diagram showing a configuration of an image signal decoding device according to an embodiment of the image signal decoding device and method according to the present invention.
  • FIG. 25 is a block diagram of the image signal decoding device shown in FIG.
  • FIG. 4 is a block diagram showing a detailed configuration of the evening mark detector.
  • FIG. 26 is a flowchart for explaining the operation of the watermark detector shown in FIG. 25 above.
  • FIG. 27 is a block diagram showing a configuration of a modified example of the watermark adder shown in FIG. 16 described above.
  • FIG. 28 is a flow chart for explaining the operation of the modification shown in FIG. 27 above.
  • FIG. 29 is a block diagram showing a configuration of a modification of the power mark detector shown in FIG. 25.
  • FIG. 30 is a flowchart for explaining the operation of the modification shown in FIG. 29 described above.
  • FIG. 31 is a block diagram showing a schematic configuration of the second embodiment according to the present invention.
  • FIG. 32 is a diagram for explaining an example in which the average value is increased by one by increasing some pixel values in the block by one.
  • FIG. 33 is a flowchart for explaining the operation of the second embodiment according to the present invention.
  • FIG. 34 is a flowchart for explaining the operation of the second embodiment according to the present invention.
  • FIG. 35A is a block diagram showing a configuration of a watermark adder constituting a third embodiment according to the present invention.
  • FIG. 35B is a block diagram showing the configuration of the watermark detector constituting the third embodiment.
  • the configuration and operation of the encoder 2 are the same as those of the encoder 72 shown in FIG. 8 described above, and the description is omitted here.
  • the configuration of the warrior mark adder 1 in FIG. 15 is different from that of the warrior mark adder 71 shown in FIG. As shown in the figure, a simple code decoder 11, ancillary information adder 12, a DC component difference value encoding table unit 13, a ⁇ —even mark pattern matching controller 14, And a mark pattern holding memory 15.
  • the watermark bit adder 1 receives an encoded bit string and accompanying information.
  • the input coded bit string is simply decoded by the simple code decoder 11 to find the position of the code to which the additional information is added.
  • the simple code decoder 11 decodes the input code with reference to a coding table unit 13 for coding, for example, a difference value of a DC component of DCT (DC component).
  • the encoded code obtained as a result of decoding by the simple code decoder 11 is used.
  • the code position information b indicating the position of the target code when adding the additional information f on the packet sequence is passed to the additional information adder 12 together with the input encoded bit sequence.
  • the accompanying information adder 12 adds the position information p to be added to the target code on the coded bit string in order to add a watermark pattern. It is passed to evening pattern matching controller 14.
  • coding is performed in units of macroblocks or blocks, so that the position information P of the code to be added generally indicates their spatial position .
  • a one-dimensional position expression that indicates the position in the scanning order from the upper left position of the image as a starting point, and which coordinate in space also uses the upper left position of the image as the origin
  • a two-dimensional position expression that indicates whether the position is located is used.
  • the watermark mark pattern matching controller 14 refers to the symbol of the watermark mark pattern recorded in the memory mark holding memory 15 based on the position information p, and obtains the obtained symbol S as accompanying information. Hand over to adder 1 and 2. Using the passed symbol S, the additional information adder 12 adds a watermark pattern to the code to be added. Specifically, corrections are made, such as replacing the code to be added with a new code.
  • the DC component When encoding the differential value of the DC component, the DC component is represented by the size and the actual value (DC Differential) represented by the size.
  • the former is a variable length code (VLC)
  • the latter is a fixed length code (FLC: Fixed Length Code).
  • the accompanying information is added within a range in which the variable-length code portion and the fixed-length code portion are combined, so that the code length as a whole is not changed.
  • the size of the DC component (DC difference component) is defined as shown in Table 1 below.
  • the color difference signal is specified as shown in Table 2 below [Table 2].
  • the DC difference component is defined as shown in Table 3 below.
  • the difference value is represented by 101001.
  • the configuration in the first embodiment is as shown in FIGS. 15 and 16 described above.
  • a watermark mark adder 1 is provided after the encoder 2 and the Characteristically, an encoding table 13 is provided inside the adder 1, and the target of correcting the encoded bit string is a fixed-length code portion and a variable-length code portion.
  • the word mark adder 1 shown in FIG. 16 is replaced with the word mark adder 3 shown in FIG. 18, and the encoding table 16 has a fixed length code table. Was required.
  • step S1 the addition levels a and b of the short mark are set in step S1.
  • step S2 the encoded bit sequence is read up to the position of the target code when the additional information is added on the encoded bit sequence. Thereafter, as shown by the dotted line in step S3, a correction may be made for the mismatch generated in the immediately preceding block. This will be described later.
  • step S4 matching with the watermark pattern is performed according to the block position of the target code on the coded bit string. If, for example, additional information is added to the code of the DC component of the DCT, and if the symbol of the watermark at the block position is a brass in step S5, the process proceeds to step S6 and the code is displayed.
  • a value x ' is calculated by adding a to the DC component X to be calculated. If the symbol of the watermark at the block position is negative in step S5, the flow advances to step S7 to calculate a value x 'obtained by subtracting a from the DC component X represented by the sign. Then, in step S8B, the sign of the DC component X at that block position is corrected to the sign of x '.
  • step S9 When making corrections, only the fixed-length code is changed, referring mainly to the table that encodes the difference value of the DC component of the DCT (DC component). Since only the fixed-length code part is changed, this correction process is merely a code replacement. Then, the determination in step S9 is repeated, and the process ends after performing these processes for all the codes in the target area.
  • the DC component of the DCT is subjected to differential coding (DPCM: Differential Pulse Code Modulation).
  • DPCM Differential Pulse Code Modulation
  • To give a specific example of differential encoding if there is a sequence of 3, 6, 12, 4, 7 then calculate the difference from the immediately preceding numerical value, for example, the sequence of 3, 3, 6, -8, 3 And encoding is performed. At this time, for example, if the third difference value is replaced with 4 and additional information is added, the values after the 4th will be 2 smaller than the original values unless correction is made.
  • To correct the fourth and subsequent numerical values without replacing the third numerical value and adding the accompanying information replace the fourth differential value with -6, which is larger by two.
  • the processing method may be determined according to the method of adding the accompanying information.
  • the actual coded bit sequence is generated according to various restrictions such as a coding rate.
  • a coding rate As an example, when the code to be added is replaced with a new code, the replacement often changes the word length of the code, causing various problems.
  • the watermark mark adder 3 shown in Fig. 18 examines the target code when adding the accompanying information on the coded bit string, Various measures are taken, such as adding additional information only to the long code part.
  • FIG. 21 illustrates the principle of appending additional information in the MPEG system.
  • G0P Group Of Pictures
  • one G0P is constituted by 15 pictures.
  • DCT DC encoded in units of work When adding additional information to a component, configure G0P
  • I picture is selected from.
  • the macro block of 16 ⁇ 16 pixels is composed of four blocks of 8 ⁇ 8 pixels in the case of the luminance signal (Y).
  • the color difference signals Cb and Cr are represented by a block of 8x8 pixels for one macroprogram of 16x16 pixels.
  • These pixel data are converted to DCT coefficients by DCT (Discrete Cosine Transform).
  • Coeff [0] [0] (scan [0]) in the upper left represents the DC component (DC component). From this DC component, the DC component of the block immediately before was used as the predicted value. A difference value is calculated, and the difference value is encoded. The remaining AC components (AC components) are coded by zigzag scanning within the block, after being sorted as scan [0] as a direct component, followed by scan [l] to scan [63]. You.
  • the difference between the DC component and the immediately preceding DC component is calculated, and the difference value is encoded.
  • the order of the four blocks is as follows: upper left, upper right, lower left, lower right. Therefore, as the DC component of the upper left block, the difference from the DC component of the lower right block of the immediately preceding macroblock is encoded, and as the DC component of the upper right block, the difference from the DC component of the upper left block is coded.
  • the DC component of the lower left block is coded as the difference between the DC component of the upper right block, and the DC component of the block of the lower right block is the difference between the DC component of the lower left block and the DC component of the lower left block. Encoded.
  • the difference between the immediately preceding corresponding color difference signal and the DC component of the block is encoded.
  • the DC component when encoding the difference value of the DC component, the DC component is represented by a size and an actual value represented by the size (DC Differential).
  • the former is a variable length code (VLC: Variable Length Code)
  • the latter is a fixed length code (FLC: Fixed Length Code).
  • the additional information is added, if the DC difference component is changed within a range where the size of the DC component (DC difference component) does not change, the additional information is added using only the fixed-length code portion. can do.
  • the size of the DC difference component of the luminance signal is 3, and the actual DC difference component zz [0] is -6.
  • the symbol of the warrior mark pattern is plus and the additional level a is 1, if the difference value is replaced from 101001 to 101010, the actual DC difference component becomes -5, which is one larger than -6.
  • the symbol of the warrior mark pattern is negative and the additional level b is 1, if the difference value is replaced from 101001 to 101000, the actual DC difference component becomes -7, which is one smaller than -6.
  • the difference value may be replaced with 101001 to 101011.
  • the fact that the actual DC difference component has become -4, which is larger than -6 by 2 is recorded in a register or the like and the next addition to the DC difference component is performed. Should be used by referring to the value.
  • the size of the DC component is 0, that is, when the actual DC difference component zz [0] is 0, additional information cannot be added using only the fixed-length code portion, and the additional information is added at the block position. No information is added. Alternatively, additional information may be added by some processing.
  • the next addition when the actual DC difference component zz [0] is 7, the size of the DC difference component of the luminance signal is 3.
  • Motion_residual in the code obtained by encoding the difference value of the motion vector (motion vector) is described.
  • FLC Motion_residual in the code obtained by encoding the difference value of the motion vector
  • the motion vector detector 150 detects the motion vectors of the P picture and the B picture, encodes them, and encodes them in the bit stream. It is intended to be transmitted together.
  • This Motion Vector is represented by Motion-code as VLC as shown in Tables 4 and 5, and Motion_residual as FLC.
  • Motion-code represents a rough value of the Motion Vector
  • Motion-resi dual represents a correction value for representing a fine value.
  • f_code indicates the accuracy (magnification) of Motion-code.
  • Motion-code represents a value with 0.5 precision.
  • Motion_residual is not used.
  • Motion-code represents integer precision
  • Motion-resi dual represents a value with 0.5 precision. That is, at this time, the Motion residual is Expressed as a 1-bit FLC indicating 0 or 0.5.
  • Motion-code represents a value with a precision of a multiple of 2
  • Motion-residual represents a 2-bit FLC representing 0, 0.5, 1.0 or 1.5.
  • accompanying information can be added to such Motion-residual FLC.
  • an evaluation value may be calculated by adding and subtracting a motion vector or a difference value thereof.
  • the accompanying information may be detected using other methods.
  • the Motion residual exists in the P picture and the B picture, if the Motion residual of the B picture is used, the B picture is not used for the prediction of other pictures. It is possible to prevent other pictures from being affected by the insertion.
  • the additional information may be added using a code other than fixed length (variable code), but in this case, unnecessary bits are inserted into the coded bit sequence, It was necessary to take the necessary configuration, such as removing unnecessary bits above, before processing. These can be similarly applied to any encoding method or any decoding method.
  • the encoder table unit 13 is provided with a fixed-length code and a variable-length code in the power mark adder 1 shown in FIG.
  • the war symbol adder 1 shown in Figure 16 is The difference from the watermark adder 3 shown is the coding table unit 13 referred to by the simple code decoder 11.
  • the encoding table unit 13 not only fixed-length codes but also variable-length codes are indispensable.
  • FIG. 17 shows a series of processes performed by the watermark adder 1 in FIG.
  • the coding table referred to in step S8A to correct the target code is different from the coding table referred to by the watermark adder 3 shown in FIG.
  • an example is shown in which an encoding table of the difference value of the DC component is used.
  • the image signal processing apparatus can add the accompanying information without re-encoding by the watermark adder 1, and has a code length within a range including the variable length code portion and the fixed length code portion. Additional information can be added without changing the information.
  • the input code bit string is first input to the Warner mark detector 22 to detect the Warner mark, and then the Warner mark detector.
  • the Warner mark detector This is an image signal decoding device in which the code bit string output from 22 is supplied to the decoder 21 and decoded.
  • the configuration and operation of the decoder 21 are the same as those of the decoder 81 shown in FIG. 10 described above, and description thereof is omitted here.
  • the watermark detector 22 shown in FIG. 24 has a different configuration from the watermark detector 82 shown in FIG. 12, and as shown in FIG.
  • An encoding template 31; a simple code decoder 32; an evaluation value calculator 33; a Warmark pattern matching controller 34; a Warmark mark storage memory 35; An evaluation value comparator 36 and a code converter 37 are provided.
  • the encoded bit string is input to the watermark detector 22.
  • the input coded bit string is simply decoded by the simple code decoder 32 in order to find the position of the code for detecting the accompanying information.
  • the simplified code decoder 32 decodes the input code with reference to, for example, an encoding table 31 for coding the DC component (DC component) of the DCT.
  • an encoding table 31 for coding the DC component (DC component) of the DCT.
  • fixed-length code and variable-length code tables are indispensable.
  • the position of the code in this case, which is decoded by the simple code decoder 32 refers to, for example, the position on the coded bit string or the spatial or frequency position when decoded. Various positions may be searched, including positions other than.
  • the position of the code to be searched depends on the type of the code to be detected when detecting the accompanying information on the coded bit string, which is the same as described in the watermark adder 1. It is. In some cases, decoding may be performed on the entire or a part of the coded bit sequence to form a whole or a part of the reproduced image.
  • the code position information b indicating the position of the target code when detecting the accompanying information on the encoded bit string is passed to the evaluation value calculator 33 together with the input encoded bit string.
  • the evaluation value calculator 33 passes the code position p of the evaluation target to the watermark pattern matching controller 34. This code position P is the same as the one described in the Original or two-dimensional position representation is often used.
  • the key mark matching controller 34 refers to the key mark of the key mark pattern recorded in the key mark pattern holding memory 35 based on the code position p.
  • the obtained symbol S is passed to the evaluation value calculator 33.
  • the evaluation value calculator 33 calculates an evaluation value using the passed symbol S.
  • the calculated evaluation value is subjected to threshold processing in the evaluation value comparator 36, and the accompanying information f is output. Also, the input image data is output as it is.
  • a code converter 37 shown by a dotted line is provided, and the input coded bit string is processed or processed and output. Sometimes. In the code converter 37, processing or processing such as not outputting the coded bit string or rearranging the coded bit string randomly is performed.
  • this image signal decoding apparatus is as shown in FIGS. 24 and 25 above, and the point that a watermark detector 22 is provided in front of the decoder 21 and that the watermark detection is performed. It is characterized in that a coding table unit 31 is provided inside the unit 22 and the objects to be coded bit string are corrected to a fixed length code part and a variable length code part.
  • Fig. 26 shows a series of processes performed by the war mark detector 22.
  • the encoding table referred to in order to correct the target code in the conventional example, only the fixed length code is essentially required, but in this embodiment, the variable length code is used. Is also essentially required.
  • an example is shown in which an encoding table of DC component difference values is used.
  • the target code for detecting the accompanying information on the encoded bit string In order to read the encoded bit string to the position of the symbol, it is necessary to prepare an encoding table for all or at least the main part.
  • the fixed-length code and variable-length code tables described above generally correspond to the coding table of the main part in many cases, and should be prepared in both the earlier application and this embodiment. There are many.
  • any comparison method other than the comparison method described above may be used.
  • the comparison may be performed with a bias reliability coefficient c (( ⁇ l) indicating how much the bias component is considered to be held.
  • the auxiliary information may be detected by calculating a standard evaluation value using some method, and comparing the calculated value with the actual evaluation value.
  • any symbol other than plus and minus may be used as the symbol of the war evening mark.
  • any two or more types of symbols may be used instead of the two types.
  • three types of symbols, plus, zero, and minus, are prepared, and a code whose symbol is zero when matched with a short-term mark pattern does not affect the evaluation value sum. (The value represented by the code is not added to or subtracted from the evaluation value sum.)
  • Each symbol may have any meaning.
  • the range in which the watermark pattern is added on the coded bit string is arbitrary. In addition, matching with the added warrior mark pattern is checked. As long as the range is determined, the range for obtaining the evaluation value at the time of detection may be arbitrary. In addition, it is acceptable to add or detect a short-time mark pattern using a wider range over time or space. For example, in a moving image sequence, a temporal reference may be used, and not only the temporal position of the current frame but also past and future frames may be used.
  • one image is divided into a plurality of image regions in a certain unit and handled, and the spatial standard is used to code the current target image region.
  • the codes of the image areas located before and after in the scanning order may be used.
  • the image signal decoding apparatus can add the accompanying information without performing the encoding again by using the watermark detector 21 and code the variable-length code portion and the fixed-length code portion together. Accompanying information can be detected without changing the length.
  • FIG. 27 a modified example of the image signal processing device will be described with reference to FIGS. 27 and 28.
  • FIG. In this modified example, a word mark adder 4 is used instead of the word mark adder 2 shown in FIG.
  • the 8x8 DCT coefficients Coeff [0] [0] to Coeff [7] [7] of one process are quantized at predetermined quantization steps, and the quantization levels QF [0] [0] to QF [7 ] [7].
  • this DC component DC component
  • the AC component (AC component) is generally a variable-length code.
  • the AC component (AC component) is coded by zigzag scanning in the block, after being arranged as scan [0] as a DC component, followed by scan [l] to scan [63].
  • the evening mark pattern can be assigned, for example, in the coding scanning order.
  • a macroblock When a macroblock is coded, its AC component is first coded for the AC component scan [l] to scan [63] for the block at the upper left 0 of the luminance Y. Subsequently, the AC components scan [l] to scan [63] are encoded for one upper right block of the luminance Y, and a few blocks are encoded in the same manner. To add a warm-up mark only to the luminance signal, the lower right three blocks are coded, and then the next (generally right) macroblock is moved to the upper left of luminance Y. Encoded for zero blocks. The following is the same.
  • two scanning orders can be considered.
  • One is a scanning order method in which the blocks of the lower right 3 of the luminance Y are encoded in the above example, and then the blocks of the color difference blocks 4 and 5 are encoded.
  • the other is a scanning order method in which the chrominance signals Cb and Cr are encoded after encoding the luminance Y in the screen.
  • any other scanning order may be used.
  • the above-mentioned ordinary zigzag scanning and the above-mentioned ordinary scanning which is adapted by in-line scanning of an image.
  • Rice cake The scanning order may include not only the AC component but also the DC component. It is not necessary to use all AC components. For example, some scan [x] (0 ⁇ x 63) to be used in each block may be determined in advance, or some characteristic coefficients may be selected.
  • each DCT coefficient (mainly the AC component)
  • the number (run) of coefficient 0 preceding (following) in the scanning order and its coefficient value (level) are grouped by a variable length code. Encoded.
  • Tables 6 to 11 show the encoding tables for DCT coefficients in MPEG2.
  • VLC RUN (Level) of first DCT coefficient and next run level DCT coefficient
  • encoding is performed using the encoding tables in Tables 6 to 11 described above. However, when performing intra-image encoding (INTRA), another encoding table may be used. If the combination of run and level cannot be represented by the tables prepared in Table 6 to Table 11, the run and level are each determined using the run and level coding table following the escape code. And are fixed-length coded.
  • the code may be modified so that the code length does not change within a wider range of an arbitrary block. For example, consider the following example.
  • the coefficient that was 0 before the addition of the war evening mark may be changed to a value other than 0, and conversely, the coefficient may be changed to 0 before the addition.
  • Coefficients other than the above may be set to 0.
  • m is preferably a small positive value such as +1 or +2 when the warrior mark pattern is +.
  • the range where the code length does not change was within an arbitrary block.
  • this range may be anything.
  • the watermark signal adder 4 included in this image signal processing apparatus is configured by using only the configuration of the encoding table unit 17 as shown in FIGS. 15 and 16 above. Different from the configuration of 1.
  • the encoding table unit 17 is an encoding table that is essential for the simple code decoder 11, and is characterized in that the target for correcting the encoding bit string is only the variable-length code part.
  • a table of variable length codes is indispensable.
  • a coding table of DCT coefficients generally a variable length code including an AC component
  • FIG. 28 shows a series of processes performed by the warp mark adder 4.
  • the coding table referred to in step S8C to correct the target code is different from the coding table referred to by the watermark adder 2 shown in FIG.
  • An image signal clothing device is a watermark detector 24 as shown in FIG. 29, and a DCT coefficient encoding table device 39 is characteristic.
  • the encoder table unit 31 of the DCT coefficient of the watermark detector 22 shown in FIG. 25 described above stores the variable length code portion and the fixed length code portion. While it was possible to detect the accompanying information whose code length did not change within the combined range, it was possible to detect the accompanying information whose code length did not change only in the variable-length code part.
  • the encoding table unit 39 must have a table of variable length codes.
  • an encoding table of DCT coefficients generally a variable length code including an AC component
  • FIG. 30 shows a series of processes performed by the watermark detector 24.
  • a variable length code is required as an encoding table to be referred to in step S12C to correct the target code.
  • the watermark information detector 24 can add the additional information without re-encoding, and can change the additional information without changing the code length in the variable-length code portion. Can be detected.
  • any comparison method other than the comparison method described above may be used. For example, by utilizing the fact that the bias component B of the evaluation value is constant, the comparison may be performed together with the bias reliability coefficient c (O ⁇ c) indicating how much the bias component is considered to be held.
  • a standard evaluation value is calculated using some method, and the value is compared with an actual evaluation value to detect accompanying information. Is also good.
  • any symbol other than plus and minus may be used as the symbol of the war evening mark. It is also acceptable to use any three or more symbols instead of two. For example, three types of symbols, plus, zero, and minus, are prepared, and a code whose symbol is zero when matching with a warrior mark pattern does not affect the evaluation value sum ( Any meaning may be given to each symbol, such as adding or subtracting the value represented by the code to the evaluation value sum.
  • the range in which the watermark pattern is added on the coded bit string is arbitrary. Also, the range for obtaining the evaluation value at the time of detection may be arbitrarily set as long as the matching with the added watermark pattern is taken. Further, the watermark pattern may be added or detected using a wider range over time or space. For example, in a moving image sequence, a temporal reference may be used, and not only the temporal position of the current frame but also past and future frames may be used.
  • one image is divided into a plurality of image regions in a certain unit and handled, and the spatial standard is used to code the current target image region.
  • the codes of the image areas located before and after in the scanning order may be used.
  • the second embodiment is an image signal processing apparatus that estimates a rounding process performed by quantization when adding additional information, thereby minimizing a change in a value to be corrected at the time of addition.
  • description will be made with reference to FIGS.
  • additional information such as a war mark is attached. If the value to be added is quantized, minimize the change in the value to be corrected when adding the accompanying information by devising the addition method so that the rounding process performed in quantization can be used properly. Can be. That is, according to the second embodiment, in the signal processing for embedding the accompanying information in the input signal, the correction necessary for changing the value after quantization with respect to the signal before quantization is performed. By doing so, the above-mentioned additional information is added, and the signal including the additional information is subjected to encoding including quantization.
  • the minimum value required to change the quantization value in the encoding is modified for the signal before encoding according to the additional information. It is mentioned. In this case, it is preferable to estimate a rounding error at the time of quantization, and to correct at least a part of the signal before encoding according to the estimated rounding error and the accompanying information.
  • FIG. 31 shows a main part of an image signal processing apparatus according to a second embodiment of the present invention, in particular, an image signal processing apparatus for embedding and encoding a Water Mark as incidental information in an image signal.
  • FIG. 2 is a block diagram showing a schematic configuration.
  • an input signal such as an image signal is sent to a rounding error estimator 8 of a warner mark adding device 1 which is an additional information adding means, and an output from the rounding error estimator 8 corrects a pixel value. It is sent to the additional information adder 9 as a means.
  • the output from the additional information adder 9 of the watermark adder 1 is sent to the encoder 2 and encoded.
  • the encoder 2 for example, one having a configuration such as the encoder 72 in FIG. 8 described above, which performs DCT encoding and then quantization, can be used. It is not limited to this.
  • a rounding error estimator 8 in the watermark adder 1 estimates a rounding error at the time of quantization, and sends rounding error information err to an additional information adder 9.
  • the accompanying information adder 9 converts the pixel value and the like of the input signal data such as the image signal in accordance with the accompanying information f and the power mark pattern from the watermark mark holding memory 10. The evening was corrected and sent to encoder 2.
  • the DC component of the DCT (DC component) is quantized by encoding.
  • DC component DC component
  • a short mark is added to this DC component with an addition amount of, for example, ⁇ 1
  • processing has been performed such that the DC component is corrected by ⁇ 1.
  • This is equivalent to making the luminance value ⁇ 1 for all the pixels in the 8 ⁇ 8 block on the image subjected to DCT.
  • quantization is performed at the time of encoding, only the minimum necessary pixels corresponding to the rounding error method at the time of quantization are corrected, and the DC component is marked with an additional amount of ⁇ 1 for the DC component. The same effect as that added can be obtained.
  • Fig. 32 shows an example of an 8x8 block before DCT.
  • the DC component of the DCT is equivalent to the average value of the block.
  • the average values of the three blocks shown in Fig. 32 are different, when quantized by rounding the first decimal place to the nearest whole number, the average value of all blocks is 43.
  • Adding +1 to the DC component is equivalent to adding +1 to the average of the block obtained by rounding off the first decimal place of the average. If the average value before quantization becomes 43.5, the DC component should be +1. Therefore, the number of pixels n is calculated by increasing some of the pixels in the proxies by 1 so that the average value becomes 43.5 or more.
  • the number of pixels to be corrected can be reduced, and for example, an effect such that the degree of deterioration of image quality due to addition can be reduced can be obtained.
  • any additional amount may be set, such as providing a pixel having another additional amount such as +2.
  • 1 pixel may be incremented by 1 and 1 pixel may be incremented by 4.
  • two pixels may be set to ⁇ 2, and three pixels to +3.
  • the pixel to be corrected in the block may be set at random, or the position of a pixel containing many high-frequency components that are difficult to detect with human eyes may be detected and added intensively there. .
  • the range for estimating rounding during quantization usually depends on the range of the quantization target. However, other ranges may be estimated as units. In the above example, the estimation is made in the range of 8x8 procks, but as an example, a range of this integral multiple (such as 16x16) may be used as a unit.
  • the rounding method at the time of quantization may be any method other than rounding.
  • the DC component (DC component) of the DCT Although the example of adding a tag has been described, it is not necessary to be limited to this. — — Any value can be used as long as the value to be added to the evening mark is quantized.
  • FIG. 33 and FIG. 34 show a series of processes when the additional information is added in the second embodiment of the signal processing device and the signal processing method.
  • the configuration of the second embodiment differs from the conventional technology in that the value of the watermark addition target is estimated by the rounding process at the time of quantization, and the rounding error information err which is the estimation result is obtained.
  • the feature is that is reflected when a watermark is added.
  • FIG. 31 above which shows an example of the configuration according to the present embodiment, mainly shows the configuration of the watermark mark adder 1, and what happens to the value to be added with the watermark mark due to rounding processing during quantization.
  • the rounding error estimator 8 estimates rounding error information err at the time of quantization.
  • the additional information f is on, the additional information is added by the additional information adder 9 using the Warm evening mark pattern recorded in the Warm evening mark pattern holding memory 10 and the rounding error information err.
  • the accompanying information f is off, the accompanying information adder 9 outputs the input image data as it is.
  • steps S 101 of FIG. 33 the additional levels a and b of the war mark are set.
  • the rounding error information err in the block is estimated on the image to which the additional information is to be added, and the number n of pixels for correcting the luminance value is obtained.
  • the process from 1 to 2 (1 to 2) is repeated while changing the pixel position in the block.
  • step S103 of FIG. 34 in the image to which the additional information is to be added, the target block (DCT block) including pixel X is marked with a watermark. Performs pattern matching.
  • step S 104 it is determined whether the symbol of the power mark of the block is plus or minus, and if the symbol of the war mark is positive, the process proceeds to step S 105, and Add a to the pixel value X of the pixel X in the block. When the symbol of the war mark of the block is negative, the process proceeds to step S106, and b is subtracted from the pixel value X of the pixel X in the block.
  • step S107 of FIG. 33 it is determined whether or not the processing has been performed for all the blocks in the target area. If NO, the process returns to step S102, and if YES, the process ends. are doing.
  • the processing for setting the values of a and b in step S101 may be arranged immediately before the pattern matching step S103 in FIG.
  • any symbol other than plus and minus may be used as the war symbol.
  • any two or more symbols may be used instead of two.
  • three kinds of symbols, plus, zero, and minus, are prepared, and the sign whose symbol is zero when matching with the warrior mark pattern does not affect the evaluation value sum. (The value represented by the sign is not added to or subtracted from the evaluation value sum.)
  • Each symbol may have any meaning.
  • the range may be arbitrary.
  • the range for obtaining the evaluation value at the time of detection may be arbitrarily set as long as the matching with the added watermark pattern is achieved.
  • the watermark pattern may be added or detected using a wider range over time or space.
  • a temporal reference is used, and not only the temporal position of the current frame but also past and future frames may be used.
  • the image of the profile is divided into a plurality of image regions in a certain unit and handled.
  • the codes of the image areas located before and after in the scanning order may be used.
  • a value within a block range consisting of a plurality of data of the input signal is corrected so that a representative value within the block range has regularity.
  • the additional information is added.
  • modification of the value required to make the representative value within the range of a block consisting of a plurality of data of the input signal into a value in accordance with a predetermined rule is performed in the block. At least some of the data.
  • correction of the value required to make the decimal part of the average value within the range of the block composed of a plurality of data of the input signal constant for all the blocks in the input signal is performed in the block.
  • At least a part of the data is added to add the accompanying information.
  • the above-mentioned regularity is, for example, a regularity in which a decimal part of the average value of pixel data in the DCT block is fixed.
  • an image signal is assumed as an input signal, and a watermark is added to the DC component of the DCT, for example, for each 8 ⁇ 8 pixel block, which is a DCT block for DCT coding.
  • a watermark is added to the DC component of the DCT, for example, for each 8 ⁇ 8 pixel block, which is a DCT block for DCT coding.
  • the decimal component of the average value can be set to an arbitrary value.
  • the number of pixels to be corrected is determined so that the decimal component of the average value in the block is set to 0.5.
  • the arbitrarily configurable fractional value of the average value alone can have the meaning of the new accompanying information as follows.
  • Pno: 1/2, be 100. 2 to the 10th power can be approximated as 1000 2 10 "3.
  • the probability of one thirtieth power of 30 is an astronomically low probability, and this is not usually the case. Therefore, by modifying the pixel in block units and setting the fractional component of the average value of all blocks in the image to a certain value, it is possible to add additional information. At the time of detection of the accompanying information, if the decimal component of the average value of all the programs becomes a certain value, it is determined that the accompanying information is added.
  • any additional amount may be set, such as providing a pixel having another additional amount such as +2.
  • 1 pixel may be incremented by 1 and 1 pixel may be incremented by 4.
  • two pixels may be set to ⁇ 2, and three pixels to +3.
  • the pixels to be corrected in the block may be set at random, or the positions of pixels that contain many high-frequency components that are difficult to detect with human eyes may be detected and added intensively there. good. Of course, other methods may be used.
  • a certain range is set for the decimal component at the time of detection. May be. For example, if the fractional component at the time of addition is 0.4, the additional information is added when the fractional component err-now at the time of detection is 0.3 ⁇ err—now ⁇ 0.5 in all blocks in the image. It may be considered that it is done.
  • a plurality of different decimal component values may have the meaning of a plurality of accompanying information corresponding thereto. For example, when the value of the decimal component is 0.1, it is considered that the information A is added, and when the value of the decimal component is 0.8, the information B is considered to be added. You may do it.
  • the unit for adding the accompanying information may be any area or range other than the above.
  • the decimal component is calculated within the 8x8 block and the whole image is determined.However, the decimal component is calculated within the 2x5 block and the determination is performed using arbitrary 36 blocks of the image. You may do it.
  • the representative value of each area may be any value. In the above example, the case where the average value in the block is the representative value has been described.However, any value other than the average value, such as the maximum value, the minimum value, the intermediate value, the value of a specific position in the block, etc. Is also good. In the above example, the additional information is detected and added to the pixels in the image, but other values may be used.
  • a value which originally appears only as an integer value may be reduced to a decimal number, and the additional information may be added and detected using the decimal value.
  • the motion vector obtained with one-pixel accuracy may be halved, and the value may be added and the accompanying information may be detected.
  • a watermark pattern may be prepared and used when adding and detecting accompanying information. For example, a one-night mark pattern having two symbols, 3 and 4, is prepared, and when added, the decimal component is set to 0.3 when the symbol is 3, and the decimal component is set to 0.4 when the symbol is 4. . At detection In this case, when a decimal component corresponding to the pattern is detected, it may be considered that additional information is added. Of course, any other warrior mark pattern may be used.
  • the case where the value to which the watermark is added is not quantized is mainly described, but a method of using the accompanying information in consideration of the quantization may be used.
  • the additional information is added by setting the decimal component of the average value of the 8x8 block to 0.5 as described above, and the image is encoded by the MPEG method, the average value will be an integer due to the quantization of the DC component of the DCT. Therefore, the decimal component on the decoded image becomes 0, and the additional information added cannot be detected.
  • the accompanying information is detected.
  • the accompanying information can be used so that it can be determined at the time of detection whether or not the image to be detected has been encoded once.
  • a specific example of the first path is, for example, dubbing using a television signal
  • a specific example of the second path is, for example, a television broadcast using an encoded bit sequence encoded by the MPEG system.
  • the method of using the accompanying information may be any other method.
  • FIGS. 35A and 35B An example of the configuration according to the third embodiment is shown in FIGS. 35A and 35B.
  • FIGS. 36 and 37 show a series of processes when adding or detecting accompanying information in the third embodiment.
  • FIG. 35A shows the configuration of the watermark adder 1. ⁇
  • the rounding error estimator 8 estimates rounding error information e rr at the time of quantization (where err is the same as a decimal component).
  • the accompanying information f is on, the accompanying information is added by the accompanying information adder 9 using the rounding error information err.
  • the additional information adder 9 outputs the input image data as it is.
  • Fig. 36 shows a series of processes performed by the Warmer Mark Adder 1. That is, in the first step S121 shown in FIG. 36A, on the image to which the additional information is to be added, the rounding error information err in the block is estimated, and the number n of pixels for correcting the luminance value is determined. Ask. After that, the process from 1 to 2 (1 to ⁇ ) is repeated while changing the pixel position in the block. In the processing from 1 to 2 (1 to ⁇ ) in the circle, the value X of the pixel X in the block is changed in step S122 of FIG. 36B. These processes are repeated for all blocks in the target area.
  • FIG. 35B shows the configuration of the watermark detector 22.
  • an evaluation value is calculated by the evaluation value calculator 33.
  • the calculated evaluation value is subjected to threshold processing in the evaluation value comparator 36, and the accompanying information f is output.
  • the input image data is output as it is.
  • the image converter 37 shown by the dotted line is placed, and the input image data may be processed or processed and output. This is the same as in the conventional example.
  • FIG. 37 shows a series of processing performed by the war mark detector 22.
  • step S131 the evaluation value sum is initialized and the threshold value th is set, and the decimal component reference value err-normal is set. This err-normal is the fractional component of the average value in the block, set by changing the pixel when adding.
  • the fractional component err in the block is estimated on the image from which the accompanying information is to be detected.
  • step S133 when this err is equal to err-normal, 1 is added to the evaluation value sum. This process is repeated for all the blocks in the target area (step S134). Then, in step S135, the evaluation value sum is compared with the threshold th, and if sum> th, the additional information f is set to on assuming that the additional information is added. Otherwise, turn off the accompanying information f.
  • the evaluation value sum is used for the determination as the number of counts where err is equal to err-normal, but it is also possible to use the evaluation value to determine the accompanying information by other methods.
  • the present invention is not limited to the above-described embodiments.
  • the present invention is not limited to DCT coding, and various transform coding such as wavelet coding can be adopted.
  • INDUSTRIAL APPLICABILITY According to the present invention, additional information can be added or detected without re-encoding or decoding, and a variable-length code portion and a fixed-length code portion can be added or detected within a range. Fixed length, just like the sign part These processes can be performed without being limited to the range of the code portion.
  • a value within a block range composed of a plurality of data of the input signal is corrected to give a regularity to a representative value within a block range.
  • the additional information described above is added, so that by appropriately modifying a value in a certain range, the representative value in the range can be given regularity.
  • the regularity of this representative value it is possible to construct a method for adding and detecting new accompanying information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Editing Of Facsimile Originals (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Une suite binaire codée et des informations additionnelles sont incorporées dans un additionneur de filigranes. La suite binaire codée entrée est simplement décodée par un décodeur simple de manière à rechercher la position du code pour ajouter les informations additionnelles f. Le code entré est décodé en fonction d'un dispositif de table de codage qui code la valeur différentielle du constituant CC d'une TCD à l'aide du décodeur simple. Si les information additionnelles f entrées sont en mode de fonctionnement, les informations de position p relatives à la position de l'objet d'addition sont fournies à un dispositif de vérification du type de filigrane par l'additionneur d'informations additionnelles pour ajouter un type de filigrane au code qui est l'objet sur une suite binaire codée.
PCT/JP1999/003328 1998-06-22 1999-06-22 Appareil et procede de traitement de signaux, decodeur de signaux et procede associe WO1999067942A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP10/175202 1998-06-22
JP10175202A JP2000013764A (ja) 1998-06-22 1998-06-22 画像信号処理装置及び方法、並びに画像信号復号装置及び方法
JP10/191087 1998-06-22
JP10191087A JP2000013768A (ja) 1998-06-22 1998-06-22 信号処理装置及び方法

Publications (1)

Publication Number Publication Date
WO1999067942A1 true WO1999067942A1 (fr) 1999-12-29

Family

ID=26496538

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP1999/003328 WO1999067942A1 (fr) 1998-06-22 1999-06-22 Appareil et procede de traitement de signaux, decodeur de signaux et procede associe

Country Status (1)

Country Link
WO (1) WO1999067942A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0730696A (ja) * 1993-07-06 1995-01-31 Fuji Xerox Co Ltd 画像情報付加装置
JPH09172537A (ja) * 1995-12-20 1997-06-30 Fuji Xerox Co Ltd 画像形成装置
JPH09191394A (ja) * 1995-09-28 1997-07-22 Nec Corp 電子的すかし挿入方法
JPH10276321A (ja) * 1997-01-28 1998-10-13 Mitsubishi Electric Corp 電子透かし装置
JPH10313402A (ja) * 1997-02-14 1998-11-24 Nec Corp 画像データのエンコードシステム及び画像入力装置
JPH1155638A (ja) * 1997-08-04 1999-02-26 Sony Corp 情報付加装置、情報付加方法、画像データ再生装置及び画像データ再生方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0730696A (ja) * 1993-07-06 1995-01-31 Fuji Xerox Co Ltd 画像情報付加装置
JPH09191394A (ja) * 1995-09-28 1997-07-22 Nec Corp 電子的すかし挿入方法
JPH09172537A (ja) * 1995-12-20 1997-06-30 Fuji Xerox Co Ltd 画像形成装置
JPH10276321A (ja) * 1997-01-28 1998-10-13 Mitsubishi Electric Corp 電子透かし装置
JPH10313402A (ja) * 1997-02-14 1998-11-24 Nec Corp 画像データのエンコードシステム及び画像入力装置
JPH1155638A (ja) * 1997-08-04 1999-02-26 Sony Corp 情報付加装置、情報付加方法、画像データ再生装置及び画像データ再生方法

Similar Documents

Publication Publication Date Title
CA2225867C (fr) Systeme d'insertion et de detection de donnees d'identification pour donnees numeriques
Langelaar et al. Real-time labeling of MPEG-2 compressed video
US6341350B1 (en) Device and method for processing image data, transmitting medium, and recording medium
EP0928110B1 (fr) Traitement d'un signal d'image pour l'insertion d'un filigrane électronique
US7092546B2 (en) Digital watermarking technique
EP0926897A2 (fr) Méthode de traitement d'un signal vidéo pour l'insertion d'un filigrane électronique
US20090080689A1 (en) Watermarking Encoded Content
EP2011075B1 (fr) Procede de filigranage numerique
US7630512B2 (en) Method for performing recoverable video and image watermarking which survives block-based video and image compression
US7418110B2 (en) Method and apparatus for compressed-domain watermarking
KR100327210B1 (ko) 비디오데이터의복제제어장치및그방법
WO1999067942A1 (fr) Appareil et procede de traitement de signaux, decodeur de signaux et procede associe
US7583850B2 (en) Image-processing apparatus and method
Kim et al. A robust video watermarking method
JP2000013764A (ja) 画像信号処理装置及び方法、並びに画像信号復号装置及び方法
Kong et al. Adaptive video watermarking scheme
JP2000013768A (ja) 信号処理装置及び方法
JP4239998B2 (ja) 画像データ処理装置および方法
JP2005210704A (ja) 画像処理装置及び画像処理装置
Wang et al. A novel real-Time information hiding technique in vlc domain
Ait Saadi et al. Secure and Robust Copyright Protection for H. 264/AVC based on Selected Blocks DCT.
Simitopoulos et al. Fast compressed domain watermarking of MPEG multiplexed streams
EP1145562A1 (fr) Procede et systeme ameliores de compression en cascade destine a la video et aux images numeriques
JP2004222322A (ja) 電子すかしデータ挿入方法及び装置
JP2002010089A (ja) 画像符号化装置及び画像復号化装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CA US

WWE Wipo information: entry into national phase

Ref document number: 09486112

Country of ref document: US

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载