+

WO1998005165A1 - Procede et dispositif de detection d'un corps en mouvement - Google Patents

Procede et dispositif de detection d'un corps en mouvement Download PDF

Info

Publication number
WO1998005165A1
WO1998005165A1 PCT/JP1997/002590 JP9702590W WO9805165A1 WO 1998005165 A1 WO1998005165 A1 WO 1998005165A1 JP 9702590 W JP9702590 W JP 9702590W WO 9805165 A1 WO9805165 A1 WO 9805165A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
moving object
value
density value
contrast correction
Prior art date
Application number
PCT/JP1997/002590
Other languages
English (en)
Japanese (ja)
Inventor
Hideyuki Matsumoto
Akinori Kooketsu
Akio Yoshino
Shunnichi Komaki
Masakazu Saitoh
Original Assignee
Usc Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP8214114A external-priority patent/JPH1042277A/ja
Priority claimed from JP8214115A external-priority patent/JPH1042171A/ja
Priority claimed from JP9150797A external-priority patent/JPH10271486A/ja
Priority claimed from JP9150997A external-priority patent/JPH10271488A/ja
Priority claimed from JP9150897A external-priority patent/JPH10271487A/ja
Priority claimed from JP9150697A external-priority patent/JPH10271485A/ja
Application filed by Usc Co., Ltd. filed Critical Usc Co., Ltd.
Publication of WO1998005165A1 publication Critical patent/WO1998005165A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection

Definitions

  • the present invention relates to a moving object detection method and a moving object detection device that extract only a moving object from a series of moving images, and can be used as, for example, an intruder monitoring device. Furthermore, the present invention relates to a moving object detection method and a moving object detection device for the purpose of improving accuracy and speed, improving robustness, and the like of processing relating to detection of various kinds of moving objects.
  • Technical background When detecting a moving object from a moving image, in the past, a person continuously looked at the moving image projected on the display, and the moving object was detected based on his judgment. For example, in order to detect or record a trespasser, a monitoring device using a monitoring camera has been conventionally used.
  • Such a monitoring device projects an image in a predetermined area photographed by a surveillance camera, and a surveillant who monitors this image determines whether or not an illegal intruder exists.
  • Such monitoring work requires labor and may overlook the presence of an intruder, depending on the degree of fatigue of the monitor. In other words, the task of detecting moving objects was cumbersome, sometimes overlooked, and used for certainty.
  • the present invention has been made in view of the above situation, and a purpose thereof is to provide a moving object detection method and a moving object capable of easily and reliably detecting a moving object such as an unauthorized intruder without requiring labor. It is intended to provide a low-cost detection device. Further, it is another object of the present invention to improve the reliability of moving object detection, for example, by improving the robustness in detecting the moving object as described above. Disclosure of the invention Among the moving object detection method and the moving object detection device according to the present invention, the invention according to the moving object detection method according to claim 1 is characterized in that the quantization direction of the input frame obtained by the imaging unit is alternately inverted. A feature is to extract a moving body portion by alternately outputting a positive frame and a negative frame and by equalizing the density value of a stationary portion common to the positive frame and the negative frame adjacent in the forward direction.
  • the invention described in claim 1 described above it may be configured to perform contrast correction. That is, as described in claim 2, for the first frame on the time axis of the input frame group consisting of a desired number of input frames, the brightness is set to a predetermined value for the first frame on the time axis when the brightness is higher than the desired value. Re-quantize by applying contrast correction for correction, and re-quantize the remaining frames of the input frame group using the contrast correction information obtained in the first frame. Configuration.
  • the brightness of the frame whose brightness is equal to or more than the desired value is determined. Re-quantization is performed by performing contrast correction for correcting to a predetermined value, and for a frame following this frame, re-quantization is performed using the contrast correction information in the frame preceding that frame. Can be configured.
  • skip processing can be performed. That is, as described in claim 4, at least one of the input frames is set as a search target frame, and a maximum density value and a minimum intensity value are calculated from all pixels constituting the search target frame. Then, each is set as a first threshold value and a second threshold value, and a difference between the maximum density value and the minimum density value is calculated to obtain a third ⁇ value. In addition, the remaining frames other than the search target frame among the input frames are set as template frames, and the maximum density value and the minimum density value are calculated from all the pixels constituting the template frames. Then, it is determined whether the maximum density value and the minimum density value obtained from these template frames exceed the first K value and the second! 3 ⁇ 4 value, respectively.
  • the maximum density value and the minimum degree value obtained from the template frame both exceed the first and second 1 ⁇ values. Then, the difference between the maximum density value and the minimum density value obtained from the template frame is compared with the third 3 ⁇ 4 value, and if the difference is smaller than the third threshold value, the above template is compared. It is determined that no moving object exists in the frame. On the other hand, when the maximum density value and the minimum density value obtained from the template frame both exceed the first and second ⁇ values, and the difference is equal to or greater than the third threshold value. Then, it is determined that there is a moving object in the above template frame.
  • the vector connection processing may be performed. That is, as described in claim 5, a change in coordinate data in each input frame of a pixel which is estimated to form a moving object portion among pixels constituting the input frame and a pixel in the vicinity thereof, And the moving direction of the input image and its neighboring image in each input frame are detected, and the object consisting of all the pixels whose change in the coordinate data coincides with the moving direction and the object composed of the neighboring pixels is regarded as one moving object. I reckon.
  • the brightness is set for the frame whose brightness is equal to or more than the desired value.
  • the first contrast correction is performed.
  • the following skip processing is performed as one of the so-called pattern matching.
  • At least one of the moving object detection frames obtained by performing the first contrast correction is set as a search target frame, and the maximum density value and the minimum density value are obtained from all the pixels constituting the search target frame.
  • the remaining frames other than the search target frame in the moving object detection frames are used as template frames, and the maximum density value and the minimum density value are calculated from all the pixels constituting the template frame. Whether the maximum density value and the minimum intensity value obtained from the template frame exceed the first and second values, respectively. If the maximum density value and the minimum density value do not exceed the first and second values, it is determined that no moving object exists in the template frame.
  • the maximum density value and the minimum density value obtained from the template frame both exceed the first and second levels
  • the maximum density value and the maximum density value obtained from the template frame are used.
  • the difference from the minimum density value is compared with the third 3 ⁇ 4 value. If the difference is smaller than the third ⁇ value, it is determined that no moving object exists in the template frame.
  • the maximum density value and the minimum strain value obtained from the template frame both exceed the first and second threshold values, and the difference is equal to or greater than the third value. Then, it is determined that a moving object exists in the template frame.
  • a portion where there is no movement with respect to the temporally previous frame has an intermediate degree value (for example, around 128 in an 8-bit grayscale image). Utilizes such characteristics to detect whether or not there are pixels in the pixels composing the template frame that are more prominent than the first and second reference values obtained in advance. In such a detection, first, it is checked whether or not a density value exceeding the first and second ⁇ values exists in the pixels of the template frame. If the values do not exceed each value, it is determined that no moving object exists in the template frame.If the values exceed the first and second ⁇ values, the IE determines the peak value.
  • an intermediate degree value for example, around 128 in an 8-bit grayscale image
  • the third M value obtained by the frame to be searched Is compared with the difference obtained by the template frame, and if this difference value is smaller than the third ⁇ value, it is determined that no moving object exists in the template frame. Since skip processing is performed in two stages, the speed of pattern matching processing can be increased and the mouth-cutting performance can be improved.
  • the following vector connection processing is performed. That is, a change in coordinate data of each of the pixels constituting the moving object detection frame in the moving object detection frame, and a moving direction of each of the pixels in the moving object detection frame are detected.
  • the object composed of all the pixels that almost coincide with the moving direction is regarded as one moving object, and vector connection processing is performed.
  • a second contrast correction may be performed instead of the first contrast correction. That is, contrast correction for correcting the luminance of a first frame on the time axis of a group of input frames including a desired number of input frames to a predetermined value for a frame having a luminance higher than a desired value. And performs a second contrast correction for re-quantizing the frame following this frame using the contrast correction information in the frame preceding the frame.
  • the moving object detecting device includes a photoelectric conversion means for converting an optical input into a charge signal and storing the signal.
  • the photoelectric conversion means quantizes the input optical information to a high level when the luminance thereof is equal to or more than a predetermined value and a low level when the luminance is less than a predetermined value;
  • the above-mentioned image frames which have been subjected to the first quantization are alternately subjected to a low level and quantized to a low level below a predetermined value as a high level.
  • an imaging unit such as a CCD camera can be adopted as described in claim 9, and further, a detection unit for detecting a moving object extracted by the imaging unit can be provided. Further, as described in claim 10, a notifying means which operates when the presence of a moving object is detected by the detection means and notifies the presence of the moving object can be provided. Further, as described in claim 11, it is also possible to provide a recording unit that operates when the presence of a moving object is detected by the detection unit and records the moving object.
  • a contrast correction means may be additionally provided as described in claim 12. That is, of each pixel in a state where the light input is quantized, a contrast correction unit for performing a contrast correction for correcting a luminance of a pixel whose luminance is equal to or more than a desired value to a predetermined value is provided.
  • the contrast correction means performs the contrast correction on the first frame on the time axis of the input frame group composed of a desired number of input frames, requantizes the frame, and re-quantizes the input frame group. The rest of us It has a function to requantize the frame using the contrast correction information obtained in the first frame.
  • the photoelectric conversion means can freely convert the light input corrected by the contrast correction means into a charge signal.
  • a contrast correction means as described in claim 13 may be provided. That is, the contrast correction means performs the above-described contrast correction on the first frame on the time axis of the input frame group composed of a desired number of input frames, requantizes the frames, and outputs the frames. It has a function to requantize the subsequent frame using contrast correction information in the frame preceding the frame.
  • first contrast correction means may be configured to include first contrast correction means, skip processing means, and vector connection processing means.
  • first contrast correction means performs the contrast correction on the first frame on the time axis of the input frame group including a desired number of input frames, and requantizes the first frame. It has a function to requantize the remaining frames in the group using the contrast correction information obtained in the first frame.
  • the skip processing means includes, as a search target frame, at least one of the moving object detection frames obtained by performing the contrast correction by the first contrast correction means,
  • the maximum density value and the minimum density value are calculated from all the pixels constituting the search target frame, and are respectively set as the first threshold value and the second ia value. Is calculated as the third threshold value.
  • the remaining frames other than the search target frame among the above-mentioned motion detection frames are used as template frames, and the maximum density value and the minimum density value are calculated from all the pixels constituting the template frame. I do. Then, it is determined whether or not the maximum density value and the minimum density value obtained from these template frames exceed the first K value and the second ⁇ ⁇ ⁇ ⁇ value, respectively.
  • the density value does not exceed the first and second 13 ⁇ 4 values, it is determined that no moving object exists in the template frame.
  • the maximum density value and the minimum density value obtained from the template frame both exceed the first and second minimum values.
  • the difference between the maximum density value and the minimum density value obtained from the template frame is compared with the third threshold value.If the difference is smaller than the third ⁇ value, the template frame is compared. Determines that there is no moving object.
  • the maximum density value and the minimum density value obtained from the template frame both exceed the first and second threshold values and the difference is equal to or greater than the third threshold value, It has a function of determining that a moving object exists in the template frame.
  • the vector connection processing means includes: a change in coordinate data of a pixel constituting the moving object detection frame in each moving object detection frame; and a moving direction of the pixel in each moving object detection frame. And has a function of detecting an object composed of all the pixels in which the change in the coordinate data and the movement direction almost coincide with each other as one moving object. .
  • FIG. 1 is a schematic diagram for explaining a basic principle of a moving object detection method.
  • FIG. 2 is a flowchart for explaining the basic principle of the moving object detection processing.
  • FIG. 3 is a diagram showing the charge accumulation amount and the refresh timing.
  • FIG. 4 is a block diagram showing the first embodiment of the present invention.
  • FIG. 5 is a block diagram showing a configuration of a moving object detection processing circuit.
  • FIG. 6 is a block diagram showing a second embodiment of the present invention.
  • FIG. 7 is a diagram for explaining a third embodiment of the present invention.
  • FIG. 8 is a diagram for explaining the first contrast correction.
  • FIG. 9 is a diagram for explaining pattern matching.
  • FIG. 10 is a flowchart for explaining the skip processing.
  • FIG. 11 is a diagram for explaining the vector connection process.
  • FIG. 12 is a diagram for explaining an undesired vector connection process.
  • FIG. 13 is a diagram showing a modification of the third embodiment.
  • a positive frame 1 and a negative frame 2 are output alternately as shown in FIG.
  • the moving object detection frame 4 is output by equalizing the density value of the stationary portion 3 common to the positive frame 1 and the negative frame 2 which are adjacent in the forward direction.
  • the moving body detection frame 4 the moving body part 5 emerges because the density value of the stationary part 3 is uniform.
  • “sum / 2” in FIG. 1 indicates a process of subtracting the Macao value of each of the frames 1 and 2.
  • simply overlaying the positive frame 1 and the negative frame 2 has density information for two screens, so that an image having an extremely high density value is obtained. Become. Therefore, an appropriate amount of the constant value is subtracted.
  • the imaging means converts the input optical information. First, the density value is converted into a charge by positive logic, and then the density is stored by negative logic while storing the charge. Converts a value to a charge.
  • the adjacent positive frame 1 and negative frame 2 obtained by alternately inverting the quantization direction, the adjacent positive frame 1 and negative frame 2
  • the stationary portion is canceled out, so that the moving body portion 5 can be extracted.
  • FIG. 4 is a block diagram showing a moving object detection device according to the present embodiment.
  • the device according to the present embodiment is provided with a photoelectric conversion unit 10 that converts an optical input into a charge signal and stores the charge signal, similarly to a conventionally known CCD camera.
  • the photoelectric conversion means 10 includes a lens 11 for inputting optical information, an image sensor (CCD) 12, a signal processing circuit 13, a synchronization circuit 14, And a driving unit 15 for driving the element 12.
  • the signal processing circuit 13 includes a CDS 16 which is a circuit for removing noise and extracting only a video signal.
  • CDS 16 is a circuit for removing noise and extracting only a video signal.
  • Such a configuration is the same as a conventionally known CCD camera.
  • the signal processing circuit 13 is provided with a moving object detection processing circuit 17 which is a feature of the present invention.
  • the moving object detection processing circuit 17 includes an A / D converter 18 that performs A / D conversion of input optical information, and before performing various preprocessing for performing the moving object detection processing.
  • a processing circuit 19 a frame memory 20 for converting the density value into electric charge by positive logic, and storing the image frame converted into the electric charge, and an inversion circuit for converting the density value into electric charge by negative logic.
  • a synthesizing circuit 22 for synthesizing the image frames obtained by the frame memory 20 and the inverting circuit 21, respectively, and a signal obtained by the synthesizing circuit 22 is D / A converted and output. And a D / A converter 23.
  • Reference numeral 24 denotes a distributor for transmitting a part of the input signal as a through output signal.
  • the frame memory 20 converts the A / D-converted signal sent through the pre-processing circuit 19 into a high-level signal having a luminance equal to or higher than a predetermined value and a signal having a luminance lower than the predetermined value. Performs the first quantization to quantize (in positive logic) as a verbal level. Then, the image data subjected to the first quantization is stored.
  • the inversion circuit 21 converts the signal after the A / D conversion into a signal whose luminance is equal to or less than a predetermined value.
  • the upper one is set to the low level, and the one below the predetermined value is set to the high level, and the second quantization is performed (with negative logic). That is, in the frame memory 20, the input signal is converted into a charge value by positive logic into electric charge.
  • the inverting circuit 21 converts an input signal into negative electric charge by negative logic.
  • the image frame stored in the frame memory 20 and the image frame subjected to the second nesting by the inverting circuit 21 are sent to the synthesizing circuit 22, and the synthesizing circuit 22
  • the two are synthesized and compared.
  • the synthesizing circuit 22 the pixels having the same luminance are canceled by the two. In other words, the density of both stationary parts is made uniform.
  • the processing in this case is performed based on the threshold value given from the preprocessing circuit 19.
  • the output of the stationary portion is made uniform, and the luminance that is considered to be a moving object differs between the two. Are extracted. Therefore, in the output signal, the moving object is in a raised state.
  • the frame memory 20 and the inverting circuit 21 After transmitting the image frame signal to the synthesizing circuit 22, the frame memory 20 and the inverting circuit 21 receive the next signal and perform the same processing.
  • the synthesizing circuit 22 sends an output signal to wait for a new input.
  • the moving object detection device Since the moving object detection device according to the present embodiment is configured as described above, the input optical information is subjected to the first quantization and the second quantization alternately, and these are superimposed. By doing so, the stationary part is canceled and the moving part is raised as a result. Therefore, the moving object detection operation can be performed easily and reliably.
  • the structure can be easily achieved only by adding the moving object detection processing circuit 17 to the signal processing circuit 13 of a conventionally known CCD camera.
  • a moving object detection processing circuit 17 can be incorporated into the above-mentioned CCD camera, or it can be manufactured as an external adapter and used by attaching it to an existing CCD camera. Therefore, the manufacturing cost does not increase significantly.
  • the input image is a gray scale.
  • moving objects can be detected even if the input image is a full-color image, extra information is added to the output image because the full-color image can express small color differences and saturation differences. would. For this reason, a gray scale is preferable as the input image.
  • the position, angle, and focal length of the apparatus need to be fixed. This is because if these change, all the shifts due to this change will be extracted.
  • the present embodiment can be implemented using a computer based on data captured by a conventional CCD camera.
  • a second embodiment of the present invention will be described.
  • This embodiment is applied as a monitoring device.
  • a CCD camera 25 for extracting a moving object from an input signal
  • a detecting means motion-diode
  • detecting the moving object extracted by the CCD camera 25 Detector 26
  • an alarm 27 that operates when the detection means 26 detects a moving object such as an unauthorized intruder
  • a monitor 28 that displays the input signal one by one.
  • a timelabs video 29 that also operates as a trigger when the detection means 26 detects a moving object such as an unauthorized intruder.
  • Reference numeral 30 denotes a switcher, which controls the operation and stoppage of the CCD camera.
  • the CCD camera 25 converts the input signal to a high level with a luminance higher than a predetermined value.
  • a first quantization that quantizes a luminance less than a predetermined value as a mouth level and a second quantization that quantizes a luminance higher than the predetermined value as a low level and a luminance lower than the predetermined value as a high level. It has a function of extracting a moving object portion by alternately applying the image signals obtained by the first and second quantizations and canceling out a static portion having no change in luminance.
  • Such a function employs a CCD camera 25a incorporating a circuit for performing such a function, and a conventionally known CCD camera 25b with an adapter 35 described below. May be adopted.
  • FIG. 6 shows both cameras 5a and 5b, it is only necessary to provide one of them. Circuits for performing the above functions are the same as those in FIGS. 4 and 5 showing the first embodiment described above.
  • the moving object extracted by the CCD camera 25 as described above is detected by the detecting means (motion 'detector) 26.
  • the detecting means 26 detects the moving object by detecting a luminance that is regarded as a moving object or a luminance different from the luminance of the stationary portion.
  • a detecting means 26 can be manufactured by using a conventionally known circuit.
  • an alarm 27 is provided which operates when the detection means 26 detects a moving object such as an illegal intruder or the like as a trigger. In the case of the present embodiment, the alarm 27 is incorporated in the detection means 26.
  • a monitor 28 for displaying the input signals one by one is provided, and similarly to the conventional monitoring device, the moving object can be detected also by the video projected on the monitor 28. Further, when the detecting means 26 detects a moving object such as an illegal intruder, an evening video 29 is provided which operates using this detection signal as a trigger. With this, it is possible to record an image related to the moving object as the moving object is detected. Various other conventionally known recording means can be employed. Since the moving object detection device of this embodiment is configured as described above, the moving object is extracted by the CCD camera 25a. That is, as shown in FIG.
  • the frame memory 20 stores the signal after the A / D conversion transmitted through the pre-processing circuit 19 and the signal whose luminance is equal to or more than a predetermined value.
  • the first quantization is performed in which quantization is performed at a high level and that below a predetermined value is defined as a low level (positive logic). Then, the image data subjected to the first quantization is stored.
  • the inverting circuit 21 converts the signal after the A / D conversion into a low level when the luminance is equal to or higher than a predetermined value and a high level when the luminance is lower than the predetermined value (by negative logic). And perform the second quantization. That is, in the frame memory 20, the input signal is converted into a density value into a charge by positive logic. The inverting circuit 21 converts the density of the input signal into electric charges by negative logic.
  • the image frame stored in the frame memory 20 and the image frame subjected to the second quantization by the inverting circuit 21 are sent to the synthesizing circuit 22, and the synthesizing circuit 22 22 Combine the two and compare them.
  • the synthesizing circuit 22 22 Cancel the pixels having the same luminance. In other words, the density of both stationary parts is made uniform.
  • the processing in this case is performed based on the threshold value given from the preprocessing circuit 19. As a result, moving objects are extracted.
  • This moving object is detected by the detecting means 26. Therefore, unlike the above-described conventional monitoring device, the monitor does not require effort such as monitoring the video to find the presence of an unauthorized intruder, and does not overlook the presence of a moving object. Further, in the case of the present embodiment, an alarm device 27 is provided as a notification means that operates in conjunction with the detection of the moving object by the detection means 26 described above, so that the person in charge of monitoring the presence of this moving object is provided. Etc. can be notified promptly. In addition, since the timelabs video 9 records an image of the moving object in accordance with the detection of the moving object by the detection means 26, an image of only the moving object such as an illegal intruder can be stored. It is preferable that the position and angle of the camera and the focal length are fixed, as in the case of the structure of the first example described above. Third example
  • a moving object detection device is configured using a personal computer that has been widely used in the past. That is, as shown in FIG. 7, the constituent circuits 13 and 14 shown in FIG. 1 are assembled on one board 33, and this board 33 can be freely attached to an expansion slot of a personal computer. I do.
  • the board 33 has a function of performing pre-processing and pattern matching as shown in FIG. 9, including first contrast correction, skip processing, and vector connection processing, which are characteristic parts of the present invention.
  • this embodiment is characterized in that it performs contrast correction, skip processing, and vector connection processing, and other configurations and operations are the same as those of the first, second, and second embodiments described above. It is. Therefore, overlapping description will be omitted or simplified, and the following description focuses on the features of the present embodiment.
  • a contrast correction circuit is provided in the preprocessing circuit 19 (see FIG. 5).
  • This contrast correction circuit as shown in Figure S, First, an LUT (Look Up Table) is created for the first frame 30 on the time axis of each GO P (Group Of Picture), and the LUT (Look Up Table) is created. The remaining frame 31 functions to quantize using the LUT created in the first frame 30 above.
  • the GOP is a force which is a concept in the MPEG, which is one standard of the compression processing.
  • This G0P corresponds to a frame group described in the claims.
  • the contrast correction circuit constitutes a first contrast correction means described in the claims.
  • the above-mentioned contrast correction circuit is provided for the following reason. That is, quantization (first and second quantization) for obtaining a positive frame (image frame subjected to the first quantization) and a negative frame (image frame subjected to the second quantization). ), Quantization is performed in advance with the default settings, luminance is corrected for the frames quantized with the default settings, and the image displayed on a display such as a monitor is monitored as described above. So that it is easy for people to see. Such correction is performed in the conventional structure. That is, for example, in the case of a monitoring device that configures a security system, the monitoring is often performed in darkness, and the video projected on the display is extremely large as it is. It is difficult for people to monitor. For this reason, it is necessary to perform contrast correction.
  • the conventional contrast correction first performs quantization with default settings, then creates an LUT (Look Up Table) by scanning all pixels, and then re-references this LUT. Perform quantization.
  • the LUT refers to an operation process of converting a luminance equal to or higher than a desired value among pixels constituting a frame input and quantized with default settings to a predetermined luminance to obtain a desired contrast.
  • the contrast correction according to this embodiment was created in view of the current situation.
  • the above-described skip processing means is provided on the board 33.
  • This skip processing means is constituted by an arithmetic circuit (MPU) not shown.
  • MPU arithmetic circuit
  • Can be The effect is as shown in the flowchart of Fig.10. That is, at least one of the preprocessed image frames is set as the search target frame 34, and the maximum density value (SH) and the minimum density value (SH) are obtained from all the pixels constituting the search target frame 34. SL), and use them as the first threshold SH and the second threshold SL, respectively. At the same time, the difference (SPP) between the maximum density value (SH) and the minimum density value (SL) is calculated and used as the third threshold value SPP (step 1).
  • SPP difference between the maximum density value (SH) and the minimum density value (SL)
  • step 2 in parallel with step 1, the remaining frames of the above image frames other than the search target frame 34 are set as template frames 35, and the maximum of all the pixels constituting the template frames 35 is set.
  • the search target frame 34 and the template frame 35 if the respective values SH, SL, DH, and DL are obtained, as step 3, the values obtained from these template frames 35 are obtained. It is determined whether the maximum Pu value DH and the minimum concentration value D exceed the first threshold value SH and the second BB value SL, respectively. If none of the maximum DH and the minimum concentration DL exceed the first and second thresholds SH and SL (DH ⁇ SH, and DL> SL), the template frame 3 It is determined that no moving object exists in 5 and the vector generation processing is skipped (step 4).
  • the above difference DPP is calculated in advance in step 2. If the difference DPP is smaller than the third threshold value SPP (DPP + SPP), it is determined that no moving object exists in the template frame 35, and the process jumps to the step 4 to generate the vector. To skip.
  • Such pattern matching is widely used for positioning of various components, character recognition, defect inspection, etc., and is an imaging technology that is the core of FA (Factory-Automation).
  • Such pattern matching is performed to quickly determine whether or not a moving object is present in an image frame (moving object detection frame) in which the positive frame and the negative frame are superimposed.
  • the processing is performed by using the correlation according to 0.
  • Such pattern matching is composed of skip processing, vector generation processing, and determination processing as shown in Fig. 9.
  • the skip processing is This is performed so that the next frame generation processing step can be omitted for an image frame in which no moving object is assumed to exist due to the shading degree value, etc. Therefore, if this skip processing can be performed reliably, the moving object The time required for the detection is reduced, and the effective skip processing contributes to the improvement of the robustness, and is also preferable from this point.
  • the skip processing described above is performed based on such a viewpoint.
  • a force for performing the vector connection processing is provided.
  • a vector connection processing means is provided.
  • This vector connection processing means can also be constituted by an arithmetic circuit (the same as the skip processing means), like the above-mentioned skip processing means.
  • the vector connection processing means detects a change in coordinate data in each moving object detection frame among the pixels constituting the moving object detection frame. That is, it detects how each pixel in one moving object detection frame changes its coordinate position with time. For the coordinate position (state data), XY orthogonal coordinates are virtually set in the moving object detection frame, and the position is detected by this. At the same time, the moving direction of each of these pixels in each moving object detection frame is detected.
  • the movement vector of each pixel is detected.
  • This vector is the coordinate data of each pixel in the adjacent motion detection frame. Can be easily obtained from Then, an object consisting of all the pixels that almost coincide with the change in the coordinate data, the moving direction, the force, and the 'is regarded as one moving object.
  • the moving object detection frames 31 and 31 as shown in FIGS. 11 (A) and (B) are used as shown in FIG. 11 (C).
  • the frame 32 in which a single moving object 42 exists can be obtained.
  • the moving direction is detected along with the change in the coordinate data, and it is determined whether the moving object exists in the image.
  • the vector connection process is a process for determining the shape and size of the moving body portion.
  • the input of each pixel constituting the input frame is performed. It is conceivable to detect a change in coordinate data in a frame and regard a portion constituted by a pixel having a change and pixels in the vicinity thereof as a moving object. Specifically, by detecting a change in the coordinate data of each of the pixels constituting the input frame in the input frame, the pixels having the change are indicated by a diagonal grid in Fig. 12 (A).
  • pixels other than the detection target may be included in the pixels determined to be a part constituting the moving object due to the change in the coordinate data.
  • a lighting device such as a fluorescent lamp
  • disturbances caused by natural phenomena such as wind and rain, etc.
  • the processing required for detecting the moving object is unnecessarily increased, and the processing speed is reduced. It also impedes reliable detection of moving objects.
  • the plurality of detected objects may be determined to be one. That is, in the vector connection process that is generally considered, only one moving object A shown in FIG. 11 (C) is detected from the frames shown in FIGS. 11 (A) and 11 (B). Thus, it is not preferable that the number of detected moving objects is reduced in spite of the fact that there are actually a plurality of moving objects.
  • the vector connection processing according to the present embodiment was devised and provided.
  • the contrast correction circuit creates an LUT for the first frame 30 on the time axis of each GOP, and creates the LUT for the remaining frame 31 of each GOP. Quantize using the LUT created in frame 30. Therefore, quantization with default settings and creation of LUT by scanning all pixels, which were conventionally required for contrast correction, can be omitted. As a result, the processing procedure can be shortened, and the processing speed can be improved accordingly.
  • the above LU is equivalent to the contrast correction information described in the claims.
  • the skip processing is performed in two stages, so that the speed of the pattern matching processing can be increased and the mouth-cutting performance can be improved. Further, since it is detected whether or not each density value of the template frame 35 exceeds each threshold value on both the high density side and the low density side, the possibility of accidental data squibbing can be eliminated. . Further, since the first, second, and third IM values are obtained from all the pixels of the search target frame 34, each of these ⁇ values themselves can take a value suitable for the input image condition.
  • the first, second, and third values SH, SL, and SPP are calculated by the following equations.
  • SH Ave + Hi (1)
  • Ave represents the average value when n is the total number of pixels in the search target frame and X is the density value of each pixel.
  • p represents the variance.
  • Ave is given by the following equation (4)
  • the variance p is given by the following equation (5).
  • the present embodiment is configured as described above, it is prevented from being recognized as a moving object similar to the object to be detected, despite the fact that the object is not the object to be detected due to disturbance or the like as described above. Also, despite the existence of a plurality of detection targets, the number of moving objects to be detected does not become smaller than the actual one. As a result, unnecessary data processing is omitted, and the speed and reliability of the moving object detection process can be improved. Further, the moving object detection device according to this embodiment can be configured by incorporating the above-described processing means into an arithmetic device (MPU, CPU) or the like provided in the preprocessing circuit 19 or the like.
  • MPU arithmetic device
  • bus using the PCI bus can be used.
  • reference numeral 36 denotes a display.
  • the board 33 has a function of performing the preprocessing and the pattern matching (skip processing and vector connection processing).
  • the input image is grayscale.
  • a configuration as shown in FIG. 13 can be adopted based on the same concept as the configuration of the third embodiment described above. That is, a video control circuit and the like are provided on the board 33a together with the above-mentioned constituent circuits 13 and 14, and a personal computer is provided. By storing software for video control etc. in the RAM, it is possible to freely output judgment results.
  • the through output signal is supplied to the video deck 37, and the video is displayed on the monitor display 38. Further, the image signal subjected to the above-described contrast correction and the like is sent to the display 36, and the image is displayed on the display 36.
  • the monitor display 38 displays the image as it is projected by the CCD camera; the display 36 of the personal computer is contrast-corrected. An image with high brightness and brightness is displayed. Since the correction process at this time is performed promptly as described above, a large time lag does not occur on the display screen of the monitor display 38.
  • a camera adapter is connected to the CCD camera. From this camera dub, recording is performed as a still image or the like on recording means such as a hard disk via the board 33a. At the same time, an image is sent from the camera adapter to the monitor display 38 via the video deck 37.
  • a conventionally known VCR 37 can be used, and the video is also recorded by the VCR 37.
  • a function that can more effectively detect a moving object can be incorporated into the board 33a. For example, the detection range can be surrounded by a red line, or the moving direction of the moving object can be indicated by an arrow. Such a function can be easily performed by a conventionally known image processing technology.
  • an LUT is created for the first frame on the time axis of each G 0 P, and the first frame is created for the remaining frames of each GOP.
  • the circuit is configured to create an LUT for the first frame on the time axis-For frames following the above frame, quantize using the LUT in the frame before the relevant frame (Second contrast correction means) Yes.
  • the processing speed is inferior to the contrast correction circuit of the embodiment described above, but the default setting required for the contrast correction is used. Quantization and scanning of all pixels in each frame LUT creation can be simplified, and the processing procedure can be shortened, resulting in an improvement in processing speed.
  • the moving object detection method and the moving object detection device according to the present invention are not limited to the above-described example, and can take various configurations. For example, it can be an independent device without being incorporated into the board 3333a (without using a personal computer). It is also possible to select and execute any of the above-described contrast correction, skip processing, and vector connection processing. INDUSTRIAL APPLICABILITY As described above, the moving object detection method according to claim 1 is configured as described above, and is easy and reliable despite the small increase in manufacturing cost. The excellent effect that the moving object detection can be performed is obtained.
  • the moving object detection method according to claims 2 and 3 can improve detection performance and processing speed under low illuminance conditions, and can quickly detect moving objects.
  • the moving object detection method described in claim 4 can achieve a reduction in the time required for moving object detection and an improvement in mouth-bustness, in addition to the effects described in claim 1.
  • the moving object detection method according to claim 5 has the effect described in claim 1 and also prevents the object from being recognized as a detection target despite being not a detection target due to disturbance or the like. It is possible to ensure and speed up moving object detection. In particular, in the case of this method, only a person who enters the room or only a person who leaves the room can be detected, which has a great practical effect.
  • the moving object detection method according to claims 6 and 7 has all of the above effects. That is, the processing speed can be improved, and quick and reliable moving object detection can be performed. In addition, the robustness can be improved, and the possibility of accidental skipping can be eliminated.
  • the moving object detection device since the moving object detection device according to claim 8 is configured as described above, it is possible to easily and surely detect a moving object despite a small increase in manufacturing cost. An excellent effect of being able to provide a body detection device is obtained. For example, if this moving object detection device is used as a monitoring device, the load required for the monitoring operation can be reduced and the moving object can be reliably detected. Moreover, since the imaging means can be configured by adding a slight configuration to the conventional CCD camera or by attaching an adapter, the configuration can be made easily and the manufacturing cost is not increased. Therefore, the effect as a monitoring device is great.
  • the moving object detection device provides quick notification (alarm), reliable and efficient recording. Is possible, and the practical effect is great. That is, the conventional monitoring device records video using a recording medium such as an endless tape regardless of the presence or absence of a moving object. Therefore, recording media such as tapes were often wasted, and there was a strong demand for improvement.
  • the recording means can be separately activated only when the detecting means detects the moving object, the recording medium can be used efficiently.
  • a recording medium such as the above-mentioned endless tape is used to record a signal input to the imaging means, or a combined image created by an imaging means to extract the moving object. Record the frame data on a recording medium. Further, such image information can be compressed and stored by a conventionally known compression means.
  • the moving object detection device is to improve the detection performance and processing speed under low illuminance conditions in addition to the effect of the moving object detection device according to claim 8. And can quickly detect moving objects.
  • the moving object detection device described in claims 14 and 15 is caused by shortening the time required for moving object detection, improving robustness, and disturbance.
  • the detection of moving objects can be reliably performed and the speed thereof can be increased, and the practical effect is great.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention a trait à un procédé et un dispositif au moyen duquel un corps en mouvement peut être détecté facilement et de façon sûre, sans augmentation du coût de production. Selon ledit procédé, des signaux d'entrée sont quantifiés au cours d'une première et d'une seconde quantification respectivement. On réalise la première quantification en mettant à un niveau élevé des signaux d'entrée dotés d'une luminance égale ou supérieure à une valeur prescrite, et à un niveau bas ceux qui sont dotés d'une luminance inférieure à ladite valeur. On réalise la seconde quantification en mettant à un niveau bas des signaux d'entrée d'une luminance égale ou supérieure à une valeur prescrite, et à un niveau élevé ceux qui sont dotés d'une luminance inférieure à ladite valeur. Un corps en mouvement est détecté par superposition d'une image (1) soumise à une première quantification et d'une image (2) soumise, à une seconde quantification successive à la première, afin d'obtenir que les éléments des images (1 et 2) ayant une même luminance se compensent mutuellement.
PCT/JP1997/002590 1996-07-26 1997-07-25 Procede et dispositif de detection d'un corps en mouvement WO1998005165A1 (fr)

Applications Claiming Priority (12)

Application Number Priority Date Filing Date Title
JP8/214114 1996-07-26
JP8/214115 1996-07-26
JP8214114A JPH1042277A (ja) 1996-07-26 1996-07-26 動体検出方法とその装置
JP8214115A JPH1042171A (ja) 1996-07-26 1996-07-26 動体検出装置
JP9150797A JPH10271486A (ja) 1997-03-26 1997-03-26 動体検出方法
JP9150997A JPH10271488A (ja) 1997-03-26 1997-03-26 動体検出方法及び動体検出装置
JP9/91509 1997-03-26
JP9150897A JPH10271487A (ja) 1997-03-26 1997-03-26 動体検出方法
JP9150697A JPH10271485A (ja) 1997-03-26 1997-03-26 動体検出方法及び動体検出装置
JP9/91508 1997-03-26
JP9/91507 1997-03-26
JP9/91506 1997-03-26

Publications (1)

Publication Number Publication Date
WO1998005165A1 true WO1998005165A1 (fr) 1998-02-05

Family

ID=27551846

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP1997/002590 WO1998005165A1 (fr) 1996-07-26 1997-07-25 Procede et dispositif de detection d'un corps en mouvement

Country Status (1)

Country Link
WO (1) WO1998005165A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH057364A (ja) * 1991-06-27 1993-01-14 Toshiba Corp 画像監視装置
JPH0549031A (ja) * 1991-08-15 1993-02-26 Pioneer Electron Corp 画像監視装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH057364A (ja) * 1991-06-27 1993-01-14 Toshiba Corp 画像監視装置
JPH0549031A (ja) * 1991-08-15 1993-02-26 Pioneer Electron Corp 画像監視装置

Similar Documents

Publication Publication Date Title
EP3879814A1 (fr) Procédé et appareil de détection et de suppression automatiques de franges, dispositif électronique et support de stockage lisible par ordinateur
WO2009122721A1 (fr) Système d'imagerie, procédé d'imagerie et support apte à être lu par ordinateur contenant un programme
JP2008077517A (ja) カメラ妨害検知方式
US20090009655A1 (en) Imaging apparatus and imaging method
JP4718253B2 (ja) 監視カメラの画像異常検出装置
JP2010136224A (ja) 撮像装置及び撮像方法
US20080198094A1 (en) System and Method for Detecting Real-Time Events in an Image
US6950133B2 (en) Method of detecting defective pixels of a solid-state image-pickup device and image-pickup apparatus using the same
JP5747105B2 (ja) 画像処理装置
JP5544223B2 (ja) 撮像装置
JP2008005365A (ja) 撮像装置
CN201726494U (zh) 利用图像色彩信息执行图像比对的装置与系统
JP2007201963A (ja) 撮像装置
JP2003283873A (ja) 輪郭強調回路
JP4442571B2 (ja) 撮像装置及びその制御方法
WO1998005165A1 (fr) Procede et dispositif de detection d'un corps en mouvement
JP2003199099A (ja) 画像処理装置及び方法、並びにコンピュータプログラム及びコンピュータ可読記憶媒体
JP2005173879A (ja) 融合画像表示装置
US20060244850A1 (en) Image pickup apparatus and image pickup method
JP2008311834A (ja) 欠陥画素補正装置及び方法
JP6729708B2 (ja) 信号調整プログラム、信号調整装置、及び信号調整方法
JP2004118424A (ja) 動き検出装置，動き検出方法，動き検出システム，およびプログラム
JPH10271488A (ja) 動体検出方法及び動体検出装置
US8395679B2 (en) Apparatus and method for color rolling suppression
JPH10271485A (ja) 動体検出方法及び動体検出装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CA IL US

NENP Non-entry into the national phase

Ref country code: CA

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载