WO2018109847A1 - 制御装置、撮像装置、移動体、制御方法、およびプログラム - Google Patents
制御装置、撮像装置、移動体、制御方法、およびプログラム Download PDFInfo
- Publication number
- WO2018109847A1 WO2018109847A1 PCT/JP2016/087126 JP2016087126W WO2018109847A1 WO 2018109847 A1 WO2018109847 A1 WO 2018109847A1 JP 2016087126 W JP2016087126 W JP 2016087126W WO 2018109847 A1 WO2018109847 A1 WO 2018109847A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- temperature
- focus lens
- imaging device
- condition
- determination unit
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 171
- 238000000034 method Methods 0.000 title claims description 36
- 238000011156 evaluation Methods 0.000 claims abstract description 42
- 230000008859 change Effects 0.000 claims description 41
- 230000004044 response Effects 0.000 claims description 3
- 238000012937 correction Methods 0.000 abstract description 67
- 230000000694 effects Effects 0.000 abstract description 5
- 238000012545 processing Methods 0.000 description 26
- 238000004891 communication Methods 0.000 description 13
- 230000007246 mechanism Effects 0.000 description 12
- 230000008569 process Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000010365 information processing Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B13/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B13/32—Means for focusing
- G03B13/34—Power focusing
- G03B13/36—Autofocus systems
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
Definitions
- the present invention relates to a control device, an imaging device, a moving body, a control method, and a program.
- a change in temperature may cause a physical change in the imaging device, for example, and a focus position may shift. Therefore, the imaging device may correct the position of the focus lens according to the temperature.
- Patent Document 1 when the elapsed time from the power-on to the image input device is included in the time range corresponding to the fluctuation period of the ambient temperature of the distance measuring sensor, the elapsed time corresponds to the stable period of the ambient temperature. It is described that the scanning range of the focus lens in autofocus is set wider than that included in the time range.
- Patent Document 1 Japanese Patent No. 4226936
- a control device includes a condition related to an evaluation value of an image captured by an imaging device, a condition related to a distance between the imaging device and a subject, a condition related to an altitude of the imaging device, a condition related to a moving speed of the imaging device, In the case where a predetermined condition including at least one of a condition regarding the moving speed of the focus lens and a condition regarding whether or not the imaging apparatus is performing contrast AF is satisfied, the position of the focus lens of the imaging apparatus is based on the temperature. You may provide the determination part which determines to correct
- the evaluation value may be an evaluation value related to contrast derived by the contrast AF method.
- the determination unit may determine that the predetermined condition is satisfied when the change amount of the evaluation value per unit time is equal to or less than the threshold, and may determine to correct the position of the focus lens based on the temperature.
- the evaluation value may be an evaluation value related to the phase difference derived by the phase difference AF method.
- the determination unit may determine that the predetermined condition is satisfied when the change amount of the evaluation value per unit time is equal to or less than the threshold, and may determine to correct the position of the focus lens based on the temperature.
- the evaluation value may be an evaluation value related to the size of the subject in the image.
- the determination unit may determine that the predetermined condition is satisfied when the change amount of the evaluation value per unit time is equal to or less than the threshold, and may determine to correct the position of the focus lens based on the temperature.
- the determination unit may determine that a predetermined condition is satisfied when the amount of change per unit time of the distance is equal to or less than a threshold, and may determine to correct the position of the focus lens based on the temperature.
- the determination unit may determine that the predetermined condition is satisfied when the amount of change per unit time of the altitude is equal to or less than the threshold, and may determine to correct the position of the focus lens based on the temperature.
- the determination unit may determine that a predetermined condition is satisfied when the moving speed of the imaging apparatus is equal to or less than a threshold value, and may determine to correct the position of the focus lens based on the temperature.
- the determination unit may determine that a predetermined condition is satisfied when the moving speed of the focus lens of the imaging apparatus is equal to or less than a threshold, and may determine to correct the position of the focus lens based on the temperature.
- the determining unit may determine that the predetermined condition is satisfied when the imaging apparatus is not performing the contrast AF, and may determine to correct the position of the focus lens based on the temperature.
- the determination unit determines that the predetermined condition is satisfied when the other condition that the change amount from the reference temperature of the image pickup apparatus satisfies the condition is at least a threshold is satisfied, and the focus lens satisfies the predetermined condition. May be determined to be corrected based on temperature.
- the determination unit may update the reference temperature based on the temperature when the amount of change from the reference temperature is greater than or equal to the threshold value.
- the determination unit determines that a predetermined condition is satisfied when the other condition that the amount of movement according to the temperature from the reference position of the focus lens is equal to or greater than the threshold is satisfied.
- the focus lens position may be determined to be corrected based on the temperature.
- the determination unit may update the reference position based on the position of the focus lens when the amount of movement from the reference position is equal to or greater than a threshold value.
- An imaging device may include the control device.
- the imaging device may include a focus lens.
- the imaging apparatus may include a control unit that controls the focus lens to correct the position of the focus lens in response to the determination unit determining to correct the position of the focus lens based on the temperature.
- a moving body according to one embodiment of the present invention is provided with the imaging device.
- a control method includes a condition related to an evaluation value of an image captured by an imaging apparatus, a condition related to a distance between the imaging apparatus and a subject, a condition related to an altitude of the imaging apparatus, a condition related to a moving speed of the imaging apparatus, In the case where a predetermined condition including at least one of a condition regarding the moving speed of the focus lens and a condition regarding whether or not the imaging apparatus is performing contrast AF is satisfied, the position of the focus lens of the imaging apparatus is based on the temperature.
- a step of determining to correct may be provided.
- a program includes a condition related to an evaluation value of an image captured by an imaging apparatus, a condition related to a distance between the imaging apparatus and a subject, a condition related to an altitude of the imaging apparatus, a condition related to a moving speed of the imaging apparatus, When a predetermined condition including at least one of a condition regarding the moving speed of the focus lens and a condition regarding whether or not the imaging apparatus is performing contrast AF is satisfied, the position of the focus lens of the imaging apparatus is corrected based on the temperature.
- the computer may execute the step of determining to do.
- FIG. 1 Various embodiments of the present invention may be described with reference to flowcharts and block diagrams.
- the blocks in the flowcharts and block diagrams may represent (1) the stage of the process in which the operation is performed or (2) the “part” of the device responsible for performing the operation.
- Certain stages and “parts” are provided with dedicated circuitry, programmable circuitry supplied with computer readable instructions stored on a computer readable storage medium, and / or computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor.
- Dedicated circuitry may include digital and / or analog hardware circuitry. Integrated circuits (ICs) and / or discrete circuits may be included.
- Programmable circuits may be logical products, logical sums, exclusive logical sums, negative logical products, negative logical sums, and other logical operations, such as field programmable gate arrays (FPGAs) and programmable logic arrays (PLA), for example. , Flip-flops, registers, and memory elements, including reconfigurable hardware circuitry.
- FPGAs field programmable gate arrays
- PLA programmable logic arrays
- a computer-readable storage medium may include any tangible device capable of storing instructions to be executed by a suitable device.
- a computer readable storage medium having instructions stored thereon comprises a product that includes instructions that can be executed to create a means for performing the operations specified in the flowcharts or block diagrams.
- Examples of computer readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory).
- EEPROM Electrically erasable programmable read only memory
- SRAM static random access memory
- CD-ROM compact disc read only memory
- DVD digital versatile disc
- Blu-ray registered trademark
- the computer readable instructions may include either source code or object code written in any combination of one or more programming languages.
- the source code or object code includes a conventional procedural programming language.
- Conventional procedural programming languages include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or Smalltalk, JAVA, C ++, etc. It may be an object-oriented programming language and a “C” programming language or a similar programming language.
- Computer readable instructions may be directed to a general purpose computer, special purpose computer, or other programmable data processing device processor or programmable circuit locally or in a wide area network (WAN) such as a local area network (LAN), the Internet, etc. ).
- the processor or programmable circuit may execute computer readable instructions to create a means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.
- FIG. 1 shows an example of the appearance of an unmanned aerial vehicle (UAV) 100.
- the UAV 100 includes a UAV main body 102, a gimbal 200, an imaging device 300, and a plurality of imaging devices 230.
- the UAV 100 is an example of a moving object.
- the moving body is a concept including, in addition to UAV, other aircraft that moves in the air, vehicles that move on the ground, ships that move on the water, and the like.
- the UAV main body 102 includes a plurality of rotor blades.
- the UAV main body 102 flies the UAV 100 by controlling the rotation of a plurality of rotor blades.
- the UAV main body 102 causes the UAV 100 to fly using four rotary wings.
- the number of rotor blades is not limited to four.
- the UAV 100 may be a fixed wing aircraft that does not have a rotating wing.
- the imaging device 300 is a camera for capturing a moving image or a still image.
- the plurality of imaging devices 230 are sensing cameras that image the surroundings of the UAV 100 in order to control the flight of the UAV 100.
- Two imaging devices 230 may be provided on the front surface that is the nose of the UAV 100.
- Two other imaging devices 230 may be provided on the bottom surface of the UAV 100.
- the two imaging devices 230 on the front side may be paired and function as a so-called stereo camera.
- the two imaging devices 230 on the bottom side may also be paired and function as a stereo camera.
- the distance from the UAV 100 to the object may be measured based on images captured by the plurality of imaging devices 230.
- Three-dimensional spatial data around the UAV 100 may be generated based on images captured by the plurality of imaging devices 230.
- the number of imaging devices 230 included in the UAV 100 is not limited to four.
- the UAV 100 only needs to include at least one imaging device 230.
- the UAV 100 may include at least one imaging device 230 on each of the nose, the tail, the side surface, the bottom surface, and the ceiling surface of the UAV 100.
- the angle of view that can be set by the imaging device 230 may be wider than the angle of view that can be set by the imaging device 300.
- the imaging device 230 may have a single focus lens or a fisheye lens.
- FIG. 2 shows an example of functional blocks of the UAV100.
- the UAV 100 includes a UAV control unit 110, a communication interface 150, a memory 160, a gimbal 200, a rotating blade mechanism 210, an imaging device 300, an imaging device 230, a GPS receiver 240, an inertial measurement device (IMU) 250, a magnetic compass 260, and an atmospheric pressure.
- An altimeter 270 is provided.
- the communication interface 150 communicates with an external transmitter.
- the communication interface 150 receives various commands for the UAV control unit 110 from a remote transmitter.
- the memory 160 stores programs necessary for the UAV control unit 110 to control the gimbal 200, the rotary blade mechanism 210, the imaging device 300, the imaging device 230, the GPS receiver 240, the IMU 250, the magnetic compass 260, and the barometric altimeter 270.
- the memory 160 may be a computer-readable recording medium and may include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
- the memory 160 may be provided inside the UAV main body 102.
- the memory 160 may be provided so as to be removable from the UAV main body 102.
- the gimbal 200 supports the imaging direction of the imaging device 300 so that it can be adjusted.
- the gimbal 200 supports the imaging device 300 rotatably around at least one axis.
- the gimbal 200 is an example of a support mechanism.
- the gimbal 200 may support the imaging device 300 rotatably about the yaw axis, the pitch axis, and the roll axis.
- the gimbal 200 may change the imaging direction of the imaging device 300 by rotating the imaging device 300 about at least one of the yaw axis, the pitch axis, and the roll axis.
- the rotary blade mechanism 210 includes a plurality of rotary blades and a plurality of drive motors that rotate the plurality of rotary blades.
- the imaging device 230 captures the surroundings of the UAV 100 and generates image data. Image data of the imaging device 230 is stored in the memory 160.
- the GPS receiver 240 receives a plurality of signals indicating times transmitted from a plurality of GPS satellites. The GPS receiver 240 calculates the position of the GPS receiver 240, that is, the position of the UAV 100, based on the received signals.
- the inertial measurement device (IMU) 250 detects the posture of the UAV 100.
- the IMU 250 detects, as the posture of the UAV 100, acceleration in the three axial directions of the front, rear, left, and upper sides of the UAV 100, and angular velocity in the three axial directions of pitch, roll, and yaw.
- the magnetic compass 260 detects the heading of the UAV 100.
- the barometric altimeter 270 detects the altitude at which the UAV 100 flies.
- the UAV control unit 110 controls the flight of the UAV 100 in accordance with a program stored in the memory 160.
- the UAV control unit 110 may be configured by a microprocessor such as a CPU or MPU, a microcontroller such as an MCU, or the like.
- the UAV control unit 110 controls the flight of the UAV 100 according to a command received from a remote transmitter via the communication interface 150.
- the UAV control unit 110 may specify the environment around the UAV 100 by analyzing a plurality of images captured by the plurality of imaging devices 230.
- the UAV control unit 110 controls the flight while avoiding obstacles based on the environment around the UAV 100, for example.
- the UAV control unit 110 may generate three-dimensional spatial data around the UAV 100 based on a plurality of images captured by the plurality of imaging devices 230, and control the flight based on the three-dimensional spatial data.
- the UAV control unit 110 may measure the distance between the UAV 100 and the object that is the subject by a triangulation method based on a plurality of images captured by the plurality of imaging devices 230.
- the UAV control unit 110 may measure the distance between the UAV 100 and the object using an ultrasonic sensor, an infrared sensor, a radar sensor, or the like.
- the imaging apparatus 300 includes an imaging unit 301 and a lens unit 401.
- the lens unit 401 may be a lens unit that can be detached from the imaging unit 301.
- the imaging unit 301 includes an imaging control unit 310, an imaging element 330, and a memory 340.
- the imaging control unit 310 may be configured by a microprocessor such as a CPU or MPU, a microcontroller such as an MCU, or the like.
- the imaging control unit 310 may control the imaging device 300 in accordance with an operation command for the imaging device 300 from the UAV control unit 110.
- the memory 340 may be a computer-readable recording medium and may include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
- the memory 340 may be provided inside the housing of the imaging unit 301.
- the memory 340 may be provided so as to be removable from the housing of the imaging unit 301.
- the imaging device 330 may be configured by a CCD or a CMOS.
- the image pickup device 330 is held inside the housing of the image pickup apparatus 300 and outputs image data of an optical image formed through the plurality of lenses 432 to the image pickup control unit 310.
- the imaging control unit 310 performs a series of image processing such as noise reduction, demosaicing, gamma correction, and edge cooperation on the image data.
- the imaging control unit 310 stores image data after a series of image processing in the memory 340.
- the imaging control unit 310 may output and store the image data in the memory 160 via the UAV control unit 110.
- the imaging control unit 310 may perform an autofocus operation using image data.
- the lens unit 401 includes a lens control unit 410, a memory 420, a lens moving mechanism 430, a plurality of lenses 432, a lens position detection unit 440, and a temperature sensor 450.
- the plurality of lenses 432 includes a zoom lens and a focus lens.
- the lens control unit 410 controls the movement of the plurality of lenses 432 in the optical axis direction via the lens moving mechanism 430 in accordance with a lens operation command from the imaging unit 301.
- the lens control unit 410 controls the movement of the plurality of lenses 432 via the lens moving mechanism 430. Some or all of the plurality of lenses 432 are moved along the optical axis by the lens moving mechanism 430.
- the lens control unit 410 moves at least one of the plurality of lenses 432 along the optical axis in accordance with a lens operation command from the imaging control unit 310.
- the lens control unit 410 performs at least one of a zoom operation and a focus operation by moving at least one of the plurality of lenses 432 along the optical axis.
- the lens position detection unit 440 detects the position of each of the plurality of lenses 432.
- the lens position detection unit 440 detects the current zoom position and focus position.
- the memory 420 stores control values of a plurality of lenses 432 that move via the lens moving mechanism 430.
- the memory 420 stores, for example, lens specific information such as an F value, a focal length, and an individual number of the lens unit 401 as a control value.
- the memory 420 may include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
- the temperature sensor 450 detects the temperature of the lens unit 401 as the temperature of the imaging device 300.
- the temperature sensor 450 may be provided in the lens barrel of the lens unit 401 or may be provided outside the lens barrel of the lens unit 401.
- the temperature sensor 450 may be provided in the housing of the imaging unit 301 or may be provided in the UAV main body 102.
- the lens control unit 410 includes a temperature correction unit 412.
- the temperature correction unit 412 corrects the focus position of the focus lens according to the temperature via the lens moving mechanism 430.
- a lens barrel or the like constituting the lens unit 401 expands and contracts depending on the temperature. Due to such expansion and contraction, the focus position of the focus lens may shift. Therefore, the temperature correction unit 412 corrects the focus position of the focus lens based on the temperature information from the temperature sensor 450.
- the temperature correction unit 412 may correct the focus position according to the temperature based on a predetermined relationship between the temperature and the lens position of the focus lens. For example, as illustrated in FIG. 3, the temperature correction unit 412 uses a function that is defined for each focal length (zoom position) of the lens unit 401 and indicates the relationship between the temperature and the lens position of the focus lens. Correct. The temperature correction unit 412 may correct the focus position by using a function corresponding to each shooting distance indicating the distance between the imaging apparatus 300 and the subject and each focal length. Each function may be stored in memory 420. The memory 420 may store a table indicating the relationship between temperature and lens position for each shooting distance and focal length. The temperature correction unit 412 may specify the lens position of the focus lens and correct the focus position by referring to a table corresponding to the shooting distance and the focal length.
- the imaging control unit 310 includes an AF processing unit 312.
- the AF processing unit 312 may determine the focus position of the focus lens according to the contrast AF method or the phase difference AF method.
- the AF processing unit 312 may determine the focus position of the focus lens according to the image plane phase difference AF method. While moving the focus lens via the lens control unit 410, evaluation values relating to contrast or phase difference are sequentially derived from the image data output from the image sensor 330.
- the AF processing unit 312 determines the position of the focus lens when the evaluation value is the highest as the focus position.
- the AF processing unit 312 moves the focus lens from the closest end to the infinity end according to the contrast AF method, and the focus lens when the evaluation value is the highest in the so-called hill-climbing method is shown.
- Search for the location of. the temperature correction unit 412 may execute the correction of the focus position according to the temperature.
- the degree of focus position correction by the temperature correction unit 412 according to the temperature change is large, and as shown in FIG. 5, there is a possibility that a part of the evaluation value becomes a discontinuous point (a part surrounded by a broken line 600). Due to the presence of such discontinuous points, the AF processing unit 312 may not be able to specify the focus position appropriately.
- the imaging device 300 mounted on a moving body such as the UAV 100 often operates in an environment where the change in the ambient temperature is relatively large, the change in the temperature of the imaging device 300 may be large. Therefore, when contrast AF and temperature correction are performed simultaneously, there is a possibility of affecting the focus position specification.
- the imaging apparatus 300 when it is preferable not to correct the position of the focus lens according to the temperature, the imaging apparatus 300 according to the present embodiment does not execute the temperature correction by the temperature correction unit 412 even if the temperature changes. As a result, the temperature correction unit 412 does not unnecessarily perform temperature correction, thereby reducing the processing burden on the imaging apparatus 300. For example, when the imaging apparatus 300 is mounted on the UAV 100, the temperature varies greatly depending on the altitude. In such a situation, when the imaging apparatus 300 is used, temperature correction may be frequently performed. As a result, the processing load of the imaging apparatus 300 increases, and there is a possibility that problems such as an increase in power consumption or an increase in the amount of heat generated by the CPU or the like may occur.
- the temperature correction unit 412 By reducing the frequency with which the temperature correction unit 412 performs the temperature correction, it is possible to reduce the processing load of the imaging apparatus 300 and to prevent such a problem from occurring. Since the contrast AF and the temperature correction are performed in parallel, it is possible to prevent the occurrence of a trouble in specifying the focus position.
- the imaging control unit 310 and the determination unit 316 are included.
- the determination unit 316 includes a condition related to an evaluation value of an image captured by the imaging apparatus 300, a condition related to the distance between the imaging apparatus 300 and the subject, a condition related to the altitude of the imaging apparatus 300, a condition related to the moving speed of the imaging apparatus 300, It is determined whether or not a predetermined condition including at least one of a condition relating to a moving speed of the focus lens and a condition relating to whether or not the imaging apparatus 300 is performing contrast AF is satisfied.
- the determination unit 316 determines whether or not to correct the position of the focus lens of the imaging device 300 based on the temperature, depending on whether or not a predetermined condition is satisfied. When the determination unit 316 determines that the predetermined condition is satisfied, the determination unit 316 may determine to correct the position of the focus lens based on the temperature.
- the evaluation value may be an evaluation value related to contrast derived by the AF processing unit 312 using the contrast AF method.
- the evaluation value may be an evaluation value related to the phase difference derived by the phase difference AF method in the AF processing unit 312.
- the determination unit 316 may determine that the change amount per unit time of the evaluation value of the contrast or the phase difference does not satisfy the predetermined condition in the period T1 higher than the threshold value.
- the determination unit 316 may determine that a predetermined condition is satisfied in a period in which the evaluation value other than the period T1 is stable.
- the evaluation value may be an evaluation value related to the distance to the subject derived by the DFD (Depth From Defocus) method.
- the evaluation value may be an evaluation value related to the size of the subject in the image captured by the imaging apparatus 300.
- the determination unit 316 may determine that a predetermined condition is satisfied when the amount of change in the evaluation value per unit time is equal to or less than a threshold value. For example, as shown in FIG. 7, when transitioning from image (A) to image (B), the subject frame 610 of the subject in the image (A) and the subject frame 612 of the subject 500 in the image (B). Since the size does not change, the determination unit 316 determines that a predetermined condition is satisfied. On the other hand, when the image (A) transitions to the image (C), the subject frame 610 of the subject 500 in the image (A) and the subject frame 612 of the subject 500 in the image (B) change in size. The determination unit 316 determines that a predetermined condition is not satisfied.
- the determination unit 316 determines that a predetermined condition is satisfied when the change amount per unit time of the shooting distance X indicating the distance between the subject 500 and the imaging device 300 is equal to or less than a threshold value. You can do it. As illustrated in FIG. 9, the determination unit 316 determines that the predetermined condition is not satisfied in the period T2 and the period T3 in which the shooting distance X changes as the UAV 100 moves or the subject 500 moves. It's okay. On the other hand, the determination unit 316 may determine that a predetermined condition is satisfied in a period other than the period T2 and the period T3.
- the determination unit 316 may determine that a predetermined condition is satisfied when the change amount per unit time of the altitude of the imaging apparatus 300 is equal to or less than a threshold value.
- the determination unit 316 may determine that a predetermined condition is satisfied when the moving speed of the imaging apparatus 300 is equal to or less than a threshold value.
- the determination unit 316 may determine that a predetermined condition is satisfied when the moving speed of the focus lens of the imaging apparatus 300 is equal to or less than a threshold value.
- the determination unit 316 may determine that a predetermined condition is satisfied when the imaging apparatus 300 is not performing contrast AF.
- the determination unit 316 may update the reference temperature based on the temperature when the amount of change from the reference temperature is equal to or greater than the threshold value. Thereby, when the temperature change is small, the temperature correction is not performed, and therefore the frequency of execution of the temperature correction can be suppressed.
- the determination unit 316 satisfies a predetermined condition when the other condition that the amount of movement according to the temperature from the reference position of the focus lens satisfies at least one of the above-described conditions and is greater than or equal to the threshold value is satisfied. You may judge.
- the determination unit 316 may update the reference position based on the position of the focus lens when the amount of movement from the reference position is greater than or equal to the threshold value. Accordingly, when the temperature change is small and the amount of movement of the focus lens is small, the temperature correction is not performed, so that the frequency of performing the temperature correction can be suppressed.
- an allowable temperature range that is allowed without performing temperature correction due to a temperature change is ⁇ 4 [° C.] with respect to the reference temperature.
- the determining unit 316 determines that a predetermined condition is satisfied when the temperature change from the reference temperature is ⁇ 4 [° C.] or more.
- the allowable movement amount of the focus lens without performing the temperature correction due to the temperature change is set as the allowable width ⁇ .
- the determination unit 316 determines that a predetermined condition is satisfied when the amount of movement of the focus lens from the reference position at the reference temperature is equal to or larger than the allowable width ⁇ .
- FIG. 11 is a flowchart showing an example of a temperature correction execution procedure by the imaging apparatus 300.
- the determining unit 316 acquires lens information of the lens unit 401 from the lens unit 401 (S100).
- the lens unit 401 may provide the lens information stored in the memory 340 to the determination unit 316.
- the memory 340 may store information indicating whether or not the lens is compatible with temperature correction, in addition to the F value and the focal length, as lens information.
- the determining unit 316 determines whether or not the lens unit 401 is a temperature correction compatible lens based on the lens information (S102).
- the determination unit 316 ends the process. On the other hand, if the lens unit 401 is a temperature correction compatible lens, the determination unit 316 determines whether or not a predetermined condition for executing temperature correction is satisfied (S104).
- the determination unit 316 includes a condition related to an evaluation value of an image captured by the imaging apparatus 300, a condition related to the distance between the imaging apparatus 300 and the subject, a condition related to the altitude of the imaging apparatus 300, a condition related to the moving speed of the imaging apparatus 300, It may be determined whether or not a predetermined condition including at least one of a condition relating to a moving speed of the focus lens and a condition relating to whether or not the imaging apparatus 300 is performing contrast AF is satisfied.
- the determination unit 316 determines not to correct the position of the focus lens based on the temperature, and instructs the lens unit 401 to interrupt the temperature correction (S110).
- the temperature correction unit 412 interrupts temperature correction in response to an instruction to interrupt temperature correction.
- the determination unit 316 determines to correct the position of the focus lens based on the temperature, and instructs the lens unit 401 to execute the temperature correction (S106).
- the temperature correction unit 412 receives an instruction to execute the temperature correction and interrupts the temperature correction, the temperature correction unit 412 starts the temperature correction. If the temperature correction is already being executed, the temperature correction unit 412 receives the instruction to execute the temperature correction and continues the temperature correction as it is (S108).
- the imaging apparatus 300 repeats the processing from step S104 to step S112 until the imaging processing by the lens unit 401 is completed (S112).
- the imaging apparatus 300 when it is preferable not to correct the position of the focus lens according to the temperature, the imaging apparatus 300 does not perform temperature correction. Therefore, the frequency of temperature correction can be reduced, and the processing burden on the imaging apparatus 300 can be reduced. By suppressing the frequency of the temperature correction, it is possible to reduce the flicker of the image captured by the imaging apparatus 300 and to prevent the user from feeling uncomfortable.
- FIG. 12 is a flowchart illustrating an example of a procedure in which the imaging apparatus 300 performs temperature correction when the temperature changes beyond the allowable temperature range.
- the imaging apparatus 300 may execute the procedure illustrated in FIG. 12 at a predetermined cycle, for example, at an interval of 1/60 sec.
- the determination unit 316 acquires the temperature information Tc in the lens detected by the temperature sensor 450 via the lens control unit 410 (S200). The determination unit 316 derives a difference (Tc ⁇ To) between the reference temperature To and the temperature Tc as a temperature change ⁇ T (S202). The determination unit 316 determines whether or not the magnitude of the temperature change ⁇ T is 4 ° C. or more (S204). If the magnitude of the temperature change ⁇ T is within 4 ° C., the determination unit 316 determines that the predetermined condition is not satisfied and ends the process.
- the determination unit 316 determines whether or not the contrast AF is being performed (S206). If the contrast AF is being executed, the determination unit 316 updates the reference temperature To to the temperature Tc and ends the process.
- the determination unit 316 determines that a predetermined condition is satisfied.
- the determination unit 316 instructs execution of temperature correction.
- the temperature correction unit 412 corrects the focus position of the focus lens based on the temperature Tc (S208).
- the determination unit 316 updates the reference temperature To to the temperature Tc and ends the process.
- the temperature correction is not executed, so that the frequency of the temperature correction can be reduced and the processing load on the imaging apparatus 300 can be reduced.
- FIG. 13 illustrates an example of a computer 1200 in which aspects of the present invention may be embodied in whole or in part.
- a program installed in the computer 1200 can cause the computer 1200 to function as an operation associated with the apparatus according to the embodiment of the present invention or as one or more “units” of the apparatus.
- the program can cause the computer 1200 to execute the operation or the one or more “units”.
- the program can cause the computer 1200 to execute a process according to an embodiment of the present invention or a stage of the process.
- Such a program may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.
- the computer 1200 includes a CPU 1212 and a RAM 1214, which are connected to each other by a host controller 1210.
- the computer 1200 also includes a communication interface 1222 and an input / output unit, which are connected to the host controller 1210 via the input / output controller 1220.
- Computer 1200 also includes ROM 1230.
- the CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit.
- the communication interface 1222 communicates with other electronic devices via a network.
- a hard disk drive may store programs and data used by CPU 1212 in computer 1200.
- the ROM 1230 stores therein a boot program executed by the computer 1200 at the time of activation and / or a program depending on the hardware of the computer 1200.
- the program is provided via a computer-readable recording medium such as a CR-ROM, a USB memory, or an IC card or a network.
- the program is installed in the RAM 1214 or the ROM 1230 that is also an example of a computer-readable recording medium, and is executed by the CPU 1212.
- Information processing described in these programs is read by the computer 1200 to bring about cooperation between the programs and the various types of hardware resources.
- An apparatus or method may be configured by implementing information operations or processing in accordance with the use of computer 1200.
- the CPU 1212 executes a communication program loaded in the RAM 1214 and performs communication processing on the communication interface 1222 based on the processing described in the communication program. You may order.
- the communication interface 1222 reads transmission data stored in a RAM 1214 or a transmission buffer area provided in a recording medium such as a USB memory under the control of the CPU 1212 and transmits the read transmission data to a network, or The reception data received from the network is written into a reception buffer area provided on the recording medium.
- the CPU 1212 allows the RAM 1214 to read all or necessary portions of a file or database stored in an external recording medium such as a USB memory, and executes various types of processing on the data on the RAM 1214. Good. The CPU 1212 may then write back the processed data to an external recording medium.
- the CPU 1212 describes various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, and information retrieval that are described throughout the present disclosure for data read from the RAM 1214 and specified by the instruction sequence of the program. Various types of processing may be performed, including / replacement, etc., and the result is written back to RAM 1214.
- the CPU 1212 may search for information in files, databases, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 specifies the attribute value of the first attribute. The entry that matches the condition is searched from the plurality of entries, the attribute value of the second attribute stored in the entry is read, and thereby the first attribute that satisfies the predetermined condition is associated. The attribute value of the obtained second attribute may be acquired.
- the program or software module described above may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200.
- a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program is transferred to the computer 1200 via the network.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Automatic Focus Adjustment (AREA)
- Focusing (AREA)
- Camera Bodies And Camera Details Or Accessories (AREA)
Abstract
Description
特許文献1 特許第4226936号公報
102 UAV本体
110 UAV制御部
150 通信インタフェース
160 メモリ
200 ジンバル
210 回転翼機構
230 撮像装置
240 GPS受信機
260 磁気コンパス
270 気圧高度計
300 撮像装置
301 撮像部
310 撮像制御部
312 AF処理部
316 決定部
330 撮像素子
340 メモリ
401 レンズ部
410 レンズ制御部
412 温度補正部
420 メモリ
430 レンズ移動機構
432 レンズ
440 レンズ位置検出部
450 温度センサ
1200 コンピュータ
1210 ホストコントローラ
1212 CPU
1214 RAM
1220 入力/出力コントローラ
1222 通信インタフェース
1230 ROM
Claims (17)
- 撮像装置が撮像した画像の評価値に関する条件、前記撮像装置と被写体との距離に関する条件、前記撮像装置の高度に関する条件、前記撮像装置の移動速度に関する条件、前記撮像装置のフォーカスレンズの移動速度に関する条件、および前記撮像装置がコントラストAFの実行中か否かに関する条件の少なくとも1つを含む予め定められた条件を満たす場合、前記撮像装置のフォーカスレンズの位置を温度に基づいて補正することを決定する決定部と
を備える制御装置。 - 前記評価値は、コントラストAF方式で導出されるコントラストに関する評価値であり、
前記決定部は、前記評価値の単位時間あたりの変化量が閾値以下の場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。 - 前記評価値は、位相差AF方式で導出される位相差に関する評価値であり、
前記決定部は、前記評価値の単位時間あたりの変化量が閾値以下の場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。 - 前記評価値は、前記画像内の被写体の大きさに関する評価値であり、
前記決定部は、前記評価値の単位時間あたりの変化量が閾値以下の場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。 - 前記決定部は、前記距離の単位時間あたりの変化量が閾値以下の場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。
- 前記決定部は、前記高度の単位時間あたりの変化量が閾値以下の場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。
- 前記決定部は、前記撮像装置の移動速度が閾値以下の場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。
- 前記決定部は、前記撮像装置のフォーカスレンズの移動速度が閾値以下の場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。
- 前記決定部は、前記撮像装置がコントラストAFの実行中でない場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。
- 前記決定部は、前記条件の少なくとも1つを満たし、かつ前記撮像装置の温度の基準温度からの変化量が閾値以上であるという他の条件を満たす場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。
- 前記決定部は、前記基準温度からの変化量が閾値以上であるときの温度に基づいて前記基準温度を更新する、請求項10に記載の制御装置。
- 前記決定部は、前記条件の少なくとも1つを満たし、かつ前記フォーカスレンズの基準位置からの温度に応じた移動量が閾値以上であるという他の条件を満たす場合、前記予め定められた条件を満たすと判断し、前記フォーカスレンズの位置を温度に基づいて補正することを決定する、請求項1に記載の制御装置。
- 前記決定部は、前記基準位置からの移動量が閾値以上であるときの前記フォーカスレンズの位置に基づいて前記基準位置を更新する、請求項12に記載の制御装置。
- 請求項1から13の何れか1つに記載の制御装置と、
前記フォーカスレンズと、
前記決定部が前記フォーカスレンズの位置を温度に基づいて補正することを決定することに応じて、前記フォーカスレンズの位置を補正すべく前記フォーカスレンズを制御する制御部と
を備える撮像装置。 - 前記請求項14に記載の撮像装置を備えて移動する移動体。
- 撮像装置が撮像した画像の評価値に関する条件、前記撮像装置と被写体との距離に関する条件、前記撮像装置の高度に関する条件、前記撮像装置の移動速度に関する条件、前記撮像装置のフォーカスレンズの移動速度に関する条件、および前記撮像装置がコントラストAFの実行中か否かに関する条件の少なくとも1つを含む予め定められた条件を満たす場合、前記撮像装置のフォーカスレンズの位置を温度に基づいて補正することを決定する段階
を備える制御方法。 - 撮像装置が撮像した画像の評価値に関する条件、前記撮像装置と被写体との距離に関する条件、前記撮像装置の高度に関する条件、前記撮像装置の移動速度に関する条件、前記撮像装置のフォーカスレンズの移動速度に関する条件、および前記撮像装置がコントラストAFの実行中か否かに関する条件の少なくとも1つを含む予め定められた条件を満たす場合、前記撮像装置のフォーカスレンズの位置を温度に基づいて補正することを決定する段階
をコンピュータに実行させるためのプログラム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2016/087126 WO2018109847A1 (ja) | 2016-12-13 | 2016-12-13 | 制御装置、撮像装置、移動体、制御方法、およびプログラム |
JP2017559736A JP6543878B2 (ja) | 2016-12-13 | 2016-12-13 | 制御装置、撮像装置、移動体、制御方法、およびプログラム |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2016/087126 WO2018109847A1 (ja) | 2016-12-13 | 2016-12-13 | 制御装置、撮像装置、移動体、制御方法、およびプログラム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018109847A1 true WO2018109847A1 (ja) | 2018-06-21 |
Family
ID=62558246
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/087126 WO2018109847A1 (ja) | 2016-12-13 | 2016-12-13 | 制御装置、撮像装置、移動体、制御方法、およびプログラム |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6543878B2 (ja) |
WO (1) | WO2018109847A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2020067504A (ja) * | 2018-10-22 | 2020-04-30 | キヤノン株式会社 | フォーカス制御装置、撮像装置およびフォーカス制御方法 |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110708461B (zh) * | 2019-09-30 | 2020-11-17 | 杭州师范大学 | 一种适用于无人移动载体的摄像机调焦与变焦方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006270457A (ja) * | 2005-03-23 | 2006-10-05 | Nec Saitama Ltd | 携帯端末機器の電源切断システム、方法及びプログラム |
JP2012141436A (ja) * | 2010-12-28 | 2012-07-26 | Canon Inc | 焦点検出装置およびその制御方法 |
JP2013083717A (ja) * | 2011-10-06 | 2013-05-09 | Canon Inc | 焦点検出装置 |
WO2016158040A1 (ja) * | 2015-03-30 | 2016-10-06 | 富士フイルム株式会社 | 合焦制御装置、レンズ装置、撮像装置、合焦制御方法、合焦制御プログラム |
-
2016
- 2016-12-13 WO PCT/JP2016/087126 patent/WO2018109847A1/ja active Application Filing
- 2016-12-13 JP JP2017559736A patent/JP6543878B2/ja not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006270457A (ja) * | 2005-03-23 | 2006-10-05 | Nec Saitama Ltd | 携帯端末機器の電源切断システム、方法及びプログラム |
JP2012141436A (ja) * | 2010-12-28 | 2012-07-26 | Canon Inc | 焦点検出装置およびその制御方法 |
JP2013083717A (ja) * | 2011-10-06 | 2013-05-09 | Canon Inc | 焦点検出装置 |
WO2016158040A1 (ja) * | 2015-03-30 | 2016-10-06 | 富士フイルム株式会社 | 合焦制御装置、レンズ装置、撮像装置、合焦制御方法、合焦制御プログラム |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2020067504A (ja) * | 2018-10-22 | 2020-04-30 | キヤノン株式会社 | フォーカス制御装置、撮像装置およびフォーカス制御方法 |
JP7191640B2 (ja) | 2018-10-22 | 2022-12-19 | キヤノン株式会社 | フォーカス制御装置、撮像装置およびフォーカス制御方法 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2018109847A1 (ja) | 2018-12-13 |
JP6543878B2 (ja) | 2019-07-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018185939A1 (ja) | 撮像制御装置、撮像装置、撮像システム、移動体、撮像制御方法、及びプログラム | |
JP6478177B2 (ja) | 制御装置、撮像システム、移動体、制御方法、およびプログラム | |
JP2019216343A (ja) | 決定装置、移動体、決定方法、及びプログラム | |
JP2019110462A (ja) | 制御装置、システム、制御方法、及びプログラム | |
WO2018109847A1 (ja) | 制御装置、撮像装置、移動体、制御方法、およびプログラム | |
JP6565072B2 (ja) | 制御装置、レンズ装置、飛行体、制御方法、及びプログラム | |
JP6630939B2 (ja) | 制御装置、撮像装置、移動体、制御方法、及びプログラム | |
JP6496953B2 (ja) | 制御装置、撮像装置、移動体、制御方法、及びプログラム | |
US20200068128A1 (en) | Control device, imaging device, imaging system, movable object, control method, and program | |
JP6501091B1 (ja) | 制御装置、撮像装置、移動体、制御方法、及びプログラム | |
JP6587006B2 (ja) | 動体検出装置、制御装置、移動体、動体検出方法、及びプログラム | |
JP6515423B2 (ja) | 制御装置、移動体、制御方法、及びプログラム | |
JP6790318B2 (ja) | 無人航空機、制御方法、及びプログラム | |
JP6543875B2 (ja) | 制御装置、撮像装置、飛行体、制御方法、プログラム | |
JP6503607B2 (ja) | 撮像制御装置、撮像装置、撮像システム、移動体、撮像制御方法、及びプログラム | |
WO2018116417A1 (ja) | 制御装置、撮像装置、移動体、制御方法、及びプログラム | |
JP6543879B2 (ja) | 無人航空機、決定方法、およびプログラム | |
JP2020016703A (ja) | 制御装置、移動体、制御方法、及びプログラム | |
JP2020014054A (ja) | 制御装置、移動体、制御方法、及びプログラム | |
JP2019205047A (ja) | 制御装置、撮像装置、移動体、制御方法、及びプログラム | |
JP6413170B1 (ja) | 決定装置、撮像装置、撮像システム、移動体、決定方法、及びプログラム | |
JP6409239B1 (ja) | 撮像装置、撮像システム、飛行体、記録方法、及びプログラム | |
JP6459012B1 (ja) | 制御装置、撮像装置、飛行体、制御方法、及びプログラム | |
JP2020052220A (ja) | 制御装置、撮像装置、移動体、制御方法、及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2017559736 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16924149 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 08/10/2019) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16924149 Country of ref document: EP Kind code of ref document: A1 |