+

WO2016011872A1 - Image photographing method and apparatus and computer storage medium - Google Patents

Image photographing method and apparatus and computer storage medium Download PDF

Info

Publication number
WO2016011872A1
WO2016011872A1 PCT/CN2015/082399 CN2015082399W WO2016011872A1 WO 2016011872 A1 WO2016011872 A1 WO 2016011872A1 CN 2015082399 W CN2015082399 W CN 2015082399W WO 2016011872 A1 WO2016011872 A1 WO 2016011872A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
output
output image
determined
abnormal
Prior art date
Application number
PCT/CN2015/082399
Other languages
French (fr)
Chinese (zh)
Inventor
魏强
崔小辉
苗雷
里强
谭焕清
Original Assignee
努比亚技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 努比亚技术有限公司 filed Critical 努比亚技术有限公司
Publication of WO2016011872A1 publication Critical patent/WO2016011872A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene

Definitions

  • the present invention relates to the field of imaging technology, and in particular, to an image capturing method, apparatus, and computer storage medium.
  • Star-track shooting refers to the shooting mode in which the shooting device captures the running trajectory of the star through continuous exposure for a long time.
  • the exposure time usually takes 20 to 60 minutes, and the photosensitive hardware capable of supporting long-time exposure is expensive.
  • professional camera devices such as SLR cameras are equipped with the aforementioned photosensitive hardware, and for digital cameras such as digital Cameras, mobile phones, tablets, etc. cannot be equipped with such expensive photosensitive hardware.
  • Embodiments of the present invention are directed to providing an image capturing method, apparatus, and computer storage medium, which aim to eliminate interference of abnormal bright spots on the star track shooting process and improve shooting results.
  • an embodiment of the present invention provides an image capturing method, including:
  • the image is collected and output every preset time to determine whether there is an abnormal bright spot in the output image
  • the base image synthesized for the first time is a first output image with no abnormal bright spots or a preset image.
  • the synthesizing the output image and the base image into a composite image includes:
  • the pixel of the base image at the same position is replaced with the pixel of the output image, and image synthesis is performed.
  • whether the abnormal output point in the image that is determined to be output includes:
  • whether the image of the outputted image has an area abnormality includes:
  • whether the image of the outputted image has an area abnormality includes:
  • the bright point of determining whether there is a track abnormality in the output image includes:
  • the bright point of determining whether there is a track abnormality in the output image includes:
  • the bright point of determining whether there is a track abnormality in the output image includes:
  • the determining the base image includes: using the output image of the first non-abnormal bright spot as the base image.
  • the embodiment of the invention simultaneously provides an image capturing device, which comprises an output module, a judging module, a synthesizing module and a display module, wherein:
  • the output module is configured to collect an image and output it every preset time
  • the determining module is configured to determine whether there is an abnormal bright spot in the image output by the output module; when it is determined that there is no abnormal bright spot in the output image, the output image is sent to the synthesizing module;
  • the synthesizing module is configured to determine a base image, synthesize the image sent by the judging module and the base image into a composite image, and use the composite image as a base image for the next synthesis;
  • the base image is the first output image with no abnormal bright spots or a preset image;
  • the display module is configured to display a composite image synthesized by the synthesis module.
  • the synthesizing module is configured to:
  • the pixel of the base image at the same position is replaced with the pixel of the output image, and image synthesis is performed.
  • the determining module is configured to:
  • the determining module is configured to:
  • the determining module is configured to:
  • the determining module is configured to:
  • the determining module is configured to:
  • the determining module is configured to:
  • the synthesizing module is configured to use the output image of the first non-abnormal bright spot as a base image.
  • the embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions are configured to execute the image capturing method according to the embodiment of the present invention.
  • An image capturing method, device and computer storage medium provided by an embodiment of the present invention first determine whether there is an abnormal bright spot in the image before performing image synthesis on the image outputted after the acquisition, and discard the currently output image if there is an abnormal bright spot. No synthesis, only images with no abnormal bright spots are screened for synthesis, to avoid the effect of abnormal highlights affecting the final composite image, eliminating the interference of abnormal highlights such as fireflies and airplanes on the star-track shooting process, improving the star-track shooting effect and improving The user experience.
  • FIG. 1 is a flow chart of an embodiment of an image capturing method of the present invention
  • FIG. 2 is a block diagram showing the structure of an image capturing apparatus of the present invention
  • Figure 3 is a block diagram showing the main electrical configuration of a camera of one embodiment of the present invention.
  • the image capturing method of the embodiment of the invention is mainly applied to the star-track shooting, that is, the motion trajectory of the shooting stars, and the formation of the motion trajectory is caused by the relative motion between the photographer and the shooting target, and thus can also be applied to similar motions.
  • the star-track shooting that is, the motion trajectory of the shooting stars
  • the formation of the motion trajectory is caused by the relative motion between the photographer and the shooting target, and thus can also be applied to similar motions.
  • Application scenario The following examples are described in detail by taking star track shooting as an example.
  • FIG. 1 is a flow chart of an embodiment of an image capturing method of the present invention. referring to FIG. 1, the image capturing method includes the following steps:
  • Step S101 Acquire an image and output it every preset time.
  • the photographing device collects and outputs the image by the camera at a preset time interval, and the preset time interval is the exposure time, for example, it can be set to 40 seconds (S) to 60S, 5S to 10S, and the like.
  • Step S102 determining whether there is an abnormal bright spot in the output image.
  • the abnormal bright spots that is, the highlights of non-stars, such as fireflies flying in front of the camera, airplanes flying in the sky, and the like.
  • the bright spot described in this embodiment refers to a pixel point whose brightness value is greater than a preset threshold.
  • the area occupied by the abnormal bright spot in the image is usually large, so the area of the bright spot in the image can be determined. Whether it is abnormal, to determine whether there is an abnormal bright spot in the image, that is, to identify the abnormal bright spot by the size of the area of the bright spot.
  • the approximate area occupied by the star in the image is known, and a threshold value is set according to the approximate area.
  • the bright point is determined.
  • Non-star highlights determine that there are unusual bright spots in the image.
  • the statistical value of the area of the normal bright spot ie, the bright spot of the star
  • the statistical value may be an image of the current output, an image of the past no abnormal bright spot, or an arithmetic mean of all the bright spot areas in the base image, and the weighting.
  • the preset threshold is set to be 20% to 50%.
  • the length of the abnormal bright spots in the image is longer than the length of the stars, so the abnormal bright spots can be identified by the track length of the bright points.
  • the approximate length of the trajectory of the star in the image is known, and a threshold value is set according to the approximate length; when it is determined that there is a bright point in the image whose track length is greater than a preset threshold, then it is determined The bright spot is not a bright spot of the star, and it is determined that there is an abnormal bright spot in the image.
  • the statistic value of the length of the normal bright point trajectory is first obtained, and the statistic value may be an image of the current output, an image of an abnormally bright spot that has been output in the past, or an arithmetic mean of the lengths of all the bright point trajectories in the base image, a weighted average value, and Number of bits, etc.; after obtaining the statistical value, when it is judged that there is a bright spot in the image that is outputted that the track length exceeds the statistical value by a preset threshold, Then, it is determined that the bright spot is not a bright spot of the star, and it is determined that there is an abnormal bright spot in the image; wherein the preset threshold is set to be 20% to 50%.
  • the running trajectory of the stars has a certain rule to follow, and the running trajectories of all the stars are roughly the same, it is also possible to identify the abnormal bright spots by the trajectory direction of the bright points.
  • the direction of the track of the normal bright spot is obtained, and the current output image, the image of the past no abnormal bright spot or the track direction of most bright spots in the base image is taken as the track direction of the normal bright spot; after obtaining the track direction of the normal bright spot, when It is judged that there is a bright point in the output image that deviates from the preset range of the normal bright point track direction, and then the bright point of the non-star is determined, and it is determined that there is an abnormal bright spot in the image, and the preset range is set to ⁇ 10%.
  • the brightness of the bright spot may also be used to identify the abnormal bright spot.
  • the bright spot is determined to be an abnormal bright spot.
  • the plurality of abnormal bright spot recognition methods may be combined to determine the abnormal bright spot to improve the accuracy.
  • step S103 When it is determined that there is an abnormal bright spot in the output image, the process proceeds to step S103; when it is determined that there is no abnormal bright spot in the currently output image, the process proceeds to step S104.
  • Step S103 Discard the output image.
  • step S102 If there is an abnormal bright spot in the currently output image, the image is discarded and not synthesized, so as not to affect the effect of the composite image. At the same time, returning to step S102, the detection of the next image output is continued.
  • Step S104 Determine a base image, synthesize the output image and the base image into a composite image, and use the composite image as a base image for the next synthesis.
  • the image is synthesized.
  • the base image is first determined.
  • the base image is the first image of the output without the abnormal bright spot or the preset image.
  • the output image is after the start of shooting
  • the output of the first image without abnormal highlights can be used as the base image before the shooting; or there is no preset image, the first image without abnormal highlights is not synthesized, when the output has no abnormal bright spots
  • the synthesis processing is performed only when two images are used, and at this time, the image of the first output without abnormal bright spots is used as the base image.
  • the composite image obtained by the previous synthesis is determined as the base image of the synthesis.
  • the photographing device determines whether the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image; and determining whether the brightness of the pixel of the image outputted by the same position is greater than the pixel of the base image.
  • luminance pixels of the same position base image are replaced with pixels of the output image, image synthesis is performed, a composite image is generated, and the composite image is used as a base image for the next image synthesis.
  • Step S105 Display the composite image.
  • the composite image is displayed on the display screen in real time, and the process returns to step S102 to continue detecting the next image to be output, and preparing for the next image synthesis.
  • image acquisition and image synthesis are performed synchronously to facilitate the user to view the currently generated composite image in real time; before each image is acquired and image synthesis is performed, it is detected whether there is any image in the output image.
  • Abnormal bright spots if there are abnormal bright spots, discard the currently acquired images without synthesizing, and only combine the images with no abnormal bright spots and the base images to eliminate the images with abnormal bright spots, and prevent the images with abnormal bright spots from being synthesized.
  • the final composite image affects the quality of the photo, eliminating the interference of abnormal objects such as fireflies and airplanes on the star-track shooting process, and improving the shooting effect.
  • the image capturing apparatus may be a general digital camera such as a card camera, or may have Terminal devices such as mobile phones and tablet computers with camera functions.
  • the image capturing device includes an output module 21, a determining module 22, a synthesizing module 23, and a display module 24; among them,
  • the output module 21 is configured to collect images and output them every preset time; specifically, the images are collected by the camera at preset time intervals, and the preset time interval is an exposure time, for example, it can be set to 40S to 60S, 5S ⁇ 10S and so on.
  • the determining module 22 is configured to determine whether there is an abnormal bright spot in the image output by the output module 21; when it is determined that there is no abnormal bright spot in the output image, the output image is sent to the synthesizing module 23; When it is determined that there is an abnormal bright spot in the output image, the image is discarded;
  • the compositing module 23 is configured to determine a base image, synthesize the image sent by the determining module 22 and the base image into a composite image, and use the composite image as a base image for the next synthesis;
  • the base image is a first output image with no abnormal bright spots or a preset image;
  • the display module 24 is configured to display a composite image synthesized by the synthesis module 23.
  • the abnormal bright spots that is, non-star highlights, such as fireflies flying in front of the camera, airplanes flying in the sky, and the like.
  • the bright spot described in this embodiment refers to a pixel point whose brightness value is greater than a preset threshold.
  • the judging module 22 judges the image by determining whether the area of the bright spot in the image is abnormal. Whether there is an abnormal bright spot, that is, the abnormal bright spot is identified by the size of the area of the bright spot. For example, determining whether there is a bright spot whose area is larger than the preset value in the output image, or determining whether there is a bright spot in the output image that exceeds the statistical value of the area of the normal bright spot by a preset threshold; if yes, it is determined that the output image has The highlight of the area is abnormal.
  • the determining module 22 determines whether there is an abnormal bright spot in the image by determining whether the trajectory of the bright spot in the image is abnormal, that is, identifying the abnormal bright spot by the track length or/and the direction of the bright spot. For example, considering that the stars run slower, and the abnormal bright spots move relatively fast, the length of the abnormal bright spots in the image is longer than the length of the stars, so The abnormal bright spot is identified by the length of the track passing through the bright spot. Specifically, it can be determined whether there is a bright point whose track length is greater than a preset value in the output image, or whether the output image has a bright point whose track length exceeds the statistical value of the normal bright point track length by a preset threshold; if yes, the determination is performed.
  • the output image has bright spots with abnormal trajectories.
  • the determining module 22 first obtains the trajectory direction of the normal bright spot, and can use the current output image, the image of the past no abnormal bright spot or the trajectory direction of most bright points in the base image as the trajectory direction of the normal bright spot; and obtain the trajectory of the normal bright spot After the direction, when it is judged that there is a bright point in the output image that deviates from the preset range of the normal bright point track direction, it is determined that the bright spot is not a bright spot of the star, and it is determined that there is an abnormal bright spot in the image, and the preset range is set to ⁇ 10%. .
  • the determining module 22 may further identify the abnormal bright spot by using the brightness of the bright spot.
  • the determining module 22 may further identify the abnormal bright spot by using the brightness of the bright spot.
  • the determining is performed.
  • the highlight is an unusual highlight.
  • the determining module 22 may combine the plurality of abnormal bright spot recognition methods to determine the abnormal bright spot to improve the accuracy.
  • the synthesizing module 23 first determines the base image.
  • the base image is the first image of the output without the abnormal bright spot or the preset image. For example, if the output image is the first image with no abnormal bright spots output after the start of shooting, the image preset before shooting can be used as the base image; or there is no preset image, and the first image without abnormal highlights is not synthesized.
  • the synthesis processing is performed, and at this time, the image of the first output without the abnormal bright spot is used as the base image.
  • the composite image obtained by the previous synthesis is determined as the base image of the synthesis.
  • the synthesizing module 23 determines whether the brightness of the pixel of the image currently outputted at the same position is greater than the base image. The brightness of the pixel; if so, the pixel of the base image of the same position is replaced with the pixel of the output image, and image synthesis is performed accordingly, and a composite image is generated, and the composite image is used as a base image for the next image synthesis.
  • image acquisition and image synthesis are performed synchronously to facilitate the user to view the currently generated composite image in real time.
  • the image capturing device can be implemented by a digital camera, a device with a camera (such as a mobile phone, a tablet computer, a notebook computer, etc.), and an output module 21 and a determination module 22 in the imaging device.
  • the synthesis module 23 can be passed through a central processing unit (CPU), a digital signal processor (DSP) or a programmable gate array (FPGA) in the image capturing device. Field-Programmable Gate Array) is implemented; the display module 24 in the camera device can be implemented in a practical application by a display screen or display in the image capture device.
  • FIG. 6 is a block diagram showing the main electrical configuration of a camera of one embodiment of the present invention.
  • the photographic lens 101 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens or a zoom lens.
  • the photographic lens 101 can be moved in the optical axis direction by the lens driving unit 111, and controls the focus position of the taking lens 101 based on the control signal from the lens driving control unit 112, and also controls the focus distance in the case of the zoom lens.
  • the lens drive control circuit 112 performs drive control of the lens drive unit 111 in accordance with a control command from the microcomputer 107.
  • An imaging element 102 is disposed in the vicinity of a position where the subject image is formed by the photographing lens 101 on the optical axis of the photographing lens 101.
  • the imaging element 102 functions as an imaging unit that captures a subject image and acquires captured image data.
  • Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the imaging element 102. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode.
  • the front surface of each pixel is provided with a Bayer array of RGB color filters.
  • the imaging element 102 is connected to an imaging circuit 103 that performs charge accumulation control and image signal readout control in the imaging element 102, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.
  • the imaging circuit 103 is connected to the A/D conversion unit 104, which performs analog-to-digital conversion on the analog image signal, and outputs a digital image signal (hereinafter referred to as image data) to the bus 199.
  • image data a digital image signal
  • the bus 199 is a transmission path for transmitting various data read or generated inside the camera.
  • the A/D conversion unit 104 is connected to the bus 199, and an image processor 105, a JPEG processor 106, a microcomputer 107, a SDRAM (Synchronous DRAM) 108, and a memory interface (hereinafter referred to as a memory I/F) are connected. 109. LCD (Liquid Crystal Display) driver 110.
  • the image processor 105 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 102. deal with.
  • the JPEG processor 106 compresses the image data read out from the SDRAM 108 in accordance with the JPEG compression method. Further, the JPEG processor 106 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 115 is read, and after the compression processing is performed in the JPEG processor 106, the decompressed image data is temporarily stored in the SDRAM 108 and displayed on the LCD 116. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.
  • the microcomputer 107 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera.
  • the microcomputer 107 is connected to the operation unit 113 and the flash memory 114.
  • the operation unit 113 includes but not limited to a physical button or a virtual button, the entity or virtual
  • the button can be used as a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlargement button, and the like, and various operation buttons such as various input buttons, and the like.
  • the operating state of the operating member is not limited to a physical button or a virtual button, the entity or virtual
  • the button can be used as a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlargement button, and the like, and various operation buttons such as various input buttons, and the like.
  • the detection result is output to the microcomputer 107.
  • a touch panel is provided on the front surface of the LCD 116 as a display portion, and the touch position of the user is detected, and the touch position is output to the microcomputer 107.
  • the microcomputer 107 executes various processing sequences corresponding to the operation of the user based on the detection result of the operation member from the operation unit 113. (Similarly, this place can be changed to the computer 107 to execute various processing sequences corresponding to the user's operation based on the detection result of the touch panel on the front of the LCD 116.)
  • the flash memory 114 stores programs for executing various processing sequences of the microcomputer 107.
  • the microcomputer 107 performs overall control of the camera in accordance with the program. Further, the flash memory 114 stores various adjustment values of the camera, and the microcomputer 107 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.
  • the SDRAM 108 is an electrically rewritable volatile memory for temporarily storing image data or the like.
  • the SDRAM 108 temporarily stores image data output from the A/D conversion unit 104 and image data processed in the image processor 105, the JPEG processor 106, and the like.
  • the memory interface 109 is connected to the recording medium 115, and performs control for writing image data and a file header attached to the image data to the recording medium 115 and reading from the recording medium 115.
  • the recording medium 115 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body.
  • the recording medium 115 is not limited thereto, and may be a hard disk or the like built in the camera body.
  • the LCD driver 110 is connected to the LCD 116, and stores image data processed by the image processor 105 in the SDRAM.
  • the image data stored in the SDRAM is read and displayed on the LCD 116, or the image data stored in the JPEG processor 106 is compressed.
  • the JPEG processor 106 reads the compressed image data of the SDRAM, decompresses it, and displays the decompressed image data on the LCD 116.
  • the LCD 116 is disposed on the back surface of the camera body or the like to perform image display.
  • the LCD116 is provided A touch panel that detects a user's touch operation.
  • the liquid crystal display panel (LCD 116) is disposed as the display portion.
  • the present invention is not limited thereto, and various display panels such as an organic EL may be employed.
  • the image capturing apparatus of the present invention first determines whether there is an abnormal bright spot in the image before performing image synthesis on the image to be output and output. If there is an abnormal bright spot, the image that is currently output is discarded, and only the abnormal bright spot is selected.
  • the images are synthesized to avoid the effects of abnormal highlights affecting the final composite image, eliminating the interference of abnormal objects such as fireflies and airplanes on the star-track shooting process, improving the shooting effect and improving the user experience.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed.
  • the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.
  • the units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated into one unit;
  • the unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the readable storage medium when executed, executes the steps including the foregoing method embodiments; and the foregoing storage medium includes: a mobile storage device, a read-only memory (ROM), a random access memory (Various media that can store program code, such as RAM (Random Access Memory), disk or optical disk.
  • ROM read-only memory
  • RAM Random Access Memory
  • the above-described integrated unit of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product.
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a RAM, a magnetic disk, or an optical disk.
  • the embodiment of the invention is synchronously performed by image acquisition and image synthesis, so as to facilitate the user to view the currently generated composite image in real time; before each image is output and the image is synthesized, it is detected whether there is an abnormal bright spot in the output image, if any If the abnormal highlight is present, the currently acquired image will not be synthesized, and only the image with no abnormal highlights will be combined with the base image, thereby eliminating the image with abnormal highlights and preventing the image with abnormal highlights from being synthesized into the final composite image. It affects the quality of photos, eliminates the interference of abnormal objects such as fireflies and airplanes on the star-track shooting process, and improves the shooting effect.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

Disclosed are an image photographing method and apparatus and a computer storage medium. The image photographing method comprises: collecting an image and outputting same every pre-set time, and judging whether there is an abnormal bright spot in the output image; when there is no abnormal bright spot in the output image, determining a basic image, synthesizing the output image and the basic image into a synthetic image, and taking the synthetic image as the basic image for next synthesization; and displaying the synthetic image synthesized in a photographing process.

Description

图像拍摄方法、装置和计算机存储介质Image capturing method, device and computer storage medium 技术领域Technical field
本发明涉及摄像技术领域,尤其是涉及一种图像拍摄方法、装置和计算机存储介质。The present invention relates to the field of imaging technology, and in particular, to an image capturing method, apparatus, and computer storage medium.
背景技术Background technique
星轨拍摄,是指拍摄装置通过长时间持续曝光,拍摄出星星的运行轨迹的拍摄模式。进行星轨拍摄时,曝光时间通常需要20~60分钟,而能够支持长时间曝光的感光硬件都比较昂贵,只有专业的摄像装置如单反相机才配备有前述感光硬件,而对于数码拍摄装置如数码相机、手机、平板电脑等则不可能配备如此昂贵的感光硬件。Star-track shooting refers to the shooting mode in which the shooting device captures the running trajectory of the star through continuous exposure for a long time. When shooting a star track, the exposure time usually takes 20 to 60 minutes, and the photosensitive hardware capable of supporting long-time exposure is expensive. Only professional camera devices such as SLR cameras are equipped with the aforementioned photosensitive hardware, and for digital cameras such as digital Cameras, mobile phones, tablets, etc. cannot be equipped with such expensive photosensitive hardware.
由于星轨拍摄的持续时间较长,在进行星轨拍摄过程中,通常有异常物体的干扰,如有萤火虫从镜头前飞过,或者有飞机从天空中掠过等等。从而,在最终合成的星轨照片中留下了萤火虫、飞机等异常亮点的移动轨迹,影响了星轨拍摄效果。Due to the long duration of the star-track shooting, during the shooting of the star-track, there are usually interferences from abnormal objects, such as fireflies flying in front of the camera, or passing the aircraft through the sky. Thus, in the final synthesized star-track photo, the moving trajectory of the abnormal bright spots such as fireflies and airplanes is left, which affects the star-track shooting effect.
发明内容Summary of the invention
本发明实施例期望提供一种图像拍摄方法、装置和计算机存储介质,旨在消除异常亮点对星轨拍摄过程的干扰,提升拍摄效果。Embodiments of the present invention are directed to providing an image capturing method, apparatus, and computer storage medium, which aim to eliminate interference of abnormal bright spots on the star track shooting process and improve shooting results.
为达以上目的,本发明实施例提出一种图像拍摄方法,包括:In order to achieve the above objective, an embodiment of the present invention provides an image capturing method, including:
每隔预设时间采集图像并输出,判断输出的图像中是否有异常亮点;The image is collected and output every preset time to determine whether there is an abnormal bright spot in the output image;
当输出的图像中无异常亮点时,则确定基础图像,将所述输出的图像与所述基础图像合成为合成图像,并将所述合成图像作为下一次合成的基础图像; When there is no abnormal bright spot in the output image, determining a base image, synthesizing the output image and the base image into a composite image, and using the composite image as a base image for the next synthesis;
显示拍摄过程中合成的合成图像;Displaying a composite image synthesized during shooting;
其中,首次合成的所述基础图像为第一张输出的无异常亮点的图像或预设的图像。The base image synthesized for the first time is a first output image with no abnormal bright spots or a preset image.
作为一种实施方式,所述将所述输出的图像与所述基础图像合成为合成图像包括:As an implementation manner, the synthesizing the output image and the base image into a composite image includes:
判断同一位置输出的图像的像素的亮度是否大于所述基础图像的像素的亮度;Determining whether the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image;
确定同一位置输出的图像的像素的亮度大于所述基础图像的像素的亮度时,则将同一位置所述基础图像的像素替换为所述输出的图像的像素,进行图像合成。When it is determined that the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image, the pixel of the base image at the same position is replaced with the pixel of the output image, and image synthesis is performed.
作为一种实施方式,所述判断输出的图像中是否有异常亮点包括:As an implementation manner, whether the abnormal output point in the image that is determined to be output includes:
判断输出的图像中是否有面积异常或/和轨迹异常的亮点;Determining whether there is an area abnormality or/and a highlight of the trajectory abnormality in the output image;
确定输出的图像中有面积异常或/和轨迹异常的亮点时,判定输出的图像中有异常亮点。When it is determined that there is an area abnormality or/and a highlight abnormality in the output image, it is determined that there is an abnormal bright spot in the output image.
作为一种实施方式,所述判断输出的图像中是否有面积异常的亮点包括:As an implementation manner, whether the image of the outputted image has an area abnormality includes:
判断输出的图像中是否有面积大于预设值的亮点;Determining whether there is a bright spot in the output image that is larger than a preset value;
确定输出的图像中有面积大于预设值的亮点时,判定输出的图像中有面积异常的亮点。When it is determined that there is a bright spot whose area is larger than the preset value in the output image, it is determined that there is an abnormal spot in the output image.
作为一种实施方式,所述判断输出的图像中是否有面积异常的亮点包括:As an implementation manner, whether the image of the outputted image has an area abnormality includes:
判断输出的图像中是否有面积超过正常亮点面积的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright spot whose area exceeds the statistical value of the normal bright spot area by a preset threshold;
确定输出的图像中有面积超过正常亮点面积的统计值达预设阈值的亮点时,判定输出的图像中有面积异常的亮点。 When it is determined that there is a bright spot in the output image that exceeds the statistical value of the normal bright spot area by a preset threshold, it is determined that there is an abnormal spot in the output image.
作为一种实施方式,所述判断输出的图像中是否有轨迹异常的亮点包括:As an implementation manner, the bright point of determining whether there is a track abnormality in the output image includes:
判断输出的图像中是否有轨迹长度大于预设值的亮点;Determining whether there is a bright point in the output image that has a track length greater than a preset value;
确定输出的图像中有轨迹长度大于预设值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image whose track length is greater than the preset value, it is determined that there is a bright spot with an abnormal track in the output image.
作为一种实施方式,所述判断输出的图像中是否有轨迹异常的亮点包括:As an implementation manner, the bright point of determining whether there is a track abnormality in the output image includes:
判断输出的图像中是否有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright point whose track length exceeds the length of the normal bright track length by a preset threshold;
确定输出的图像中有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that the output image has a bright point whose track length exceeds the normal bright point track length and reaches a preset threshold value, it is determined that there is a bright spot of the track abnormality in the output image.
作为一种实施方式,所述判断输出的图像中是否有轨迹异常的亮点包括:As an implementation manner, the bright point of determining whether there is a track abnormality in the output image includes:
判断输出的图像中是否有轨迹方向偏离正常亮点轨迹方向预设范围的亮点;Determining whether there is a bright point in the output image that deviates from the preset range of the normal bright point track direction;
确定输出的图像中有轨迹方向偏离正常亮点轨迹方向预设范围的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image that deviates from the preset range of the normal bright point trajectory direction, it is determined that there is a bright point of the trajectory abnormality in the output image.
作为一种实施方式,所述确定基础图像包括:将输出的第一张无异常亮点的图像作为基础图像。As an implementation manner, the determining the base image includes: using the output image of the first non-abnormal bright spot as the base image.
本发明实施例同时提出一种图像拍摄装置,包括输出模块、判断模块、合成模块和显示模块,其中:The embodiment of the invention simultaneously provides an image capturing device, which comprises an output module, a judging module, a synthesizing module and a display module, wherein:
所述输出模块,配置为每隔预设时间采集图像并输出;The output module is configured to collect an image and output it every preset time;
所述判断模块,配置为判断所述输出模块输出的图像中是否有异常亮点;当判定所述输出的图像中无异常亮点时,则将所述输出的图像发送给合成模块; The determining module is configured to determine whether there is an abnormal bright spot in the image output by the output module; when it is determined that there is no abnormal bright spot in the output image, the output image is sent to the synthesizing module;
所述合成模块,配置为确定基础图像,将所述判断模块发送的图像与所述基础图像合成为合成图像,并将所述合成图像作为下一次合成的基础图像;其中,首次合成的所述基础图像为第一张输出的无异常亮点的图像或预设的图像;The synthesizing module is configured to determine a base image, synthesize the image sent by the judging module and the base image into a composite image, and use the composite image as a base image for the next synthesis; The base image is the first output image with no abnormal bright spots or a preset image;
所述显示模块,配置为显示所述合成模块合成的合成图像。The display module is configured to display a composite image synthesized by the synthesis module.
作为一种实施方式,所述合成模块配置为:As an implementation manner, the synthesizing module is configured to:
判断同一位置输出的图像的像素的亮度是否大于所述基础图像的像素的亮度;Determining whether the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image;
确定同一位置输出的图像的像素的亮度大于所述基础图像的像素的亮度时,则将同一位置所述基础图像的像素替换为所述输出的图像的像素,进行图像合成。When it is determined that the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image, the pixel of the base image at the same position is replaced with the pixel of the output image, and image synthesis is performed.
作为一种实施方式,所述判断模块配置为:As an implementation manner, the determining module is configured to:
判断输出的图像中是否有面积异常或/和轨迹异常的亮点;Determining whether there is an area abnormality or/and a highlight of the trajectory abnormality in the output image;
确定输出的图像中有面积异常或/和轨迹异常的亮点时,判定输出的图像中有异常亮点。When it is determined that there is an area abnormality or/and a highlight abnormality in the output image, it is determined that there is an abnormal bright spot in the output image.
作为一种实施方式,所述判断模块配置为:As an implementation manner, the determining module is configured to:
判断输出的图像中是否有面积大于预设值,或面积超过正常亮点面积的统计值达预设阈值的亮点;Determining whether there is a bright spot in the output image that is larger than a preset value, or a statistical value whose area exceeds the normal bright spot area reaches a preset threshold;
确定输出的图像中是否有面积大于预设值的亮点时,判定输出的图像中有面积异常的亮点。When it is determined whether there is a bright spot whose area is larger than the preset value in the output image, it is determined that there is an abnormal spot in the output image.
作为一种实施方式,所述判断模块配置为:As an implementation manner, the determining module is configured to:
判断输出的图像中是否有面积超过正常亮点面积的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright spot whose area exceeds the statistical value of the normal bright spot area by a preset threshold;
确定输出的图像中有面积超过正常亮点面积的统计值达预设阈值的亮点时,判定输出的图像中有面积异常的亮点。 When it is determined that there is a bright spot in the output image that exceeds the statistical value of the normal bright spot area by a preset threshold, it is determined that there is an abnormal spot in the output image.
作为一种实施方式,所述判断模块配置为:As an implementation manner, the determining module is configured to:
判断输出的图像中是否有轨迹长度大于预设值的亮点;Determining whether there is a bright point in the output image that has a track length greater than a preset value;
确定输出的图像中有轨迹长度大于预设值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image whose track length is greater than the preset value, it is determined that there is a bright spot with an abnormal track in the output image.
作为一种实施方式,所述判断模块配置为:As an implementation manner, the determining module is configured to:
判断输出的图像中是否有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright point whose track length exceeds the length of the normal bright track length by a preset threshold;
确定输出的图像中有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that the output image has a bright point whose track length exceeds the normal bright point track length and reaches a preset threshold value, it is determined that there is a bright spot of the track abnormality in the output image.
作为一种实施方式,所述判断模块配置为:As an implementation manner, the determining module is configured to:
判断输出的图像中是否有轨迹方向偏离正常亮点轨迹方向预设范围的亮点;Determining whether there is a bright point in the output image that deviates from the preset range of the normal bright point track direction;
确定输出的图像中有轨迹方向偏离正常亮点轨迹方向预设范围的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image that deviates from the preset range of the normal bright point trajectory direction, it is determined that there is a bright point of the trajectory abnormality in the output image.
作为一种实施方式,所述合成模块,配置为将输出的第一张无异常亮点的图像作为基础图像。As an implementation manner, the synthesizing module is configured to use the output image of the first non-abnormal bright spot as a base image.
本发明实施例同时提出一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令配置为执行本发明实施例所述的图像拍摄方法。The embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions are configured to execute the image capturing method according to the embodiment of the present invention.
本发明实施例提供的一种图像拍摄方法、装置和计算机存储介质,在对采集后输出的图像进行图像合成前,首先判断图像中是否有异常亮点,若有异常亮点,则舍弃当前输出的图像不予合成,只筛选出无异常亮点的图像进行合成,避免异常亮点影响最终的合成图像的效果,消除了萤火虫、飞机等异常亮点对星轨拍摄过程的干扰,提高了星轨拍摄效果,提升了用户体验。 An image capturing method, device and computer storage medium provided by an embodiment of the present invention first determine whether there is an abnormal bright spot in the image before performing image synthesis on the image outputted after the acquisition, and discard the currently output image if there is an abnormal bright spot. No synthesis, only images with no abnormal bright spots are screened for synthesis, to avoid the effect of abnormal highlights affecting the final composite image, eliminating the interference of abnormal highlights such as fireflies and airplanes on the star-track shooting process, improving the star-track shooting effect and improving The user experience.
附图说明DRAWINGS
图1是本发明的图像拍摄方法一实施例的流程图;1 is a flow chart of an embodiment of an image capturing method of the present invention;
图2是本发明的图像拍摄装置一实施例的结构框图;2 is a block diagram showing the structure of an image capturing apparatus of the present invention;
图3是表示本发明的一个实施例的相机的主要电气结构的框图;Figure 3 is a block diagram showing the main electrical configuration of a camera of one embodiment of the present invention;
本发明实施例目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features and advantages of the embodiments of the present invention will be further described with reference to the accompanying drawings.
具体实施方式detailed description
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
本发明实施例的图像拍摄方法主要应用于星轨拍摄,即拍摄星星的运动轨迹,而运动轨迹的形成,是由拍摄者和拍摄目标之间的相对运动所致,因此也可以应用于类似的应用场景。下述实施例以星轨拍摄为例进行详细说明。The image capturing method of the embodiment of the invention is mainly applied to the star-track shooting, that is, the motion trajectory of the shooting stars, and the formation of the motion trajectory is caused by the relative motion between the photographer and the shooting target, and thus can also be applied to similar motions. Application scenario. The following examples are described in detail by taking star track shooting as an example.
图1是本发明的图像拍摄方法一实施例的流程图;参见图1,所述图像拍摄方法包括以下步骤:1 is a flow chart of an embodiment of an image capturing method of the present invention; referring to FIG. 1, the image capturing method includes the following steps:
步骤S101:每隔预设时间采集图像并输出。Step S101: Acquire an image and output it every preset time.
这里,星轨拍摄开始后,拍摄装置通过摄像头按预设时间间隔采集图像并输出,所述预设时间间隔即为曝光时间,如可设为40秒(S)~60S、5S~10S等。Here, after the start of the star track shooting, the photographing device collects and outputs the image by the camera at a preset time interval, and the preset time interval is the exposure time, for example, it can be set to 40 seconds (S) to 60S, 5S to 10S, and the like.
步骤S102:判断输出的图像中是否有异常亮点。Step S102: determining whether there is an abnormal bright spot in the output image.
所述异常亮点,即非星星的亮点,如从镜头前飞过的萤火虫、天空中飞过的飞机等。本实施例中所述的亮点,是指亮度值大于预设阈值的像素点。The abnormal bright spots, that is, the highlights of non-stars, such as fireflies flying in front of the camera, airplanes flying in the sky, and the like. The bright spot described in this embodiment refers to a pixel point whose brightness value is greater than a preset threshold.
在一些实施例中,考虑到异常亮点相对于星星离镜头更近,所以异常亮点在图像中所占的面积通常较大,因此可以通过判断图像中亮点的面积 是否异常,来判断图像中是否有异常亮点,即,通过亮点的面积大小来识别异常亮点。In some embodiments, considering that the abnormal bright spot is closer to the lens than the star, the area occupied by the abnormal bright spot in the image is usually large, so the area of the bright spot in the image can be determined. Whether it is abnormal, to determine whether there is an abnormal bright spot in the image, that is, to identify the abnormal bright spot by the size of the area of the bright spot.
例如,根据经验值,得知星星在图像中占据的大致面积,根据所述大致面积设置一个门限值,当判断图像中有面积大于预设的门限值的亮点时,则判定所述亮点非星星的亮点,判定所述图像中有异常亮点。For example, according to the empirical value, the approximate area occupied by the star in the image is known, and a threshold value is set according to the approximate area. When it is determined that there is a bright point in the image that is larger than the preset threshold, the bright point is determined. Non-star highlights determine that there are unusual bright spots in the image.
又如,首先获取正常亮点(即星星的亮点)面积的统计值,所述统计值可以为当前输出的图像、过去输出的无异常亮点的图像或基础图像中所有亮点面积的算术平均值、加权平均值、中位数等,其中基础图像是指待与当前输出的图像进行合成处理的图像,若当前输出的图像为第N张图像,则基础图像则为第1~N-1张无异常亮点的图像所合成的合成图像;获取统计值后,当判断输出的图像中有面积超过所述统计值达预设阈值的亮点,则判定所述亮点不是星星的亮点,判定所述图像中有异常亮点,其中,所述预设阈值如设为20%~50%。For another example, first, the statistical value of the area of the normal bright spot (ie, the bright spot of the star) is obtained, and the statistical value may be an image of the current output, an image of the past no abnormal bright spot, or an arithmetic mean of all the bright spot areas in the base image, and the weighting. The average value, the median, and the like, wherein the base image refers to an image to be combined with the currently output image. If the currently output image is the Nth image, the base image is No. 1 to N-1. a composite image synthesized by the image of the bright spot; after obtaining the statistical value, when it is determined that there is a bright spot in the output image that exceeds the statistical value and reaches a preset threshold, it is determined that the bright spot is not a bright spot of the star, and it is determined that the image has An abnormal highlight, wherein the preset threshold is set to be 20% to 50%.
在另一些实施例中,还可以通过判断图像中亮点的轨迹是否异常,来判断图像中是否有异常亮点,即,通过亮点的轨迹长度或/和方向来识别异常亮点。In other embodiments, it is also possible to determine whether there is an abnormal bright spot in the image by determining whether the trajectory of the bright point in the image is abnormal, that is, identifying the abnormal bright spot by the track length or/and direction of the bright spot.
具体的,由于星星运行较慢,而异常亮点移动速度相对较快,所以异常亮点在图像中的轨迹长度比星星的轨迹长度要长,因此可以通过亮点的轨迹长度来识别异常亮点。例如,根据经验值,得知星星在图像中的轨迹的大致长度,根据所述大致长度设置一个门限值;当判断到图像中有轨迹长度大于预设的门限值的亮点时,则判定所述亮点不是星星的亮点,判定所述图像中有异常亮点。又如,首先获取正常亮点轨迹长度的统计值,所述统计值可以为当前输出的图像、过去输出的无异常亮点的图像或基础图像中所有亮点轨迹长度的算术平均值、加权平均值、中位数等;获取统计值后,当判断输出的图像中有轨迹长度超过所述统计值达预设阈值的亮点, 则判定该亮点不是星星的亮点,判定所述图像中有异常亮点;其中,所述预设阈值如设为20%~50%。Specifically, since the stars run slowly, and the abnormal bright points move relatively fast, the length of the abnormal bright spots in the image is longer than the length of the stars, so the abnormal bright spots can be identified by the track length of the bright points. For example, according to the empirical value, the approximate length of the trajectory of the star in the image is known, and a threshold value is set according to the approximate length; when it is determined that there is a bright point in the image whose track length is greater than a preset threshold, then it is determined The bright spot is not a bright spot of the star, and it is determined that there is an abnormal bright spot in the image. For another example, the statistic value of the length of the normal bright point trajectory is first obtained, and the statistic value may be an image of the current output, an image of an abnormally bright spot that has been output in the past, or an arithmetic mean of the lengths of all the bright point trajectories in the base image, a weighted average value, and Number of bits, etc.; after obtaining the statistical value, when it is judged that there is a bright spot in the image that is outputted that the track length exceeds the statistical value by a preset threshold, Then, it is determined that the bright spot is not a bright spot of the star, and it is determined that there is an abnormal bright spot in the image; wherein the preset threshold is set to be 20% to 50%.
由于星星的运行轨迹有一定的规律可循,且所有星星的运行轨迹大致相同,因此还可以通过亮点的轨迹方向来识别异常亮点。首先,获取正常亮点的轨迹方向,可以将当前输出的图像、过去输出的无异常亮点的图像或基础图像中大部分亮点的轨迹方向作为正常亮点的轨迹方向;获取正常亮点的轨迹方向后,当判断输出的图像中有轨迹方向偏离正常亮点轨迹方向预设范围的亮点,则判定该亮点非星星的亮点,判定该图像中有异常亮点,预设范围如设为±10%。Since the running trajectory of the stars has a certain rule to follow, and the running trajectories of all the stars are roughly the same, it is also possible to identify the abnormal bright spots by the trajectory direction of the bright points. First, the direction of the track of the normal bright spot is obtained, and the current output image, the image of the past no abnormal bright spot or the track direction of most bright spots in the base image is taken as the track direction of the normal bright spot; after obtaining the track direction of the normal bright spot, when It is judged that there is a bright point in the output image that deviates from the preset range of the normal bright point track direction, and then the bright point of the non-star is determined, and it is determined that there is an abnormal bright spot in the image, and the preset range is set to ±10%.
在某些实施例中,还可以通过亮点的亮度来进行异常亮点的识别,当图像中某一亮点的亮度超过预设值或超过正常亮点的统计值时,则判定所述亮点为异常亮点。In some embodiments, the brightness of the bright spot may also be used to identify the abnormal bright spot. When the brightness of a certain bright spot in the image exceeds a preset value or exceeds a statistical value of the normal bright spot, the bright spot is determined to be an abnormal bright spot.
作为优选,可以将前述多个异常亮点识别方法结合起来进行异常亮点的判断,提高准确率。Preferably, the plurality of abnormal bright spot recognition methods may be combined to determine the abnormal bright spot to improve the accuracy.
当判定输出的图像中有异常亮点时,则进入步骤S103;当判定当前输出的图像中无异常亮点时,进入步骤S104。When it is determined that there is an abnormal bright spot in the output image, the process proceeds to step S103; when it is determined that there is no abnormal bright spot in the currently output image, the process proceeds to step S104.
步骤S103:舍弃输出的图像。Step S103: Discard the output image.
若当前输出的图像中有异常亮点,则舍弃所述图像,不予合成,以免影响合成图像的效果。同时返回步骤S102,继续对输出的下一张图像进行检测判断。If there is an abnormal bright spot in the currently output image, the image is discarded and not synthesized, so as not to affect the effect of the composite image. At the same time, returning to step S102, the detection of the next image output is continued.
步骤S104:确定基础图像,将所述输出的图像与所述基础图像合成为合成图像,并将所述合成图像作为下一次合成的基础图像。Step S104: Determine a base image, synthesize the output image and the base image into a composite image, and use the composite image as a base image for the next synthesis.
若当前输出的图像中无异常亮点,则对所述图像进行合成处理。If there is no abnormal bright spot in the currently output image, the image is synthesized.
具体的,首先确定基础图像。当首次进行合成时,基础图像为第一张输出的无异常亮点的图像或预设的图像。例如,输出的图像为拍摄开始后 输出的第一张无异常亮点的图像,则可以将拍摄前预设的图像作为基础图像;或者没有预设图像,不对第一张无异常亮点的图像进行合成处理,当输出无异常亮点的第二张图像时才进行合成处理,此时则将第一张输出的无异常亮点的图像作为基础图像。此后再进行合成时,则将前一次合成得到的合成图像确定为本次合成的基础图像。Specifically, the base image is first determined. When the composition is first performed, the base image is the first image of the output without the abnormal bright spot or the preset image. For example, the output image is after the start of shooting The output of the first image without abnormal highlights can be used as the base image before the shooting; or there is no preset image, the first image without abnormal highlights is not synthesized, when the output has no abnormal bright spots The synthesis processing is performed only when two images are used, and at this time, the image of the first output without abnormal bright spots is used as the base image. When the synthesis is performed thereafter, the composite image obtained by the previous synthesis is determined as the base image of the synthesis.
确定基础图像后则进行合成处理。具体的,以星轨拍摄为例,拍摄装置判断同一位置输出的图像的像素的亮度是否大于基础图像的像素的亮度;确定同一位置输出的图像的像素的亮度是否大于所述基础图像的像素的亮度时,则将同一位置基础图像的像素替换为所述输出的图像的像素,进行图像合成,生成合成图像,并将该合成图像作为下一次图像合成的基础图像。After the basic image is determined, the synthesis process is performed. Specifically, taking the star track shooting as an example, the photographing device determines whether the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image; and determining whether the brightness of the pixel of the image outputted by the same position is greater than the pixel of the base image. In the case of luminance, pixels of the same position base image are replaced with pixels of the output image, image synthesis is performed, a composite image is generated, and the composite image is used as a base image for the next image synthesis.
步骤S105:显示所述合成图像。Step S105: Display the composite image.
生成合成图像后,在显示屏上实时显示所述合成图像,同时返回步骤S102继续对输出的下一张图像进行检测判断,准备下一次图像的合成。After the composite image is generated, the composite image is displayed on the display screen in real time, and the process returns to step S102 to continue detecting the next image to be output, and preparing for the next image synthesis.
本实施例在星轨拍摄过程中,图像采集和图像合成同步进行,以方便用户实时查看当前生成的合成图像;在每采集输出一张图像,进行图像合成前,检测判断输出的图像中是否有异常亮点,若有异常亮点,则舍弃当前采集的图像不予合成,只将无异常亮点的图像与基础图像进行合成处理,从而剔除了有异常亮点的图像,防止将有异常亮点的图像合成到最终的合成图像中而影响照片质量,消除了萤火虫、飞机等异常物体对星轨拍摄过程的干扰,提高了拍摄效果。In the embodiment of the star track shooting process, image acquisition and image synthesis are performed synchronously to facilitate the user to view the currently generated composite image in real time; before each image is acquired and image synthesis is performed, it is detected whether there is any image in the output image. Abnormal bright spots, if there are abnormal bright spots, discard the currently acquired images without synthesizing, and only combine the images with no abnormal bright spots and the base images to eliminate the images with abnormal bright spots, and prevent the images with abnormal bright spots from being synthesized. The final composite image affects the quality of the photo, eliminating the interference of abnormal objects such as fireflies and airplanes on the star-track shooting process, and improving the shooting effect.
图2是本发明的图像拍摄装置一实施例的结构框图;参见图2,提出本发明的图像拍摄装置一实施例,所述图像拍摄装置可以是普通数码相机如卡片相机等,也可以是具有摄像功能的手机、平板电脑等终端设备。所述图像拍摄装置包括输出模块21、判断模块22、合成模块23和显示模块24; 其中,2 is a block diagram showing an embodiment of an image capturing apparatus of the present invention; referring to FIG. 2, an image capturing apparatus according to the present invention is provided. The image capturing apparatus may be a general digital camera such as a card camera, or may have Terminal devices such as mobile phones and tablet computers with camera functions. The image capturing device includes an output module 21, a determining module 22, a synthesizing module 23, and a display module 24; among them,
所述输出模块21,配置为每隔预设时间采集图像并输出;具体通过摄像头按预设时间间隔采集图像,所述预设时间间隔即为曝光时间,如可设为40S~60S、5S~10S等。The output module 21 is configured to collect images and output them every preset time; specifically, the images are collected by the camera at preset time intervals, and the preset time interval is an exposure time, for example, it can be set to 40S to 60S, 5S~ 10S and so on.
所述判断模块22,配置为判断所述输出模块21输出的图像中是否有异常亮点;当判定所述输出的图像中无异常亮点时,则将所述输出的图像发送给合成模块23;当判定所述输出的图像中有异常亮点时,则舍弃该图像;The determining module 22 is configured to determine whether there is an abnormal bright spot in the image output by the output module 21; when it is determined that there is no abnormal bright spot in the output image, the output image is sent to the synthesizing module 23; When it is determined that there is an abnormal bright spot in the output image, the image is discarded;
所述合成模块23,配置为确定基础图像,将所述判断模块22发送的图像与所述基础图像合成为合成图像,并将所述合成图像作为下一次合成的基础图像;其中,首次合成的所述基础图像为第一张输出的无异常亮点的图像或预设的图像;The compositing module 23 is configured to determine a base image, synthesize the image sent by the determining module 22 and the base image into a composite image, and use the composite image as a base image for the next synthesis; The base image is a first output image with no abnormal bright spots or a preset image;
所述显示模块24,配置为显示所述合成模块23合成的合成图像。The display module 24 is configured to display a composite image synthesized by the synthesis module 23.
这里,所述异常亮点,即非星星的亮点,如从镜头前飞过的萤火虫、天空中飞过的飞机等。本实施例中所述的亮点,是指亮度值大于预设阈值的像素点。Here, the abnormal bright spots, that is, non-star highlights, such as fireflies flying in front of the camera, airplanes flying in the sky, and the like. The bright spot described in this embodiment refers to a pixel point whose brightness value is greater than a preset threshold.
在一些实施例中,考虑到异常亮点相对于星星离镜头更近,所以异常亮点在图像中所占的面积通常较大,因此判断模块22通过判断图像中亮点的面积是否异常,来判断图像中是否有异常亮点,即,通过亮点的面积大小来识别异常亮点。如,判断输出的图像中是否有面积大于预设值的亮点,或判断输出的图像中是否有面积超过正常亮点面积的统计值达预设阈值的亮点;若有,则判定输出的图像中有面积异常的亮点。In some embodiments, considering that the abnormal bright spot is closer to the lens than the star, the area occupied by the abnormal bright spot in the image is generally large, so the judging module 22 judges the image by determining whether the area of the bright spot in the image is abnormal. Whether there is an abnormal bright spot, that is, the abnormal bright spot is identified by the size of the area of the bright spot. For example, determining whether there is a bright spot whose area is larger than the preset value in the output image, or determining whether there is a bright spot in the output image that exceeds the statistical value of the area of the normal bright spot by a preset threshold; if yes, it is determined that the output image has The highlight of the area is abnormal.
在另一些实施例中,所述判断模块22通过判断图像中亮点的轨迹是否异常,来判断图像中是否有异常亮点,即,通过亮点的轨迹长度或/和方向来识别异常亮点。例如,考虑到星星运行较慢,而异常亮点移动速度相对较快,所以异常亮点在图像中的轨迹长度比星星的轨迹长度要长,因此可 以通过亮点的轨迹长度来识别异常亮点。具体的,可判断输出的图像中是否有轨迹长度大于预设值的亮点,或者判断输出的图像中是否有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点;若有,则判定输出的图像中有轨迹异常的亮点。In other embodiments, the determining module 22 determines whether there is an abnormal bright spot in the image by determining whether the trajectory of the bright spot in the image is abnormal, that is, identifying the abnormal bright spot by the track length or/and the direction of the bright spot. For example, considering that the stars run slower, and the abnormal bright spots move relatively fast, the length of the abnormal bright spots in the image is longer than the length of the stars, so The abnormal bright spot is identified by the length of the track passing through the bright spot. Specifically, it can be determined whether there is a bright point whose track length is greater than a preset value in the output image, or whether the output image has a bright point whose track length exceeds the statistical value of the normal bright point track length by a preset threshold; if yes, the determination is performed. The output image has bright spots with abnormal trajectories.
又如,考虑到星星的运行轨迹有一定的规律可循,且所有星星的运行轨迹大致相同,因此还可以通过亮点的轨迹方向来识别异常亮点。所述判断模块22首先获取正常亮点的轨迹方向,可以将当前输出的图像、过去输出的无异常亮点的图像或基础图像中大部分亮点的轨迹方向作为正常亮点的轨迹方向;获取正常亮点的轨迹方向后,当判断输出的图像中有轨迹方向偏离正常亮点轨迹方向预设范围的亮点,则判定所述亮点不是星星的亮点,判定该图像中有异常亮点,预设范围如设为±10%。For another example, considering that the running trajectory of the stars has a certain rule to follow, and the running trajectories of all the stars are substantially the same, it is also possible to identify the abnormal bright spots by the trajectory direction of the bright points. The determining module 22 first obtains the trajectory direction of the normal bright spot, and can use the current output image, the image of the past no abnormal bright spot or the trajectory direction of most bright points in the base image as the trajectory direction of the normal bright spot; and obtain the trajectory of the normal bright spot After the direction, when it is judged that there is a bright point in the output image that deviates from the preset range of the normal bright point track direction, it is determined that the bright spot is not a bright spot of the star, and it is determined that there is an abnormal bright spot in the image, and the preset range is set to ±10%. .
在某些实施例中,所述判断模块22还可以通过亮点的亮度来进行异常亮点的识别,当图像中某一亮点的亮度超过预设值或超过正常亮点的统计值时,则判定所述亮点为异常亮点。In some embodiments, the determining module 22 may further identify the abnormal bright spot by using the brightness of the bright spot. When the brightness of a certain bright spot in the image exceeds a preset value or exceeds a statistical value of the normal bright spot, the determining is performed. The highlight is an unusual highlight.
作为优选,所述判断模块22可以将前述多个异常亮点识别方法结合起来进行异常亮点的判断,提高准确率。Preferably, the determining module 22 may combine the plurality of abnormal bright spot recognition methods to determine the abnormal bright spot to improve the accuracy.
具体的,所述合成模块23首先确定基础图像。当首次进行合成时,确定基础图像为第一张输出的无异常亮点的图像或预设的图像。例如,输出的图像为拍摄开始后输出的第一张无异常亮点的图像,则可以将拍摄前预设的图像作为基础图像;或者没有预设图像,不对第一张无异常亮点的图像进行合成处理,当输出无异常亮点的第二张图像时才进行合成处理,此时则将第一张输出的无异常亮点的图像作为基础图像。此后再进行合成时,则将前一次合成得到的合成图像确定为本次合成的基础图像。Specifically, the synthesizing module 23 first determines the base image. When the composition is first performed, it is determined that the base image is the first image of the output without the abnormal bright spot or the preset image. For example, if the output image is the first image with no abnormal bright spots output after the start of shooting, the image preset before shooting can be used as the base image; or there is no preset image, and the first image without abnormal highlights is not synthesized. Processing, when the second image without the abnormal bright spot is output, the synthesis processing is performed, and at this time, the image of the first output without the abnormal bright spot is used as the base image. When the synthesis is performed thereafter, the composite image obtained by the previous synthesis is determined as the base image of the synthesis.
确定基础图像后则进行合成处理。具体的,以星轨拍摄为例,所述合成模块23判断同一位置当前输出的图像的像素的亮度是否大于基础图像的 像素的亮度;若是,则将同一位置基础图像的像素替换为输出的图像的像素,据此进行图像合成,生成合成图像,并将所述合成图像作为下一次图像合成的基础图像。After the basic image is determined, the synthesis process is performed. Specifically, taking the star track shooting as an example, the synthesizing module 23 determines whether the brightness of the pixel of the image currently outputted at the same position is greater than the base image. The brightness of the pixel; if so, the pixel of the base image of the same position is replaced with the pixel of the output image, and image synthesis is performed accordingly, and a composite image is generated, and the composite image is used as a base image for the next image synthesis.
本实施例在拍摄过程中,图像采集和图像合成同步进行,以方便用户实时查看当前生成的合成图像。In the embodiment, during image capture, image acquisition and image synthesis are performed synchronously to facilitate the user to view the currently generated composite image in real time.
上述方法实施例中的技术特征在本装置均对应适用,这里不再重述。The technical features in the above method embodiments are applicable to the device, and are not repeated here.
在本实施例中,所述图像拍摄装置在实际应用中,可由数码相机、具有摄像头的设备(如手机、平板电脑、笔记本电脑等)实现,所述拍摄装置中的输出模块21、判断模块22、合成模块23,在实际应用中,均可通过所述图像拍摄装置中的中央处理器(CPU,Central Processing Unit)、数字信号处理器(DSP,Digital Signal Processor)或可编程门阵列(FPGA,Field-Programmable Gate Array)实现;所述拍摄装置中的显示模块24,在实际应用中可由所述图像拍摄装置中的显示屏或显示器实现。In the embodiment, the image capturing device can be implemented by a digital camera, a device with a camera (such as a mobile phone, a tablet computer, a notebook computer, etc.), and an output module 21 and a determination module 22 in the imaging device. The synthesis module 23 can be passed through a central processing unit (CPU), a digital signal processor (DSP) or a programmable gate array (FPGA) in the image capturing device. Field-Programmable Gate Array) is implemented; the display module 24 in the camera device can be implemented in a practical application by a display screen or display in the image capture device.
图6是表示本发明的一个实施例的相机的主要电气结构的框图。摄影镜头101由用于形成被摄体像的多个光学镜头构成,是单焦点镜头或变焦镜头。摄影镜头101能够通过镜头驱动部111在光轴方向上移动,根据来自镜头驱动控制部112的控制信号,控制摄影镜头101的焦点位置,在变焦镜头的情况下,也控制焦点距离。镜头驱动控制电路112按照来自微型计算机107的控制命令进行镜头驱动部111的驱动控制。Figure 6 is a block diagram showing the main electrical configuration of a camera of one embodiment of the present invention. The photographic lens 101 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens or a zoom lens. The photographic lens 101 can be moved in the optical axis direction by the lens driving unit 111, and controls the focus position of the taking lens 101 based on the control signal from the lens driving control unit 112, and also controls the focus distance in the case of the zoom lens. The lens drive control circuit 112 performs drive control of the lens drive unit 111 in accordance with a control command from the microcomputer 107.
在摄影镜头101的光轴上、由摄影镜头101形成被摄体像的位置附近配置有摄像元件102。摄像元件102发挥作为对被摄体像摄像并取得摄像图像数据的摄像部的功能。在摄像元件102上二维地呈矩阵状配置有构成各像素的光电二极管。各光电二极管产生与受光量对应的光电转换电流,该光电转换电流由与各光电二极管连接的电容器进行电荷蓄积。各像素的前表面配置有拜耳排列的RGB滤色器。 An imaging element 102 is disposed in the vicinity of a position where the subject image is formed by the photographing lens 101 on the optical axis of the photographing lens 101. The imaging element 102 functions as an imaging unit that captures a subject image and acquires captured image data. Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the imaging element 102. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of RGB color filters.
摄像元件102与摄像电路103连接,该摄像电路103在摄像元件102中进行电荷蓄积控制和图像信号读出控制,对该读出的图像信号(模拟图像信号)降低重置噪声后进行波形整形,进而进行增益提高等以成为适当的信号电平。The imaging element 102 is connected to an imaging circuit 103 that performs charge accumulation control and image signal readout control in the imaging element 102, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.
摄像电路103与A/D转换部104连接,该A/D转换部104对模拟图像信号进行模数转换,向总线199输出数字图像信号(以下称之为图像数据)。The imaging circuit 103 is connected to the A/D conversion unit 104, which performs analog-to-digital conversion on the analog image signal, and outputs a digital image signal (hereinafter referred to as image data) to the bus 199.
总线199是用于传送在相机的内部读出或生成的各种数据的传送路径。在总线199连接着上述A/D转换部104,此外还连接着图像处理器105、JPEG处理器106、微型计算机107、SDRAM(Synchronous DRAM)108、存储器接口(以下称之为存储器I/F)109、LCD(液晶显示器:Liquid Crystal Display)驱动器110。The bus 199 is a transmission path for transmitting various data read or generated inside the camera. The A/D conversion unit 104 is connected to the bus 199, and an image processor 105, a JPEG processor 106, a microcomputer 107, a SDRAM (Synchronous DRAM) 108, and a memory interface (hereinafter referred to as a memory I/F) are connected. 109. LCD (Liquid Crystal Display) driver 110.
图像处理器105对基于摄像元件102的输出的图像数据进行OB相减处理、白平衡调整、颜色矩阵运算、伽马转换、色差信号处理、噪声去除处理、同时化处理、边缘处理等各种图像处理。The image processor 105 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 102. deal with.
JPEG处理器106在将图像数据记录于记录介质115时,按照JPEG压缩方式压缩从SDRAM108读出的图像数据。此外,JPEG处理器106为了进行图像再现显示而进行JPEG图像数据的解压缩。进行解压缩时,读出记录在记录介质115中的文件,在JPEG处理器106中实施了解压缩处理后,将解压缩的图像数据暂时存储于SDRAM108中并在LCD116上进行显示。另外,在本实施方式中,作为图像压缩解压缩方式采用的是JPEG方式,然而压缩解压缩方式不限于此,当然可以采用MPEG、TIFF、H.264等其他的压缩解压缩方式。When the image data is recorded on the recording medium 115, the JPEG processor 106 compresses the image data read out from the SDRAM 108 in accordance with the JPEG compression method. Further, the JPEG processor 106 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 115 is read, and after the compression processing is performed in the JPEG processor 106, the decompressed image data is temporarily stored in the SDRAM 108 and displayed on the LCD 116. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.
微型计算机107发挥作为该相机整体的控制部的功能,统一控制相机的各种处理序列。微型计算机107连接着操作单元113和闪存114。The microcomputer 107 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 107 is connected to the operation unit 113 and the flash memory 114.
操作单元113包括包括但不限于实体按键或者虚拟按键,该实体或虚 拟按键可以为电源按钮、拍照键、编辑按键、动态图像按钮、再现按钮、菜单按钮、十字键、OK按钮、删除按钮、放大按钮等各种输入按钮和各种输入键等操作部材,检测这些操作部材的操作状态。The operation unit 113 includes but not limited to a physical button or a virtual button, the entity or virtual The button can be used as a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlargement button, and the like, and various operation buttons such as various input buttons, and the like. The operating state of the operating member.
将检测结果向微型计算机107输出。此外,在作为显示部的LCD116的前表面设有触摸面板,检测用户的触摸位置,将该触摸位置向微型计算机107输出。微型计算机107根据来自操作单元113的操作部材的检测结果,执行与用户的操作对应的各种处理序列。(同样,可以把这个地方改成计算机107根据LCD116前面的触摸面板的检测结果,执行与用户的操作对应的各种处理序列。)The detection result is output to the microcomputer 107. Further, a touch panel is provided on the front surface of the LCD 116 as a display portion, and the touch position of the user is detected, and the touch position is output to the microcomputer 107. The microcomputer 107 executes various processing sequences corresponding to the operation of the user based on the detection result of the operation member from the operation unit 113. (Similarly, this place can be changed to the computer 107 to execute various processing sequences corresponding to the user's operation based on the detection result of the touch panel on the front of the LCD 116.)
闪存114存储用于执行微型计算机107的各种处理序列的程序。微型计算机107根据该程序进行相机整体的控制。此外,闪存114存储相机的各种调整值,微型计算机107读出调整值,按照该调整值进行相机的控制。SDRAM108是用于对图像数据等进行暂时存储的可电改写的易失性存储器。该SDRAM108暂时存储从A/D转换部104输出的图像数据和在图像处理器105、JPEG处理器106等中进行了处理后的图像数据。The flash memory 114 stores programs for executing various processing sequences of the microcomputer 107. The microcomputer 107 performs overall control of the camera in accordance with the program. Further, the flash memory 114 stores various adjustment values of the camera, and the microcomputer 107 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value. The SDRAM 108 is an electrically rewritable volatile memory for temporarily storing image data or the like. The SDRAM 108 temporarily stores image data output from the A/D conversion unit 104 and image data processed in the image processor 105, the JPEG processor 106, and the like.
存储器接口109与记录介质115连接,进行将图像数据和附加在图像数据中的文件头等数据写入记录介质115和从记录介质115中读出的控制。记录介质115例如为能够在相机主体上自由拆装的存储器卡等记录介质,然而不限于此,也可以是内置在相机主体中的硬盘等。The memory interface 109 is connected to the recording medium 115, and performs control for writing image data and a file header attached to the image data to the recording medium 115 and reading from the recording medium 115. The recording medium 115 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 115 is not limited thereto, and may be a hard disk or the like built in the camera body.
LCD驱动器110与LCD116连接,将由图像处理器105处理后的图像数据存储于SDRAM,需要显示时,读取SDRAM存储的图像数据并在LCD116上显示,或者,JPEG处理器106压缩过的图像数据存储于SDRAM,在需要显示时,JPEG处理器106读取SDRAM的压缩过的图像数据,再进行解压缩,将解压缩后的图像数据通过LCD116进行显示。The LCD driver 110 is connected to the LCD 116, and stores image data processed by the image processor 105 in the SDRAM. When display is required, the image data stored in the SDRAM is read and displayed on the LCD 116, or the image data stored in the JPEG processor 106 is compressed. In the SDRAM, when display is required, the JPEG processor 106 reads the compressed image data of the SDRAM, decompresses it, and displays the decompressed image data on the LCD 116.
LCD116配置在相机主体的背面等上,进行图像显示。该LCD116设有 检测用户的触摸操作的触摸面板。另外,作为显示部,在本实施方式中配置的是液晶表示面板(LCD116),然而不限于此,也可以采用有机EL等各种显示面板。The LCD 116 is disposed on the back surface of the camera body or the like to perform image display. The LCD116 is provided A touch panel that detects a user's touch operation. Further, in the present embodiment, the liquid crystal display panel (LCD 116) is disposed as the display portion. However, the present invention is not limited thereto, and various display panels such as an organic EL may be employed.
从而,本发明的图像拍摄装置,在对采集输出的图像进行图像合成前,首先判断图像中是否有异常亮点,若有异常亮点,则舍弃当前输出的图像不予合成,只筛选出无异常亮点的图像进行合成,避免异常亮点影响最终的合成图像的效果,消除了萤火虫、飞机等异常物体对星轨拍摄过程的干扰,提高了拍摄效果,提升了用户体验。Therefore, the image capturing apparatus of the present invention first determines whether there is an abnormal bright spot in the image before performing image synthesis on the image to be output and output. If there is an abnormal bright spot, the image that is currently output is discarded, and only the abnormal bright spot is selected. The images are synthesized to avoid the effects of abnormal highlights affecting the final composite image, eliminating the interference of abnormal objects such as fireflies and airplanes on the star-track shooting process, improving the shooting effect and improving the user experience.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.
上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元,即可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。The units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各实施例中的各功能单元可以全部集成在一个处理单元中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; The unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机 可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions, and the foregoing program may be stored in a computer. The readable storage medium, when executed, executes the steps including the foregoing method embodiments; and the foregoing storage medium includes: a mobile storage device, a read-only memory (ROM), a random access memory ( Various media that can store program code, such as RAM (Random Access Memory), disk or optical disk.
或者,本发明上述集成的单元如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例所述方法的全部或部分。而前述的存储介质包括:移动存储设备、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Alternatively, the above-described integrated unit of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions. A computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a RAM, a magnetic disk, or an optical disk.
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the appended claims.
工业实用性Industrial applicability
本发明实施例通过图像采集和图像合成同步进行,以方便用户实时查看当前生成的合成图像;在每采集输出一张图像,进行图像合成前,检测判断输出的图像中是否有异常亮点,若有异常亮点,则舍弃当前采集的图像不予合成,只将无异常亮点的图像与基础图像进行合成处理,从而剔除了有异常亮点的图像,防止将有异常亮点的图像合成到最终的合成图像中而影响照片质量,消除了萤火虫、飞机等异常物体对星轨拍摄过程的干扰,提高了拍摄效果。 The embodiment of the invention is synchronously performed by image acquisition and image synthesis, so as to facilitate the user to view the currently generated composite image in real time; before each image is output and the image is synthesized, it is detected whether there is an abnormal bright spot in the output image, if any If the abnormal highlight is present, the currently acquired image will not be synthesized, and only the image with no abnormal highlights will be combined with the base image, thereby eliminating the image with abnormal highlights and preventing the image with abnormal highlights from being synthesized into the final composite image. It affects the quality of photos, eliminates the interference of abnormal objects such as fireflies and airplanes on the star-track shooting process, and improves the shooting effect.

Claims (19)

  1. 一种图像拍摄方法,包括:An image capture method includes:
    每隔预设时间采集图像并输出,判断输出的图像中是否有异常亮点;The image is collected and output every preset time to determine whether there is an abnormal bright spot in the output image;
    当输出的图像中无异常亮点时,则确定基础图像,将所述输出的图像与所述基础图像合成为合成图像,并将所述合成图像作为下一次合成的基础图像;When there is no abnormal bright spot in the output image, determining a base image, synthesizing the output image and the base image into a composite image, and using the composite image as a base image for the next synthesis;
    显示拍摄过程中合成的合成图像;Displaying a composite image synthesized during shooting;
    其中,首次合成的所述基础图像为第一张输出的无异常亮点的图像或预设的图像。The base image synthesized for the first time is a first output image with no abnormal bright spots or a preset image.
  2. 根据权利要求1所述的图像拍摄方法,其中,所述将所述输出的图像与所述基础图像合成为合成图像包括:The image capturing method according to claim 1, wherein the synthesizing the output image and the base image into a composite image comprises:
    判断同一位置输出的图像的像素的亮度是否大于所述基础图像的像素的亮度;Determining whether the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image;
    确定同一位置输出的图像的像素的亮度大于所述基础图像的像素的亮度时,则将同一位置所述基础图像的像素替换为所述输出的图像的像素,进行图像合成。When it is determined that the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image, the pixel of the base image at the same position is replaced with the pixel of the output image, and image synthesis is performed.
  3. 根据权利要求1或2所述的图像拍摄方法,其中,所述判断输出的图像中是否有异常亮点包括:The image capturing method according to claim 1 or 2, wherein the determining whether the output image has abnormal highlights comprises:
    判断输出的图像中是否有面积异常或/和轨迹异常的亮点;Determining whether there is an area abnormality or/and a highlight of the trajectory abnormality in the output image;
    确定输出的图像中有面积异常或/和轨迹异常的亮点时,判定输出的图像中有异常亮点。When it is determined that there is an area abnormality or/and a highlight abnormality in the output image, it is determined that there is an abnormal bright spot in the output image.
  4. 根据权利要求3所述的图像拍摄方法,其中,所述判断输出的图像中是否有面积异常的亮点包括:The image capturing method according to claim 3, wherein the determining whether the output image has an area abnormality includes:
    判断输出的图像中是否有面积大于预设值的亮点;Determining whether there is a bright spot in the output image that is larger than a preset value;
    确定输出的图像中有面积大于预设值的亮点时,判定输出的图像中有 面积异常的亮点。When it is determined that there is a bright spot in the output image that is larger than the preset value, it is determined that there is an image in the output The highlight of the area is abnormal.
  5. 根据权利要求3所述的图像拍摄方法,其中,所述判断输出的图像中是否有面积异常的亮点包括:The image capturing method according to claim 3, wherein the determining whether the output image has an area abnormality includes:
    判断输出的图像中是否有面积超过正常亮点面积的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright spot whose area exceeds the statistical value of the normal bright spot area by a preset threshold;
    确定输出的图像中有面积超过正常亮点面积的统计值达预设阈值的亮点时,判定输出的图像中有面积异常的亮点。When it is determined that there is a bright spot in the output image that exceeds the statistical value of the normal bright spot area by a preset threshold, it is determined that there is an abnormal spot in the output image.
  6. 根据权利要求3所述的图像拍摄方法,其中,所述判断输出的图像中是否有轨迹异常的亮点包括:The image capturing method according to claim 3, wherein the determining whether the output image has a highlight abnormality includes:
    判断输出的图像中是否有轨迹长度大于预设值的亮点;Determining whether there is a bright point in the output image that has a track length greater than a preset value;
    确定输出的图像中有轨迹长度大于预设值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image whose track length is greater than the preset value, it is determined that there is a bright spot with an abnormal track in the output image.
  7. 根据权利要求3所述的图像拍摄方法,其中,所述判断输出的图像中是否有轨迹异常的亮点包括:The image capturing method according to claim 3, wherein the determining whether the output image has a highlight abnormality includes:
    判断输出的图像中是否有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright point whose track length exceeds the length of the normal bright track length by a preset threshold;
    确定输出的图像中有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that the output image has a bright point whose track length exceeds the normal bright point track length and reaches a preset threshold value, it is determined that there is a bright spot of the track abnormality in the output image.
  8. 根据权利要求3所述的图像拍摄方法,其中,所述判断输出的图像中是否有轨迹异常的亮点包括:The image capturing method according to claim 3, wherein the determining whether the output image has a highlight abnormality includes:
    判断输出的图像中是否有轨迹方向偏离正常亮点轨迹方向预设范围的亮点;Determining whether there is a bright point in the output image that deviates from the preset range of the normal bright point track direction;
    确定输出的图像中有轨迹方向偏离正常亮点轨迹方向预设范围的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image that deviates from the preset range of the normal bright point trajectory direction, it is determined that there is a bright point of the trajectory abnormality in the output image.
  9. 根据权利要求1所述的图像拍摄方法,其特征在于,所述确定基础 图像包括:将输出的第一张无异常亮点的图像作为基础图像。The image capturing method according to claim 1, wherein said determining basis The image includes: the first image of the output without abnormal bright spots is used as the base image.
  10. 一种图像拍摄装置,包括:输出模块、判断模块、合成模块和显示模块,其中:An image capturing device includes: an output module, a judging module, a synthesizing module, and a display module, wherein:
    所述输出模块,配置为每隔预设时间采集图像并输出;The output module is configured to collect an image and output it every preset time;
    所述判断模块,配置为判断所述输出模块输出的图像中是否有异常亮点;当判定所述输出的图像中无异常亮点时,则将所述输出的图像发送给合成模块;The determining module is configured to determine whether there is an abnormal bright spot in the image output by the output module; when it is determined that there is no abnormal bright spot in the output image, the output image is sent to the synthesizing module;
    所述合成模块,配置为确定基础图像,将所述判断模块发送的图像与所述基础图像合成为合成图像,并将所述合成图像作为下一次合成的基础图像;其中,首次合成的所述基础图像为第一张输出的无异常亮点的图像或预设的图像;The synthesizing module is configured to determine a base image, synthesize the image sent by the judging module and the base image into a composite image, and use the composite image as a base image for the next synthesis; The base image is the first output image with no abnormal bright spots or a preset image;
    所述显示模块,配置为显示所述合成模块合成的合成图像。The display module is configured to display a composite image synthesized by the synthesis module.
  11. 根据权利要求10所述的图像拍摄装置,其中,所述合成模块配置为:The image capture device of claim 10, wherein the synthesis module is configured to:
    判断同一位置输出的图像的像素的亮度是否大于所述基础图像的像素的亮度;Determining whether the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image;
    确定同一位置输出的图像的像素的亮度大于所述基础图像的像素的亮度时,则将同一位置所述基础图像的像素替换为所述输出的图像的像素,进行图像合成。When it is determined that the brightness of the pixel of the image outputted at the same position is greater than the brightness of the pixel of the base image, the pixel of the base image at the same position is replaced with the pixel of the output image, and image synthesis is performed.
  12. 根据权利要求10或11所述的图像拍摄装置,其中,所述判断模块配置为:The image capture device according to claim 10 or 11, wherein the determination module is configured to:
    判断输出的图像中是否有面积异常或/和轨迹异常的亮点;Determining whether there is an area abnormality or/and a highlight of the trajectory abnormality in the output image;
    确定输出的图像中有面积异常或/和轨迹异常的亮点时,判定输出的图像中有异常亮点。When it is determined that there is an area abnormality or/and a highlight abnormality in the output image, it is determined that there is an abnormal bright spot in the output image.
  13. 根据权利要求12所述的图像拍摄装置,其中,所述判断模块配置 为:The image capture device according to claim 12, wherein said determination module is configured for:
    判断输出的图像中是否有面积大于预设值的亮点;Determining whether there is a bright spot in the output image that is larger than a preset value;
    确定输出的图像中有面积大于预设值的亮点时,判定输出的图像中有面积异常的亮点。When it is determined that there is a bright spot whose area is larger than the preset value in the output image, it is determined that there is an abnormal spot in the output image.
  14. 根据权利要求12所述的图像拍摄装置,其中,所述判断模块配置为:The image capture device of claim 12, wherein the determination module is configured to:
    判断输出的图像中是否有面积超过正常亮点面积的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright spot whose area exceeds the statistical value of the normal bright spot area by a preset threshold;
    确定输出的图像中有面积超过正常亮点面积的统计值达预设阈值的亮点时,判定输出的图像中有面积异常的亮点。When it is determined that there is a bright spot in the output image that exceeds the statistical value of the normal bright spot area by a preset threshold, it is determined that there is an abnormal spot in the output image.
  15. 根据权利要求12所述的图像拍摄装置,其中,所述判断模块配置为:The image capture device of claim 12, wherein the determination module is configured to:
    判断输出的图像中是否有轨迹长度大于预设值的亮点;Determining whether there is a bright point in the output image that has a track length greater than a preset value;
    确定输出的图像中有轨迹长度大于预设值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image whose track length is greater than the preset value, it is determined that there is a bright spot with an abnormal track in the output image.
  16. 根据权利要求12所述的图像拍摄装置,其中,所述判断模块配置为:The image capture device of claim 12, wherein the determination module is configured to:
    判断输出的图像中是否有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点;Determining, in the output image, whether there is a bright point whose track length exceeds the length of the normal bright track length by a preset threshold;
    确定输出的图像中有轨迹长度超过正常亮点轨迹长度的统计值达预设阈值的亮点时,判定输出的图像中有轨迹异常的亮点。When it is determined that the output image has a bright point whose track length exceeds the normal bright point track length and reaches a preset threshold value, it is determined that there is a bright spot of the track abnormality in the output image.
  17. 根据权利要求12所述的图像拍摄装置,其中,所述判断模块配置为:The image capture device of claim 12, wherein the determination module is configured to:
    判断输出的图像中是否有轨迹方向偏离正常亮点轨迹方向预设范围的亮点; Determining whether there is a bright point in the output image that deviates from the preset range of the normal bright point track direction;
    确定输出的图像中有轨迹方向偏离正常亮点轨迹方向预设范围的亮点时,则判定输出的图像中有轨迹异常的亮点。When it is determined that there is a bright point in the output image that deviates from the preset range of the normal bright point trajectory direction, it is determined that there is a bright point of the trajectory abnormality in the output image.
  18. 根据权利要求10所述的图像拍摄装置,其中,所述合成模块,配置为将输出的第一张无异常亮点的图像作为基础图像。The image capturing apparatus according to claim 10, wherein the synthesizing module is configured to use the output image of the first non-abnormal bright spot as a base image.
  19. 一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令配置为执行权利要求1至9任一项所述的图像拍摄方法。 A computer storage medium having stored therein computer executable instructions configured to perform the image capture method of any one of claims 1 to 9.
PCT/CN2015/082399 2014-07-22 2015-06-25 Image photographing method and apparatus and computer storage medium WO2016011872A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410350273.9 2014-07-22
CN201410350273.9A CN104113692B (en) 2014-07-22 2014-07-22 Image capturing method and device

Publications (1)

Publication Number Publication Date
WO2016011872A1 true WO2016011872A1 (en) 2016-01-28

Family

ID=51710316

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/082399 WO2016011872A1 (en) 2014-07-22 2015-06-25 Image photographing method and apparatus and computer storage medium

Country Status (2)

Country Link
CN (1) CN104113692B (en)
WO (1) WO2016011872A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117622810A (en) * 2024-01-25 2024-03-01 山西戴德测控技术股份有限公司 Conveyor belt monitoring method, device, equipment and computer storage medium

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104113693B (en) * 2014-07-22 2016-04-06 努比亚技术有限公司 Image pickup method and filming apparatus
CN104113692B (en) * 2014-07-22 2015-11-25 努比亚技术有限公司 Image capturing method and device
KR20170014556A (en) * 2015-07-30 2017-02-08 삼성전자주식회사 Method and photographing device for photographing a moving object
CN110611768B (en) * 2019-09-27 2021-06-29 北京小米移动软件有限公司 Multiple exposure photographic method and device
CN112130946B (en) * 2020-09-22 2024-03-26 西安宇视信息科技有限公司 Airplane information display method and device, electronic equipment and storage medium
CN112492198B (en) * 2020-11-23 2022-05-31 维沃移动通信有限公司 Shooting method, shooting device, electronic equipment and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103109523A (en) * 2010-09-14 2013-05-15 富士胶片株式会社 Imaging device and imaging method
CN103797780A (en) * 2011-09-14 2014-05-14 株式会社理光 Image capturing apparatus
CN103888683A (en) * 2014-03-24 2014-06-25 深圳市中兴移动通信有限公司 Mobile terminal and shooting method thereof
CN103905730A (en) * 2014-03-24 2014-07-02 深圳市中兴移动通信有限公司 Shooting method of mobile terminal and mobile terminal
CN104113692A (en) * 2014-07-22 2014-10-22 深圳市中兴移动通信有限公司 Image shooting method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006174188A (en) * 2004-12-17 2006-06-29 Casio Comput Co Ltd Movie recording apparatus and movie shooting method
JP5131257B2 (en) * 2009-08-27 2013-01-30 カシオ計算機株式会社 Display control apparatus and display control program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103109523A (en) * 2010-09-14 2013-05-15 富士胶片株式会社 Imaging device and imaging method
CN103797780A (en) * 2011-09-14 2014-05-14 株式会社理光 Image capturing apparatus
CN103888683A (en) * 2014-03-24 2014-06-25 深圳市中兴移动通信有限公司 Mobile terminal and shooting method thereof
CN103905730A (en) * 2014-03-24 2014-07-02 深圳市中兴移动通信有限公司 Shooting method of mobile terminal and mobile terminal
CN104113692A (en) * 2014-07-22 2014-10-22 深圳市中兴移动通信有限公司 Image shooting method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117622810A (en) * 2024-01-25 2024-03-01 山西戴德测控技术股份有限公司 Conveyor belt monitoring method, device, equipment and computer storage medium
CN117622810B (en) * 2024-01-25 2024-04-19 山西戴德测控技术股份有限公司 Conveyor belt monitoring method, device, equipment and computer storage medium

Also Published As

Publication number Publication date
CN104113692A (en) 2014-10-22
CN104113692B (en) 2015-11-25

Similar Documents

Publication Publication Date Title
WO2016011872A1 (en) Image photographing method and apparatus and computer storage medium
JP6267502B2 (en) IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, AND PROGRAM
CN111684788A (en) Image processing method and device
WO2016023406A1 (en) Shooting method for motion trace of object, mobile terminal and computer storage medium
US10419661B2 (en) Shooting method and shooting device
US20170302848A1 (en) Photographing method, device and computer storage medium
WO2015143842A1 (en) Mobile terminal photographing method and mobile terminal
CN108833804A (en) Imaging method, device and electronic equipment
CN110430370B (en) Image processing method, device, storage medium and electronic device
CN110198418B (en) Image processing method, device, storage medium and electronic device
WO2016011859A1 (en) Method for filming light painting video, mobile terminal, and computer storage medium
KR101889932B1 (en) Apparatus and Method for photographing image
WO2016008359A1 (en) Object movement track image synthesizing method, device and computer storage medium
CN111586312B (en) Automatic exposure control method and device, terminal and storage medium
JP6351271B2 (en) Image composition apparatus, image composition method, and program
WO2017080348A2 (en) Scene-based photographing device and method, and computer storage medium
KR20160032587A (en) Image photographing apparatus and photographing method thereof
CN110198419A (en) Image processing method, device, storage medium and electronic device
CN109756680B (en) Image synthesis method, apparatus, electronic device and readable storage medium
US10311327B2 (en) Image processing apparatus, method of controlling the same, and storage medium
KR20160044945A (en) Image photographing appratus
CN110290325A (en) Image processing method, device, storage medium and electronic device
US10999489B2 (en) Image processing apparatus, image processing method, and image capture apparatus
KR102368625B1 (en) Digital photographing apparatus and the method for the same
WO2016169488A1 (en) Image processing method and apparatus, computer storage medium and terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15824005

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 23/06/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15824005

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载