CN105430360A - Imaging method, image sensor, imaging device and electronic device - Google Patents

Abstract

The present invention discloses an imaging method. First, an image sensor is provided. The image sensor includes a photosensitive pixel array and a filter arranged on the photosensitive pixel array. The filter includes a filter unit array. The filter unit includes an infrared filter area and a color filter area. The infrared filter area covers a photosensitive pixel, and the color filter area covers at least one photosensitive pixel. Next, the output of the photosensitive pixel array is read, and the pixel value of the merged pixel is calculated based on the output of the photosensitive pixel of the same merged pixel to generate a merged image. The obtained merged image contains complete color information, has high brightness and clarity, and has less noise. The present invention also discloses an image sensor, an imaging device, and an electronic device using the imaging device that can be used to implement this imaging method.

Description

Imaging method, image sensor, imaging device and electronic device

technical field

The invention relates to imaging technology, in particular to an imaging method, an image sensor, an imaging device and an electronic device.

Background technique

The arrangement of the filter pixels of the existing image sensor is RG, GB or RW, GW, wherein R, G, B and W represent red, green, blue and white respectively. RG, GB is the traditional arrangement, which can collect accurate color information, but there are many noises and unclear under low illumination. RW, GW arrangement can receive better definition under low illumination, but the color will be inaccurate.

Contents of the invention

The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, the present invention needs to provide an imaging method, an image sensor, an imaging device and an electronic device.

The imaging method of the embodiment of the present invention comprises the following steps:

An image sensor is provided, the image sensor includes an array of photosensitive pixels and a filter disposed on the array of photosensitive pixels, the filter includes an array of filter units, and the filter unit includes an infrared filter area and a color filter a light area; the infrared filter area covers one of the photosensitive pixels; the color filter area covers at least one of the photosensitive pixels; the photosensitive pixels covered by the same filter unit form a merged pixel; and

Reading the output of the photosensitive pixel array, and calculating the pixel value of the combined pixel according to the output of the photosensitive pixel of the same combined pixel to generate a combined image.

The color filter area of the filter unit in the imaging method according to the embodiment of the present invention is used to obtain the color information of the merged pixels, and the infrared filter area is used to obtain the brightness information of the merged pixels under low illumination, and the brightness information has less noise. In this way, the pixel values of the merged image include both color information and low-noise brightness information, and the merged image has complete color, better brightness and definition, and less noise. Certain issues with existing imaging methods are addressed.

The present invention also provides an image sensor for implementing the imaging method in the embodiment of the present invention, which includes:

photosensitive pixel array; and

a filter disposed on the photosensitive pixel array;

The filter includes an array of filter units, and each filter unit includes an infrared filter area and a color filter area; the infrared filter area covers one photosensitive pixel; the color filter area covers n - 1 photosensitive pixel, n is the number of photosensitive pixels covered by one filter unit;

The photosensitive pixels covered by the same filter unit form a merged pixel.

The present invention also provides an imaging device including the image sensor in the embodiment of the present invention, which includes an image processing module connected to the image sensor;

The image processing module is used to read the output of the photosensitive pixel array, and calculate the pixel value of the combined pixel according to the output of the photosensitive pixel of the same combined pixel to generate a combined image.

The present invention also provides an electronic device including the imaging device in the embodiment of the present invention.

Additional aspects and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and comprehensible from the description of the embodiments in conjunction with the following drawings, wherein:

FIG. 1 is a schematic flowchart of an imaging method according to an embodiment of the present invention.

FIG. 2 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 3 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 4 is a schematic side view of an image sensor according to an embodiment of the present invention.

FIG. 5 is a schematic diagram of a filter unit of an image sensor according to an embodiment of the present invention.

FIG. 6 is a schematic diagram of a filter unit array of a Bayer structure.

FIG. 7 is a schematic diagram of an array of filter units of an image sensor according to an embodiment of the present invention.

FIG. 8 is a schematic perspective view of the three-dimensional structure of the image sensor according to the embodiment of the present invention.

FIG. 9 is a schematic diagram of functional modules of an image sensor according to an embodiment of the present invention.

FIG. 10 is a schematic diagram of a circuit structure of a photosensitive pixel of an image sensor according to an embodiment of the present invention.

FIG. 11 is a schematic perspective view of the three-dimensional structure of an image sensor according to an embodiment of the present invention.

FIG. 12 is a schematic diagram of functional modules of an imaging device according to an embodiment of the present invention.

FIG. 13 is a schematic diagram of the circuit structure of an imaging device according to some embodiments of the present invention.

FIG. 14 is a schematic diagram of the circuit structure of an imaging device according to other embodiments of the present invention.

FIG. 15 is a schematic diagram of functional modules of an electronic device according to an embodiment of the present invention.

FIG. 16 is a schematic diagram of functional modules of an electronic device according to an embodiment of the present invention.

detailed description

Embodiments of embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary, are only for explaining the embodiments of the present invention, and should not be construed as limiting the embodiments of the present invention.

The imaging method, image sensor, imaging device and electronic device according to the embodiments of the present invention will be further described below with reference to the accompanying drawings.

Please refer to Fig. 1, the imaging method of the embodiment of the present invention comprises the following steps:

S1, providing an image sensor, the image sensor includes a photosensitive pixel array and a filter arranged on the photosensitive pixel array, the filter includes an array of filter units, the filter unit includes an infrared filter area and a color filter area, and the infrared filter The area covers one photosensitive pixel, the color filter area covers at least one photosensitive pixel, and the photosensitive pixels covered by the same filter unit form a combined pixel.

S2. Read the output of the photosensitive pixel array, and calculate the pixel value of the combined pixel according to the output of the photosensitive pixel of the same combined pixel to generate a combined image.

The color filter area of the filter unit in the imaging method according to the embodiment of the present invention is used to obtain the color information of the merged pixels, and the infrared filter area is used to obtain the brightness information of the merged pixels under low illumination, and the brightness information has less noise. In this way, the pixel values of the merged image include both color information and low-noise brightness information, and the merged image has complete color, better brightness and definition, and less noise.

Please refer to FIG. 8 , in some embodiments, each filter unit covers 2*2 photosensitive pixels.

In this embodiment, the pixel value of the combined pixel includes a color pixel value, and the color pixel value is an average value or a sum of outputs of photosensitive pixels covered by the color filter area. The output of the photosensitive pixels covered by the color filter is averaged or summed by hardware or software methods. Hardware methods include parallel summation of charge signals, etc., and software methods such as the averaging or summing of digital signals by an external chip ISP (image signal processing chip). Through signal combining, the signal-to-noise ratio of the obtained color pixel values is high.

Specifically, in some embodiments, the image sensor includes a control module, and the control module is used to control the average value or the sum of the outputs of the photosensitive pixels covered by the output color filter area of the image sensor.

This is the hardware combination method, and the signal combination processing is completed in the internal circuit of the image sensor, rather than the software processing of the ISP chip. The processing speed of the hardware method is faster.

In the imaging method in this embodiment, the image sensor includes a digital-to-analog converter, and the digital-to-analog converter is used to convert the output of the photosensitive pixel into a digital signal. Please refer to FIG. 2, and step S2 further includes:

S21: Calculate the average value or sum of the digital signals of the photosensitive pixels covered by the color filter area as the color pixel value of the merged pixel.

This is a software method, which uses an external chip to process digital signals. This method preserves the original signal data, such as the output of each photosensitive pixel covered by the color filter area.

Referring to FIG. 3 , in some embodiments, the combined pixels include color pixel values and infrared pixel values. Step S2 further includes:

S23: Use the color pixel value, the color pixel value minus the infrared pixel value, or the color pixel value plus the infrared pixel value as the pixel value of the merged pixel.

In this way, the color pixel values and the infrared pixel values can be properly processed according to different illuminances of the environment, so as to generate a combined image with complete and vivid colors and high definition.

The imaging method of the embodiment of the present invention can be realized by the image sensor of the embodiment of the present invention.

Referring to FIG. 4 and FIG. 5 , the image sensor 10 according to the embodiment of the present invention includes a photosensitive pixel array 11 and a filter 13 disposed on the photosensitive pixel array 11 . The filter 13 includes an array of filter units 131, each filter unit 1311 includes an infrared filter area 1313 and a color filter area 1315, the infrared filter area 1313 covers one photosensitive pixel 111, and the color filter area 1315 covers at least one photosensitive pixel 111 Pixel 111. For example, in FIG. 5 , the color filter area 1315 is a green filter area, covering three photosensitive pixels. The photosensitive pixels 111 covered by the same filter unit 1311 form a merged pixel. The external light irradiates the photosensitive part 1111 of the photosensitive pixel 111 through the filter 13 to generate an electrical signal, that is, the output of the photosensitive pixel 111 .

The color filter area 1315 of the filter unit 1311 of the image sensor in the embodiment of the present invention is used to obtain the color information of the merged pixels, and the infrared filter area 1313 is used to obtain the brightness information of the merged pixels under low illumination, and the noise of the brightness information is relatively low. few. The pixel value of the merged image generated by this method contains both color information and low-noise brightness information, and the merged image has complete color, better brightness and definition, and less noise.

Please refer to FIG. 6 , in some embodiments, the color filter regions form a Bayer pattern. The Bayer array includes filter structures 1317, and each filter structure 1317 includes 2*2 filter units 1311, which are green, red, blue, and green filter units 1311, respectively.

By adopting the Bayer structure, the traditional algorithm for the Bayer structure can be used to process the image signal, so there is no need for major adjustments in the hardware structure.

In a traditional filter unit array structure, each filter unit corresponds to a photosensitive pixel and an image pixel. Please refer to FIG. 7 , in this embodiment, the filter unit array 131 adopts a Bayer structure, including filter structures 1317, and each filter structure 1317 includes green, red, blue, and green filter units 1311, and the difference is Each filter unit 1311 corresponds to a plurality of photosensitive pixels 111 , wherein the infrared filter area 1313 corresponds to one photosensitive pixel 111 , and the color filter area 1315 corresponds to at least one photosensitive pixel 111 .

Please refer to FIG. 8 and FIG. 7 , in some embodiments, each filter unit 1311 covers 2*2 photosensitive pixels 111 to form binning pixels.

In addition to the 2*2 structure, there are also 3*3, 4*4, and even any n*m structures (n, m are natural numbers). It can be understood that the number of photosensitive pixels 111 that can be arranged on the photosensitive pixel array 11 is Limited, if there are too many photosensitive pixels 111 included in each merged pixel, the resolution of the image will be limited. For example, if the pixel value of the photosensitive pixel array 11 is 16M, a 2*2 merged pixel structure will be used to obtain resolution A merged image with a rate of 4M, and a merged image with a resolution of 1M can only be obtained with a 4*4 structure. Therefore, the 2*2 binning pixel structure is a better arrangement to improve image brightness, contrast, and clarity while sacrificing resolution as little as possible. At the same time, the 2*2 structure is used to facilitate the reading and merging of the output of the photosensitive pixels on the hardware.

Referring to FIG. 9 , in some embodiments, the image sensor further includes a control module 17 for controlling the exposure of the photosensitive pixel array 11 row by row.

Specifically, the control module 17 is connected with a row selection logic unit 171 and a column selection logic unit 173 to control the processing of the output of the photosensitive pixels 111 row by row.

The method of progressive exposure and output is easier to implement on hardware.

Please refer to FIG. 9 together. In this embodiment, the image sensor 10 further includes a register 19, and the control module 17 is used to sequentially collect the outputs of the photosensitive pixels 111 of the kth row and the k+1th row that are currently exposed and store them in Register 19, wherein k=2n−1, n is a natural number, and k+1 is less than or equal to the total number of rows of the photosensitive pixel array 11 .

Specifically, referring to FIG. 10 and FIG. 9 , the image sensor 10 includes a control module 17 connected to a row selection logic unit 171 and a column selection logic unit 173 . The row selection logic unit 171 and the column selection logic unit 173 are connected to the switch transistor 1115 corresponding to each photosensitive pixel 111, and the control module 17 is used to control the row selection logic unit 171 and the column selection logic unit 173 to gate the photosensitive pixel 111 at a specific position The switching tube 1115.

Referring to FIG. 11 , in some implementations, the image sensor 10 includes a micromirror array 23 disposed on the filter 13 , and each micromirror 231 corresponds to one photosensitive pixel 111 .

Specifically, each micromirror 231 corresponds to one photosensitive pixel 111 , including size and position correspondence. In some embodiments, each filter unit 1311 corresponds to 2*2 photosensitive pixels 111 and 2*2 micromirrors 231 . With the development of technology, in order to obtain images with higher resolution, there are more and more photosensitive pixels 111 on the photosensitive sheet, and the arrangement becomes denser, and the single photosensitive pixel 111 is also smaller and smaller, which is affected by light, and the photosensitive pixels 111 The area of the photosensitive part 1111 is limited, and the micromirror 231 can gather light to the photosensitive part 1111, thereby increasing the intensity of light received by the photosensitive pixel 111 to improve image quality.

To sum up, each filter unit of the image sensor in the embodiment of the present invention includes an infrared filter area and a color filter area, so that the pixel value of the merged pixel contains both color information and low-noise brightness information, so as to facilitate subsequent circuits. Produces a merged image with full color and high signal-to-noise ratio.

Referring to FIG. 12 , the present invention also provides an imaging device 100 , which includes not only the image sensor 10 according to the embodiment of the present invention, but also an image processing module 50 connected to the image sensor 10 .

The image processing module 50 is used for the image processing module to read the output of the photosensitive pixel array, and calculate the pixel value of the combined pixel according to the output of the photosensitive pixel of the same combined pixel to generate a combined image.

Specifically, the image sensor in the embodiment of the present invention may include a control module 17, a row selection logic unit 171, a column selection logic unit 173, an analog-to-digital converter array 21, a register 19, etc., and the output of the photosensitive pixel array 11 is passed through the analog-to-digital converter The array 21 is converted into a digital signal, stored in the register 19 row by row and sent to the image processing module 50 for processing, until the outputs of all photosensitive pixels are processed to generate a combined image.

In this way, the image processing module 50 generates a color combined image with complete color information according to the color combined pixel values corresponding to the color filter area, and generates an infrared image with higher brightness and less noise according to the infrared pixel values corresponding to the infrared filter area.

Please refer to FIG. 12 and FIG. 10 together. In some embodiments, the image sensor 10 includes an array of analog-to-digital converters 21 , and each photosensitive pixel 111 is respectively connected to an analog-to-digital converter 17 . The analog-to-digital converter 17 is used to convert the analog signal output of the photosensitive pixel 111 into a digital signal output, and is used to calculate the average value or the sum of the digital signals of the photosensitive pixels covered by the color filter area as the color pixel value of the combined pixel. The photosensitive pixel 111 in this embodiment includes a photodiode 1113 . The photodiode 1113 is used to convert light into electric charges, and the electric charges generated are proportional to the light intensity. The switch tube 1115 is used to control the on and off of the circuit according to the control signals of the row selection logic unit 171 and the column selection logic unit 173. When the circuit is turned on, the source follower 1117 (source follower) is used to connect the photodiode 1113 The charge signal generated by light is converted into a voltage signal. The analog-to-digital converter 211 (Analog-to-digital converter) is used to convert the voltage signal into a digital signal for transmission to subsequent circuits for processing.

This output processing method converts the output of the photosensitive pixel into a digital signal, which is processed by software in the subsequent digital circuit or in the chip. Therefore, the output information of each photosensitive pixel can be retained. For example, for an image sensor with 16M pixels, the imaging method in the embodiment of the present invention can retain the information of 16M pixels (that is, the image before merging), and on this basis, the obtained Merged images of 4M pixels or images of other resolutions. The final generated image has a lower probability of bad pixels. In addition, this output processing method is less noisy and has a higher signal-to-noise ratio. Please refer to FIG. 10 together. In this embodiment, the image sensor includes a source follower 1117 connected to the photosensitive pixel 111 , and the source follower 1117 is connected to the analog-to-digital converter 211 . The source follower 1117 is used to convert the charge signal of the photosensitive pixel 111 into a voltage signal, which is further converted into a digital signal by the analog-to-digital converter 211 .

The output of the light-sensitive pixels covered by the color filter area can also be combined by hardware. According to the connection between the light-sensitive pixels and the source follower, there are two ways of hardware combination.

Please refer to FIG. 13 , in some implementations, each photosensitive pixel 111 is connected to a source follower 1117, and the source follower 1117 corresponding to the photosensitive pixel 111 covered by the color filter region 1315 of the same binning pixel is connected to a module. The digital converter 211 is connected. That is, each photodiode 1113 is connected to a source follower 1117 , and there are several source followers 1117 connected to the analog-to-digital converter 211 .

Compared with the software merging method, the hardware merging method has the same signal output strength of the circuit structure of the photosensitive pixel 111, and the photodiode 1113 noise and the source follower 1117 noise are both lower, so the overall signal-to-noise ratio is higher , resulting in a clearer image.

Please refer to FIG. 14 , in some other implementation manners, the photosensitive pixels 111 covered by the color filter region 1315 of the same binning pixel are connected to a source follower 1117 .

That is, multiple photodiodes 1113 are connected to one source follower 1117 , and each source follower 1117 is connected to one analog-to-digital converter 211 . Compared with the software merging method, the output noise of this hardware merging method is slightly higher, but the output intensity is n times, and n is the number of photosensitive pixels 111 of the common source follower 1117, so the overall signal-to-noise ratio is higher , resulting in a clearer image.

Regardless of the processing method of hardware merging or software merging, the output of multiple photosensitive pixels is combined to form a higher signal-to-noise ratio of the image corresponding to the combined pixel. For example, assuming that the original output of each photosensitive pixel is S, the noise is N, and the merged pixel includes m color photosensitive pixels, then the pixel value of the merged pixel is m*S, and the noise of the merged pixel is m is a natural number greater than or equal to 1. It can be understood that, in the case of m>1, the noise of the merged pixels is smaller than the sum of the noises output by each color photosensitive pixel before the merge. The output of the merged pixels is the sum of the outputs of the color photosensitive pixels before the merge, so the overall noise of the merged image is reduced, the signal-to-noise ratio is improved, and the definition is improved.

In some embodiments, the image processing module is configured to add the output of the photosensitive pixel covered by the color filter area and the output of the photosensitive pixel covered by the infrared filter area of the same binning pixel to obtain the pixel value of the binning pixel. After the color merged pixel is obtained, it is added to the output of the photosensitive pixel covered by the infrared filter area to obtain a merged pixel containing both color information and infrared photosensitive information to generate a merged image. The signal-to-noise ratio of the combined image (such as 4M resolution) is higher than that of the non-combined image (such as 16M resolution), and the color is complete, and the brightness, contrast and definition under low illumination are higher.

The invention also provides an electronic device using the imaging device. In some embodiments, the electronic device includes an imaging device. Therefore, the electronic device has a camera function and can generate a combined image with complete color, high signal-to-noise ratio, and high definition under low illumination.

The electronic device may be a mobile phone.

In some embodiments, the imaging device may be a front-facing camera of a mobile phone. Since the front-facing camera is mostly used for self-portraits, and self-portraits generally require image clarity but not high image resolution, the electronic device adopting this embodiment can meet this requirement.

Please refer to FIG. 15 , in some embodiments, the electronic device 200 includes a central processing unit 81 connected to the imaging device 100 and an external memory 83 , and the central processing unit 81 is used to control the external memory 83 to store the merged image.

In this way, the resulting merged image can be stored for later viewing, use or transfer. The external memory 83 includes an SM (SmartMedia) card, a CF (CompactFlash) card, and the like.

Please refer to FIG. 16 , in some embodiments, the electronic device 200 further includes a central processing unit 81 and a display device 85 connected to the imaging device 100 , and the central processing unit 81 is used to control the display device 85 to display the merged image. In this way, the image captured by the electronic device 200 can be displayed on the display device for the user to view. The display device includes an LED display and the like.

To sum up, the electronic device adopting the embodiment of the present invention has a camera function and can generate a combined image with complete color, high signal-to-noise ratio, and high definition under low illumination. In particular, when the electronic device is a front camera of a mobile phone, it can improve the brightness and definition of the selfie image under low illumination and reduce the noise.

For the unexpanded parts of the imaging method and the electronic device in the embodiments of the present invention, reference may be made to the corresponding parts of the image sensor and the imaging device in the above embodiments, and will not be expanded in detail here.

In the description of this specification, reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific examples" or "some examples" etc. Specific features, structures, materials, or features described in an embodiment or example are included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment for use. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. processing to obtain the program electronically and store it in computer memory.

It should be understood that various parts of the present invention can be realized by hardware, software, firmware or their combination. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like.

Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (23)

1. a formation method, is characterized in that, comprises the following steps:

There is provided imageing sensor, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, and described filter comprises filter unit array, and described filter unit comprises infrared filtering district and colorized optical filtering district; Described infrared filtering district covers a described photosensitive pixel; Described colorized optical filtering district covers photosensitive pixel described at least one; The described photosensitive pixel that same described filter unit covers forms merging pixel; And

Read the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.

2. as claimformation method described in 1, is characterized in that, each described filter unit covers 2*2 described photosensitive pixel.

3. as claimformation method described in 1, is characterized in that, the pixel value of described merging pixel comprises color pixel values, described color pixel values be described colorized optical filtering district cover described photosensitive pixel output mean value or and.

4. as claimformation method described in 3, is characterized in that, described imageing sensor comprises control module, described control module for control described imageing sensor export mean value that described photosensitive pixel that described colorized optical filtering district covers exports or and.

5. as claimformation method described in 3, is characterized in that, described imageing sensor comprises digital to analog converter, and described digital to analog converter is used for the output of described photosensitive pixel to be converted to digital signal;

Described read step comprises further:

Calculate the described digital signal of the described photosensitive pixel that described colorized optical filtering district covers mean value or with as the described color pixel values of described merging pixel.

6. as claimformation method described in 1, is characterized in that, described merging pixel comprises color pixel values and infrared image element value, and described read step comprises further:

Using described color pixel values, described color pixel values deducts described infrared image element value or described color pixel values adds the pixel value of described infrared image element value as described merging pixel.

7. an imageing sensor, is characterized in that, comprising:

Photosensitive pixel array; And

Be arranged at the filter on described photosensitive pixel array;

Described filter comprises filter unit array, and each described filter unit comprises infrared filtering district and colorized optical filtering district; Described infrared filtering district covers a described photosensitive pixel; Described colorized optical filtering district covers n-1 described photosensitive pixel, and n is the number of the described photosensitive pixel that a described filter unit covers;

The described photosensitive pixel that same described filter unit covers forms merging pixel.

8. as claimimageing sensor described in 7, is characterized in that, described colorized optical filtering district forms Bayer array.

9. as claimimageing sensor described in 7, is characterized in that, each described filter unit comprises 2*2 described photosensitive pixel.

10. as claimimageing sensor described in 9, is characterized in that, described imageing sensor comprises control module, and described control module exposes line by line for controlling described photosensitive pixel array.

11. as claimimageing sensor described in 10, it is characterized in that, described imageing sensor also comprises register, described control module be used for the described photosensitive pixel gathering the row k that completes of current exposure and kth+1 row successively output and stored in described register, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of described photosensitive pixel array.

12. as claimimageing sensor described in 7, is characterized in that, described imageing sensor comprises the micro mirror array be arranged on filter, and each described micro mirror is corresponding with a described photosensitive pixel.

13. 1 kinds of imaging devices, is characterized in that comprising as claimimageing sensor described in 7-12 any one;

Described imaging device also comprises the image processing module be connected with described imageing sensor;

Described image processing module is for reading the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.

14. as claimimaging device described in 13, is characterized in that, described imageing sensor comprises analog to digital converter array, and each described analog to digital converter is connected with a described photosensitive pixel;

Described image processing module is used for the analog signal output that described photosensitive pixel produces being converted to digital signal and exports, and for the mean value of the described digital signal that calculates the described photosensitive pixel that described colorized optical filtering district covers or with as the described color pixel values of described merging pixel.

15. as claimimaging device described in 13, is characterized in that, described imageing sensor comprises the source follower be connected with described photosensitive pixel;

Described source follower is connected with described analog to digital converter.

16. as claimimaging device described in 15, is characterized in that, each described photosensitive pixel is connected with a described source follower; The described source follower that the described photosensitive pixel of the described colorized optical filtering district covering of same described merging pixel is corresponding is connected with a described analog to digital converter.

17. as claimimaging device described in 15, is characterized in that, the described photosensitive pixel that the described colorized optical filtering district of same described merging pixel covers is connected with a described source follower.

18. as claimimaging device described in 13, it is characterized in that, the output of the described photosensitive pixel that the output that described image processing module is used for the described photosensitive pixel covered in the described colorized optical filtering district of same described merging pixel covers with described infrared filtering district is added to obtain the pixel value of described merging pixel.

19. 1 kinds of electronic installations, is characterized in that, comprise as claimimaging device described in 16-18 any one.

20. as claimelectronic installation described in 19, is characterized in that, described electronic installation comprises mobile phone.

21. as claimelectronic installation described in 20, is characterized in that, described imaging device comprises the Front camera of described mobile phone.

22. as claimelectronic installation described in 19, is characterized in that, described electronic installation comprises the central processing unit and external memory that are connected with described imaging device, and described central processing unit stores described merging image for controlling described external memory.

23. as claimelectronic installation described in 19, is characterized in that, described electronic installation also comprises the central processing unit and display unit that are connected with described imaging device, and described central processing unit shows described merging image for controlling described display unit.