CN114979522A - An adaptive pixel-level high dynamic CMOS image sensor and its realization method - Google Patents
An adaptive pixel-level high dynamic CMOS image sensor and its realization method Download PDFInfo
- Publication number
- CN114979522A CN114979522A CN202210550325.1A CN202210550325A CN114979522A CN 114979522 A CN114979522 A CN 114979522A CN 202210550325 A CN202210550325 A CN 202210550325A CN 114979522 A CN114979522 A CN 114979522A
- Authority
- CN
- China
- Prior art keywords
- pixel
- level
- comparator
- high dynamic
- tube
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 12
- 230000003044 adaptive effect Effects 0.000 title claims description 19
- 238000012546 transfer Methods 0.000 claims description 11
- 239000003990 capacitor Substances 0.000 claims description 6
- 229920006395 saturated elastomer Polymers 0.000 claims description 4
- 230000015572 biosynthetic process Effects 0.000 claims description 2
- ALKZAGKDWUSJED-UHFFFAOYSA-N dinuclear copper ion Chemical compound [Cu].[Cu] ALKZAGKDWUSJED-UHFFFAOYSA-N 0.000 claims description 2
- 238000003786 synthesis reaction Methods 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 6
- 230000006872 improvement Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000005036 potential barrier Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
- H04N25/75—Circuitry for providing, modifying or processing image signals from the pixel array
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
Description
技术领域technical field
本发明属于图像传感器技术领域,涉及一种自适应像素级高动态CMOS图像传感器及其实现方法。The invention belongs to the technical field of image sensors, and relates to an adaptive pixel-level high dynamic CMOS image sensor and a realization method thereof.
背景技术Background technique
CMOS图像传感器被广泛应用于空间探测、对地观测、工业监测和消费电子中,通过多种类型复杂光线收集,实现目标获取、探测感知和成像拍摄等应用需求。CMOS图像传感器的动态范围为能够监测光线强度的范围,由于器件的阱容量有限,当入射光线过强时,像素快速饱和,导致强光信息丢失。自然界从直射阳光到暗夜,动态范围达到180dB,具有较宽动态范围的传感器可以探测更宽的场景照度范围,从而可以产生更多细节的图像。提升器件的动态范围有利于良好的科学探测,工业应用和成像质量,对提升科技力量和国民生活具有重要价值。CMOS image sensors are widely used in space exploration, earth observation, industrial monitoring and consumer electronics. Through various types of complex light collection, application requirements such as target acquisition, detection perception and imaging shooting are realized. The dynamic range of the CMOS image sensor is the range that can monitor the light intensity. Due to the limited well capacity of the device, when the incident light is too strong, the pixels are quickly saturated, resulting in the loss of strong light information. In nature, from direct sunlight to dark night, the dynamic range reaches 180dB. A sensor with a wider dynamic range can detect a wider range of scene illumination, which can produce more detailed images. Improving the dynamic range of the device is conducive to good scientific detection, industrial application and imaging quality, and is of great value to improving scientific and technological strength and national life.
目前所采用的高动态范围实现方案包括:势阱容量调节技术,多次采样技术,对数响应技术。势阱容量调节技术,增加横向溢出栅,在曝光期间将势阱容量增加一倍或几倍,这样可使CMOS图像传感器电荷随光强变化的传输曲线得到压缩。多次采样技术,同一个场景在不同的曝光时间下进行多次采样,然后将多次采样的输出组合成一幅大动态范围的图像。对数响应技术,利用二极管连接的MOS晶体管工作于亚阈值区的特性,得到光电二极管对数响应传输曲线。The currently adopted high dynamic range implementation schemes include: potential well capacity adjustment technology, multiple sampling technology, and logarithmic response technology. Potential well capacity adjustment technology, adding lateral overflow gates, and increasing the potential well capacity by one or several times during exposure, which can compress the transfer curve of the CMOS image sensor charge as a function of light intensity. Multi-sampling technology, the same scene is sampled multiple times at different exposure times, and then the output of the multiple samples is combined into an image with a large dynamic range. The logarithmic response technology utilizes the characteristics of diode-connected MOS transistors operating in the subthreshold region to obtain the photodiode logarithmic response transfer curve.
现有技术中的高动态实现方法,主要采用平面2D结构,采用单一的像素级ADC或者列级ADC。参见图8为现有技术中高动态图像传感器整体结构图,像素阵列和列级ADC读出电路处于同一平面,分别完成光电转换和模数转换,通过光线判断,由外部SPI接口输入高动态配置信号实现动态范围提升。具体结构图参见图9,像素阵列包括全局曝光控制管、传输管、高动态复位管、源跟随管和读出控制管,列级ADC读出电路包括比较器和计数器,通过外部配置调整高动态管的电压和控制时间,达到高动态目标,但是通过拍摄场景判断高动态模式,反馈周期长,无法适应明暗高速变换的拍摄场景,不能够满足高动态的成像需求,也没有充分利用纵向空间,在空间利用率上也有待提升。The high dynamic implementation method in the prior art mainly adopts a planar 2D structure, and adopts a single pixel-level ADC or column-level ADC. 8 is an overall structural diagram of a high-dynamic image sensor in the prior art. The pixel array and the column-level ADC readout circuit are in the same plane, and photoelectric conversion and analog-to-digital conversion are completed respectively. The high-dynamic configuration signal is input through the external SPI interface through light judgment. To achieve dynamic range improvement. See Figure 9 for the specific structure diagram. The pixel array includes a global exposure control tube, a transfer tube, a high dynamic reset tube, a source follower tube and a readout control tube. The column-level ADC readout circuit includes a comparator and a counter, and the high dynamic range is adjusted by external configuration. The voltage and control time of the tube can achieve the high dynamic target, but the high dynamic mode is judged by the shooting scene, and the feedback cycle is long, which cannot adapt to the shooting scene with high-speed change of light and dark, can not meet the high dynamic imaging requirements, and does not make full use of the vertical space, There is also room for improvement in space utilization.
发明内容SUMMARY OF THE INVENTION
本发明的目的在于解决现有技术中仅使用单一ADC高动态校准实时性较差,在光线快速变换条件下,不能满足高动态成像需求的问题,提供一种自适应像素级高动态CMOS图像传感器及其实现方法。The purpose of the present invention is to solve the problem in the prior art that only a single ADC is used for high dynamic calibration, the real-time performance is poor, and the requirements for high dynamic imaging cannot be met under the condition of rapid light change, and an adaptive pixel-level high dynamic CMOS image sensor is provided. and its implementation method.
为达到上述目的,本发明采用以下技术方案予以实现:To achieve the above object, the present invention adopts the following technical solutions to realize:
一种自适应像素级高动态CMOS图像传感器,包括像素阵列、列级ADC读出电路和像素级ADC电路;An adaptive pixel-level high dynamic CMOS image sensor includes a pixel array, a column-level ADC readout circuit and a pixel-level ADC circuit;
所述像素阵列和列级ADC读出电路设于上层芯片上,像素级ADC电路设于下层芯片上,上层芯片与下层芯片之间采用3D堆叠结构设置;The pixel array and the column-level ADC readout circuit are arranged on the upper-layer chip, the pixel-level ADC circuit is arranged on the lower-layer chip, and a 3D stacking structure is used between the upper-layer chip and the lower-layer chip;
所述像素阵列输出光电信号,将光电信号分别输入至列级ADC读出电路和像素级ADC电路;The pixel array outputs photoelectric signals, and the photoelectric signals are respectively input to the column-level ADC readout circuit and the pixel-level ADC circuit;
所述列级ADC读出电路包括比较器、计数器和数据合成器,比较器的负端接收光电信号,正端输入斜坡信号,比较结果通过计数器传输至数据合成器;The column-level ADC readout circuit includes a comparator, a counter and a data synthesizer, the negative terminal of the comparator receives the photoelectric signal, the positive terminal inputs the ramp signal, and the comparison result is transmitted to the data synthesizer through the counter;
所述像素级ADC电路包括比较单元、控制单元和寄存器单元,比较单元的正端接收光电信号,负端接收参考信号,比较结果通过寄存器单元处理后,分别输送至控制单元和数据合成器,控制单元生成控制时长数据并将其反馈至像素阵列,数据合成器中产生最终结果输出。The pixel-level ADC circuit includes a comparison unit, a control unit, and a register unit. The positive end of the comparison unit receives the photoelectric signal, and the negative end receives the reference signal. After the comparison result is processed by the register unit, it is respectively sent to the control unit and the data synthesizer. The unit generates control duration data and feeds it back to the pixel array, where the final result output is produced in the data synthesizer.
本发明的进一步改进在于:A further improvement of the present invention is:
所述像素阵列包括全局曝光控制管、传输管、高动态复位管、源跟随管、读出控制管、二极管和电容,全局曝光控制管、高动态复位管和源跟随管的漏极均连接VDD,全局曝光控制管的源极与传输管的源极连接后通过二极管接地,传输管的漏极与高动态复位管的源极连接至FD点,FD点连接源跟随管的栅极以及通过电容接地,源跟随管的源极连接读出控制管的漏极,读出控制管的源极输出光电信号。The pixel array includes a global exposure control tube, a transfer tube, a high dynamic reset tube, a source follower tube, a readout control tube, a diode and a capacitor, and the drains of the global exposure control tube, the high dynamic reset tube and the source follower tube are all connected to VDD , the source of the global exposure control tube is connected to the source of the transfer tube and then grounded through a diode. The drain of the transfer tube and the source of the high dynamic reset tube are connected to the FD point, and the FD point is connected to the gate of the source follower tube and through the capacitor. Grounding, the source of the source follower tube is connected to the drain of the readout control tube, and the source of the readout control tube outputs a photoelectric signal.
所述比较单元包括第一比较器、第二比较器和第三比较器,第一比较器、第二比较器和第三比较器的正输入端均为光电信号,负输入端分别为参考电平高VREFH、参考电平VREF和参考电平低VREFL。The comparison unit includes a first comparator, a second comparator and a third comparator. The positive input terminals of the first comparator, the second comparator and the third comparator are all photoelectric signals, and the negative input terminals are respectively the reference voltage. Level high VREFH, reference level VREF, and reference level low VREFL.
所述参考电平高VREFH、参考电平VREF和参考电平低VREFL具体表示为:The reference level high VREFH, the reference level VREF and the reference level low VREFL are specifically expressed as:
其中,V0为像素复位条件下输出电压值,V_fullscale为像素饱和时输出的电压值和像素复位时输出的电压值之差。Among them, V0 is the output voltage value under the pixel reset condition, and V_fullscale is the difference between the voltage value output when the pixel is saturated and the voltage value output when the pixel is reset.
所述寄存器单元为真值表寄存器,对比比较单元的输出结果和真值表寄存器中的数值,判断光线强度。The register unit is a truth table register, and compares the output result of the comparison unit with the value in the truth table register to judge the light intensity.
所述上层芯片与下层芯片之间采用铜-铜互联结构。A copper-copper interconnect structure is used between the upper-layer chip and the lower-layer chip.
一种自适应像素级高动态CMOS图像传感器的实现方法,包括以下步骤:A method for implementing an adaptive pixel-level high dynamic CMOS image sensor, comprising the following steps:
像素阵列输出光电信号,像素级ADC电路的比较单元中接收光电信号进行比较,分别输入至第一比较器、第二比较器和第三比较器的正输入端,负输入端分别为参考电平高VREFH、参考电平VREF和参考电平低VREFL,比较完成后输出数字信号;The pixel array outputs photoelectric signals, and the comparison unit of the pixel-level ADC circuit receives the photoelectric signals for comparison, and inputs them to the positive input terminals of the first comparator, the second comparator and the third comparator respectively, and the negative input terminals are respectively the reference level High VREFH, reference level VREF and reference level low VREFL, output digital signal after the comparison is completed;
根据数字信号在真值表寄存器中进行对比,判断光线强弱,真值表寄存器输出对应的高位数字信号至数据合成器中,并确定时间控制器输出对应的控制时长数据,时间控制器将控制时长数据反馈至像素阵列,对高动态复位管进行实时调节;Compare the digital signal in the truth table register to judge the light intensity, the truth table register outputs the corresponding high-order digital signal to the data synthesizer, and determines the time controller to output the corresponding control duration data, the time controller will control the The duration data is fed back to the pixel array, and the high dynamic reset tube is adjusted in real time;
光电信号输入至比较器的负输入端与斜坡信号进行比较,光电信号大于斜坡信号时,比较器翻转,计数器进行一次计数,并将计数结果输送至数据合成器中;The photoelectric signal is input to the negative input terminal of the comparator and compared with the ramp signal. When the photoelectric signal is greater than the ramp signal, the comparator turns over, the counter counts once, and the counting result is sent to the data synthesizer;
数据合成器对接收到的数据进行合成,输出最终结果。The data synthesizer synthesizes the received data and outputs the final result.
所述光电信号小于VREFL时,比较单元输出000;所述光电信号小于VREF时,比较单元输出001;所述光电信号小于VREFH时,比较单元输出011;所述光电信号大于VREFH时,比较单元输出111。When the photoelectric signal is smaller than VREFL, the comparison unit outputs 000; when the photoelectric signal is smaller than VREF, the comparison unit outputs 001; when the photoelectric signal is smaller than VREFH, the comparison unit outputs 011; when the photoelectric signal is larger than VREFH, the comparison unit outputs 111.
与现有技术相比,本发明具有以下有益效果:Compared with the prior art, the present invention has the following beneficial effects:
通过利用像素阵列输出的光电信号,在像素级ADC电路中实现对光线的实时探测和处理,以及对控制时间的对比计算,达到高动态控制的目标,并且将像素级ADC电路的高实时性特点和列级ADC读出电路的高精度特点有机结合,由数据合成器输出最终结果,在光线快速变化时,实现高动态成像需求,并且通过采用3D堆叠架构充分利用了纵向空间。By using the photoelectric signal output by the pixel array, the real-time detection and processing of light and the comparative calculation of the control time are realized in the pixel-level ADC circuit to achieve the goal of high dynamic control, and the high real-time characteristics of the pixel-level ADC circuit are realized. It is organically combined with the high-precision characteristics of the column-level ADC readout circuit, and the final result is output by the data synthesizer. When the light changes rapidly, high dynamic imaging requirements are achieved, and the vertical space is fully utilized by using a 3D stacking structure.
附图说明Description of drawings
为了更清楚的说明本发明实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,应当理解,以下附图仅示出了本发明的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他相关的附图。In order to describe the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings that need to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present invention, and therefore do not It should be regarded as a limitation of the scope, and for those of ordinary skill in the art, other related drawings can also be obtained according to these drawings without any creative effort.
图1为本发明的自适应像素级高动态CMOS图像传感器整体结构图;1 is an overall structural diagram of an adaptive pixel-level high dynamic CMOS image sensor of the present invention;
图2为本发明的自适应像素级高动态CMOS图像传感器具体结构图;2 is a specific structural diagram of an adaptive pixel-level high dynamic CMOS image sensor of the present invention;
图3为本发明的传感器预曝光时序图;Fig. 3 is the sensor pre-exposure timing chart of the present invention;
图4为本发明的传感器高动态时序图;4 is a high dynamic timing diagram of the sensor of the present invention;
图5为高动态复位管电压图;Figure 5 is a high dynamic reset tube voltage diagram;
图6为本发明的传感器高动态电压曲线;Fig. 6 is the high dynamic voltage curve of the sensor of the present invention;
图7为本发明的传感器工作流程图;Fig. 7 is the sensor working flow chart of the present invention;
图8为现有技术中高动态图像传感器整体结构图;8 is an overall structural diagram of a high dynamic image sensor in the prior art;
图9为现有技术中高动态图像传感器具体结构图。FIG. 9 is a specific structural diagram of a high dynamic image sensor in the prior art.
其中:101-像素阵列,102-列级ADC读出电路,103-像素级ADC电路,10-全局曝光控制管;11-传输管;12-高动态复位管;13-源跟随管;14-读出控制管;15-第一比较器;16-第二比较器;17-第三比较器;18-时间控制器;19-真值表寄存器;20-比较器;21-计数器;22-数据合成器。Among them: 101-pixel array, 102-column-level ADC readout circuit, 103-pixel-level ADC circuit, 10-global exposure control tube; 11-transmission tube; 12-high dynamic reset tube; 13-source follower tube; 14- Readout control tube; 15-first comparator; 16-second comparator; 17-third comparator; 18-time controller; 19-truth table register; 20-comparator; 21-counter; 22- data synthesizer.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。通常在此处附图中描述和示出的本发明实施例的组件可以以各种不同的配置来布置和设计。In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. The components of the embodiments of the invention generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations.
因此,以下对在附图中提供的本发明的实施例的详细描述并非旨在限制要求保护的本发明的范围,而是仅仅表示本发明的选定实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。Thus, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed, but is merely representative of selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步定义和解释。It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.
在本发明实施例的描述中,需要说明的是,若出现术语“上”、“下”、“水平”、“内”等指示的方位或位置关系为基于附图所示的方位或位置关系,或者是该发明产品使用时惯常摆放的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。此外,术语“第一”、“第二”等仅用于区分描述,而不能理解为指示或暗示相对重要性。In the description of the embodiments of the present invention, it should be noted that if the terms "upper", "lower", "horizontal", "inside", etc. appear, the orientation or positional relationship indicated is based on the orientation or positional relationship shown in the accompanying drawings , or the orientation or positional relationship that the product of the invention is usually placed in use, it is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed in a specific orientation and operation, and therefore should not be construed as limiting the present invention. Furthermore, the terms "first", "second", etc. are only used to differentiate the description and should not be construed to indicate or imply relative importance.
此外,若出现术语“水平”,并不表示要求部件绝对水平,而是可以稍微倾斜。如“水平”仅仅是指其方向相对“竖直”而言更加水平,并不是表示该结构一定要完全水平,而是可以稍微倾斜。Furthermore, the presence of the term "horizontal" does not imply that the component is required to be absolutely horizontal, but rather may be tilted slightly. For example, "horizontal" only means that its direction is more horizontal than "vertical", it does not mean that the structure must be completely horizontal, but can be slightly inclined.
在本发明实施例的描述中,还需要说明的是,除非另有明确的规定和限定,若出现术语“设置”、“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本发明中的具体含义。In the description of the embodiments of the present invention, it should also be noted that, unless otherwise expressly specified and limited, the terms "set", "installed", "connected" and "connected" should be understood in a broad sense. It can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate medium, and it can be internal communication between two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.
下面结合附图对本发明做进一步详细描述:Below in conjunction with accompanying drawing, the present invention is described in further detail:
参见图1,为本发明的自适应像素级高动态CMOS图像传感器整体结构图,包括像素阵列101、列级ADC读出电路102和像素级ADC电路,像素阵列101和列级ADC电路102设于上层芯片上,像素级ADC电路103设于下层芯片上,上层芯片与下层芯片的各节点之间通过金属连接柱相连接。Referring to FIG. 1, it is an overall structural diagram of an adaptive pixel-level high dynamic CMOS image sensor of the present invention, including a
参见图2,为本发明的自适应像素级高动态CMOS图像传感器具体结构图,包括像素阵列101中的全局曝光控制管10、传输管11、高动态复位管12、源跟随管13、读出控制管14、二极管和电容,列级ADC读出电路102中的比较器20、计数器21和数据合成器22,像素级ADC电路103中的第一比较器15、第二比较器16、第三比较器17、时间控制器18和真值表寄存器19,全局曝光控制管10、高动态复位管12和源跟随管13的漏极均连接VDD,全局曝光控制管10的源极与传输管11的源极连接后通过二极管接地,传输管11的漏极与高动态复位管12的源极连接至FD点,FD点连接源跟随管13的栅极以及通过电容接地,源跟随管13的源极连接读出控制管14的漏极,读出控制管14的源极输出光电信号;比较器20的负端接收光电信号,正端输入斜坡信号,比较结果通过计数器21传输至数据合成器22;比较单元包括第一比较器15、第二比较器16和第三比较器17,第一比较器15、第二比较器16和第三比较器17的正输入端均为光电信号,负输入端分别为参考电平高VREFH、参考电平VREF和参考电平低VREFL,光电信号与参考信号进行比较后输出温度计码,在真值表寄存器19中进行比对,判断光线强弱,真值表寄存器19输出对应的高位数字信号至数据合成器22中,并确定时间控制器18输出对应的控制时长数据,时间控制器18将控制时长数据反馈至像素阵列101,对高动态复位管12进行实时调节;光电信号输入至比较器20的负输入端与斜坡信号进行比较,光电信号大于斜坡信号时,比较器20翻转,计数器21进行一次计数,并将计数结果输送至数据合成器22中;数据合成器22对接收到的数据进行合成,输出最终结果。Referring to FIG. 2, it is a specific structural diagram of the adaptive pixel-level high dynamic CMOS image sensor of the present invention, including a global
参见图3为本发明的传感器预曝光时序图,全局曝光控制管10作为全局复位控制开关,在每一帧开始时打开一次,对整个像元阵列的光电二极管进行复位;在将整个像元阵列的图像信号从PD转移到FD之前,高动态复位管12打开,对FD进行复位;FD点复位完成后,整个像元阵列的传输管11同时开启,图像信号从PD转移至FD点,由于采用像素级ADC结构,所有像素并行执行,行选开关源跟随管13开启,读出光强电信号,进入列级ADC读出电路102。光电信号通过比较器15~17,与参考电平高VREFH、参考电平VREF、参考电平低VREFL进行比较。像素饱和时输出的电压值为Vf,像素复位条件下输出电压值为V0,二者之差为像素输出摆幅V_fullscale,其中VREFL、VREF、VREFH的电压值分别为:Referring to FIG. 3 is the sensor pre-exposure timing diagram of the present invention, the global
如表1所示,比较器输出为温度计码,通过对比真值表,确定t1~t3的取值。其中A、B、C分别为比较器15~17的输出,由于光强越强像素输出电压值越低,因此当光强很强时,PIXEL_OUT的输出电压小于VREFL,ABC输出000;当光强较强时,PIXEL_OUT的输出电压小于VREF,ABC输出001;当光强较弱时,PIXEL_OUT的输出电压小于VREFH,ABC输出011;当光强弱时,PIXEL_OUT的输出电压大于VREFH,ABC输出111。对应的t1~t3设置如表1所示,用以满足不同的高动态需求,如图4所示,t1~t3的总时长为曝光时长t,根据器件使用需求由用户进行配置,真值表中列出的为t1~t3时常的比例关系。如果光强为弱光,则t1~t3均为0,曝光时常t内高动态复位管12连接电源电压。As shown in Table 1, the output of the comparator is a thermometer code, and the values of t1 to t3 are determined by comparing the truth table. Among them, A, B, and C are the outputs of
表1光线强弱与高动态时序对应真值表Table 1 Corresponding truth table of light intensity and high dynamic timing
在像素复位阶段时,如图5所示,高动态复位管12上的电压为3.3V,此时该管的势垒较低,光电流通过该管放电;随后,高动态复位管12管由3.3V降低到V1电压值并持续t1时长,V1默认为1.4V,由于高动态复位管12电压降低,因此该管势垒升高,由于此时光电二极管上电压Vpd>V1-Vth,光电流积分,Vpd随之下降,当Vpd<V1-Vth时,高动态复位管12导通,光电流积分停止,此时PD积累的电荷为Qh(t),Qh(t)反应了当高动态复位管12栅压降低时光电二极管能够积累的最大电荷量,当积累的电荷量大于Qh(t)时,多余的电荷将迫使高动态复位管12导通,通过VDD、高动态复位管12、传输管11、光电二极管10、GND形成的回路放电;随后高动态复位管12的栅压再次降低至V2电压值并持续t2时长,V2默认为1.2V,随着高动态复位管12栅压的再次降低,Vpd>V2-Vth,因此M2管再次截止,光电流继续积分,直至Vpd<V2-Vth;随后降低至V3电压值并持续t3时长,V3默认为1.0V,将继续重复上述过程;最后降低至V4电压值并保持在这个电压水平直至曝光结束,V4默认为0.8V,这个电压很低,可以避免光电二极管处于过度曝光的状态。In the pixel reset stage, as shown in FIG. 5, the voltage on the high
图6为高动态复位管12栅压的变化带来传感器像元分段线性响应的结果。从图中可以看出,当亮度较高时,输出斜率变缓,实现了动态范围扩展。FIG. 6 is the result of the piecewise linear response of the sensor pixel brought about by the change of the gate voltage of the high
图7所示为整体执行过程,通过预积分,输出光电信号,光电信号与参考比较,利用3D堆叠型芯片级ADC判断光线强弱,根据强弱光结果,控制分段积分时间长度。然后通过列级ADC进行低位转换和高低位ADC数据合成,实现自适应高动态图像传感器。Figure 7 shows the overall execution process. Through pre-integration, the photoelectric signal is output, and the photoelectric signal is compared with the reference. The 3D stacked chip-level ADC is used to judge the light intensity, and the segment integration time length is controlled according to the strong and weak light results. Then low-bit conversion and high-low-bit ADC data synthesis are performed by column-level ADC to realize adaptive high-dynamic image sensor.
本发明一实施例提供了一种自适应像素级高动态CMOS图像传感器的实现方法,包括以下步骤:An embodiment of the present invention provides a method for implementing an adaptive pixel-level high dynamic CMOS image sensor, including the following steps:
像素阵列101输出光电信号,光电信号与参考信号在像素级ADC电路103的比较单元中进行比较,输出数字信号;The
根据数字信号在真值表寄存器19中进行对比,判断光线强弱,真值表寄存器19输出对应的高位数字信号至数据合成器22中,并确定时间控制器18输出对应的控制时长数据,时间控制器18将控制时长数据反馈至像素阵列101,对高动态复位管12进行实时调节;According to the digital signal, the
光电信号输入至比较器20的负输入端与斜坡信号进行比较,光电信号大于斜坡信号时,比较器20翻转,计数器21进行一次计数,并将计数结果输送至数据合成器22中;The photoelectric signal is input to the negative input terminal of the
数据合成器22对接收到的数据进行合成,输出最终结果。The
以上仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210550325.1A CN114979522B (en) | 2022-05-20 | 2022-05-20 | Self-adaptive pixel-level high-dynamic CMOS image sensor and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210550325.1A CN114979522B (en) | 2022-05-20 | 2022-05-20 | Self-adaptive pixel-level high-dynamic CMOS image sensor and implementation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114979522A true CN114979522A (en) | 2022-08-30 |
| CN114979522B CN114979522B (en) | 2024-09-27 |
Family
ID=82984484
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210550325.1A Active CN114979522B (en) | 2022-05-20 | 2022-05-20 | Self-adaptive pixel-level high-dynamic CMOS image sensor and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114979522B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119946459A (en) * | 2025-01-02 | 2025-05-06 | 西安微电子技术研究所 | A trigger type CMOS image sensor and its implementation method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030058360A1 (en) * | 2001-09-24 | 2003-03-27 | Xinqiao Liu | CMOS image sensor system with self-reset digital pixel architecture for improving SNR and dynamic range |
| JP2010004439A (en) * | 2008-06-23 | 2010-01-07 | Konica Minolta Business Technologies Inc | Solid-state image pickup device |
| CN105847713A (en) * | 2016-04-07 | 2016-08-10 | 天津大学 | 3D stacked structure image sensor reading method based on one-dimensional decoding |
| CN108184081A (en) * | 2018-01-15 | 2018-06-19 | 北京时代民芯科技有限公司 | A kind of high-speed data reading circuit in cmos image sensor |
| CN108988862A (en) * | 2018-08-13 | 2018-12-11 | 中国科学院微电子研究所 | Analog-to-digital converter and analog-to-digital conversion method |
| CN109246372A (en) * | 2018-10-22 | 2019-01-18 | 天津大学 | 3D based on block parallel fault-tolerant architecture stacks imaging sensor |
| CN112954240A (en) * | 2021-03-01 | 2021-06-11 | 哈尔滨工程大学 | CMOS image sensor pixel level ADC circuit |
-
2022
- 2022-05-20 CN CN202210550325.1A patent/CN114979522B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030058360A1 (en) * | 2001-09-24 | 2003-03-27 | Xinqiao Liu | CMOS image sensor system with self-reset digital pixel architecture for improving SNR and dynamic range |
| JP2010004439A (en) * | 2008-06-23 | 2010-01-07 | Konica Minolta Business Technologies Inc | Solid-state image pickup device |
| CN105847713A (en) * | 2016-04-07 | 2016-08-10 | 天津大学 | 3D stacked structure image sensor reading method based on one-dimensional decoding |
| CN108184081A (en) * | 2018-01-15 | 2018-06-19 | 北京时代民芯科技有限公司 | A kind of high-speed data reading circuit in cmos image sensor |
| CN108988862A (en) * | 2018-08-13 | 2018-12-11 | 中国科学院微电子研究所 | Analog-to-digital converter and analog-to-digital conversion method |
| CN109246372A (en) * | 2018-10-22 | 2019-01-18 | 天津大学 | 3D based on block parallel fault-tolerant architecture stacks imaging sensor |
| CN112954240A (en) * | 2021-03-01 | 2021-06-11 | 哈尔滨工程大学 | CMOS image sensor pixel level ADC circuit |
Non-Patent Citations (3)
| Title |
|---|
| GÖZEN KÖKLÜ: "An event-detection high dynamic range CMOS image sensor", 《SENSORS, 2013 IEEE》, 6 November 2013 (2013-11-06) * |
| 潘银松, 袁祥辉, 林聚承, 孟丽娅, 黄友恕: "CMOS数字图像传感器研究进展", 重庆大学学报(自然科学版), no. 09, 30 September 2005 (2005-09-30) * |
| 高雷: "集成模数转换器的红外焦平面读出电路研究", 《 中国科学院研究生院(上海技术物理研究所)》, 1 April 2015 (2015-04-01) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119946459A (en) * | 2025-01-02 | 2025-05-06 | 西安微电子技术研究所 | A trigger type CMOS image sensor and its implementation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114979522B (en) | 2024-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12010447B2 (en) | Dynamic vision sensor architecture | |
| Posch et al. | A QVGA 143dB dynamic range asynchronous address-event PWM dynamic image sensor with lossless pixel-level video compression | |
| US9973720B2 (en) | Solid state imaging device, method of outputting imaging signal and electronic device | |
| US6133563A (en) | Sensor cell having a soft saturation circuit | |
| US7746398B2 (en) | Wide dynamic range active pixel with knee response | |
| US20080218614A1 (en) | Dynamic range enhancement scheme for imagers | |
| CN106412453A (en) | High-dynamic range image sensor based on two times of charge transfer and signal reading method | |
| CN104967793B (en) | Power supply noise cancellation circuit suitable for CMOS image sensor | |
| CN101300825A (en) | Image sensor | |
| CN110809122A (en) | Dynamic expansion method applied to CMOS image sensor | |
| US20120262597A1 (en) | Method for capturing wide dynamic range image in a 16 bit floating point format | |
| CN117479034A (en) | Low power event driven pixels with passive differential detection circuitry and reset control circuits therefor | |
| US10051216B2 (en) | Imaging apparatus and imaging method thereof using correlated double sampling | |
| US10063797B2 (en) | Extended high dynamic range direct injection circuit for imaging applications | |
| CN109714545B (en) | High-speed hyperspectral imager image processing system | |
| CN114979522A (en) | An adaptive pixel-level high dynamic CMOS image sensor and its realization method | |
| US7598987B2 (en) | Flicker detection gain control circuit, digital imaging system, and method | |
| US20250088774A1 (en) | Ramp generation circuit, image sensing device including the ramp generation circuit, and method for operating the image sensing device | |
| US8902343B1 (en) | Charge pump for pixel floating diffusion gain control | |
| CN112399099B (en) | Charge domain sampling low-noise pixel structure | |
| CN107040733A (en) | Cmos image sensor | |
| CN212677264U (en) | Power supply noise suppression circuit and image sensor | |
| Kuo | A novel linear-logarithmic active pixel CMOS image sensor with wide dynamic range | |
| CN117041752A (en) | High-speed large dynamic range pixel architecture compatible with three working modes | |
| US12192644B2 (en) | Pulse-width modulation pixel sensor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |