+

CN114862773A - Liver medical image registration and fusion method and system - Google Patents

Liver medical image registration and fusion method and system Download PDF

Info

Publication number
CN114862773A
CN114862773A CN202210422530.XA CN202210422530A CN114862773A CN 114862773 A CN114862773 A CN 114862773A CN 202210422530 A CN202210422530 A CN 202210422530A CN 114862773 A CN114862773 A CN 114862773A
Authority
CN
China
Prior art keywords
liver
image
phase
images
fusion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202210422530.XA
Other languages
Chinese (zh)
Inventor
魏宾
董蒨
朱呈瞻
董冰子
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Affiliated Hospital of University of Qingdao
Original Assignee
Affiliated Hospital of University of Qingdao
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Affiliated Hospital of University of Qingdao filed Critical Affiliated Hospital of University of Qingdao
Priority to CN202210422530.XA priority Critical patent/CN114862773A/en
Publication of CN114862773A publication Critical patent/CN114862773A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration using histogram techniques
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/37Determination of transform parameters for the alignment of images, i.e. image registration using transform domain methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38Registration of image sequences
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20048Transform domain processing
    • G06T2207/20056Discrete and fast Fourier transform, [DFT, FFT]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20192Edge enhancement; Edge preservation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30056Liver; Hepatic
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30101Blood vessel; Artery; Vein; Vascular

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a liver medical image registration and fusion method and a system, wherein the method comprises the following steps: acquiring a liver CT image sequence map group of an arterial phase and a liver CT image sequence map group of a venous phase of the same liver, wherein the liver CT image sequence map group of the arterial phase comprises at least ten liver CT images of the arterial phase, and the liver CT image sequence map group of the venous phase comprises at least thirty liver CT images of the venous phase; sequentially registering each arterial-phase liver CT image, finding venous-phase liver CT images with the same cross section as the venous-phase liver CT images in a venous-phase liver CT image sequence map group, and acquiring at least ten venous-phase liver CT images registered with at least ten arterial-phase liver CT images; sequentially fusing each arterial-stage liver CT image and one venous-stage liver CT image registered with each arterial-stage liver CT image to obtain at least ten liver CT fused images; and performing sequence three-dimensional reconstruction on at least ten liver CT fusion images to obtain a liver three-dimensional fusion CT image.

Description

肝脏医学图像配准与融合方法及系统Liver medical image registration and fusion method and system

技术领域technical field

本发明涉及医学图像处理技术领域,特别涉及一种肝脏医学图像的处理方法及系统。The present invention relates to the technical field of medical image processing, in particular to a method and system for processing liver medical images.

背景技术Background technique

肝脏是人体内重要的器官,肝脏内部有肝动脉、肝静脉、门静脉以及胆管系统等众多复杂的管道系统,对其进行图像处理、可视化研究、生物建模具有重要的意义。The liver is an important organ in the human body. There are many complex piping systems in the liver, such as hepatic artery, hepatic vein, portal vein, and bile duct system. Image processing, visualization research, and biological modeling are of great significance.

肝脏的可视化研究可应用于临床诊断、手术和肝脏移植,其可以帮助医生在手术前了解肝脏内管道系统的分布和连接关系,未诊断定位和手术提供帮助。The visualization study of the liver can be applied to clinical diagnosis, surgery and liver transplantation. It can help doctors to understand the distribution and connection of the piping system in the liver before surgery, and provide assistance for undiagnosed positioning and surgery.

医学图像配准是指对一幅医学图像寻求一种或一系列空间变换,使它与另一幅医学图像上的对应点达到空间上的一致。这种一致是指人体上的同一解剖点在两张匹配图像上有相同的空间位置。配准的结果应使两幅图像上所有的解剖点,或至少是所有具有诊断意义的点都达到匹配。Medical image registration refers to seeking one or a series of spatial transformations for a medical image to make it spatially consistent with the corresponding points on another medical image. This agreement means that the same anatomical point on the human body has the same spatial location on the two matched images. The result of the registration should match all anatomical points, or at least all points of diagnostic significance, on the two images.

图像融合(Image Fusion)是指将多源信道所采集到的关于同一目标的图像数据经过图像处理和计算机技术处理等,最大限度的提取各自信道中的有利信息,最后综合成高质量的图像,以提高图像信息的利用率、改善计算机解译精度和可靠性、提升原始图像的空间分辨率和光谱分辨率,利于监测。待融合图像已配准好且像素位宽一致,综合和提取两个或多个多源图像信息。高效的图像融合方法可以根据需要综合处理多源通道的信息,从而有效地提高了图像信息的利用率、系统对目标探测识别地可靠性及系统的自动化程度。其目的是将单一传感器的多波段信息或不同类传感器所提供的信息加以综合,消除多传感器信息之间可能存在的冗余和矛盾,以增强影像中信息透明度,改善解译的精度、可靠性以及使用率,以形成对目标的清晰、完整、准确的信息描述。Image fusion (Image Fusion) refers to the image data collected by multiple source channels about the same target through image processing and computer technology processing, etc., to maximize the extraction of favorable information in each channel, and finally synthesized into high-quality images. In order to improve the utilization rate of image information, improve the accuracy and reliability of computer interpretation, and improve the spatial resolution and spectral resolution of the original image, it is conducive to monitoring. The images to be fused have been registered and the pixel bit widths are consistent, and the information of two or more multi-source images is synthesized and extracted. The efficient image fusion method can comprehensively process the information of multi-source channels according to the needs, thereby effectively improving the utilization rate of image information, the reliability of the system for target detection and recognition, and the automation degree of the system. Its purpose is to integrate the multi-band information of a single sensor or the information provided by different types of sensors, to eliminate the possible redundancy and contradiction between the multi-sensor information, to enhance the transparency of the information in the image, and to improve the accuracy and reliability of interpretation. and usage rates to form a clear, complete, and accurate information description of the target.

传统意义上将肝脏CT增强扫描分为动脉期、门脉期及延迟期。扫描时,检查者呈仰卧位并屏气不动,操作者按照一定的流速,将一定剂量的造影剂注射到患者体内,注药后一段时间先进行全肝动脉期扫描;再间隔一段时间后进行全肝门脉期扫描;最后再间隔一定的时间后对病灶区行延迟扫描。门脉期和延迟期持续时间相对较长,扫描时间的要求相对较宽松,动脉期持续时间短,峰值消失快,如果操作不当,很容易错过最佳扫描时间。Traditionally, enhanced liver CT scans are divided into arterial phase, portal venous phase and delayed phase. During the scan, the examiner is in a supine position and holds his breath. The operator injects a certain dose of contrast agent into the patient at a certain flow rate. After the injection, the whole hepatic arterial phase scan is performed first; The whole hepatic portal venous phase was scanned; finally, the lesion area was scanned after a certain interval. The portal venous phase and the delayed phase last for a relatively long time, and the requirements for the scanning time are relatively loose. The duration of the arterial phase is short, and the peak disappears quickly.

不同相期的图像是造影剂在流经肝脏内部不同的血管时CT扫描所捕获的图像,具有不同的特点。动脉期图像是造影剂流经肝脏动脉时获取的图像,因此动脉期图像中肝动脉呈现高亮度显示,容易从图像中区分出来,而肝脏内部的其余管道,如肝静脉、门静脉等管道中不存在造影剂,因此这些管道与肝实质在CT数值上较为接近,不易从图像中区分出来。同理,门脉期图像中,容易将肝静脉、门静脉管道从图像中区分出来。Images in different phases are images captured by CT scans when the contrast agent flows through different blood vessels inside the liver, and have different characteristics. The arterial phase image is the image obtained when the contrast agent flows through the hepatic artery. Therefore, the hepatic artery in the arterial phase image is displayed with high brightness and can be easily distinguished from the image. Contrast agent is present, so these ducts are numerically close to the liver parenchyma and cannot be easily distinguished from the image. Similarly, in the portal venous phase image, it is easy to distinguish the hepatic vein and the portal vein from the image.

在肝病的诊断中,往往需要将同一位置的几幅多期图像进行分析,需要同时观察到同一位置肝内不同的管道结构,给诊断提供依据。然而,由于CT扫描时其起始位置未必完全一致,以及患者在扫描过程中可能存在呼吸运动或其他轻微的身体位置的移动,肝脏不同相期的扫描图像序列,它们在空间上的位置关系并不是一一对应的,不同相期间的图像并不是完全对齐的。例如动脉期的第5张图像未必就对应着静脉期的第5张图像,它们可能表示肝脏的不同位置。目前,医生只能根据主观经验来选择、匹配同一位置的不同图像,这就给诊断分析带来了困难和不便。因此在对肝脏CT多相期图像融合之前,首先需要将这些图像进行对齐,即需要对肝脏CT多相期图像进行图像配准。配准结果的好坏直接影响图像融合的质量,进而甚至可能对医生的诊断带来影响。In the diagnosis of liver disease, it is often necessary to analyze several multi-phase images at the same location, and to observe different duct structures in the liver at the same location at the same time to provide a basis for diagnosis. However, since the starting position of the CT scan may not be exactly the same, and the patient may have breathing motion or other slight body position movement during the scanning process, the scanning image sequences of different phases of the liver, their spatial positional relationship is not the same. There is not a one-to-one correspondence, and the images during different phases are not perfectly aligned. For example, the fifth image in the arterial phase does not necessarily correspond to the fifth image in the venous phase, they may represent different locations of the liver. At present, doctors can only select and match different images of the same location based on subjective experience, which brings difficulties and inconvenience to diagnostic analysis. Therefore, before fusion of liver CT multiphase images, these images need to be aligned first, that is, image registration of liver CT multiphase images is required. The quality of the registration results directly affects the quality of image fusion, which may even affect the doctor's diagnosis.

如中国专利申请公开第104835112B号揭示的一种肝脏多相期CT图像融合方法,首先利用基于联合直方图的多分辨率CT图像配准方法对源图像序列进行粗配准,接着结合置信连接的区域生长算法实现了肝脏的图像自动分割和基于梯度向量流snake模型的肝脏图像分割,有效的提取肝脏的边缘信息;再对肝脏图像进行基于定向区域生长算法的血管提取,接着对肝实质图像进行基于B样条自由形变变换和基于空间加权互信息的肝脏非刚性配准,精确找到空间同一位置的图像对;最后基于小波变换进行图像融合。然而该专利申请公开的肝脏多相期CT图像融合方法采用小波变换融合CT图像,得到的融合图像的细节破坏比较严重。For example, Chinese Patent Application Publication No. 104835112B discloses a liver multiphase CT image fusion method. First, the multi-resolution CT image registration method based on joint histogram is used to perform rough registration on the source image sequence, and then combined with the confidence connection The region growing algorithm realizes the automatic segmentation of the liver image and the liver image segmentation based on the gradient vector flow snake model, and effectively extracts the edge information of the liver; then the liver image is extracted based on the directional region growing algorithm, and then the liver parenchyma image is processed. Based on B-spline free deformation transformation and liver non-rigid registration based on spatially weighted mutual information, the image pairs in the same spatial position can be accurately found. Finally, image fusion is performed based on wavelet transform. However, the CT image fusion method in the multiphase phase of the liver disclosed in this patent application uses wavelet transform to fuse CT images, and the details of the obtained fused images are severely damaged.

又如中国专利申请公开第101987019A号揭示的一种基于小波变换的PET图像和CT图像异机融合方法,包括步骤:将病人固定在一个定位框架内;根据该框架采集PET图像;同时利用该定位框架采集CT图像;对PET/CT图像分别进行提取处理;将步处理后的PET/CT图像根据定位框架中得到的定位点进行配准;对配准后的PET/CT图像进行小波分解、变分求解融合;最后对融合后的PET/CT图像进行小波反变换生成融合图像。然而该专利申请公开的图像融合方法主要用于PET图像和CT图像间的融合,无法处理处于不同相期的CT图像。Another example is a method for heterogeneous fusion of PET images and CT images based on wavelet transform disclosed in Chinese Patent Application Publication No. 101987019A, comprising the steps of: fixing the patient in a positioning frame; collecting PET images according to the frame; The frame collects CT images; the PET/CT images are extracted and processed separately; the PET/CT images after step processing are registered according to the positioning points obtained in the positioning frame; the registered PET/CT images are subjected to wavelet decomposition and transformation. Finally, the fused PET/CT image is subjected to wavelet inverse transformation to generate a fusion image. However, the image fusion method disclosed in this patent application is mainly used for fusion between PET images and CT images, and cannot process CT images in different phases.

因此,提供一种能够先对肝脏CT多相期图像进行图像配准后再进行融合,可快速地获得清晰、准确、全面的肝脏图像的肝脏医学图像配准与融合方法及系统成为业内急需解决的问题。Therefore, to provide a liver medical image registration and fusion method and system that can first perform image registration on liver CT multiphase images and then perform fusion, which can quickly obtain clear, accurate and comprehensive liver images, has become an urgent solution in the industry. The problem.

发明内容SUMMARY OF THE INVENTION

本发明的目的是提供一种肝脏医学图像配准与融合方法及系统,能够将处于不同相期的同一位置的肝脏CT图像进行配准后再进行快速融合,获得清晰、准确、全面的肝脏图像,为后续的诊断提供帮助。The purpose of the present invention is to provide a liver medical image registration and fusion method and system, which can register the liver CT images at the same position in different phases and then perform rapid fusion to obtain a clear, accurate and comprehensive liver image. , to help with subsequent diagnosis.

为了实现上述目的,本发明的第一个目的在于提供一种肝脏医学图像配准与融合方法,其包括如下步骤:(1)、获得对于同一个肝脏的动脉期肝脏CT图像序列图组及静脉期肝脏CT图像序列图组,动脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少十幅动脉期肝脏CT图像,静脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少三十幅静脉期肝脏CT图像;(2)、依次对至少十幅动脉期肝脏CT图像及至少三十幅静脉期肝脏CT图像进行预处理;(3)、对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像,依次利用基于联合直方图的多分辨率CT图像配准方法进行配准,在静脉期肝脏CT图像序列图组中找到与其取自相同截面的静脉期肝脏CT图像,获取与至少十幅动脉期肝脏CT图像配准的至少十幅静脉期肝脏CT图像;(4)、依次对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像及与其配准的一幅静脉期肝脏CT图像进行基于图形处理器硬件加速的频域非下采样轮廓波变换实现图像融合,获取至少十幅肝脏CT融合图像;以及(5)对至少十幅肝脏CT融合图像进行序列三维重建,得到肝脏三维融合CT图像。In order to achieve the above object, the first object of the present invention is to provide a liver medical image registration and fusion method, which includes the following steps: (1) Obtaining an arterial phase liver CT image sequence map group and veins for the same liver The liver CT image sequence map group in the arterial phase, the arterial phase liver CT image sequence map group includes at least ten arterial phase liver CT images taken from different sections of the same liver, and the venous phase liver CT image sequence map group includes the same liver. At least thirty venous phase liver CT images obtained from different sections; (2), sequentially preprocessing at least ten arterial phase liver CT images and at least thirty venous phase liver CT images; (3), arterial phase liver CT images Each arterial phase liver CT image in the liver CT image sequence map group is registered by the multi-resolution CT image registration method based on joint histogram in turn, and found in the venous phase liver CT image sequence map group. Obtaining at least ten venous phase liver CT images registered with at least ten arterial phase liver CT images of the venous phase liver CT images of the same cross-section; (4), sequentially analyzing each image in the arterial phase liver CT image sequence map group Perform image fusion on an arterial phase liver CT image and a registered venous phase liver CT image through frequency-domain non-subsampling contourlet transform based on graphics processor hardware acceleration, and obtain at least ten liver CT fusion images; and (5) Sequence three-dimensional reconstruction is performed on at least ten liver CT fusion images to obtain liver three-dimensional fusion CT images.

可选择地,步骤(2)依次包括:对肝脏CT图像序列组中的每幅肝脏CT图像依次进行去噪声处理步骤、对比度增强处理步骤、以及靶点区域分隔处理步骤。Optionally, step (2) sequentially includes: sequentially performing denoising processing, contrast enhancement processing, and target area separation processing on each liver CT image in the liver CT image sequence group.

优选地,本发明的去噪声处理步骤采用高斯平滑滤波去噪,通过邻域运算对图像细微的不连续像素加以平滑填充,以减少轮廓提取时的漏点现象,改善图像质量。Preferably, in the denoising processing step of the present invention, Gaussian smoothing filtering is used for denoising, and the subtle discontinuous pixels of the image are filled smoothly through the neighborhood operation, so as to reduce the leakage phenomenon during contour extraction and improve the image quality.

优选地,本发明的对比度增强处理步骤可采用灰度变换增强或空域滤波增强,其中,灰度变换增强可以为直接灰度变换增强或直方图修正变换增强,空域滤波增强可以为平滑滤波增强或锐化滤波增强。Preferably, the contrast enhancement processing step of the present invention may adopt grayscale transformation enhancement or spatial filtering enhancement, wherein the grayscale transformation enhancement may be direct grayscale transformation enhancement or histogram correction transformation enhancement, and the spatial filtering enhancement may be smooth filtering enhancement or Sharpening filter enhancement.

可选择地,步骤(3)包括:(3-1)确定动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像作为待配准的动脉期肝脏CT图像,选择静脉期肝脏CT图像序列图组中的一幅静脉期肝脏CT图像作为待配准的静脉期肝脏CT图像,对待配准的动脉期肝脏CT图像及静脉期肝脏CT图像分别进行多分辨率处理,构成含有三层的动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔,其中,动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的顶层图像分辨率最小,最底层为原始图像;(3-2)对动脉期肝脏CT图像金字塔的顶层图像的指定区域进行几何坐标刚体变换得到新区域;(3-3)通过三次B样条插值方法得到静脉期肝脏CT图像金字塔的顶层图像在步骤(3-2)获取的新区域的坐标;(3-4)利用基于联合直方图的相似性测度计算动脉期肝脏CT图像金字塔的顶层图像与插值图之间的相似度,得到相似度函数;(3-5)将步骤(3-4)得到的相似度函数输入至粒子群算法优化算法中进行最优化计算得到最优变换参数,重复步骤(3-2)~(3-4),直到取得最大值;(3-6)将最优变换参数作为鲍威尔算法搜索的起始点,分别对动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的最后两层图像进行处理,重复步骤(3-2)~(3-5);以及(3-7)输出静脉期肝脏CT图像在最终变换下的配准图像;经配准,获取与至少十幅动脉期肝脏CT图像配准的至少十幅静脉期肝脏CT图像。Optionally, step (3) includes: (3-1) determining an arterial phase liver CT image in the arterial phase liver CT image sequence map group as the arterial phase liver CT image to be registered, and selecting a venous phase liver CT image A venous phase liver CT image in the sequence map group is used as the venous phase liver CT image to be registered. The arterial phase liver CT image pyramid and the venous phase liver CT image pyramid, of which the top image resolution of the arterial phase liver CT image pyramid and the venous phase liver CT image pyramid is the smallest, and the bottom layer is the original image; (3-2) For the arterial phase liver CT image pyramid The specified area of the top image of the liver CT image pyramid is subjected to geometric coordinate rigid body transformation to obtain a new area; (3-3) The top image of the liver CT image pyramid in the venous phase is obtained by the cubic B-spline interpolation method. The top image obtained in step (3-2) The coordinates of the new area; (3-4) Calculate the similarity between the top-level image of the arterial phase liver CT image pyramid and the interpolation map using the similarity measure based on the joint histogram, and obtain the similarity function; (3-5) Step (3-4) The obtained similarity function is input into the particle swarm optimization algorithm for optimization calculation to obtain the optimal transformation parameters, and steps (3-2) to (3-4) are repeated until the maximum value is obtained; (3- 6) Take the optimal transformation parameter as the starting point of Powell's algorithm search, and process the last two images of the liver CT image pyramid in the arterial phase and the last two layers of the liver CT image pyramid in the venous phase respectively, and repeat steps (3-2) to (3-5). ); and (3-7) output the registration images of the venous phase liver CT images under the final transformation; after registration, obtain at least ten venous phase liver CT images registered with at least ten arterial phase liver CT images.

其中,步骤(3-4)对两幅图像的联合直方图的定义为:两幅图像中对应像素灰度值的统计概率分布,对于离散图像,其概率密度为:Among them, the joint histogram of the two images in step (3-4) is defined as: the statistical probability distribution of the gray value of the corresponding pixels in the two images. For discrete images, the probability density is:

P(m,n)=N(m,n)/MP(m,n)=N(m,n)/M

其中,M为一幅图像所包含的像素总数;N(m,n)为两幅图像中对应像素灰度值分别为m和n的像素总数,以一幅图像的灰度值为横坐标,另一幅图像的灰度值为纵坐标,画出的概率分布图称为联合直方图。Among them, M is the total number of pixels contained in an image; N(m, n) is the total number of pixels whose gray values are m and n respectively in the two images, and the gray value of one image is the abscissa, The gray value of the other image is the ordinate, and the drawn probability distribution map is called the joint histogram.

基于联合直方图的配准相似性测度如下:The joint histogram-based registration similarity measure is as follows:

Figure BDA0003607076520000051
Figure BDA0003607076520000051

其中阈值h取图像中像素取值范围的10%能获得较好的效果。The threshold h takes 10% of the pixel value range in the image to obtain better results.

在实现时,计算阈值区域内的点的个数,在求解

Figure BDA0003607076520000052
时,就能够计算相似函数中
Figure BDA0003607076520000053
的值。During implementation, the number of points in the threshold region is calculated, and the solution is
Figure BDA0003607076520000052
, it is possible to calculate the similarity function in
Figure BDA0003607076520000053
value of .

进一步的,所述步骤(3-5)中,设定一个搜索问题,规模为R的粒子群在D维空间优化,粒子i(1≤i≤R)在第n(1≤n≤Nmax)代的速度表示为Vi(n)=(vi1,vi2,…,viD),位置表示为Xi(n)=(xi1,xi2,…,xiD);为了保持每个粒子的速度惯性,引入了惯性常数ω这个量;ω值较小时,能使得粒子最终收敛到最佳位置;ω值较大时,能使得粒子在全局范围内搜索能力提高;改进的粒子速度更新公式如下所示:Further, in the step (3-5), a search problem is set, the particle swarm of scale R is optimized in the D-dimensional space, and the particle i (1≤i≤R) is in the nth (1≤n≤Nmax) The velocity of generation is represented as Vi(n)=(vi1,vi2,…,viD), and the position is represented as Xi(n)=(xi1,xi2,…,xiD); in order to maintain the velocity inertia of each particle, inertia is introduced The constant ω is the quantity; when the value of ω is small, the particle can finally converge to the optimal position; when the value of ω is large, the search ability of the particle in the global scope can be improved; the improved particle velocity update formula is as follows:

vij(n)=ωvij(n-1)+α1β1[pij-xij(n-1)]+α2β2[puj-xij(n-1)]v ij (n)=ωv ij (n-1)+α 1 β 1 [p ij -x ij (n-1)]+α 2 β 2 [p uj -x ij (n-1)]

其中n为迭代次数,α1、α2为加速常数,β1、β2的取值为[0,1]范围内的随机数。pij为粒子i的历史最佳位置在j维上的值,而puj为某一局部区域内所有粒子的历史最佳位置在j维上的值。若该区域所包含的粒子为整个群体,则pu代表的是整个粒子群最佳历史位置,否则pu代表局部的最佳位置。当算法迭代次数达到最大值时或者当粒子搜索的最佳历史位置低于设定的阈值以及在参数空间中粒子之间的距离接近设定的阈值时,算法将终止迭代。Among them, n is the number of iterations, α 1 and α 2 are acceleration constants, and the values of β 1 and β 2 are random numbers in the range of [0, 1]. p ij is the value of the historical best position of particle i in the j dimension, and p uj is the value of the historical best position of all particles in a certain local area in the j dimension. If the particles contained in this area are the entire swarm, then p u represents the best historical position of the entire particle swarm, otherwise p u represents the local best position. The algorithm will terminate the iteration when the number of algorithm iterations reaches the maximum value or when the best historical position of the particle search is lower than the set threshold and the distance between particles in the parameter space is close to the set threshold.

可选择地,步骤(4)包括:(4-1)选择动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像及与其处于同一截面的静脉期肝脏CT图像;(4-2)对选择的动脉期肝脏CT图像及静脉期肝脏CT图像进行FFT,即快速傅里叶变换,得到图像频域信号,对图像频域信号分别进行频域非下采样轮廓波分解变换,得到变换结果;(4-3)对变换结果进行IFFT,即逆快速傅里叶变换,分别对低频部分CL和高频部分CH采取相应的变换,得到低频融合图像

Figure BDA0003607076520000063
和高频融合图像
Figure BDA0003607076520000064
(4-4)对融合结果进行FFT,即快速傅里叶变换,对整个过程进行频域非下采样轮廓波重建变换,得到该截面的肝脏CT融合图像结果;以及(4-5)依次选择动脉期肝脏CT图像序列图组中的其他的一幅动脉期肝脏CT图像及与其处于同一截面的静脉期肝脏CT图像,重复步骤(4-2)~(4-4),直至获取至少十幅肝脏CT融合图像。Optionally, step (4) includes: (4-1) selecting an arterial phase liver CT image and a venous phase liver CT image in the same section of the arterial phase liver CT image sequence image group; (4-2) Perform FFT on the selected arterial phase liver CT images and venous phase liver CT images, that is, fast Fourier transform, to obtain image frequency domain signals, and perform frequency domain non-subsampling contourlet decomposition transformation on the image frequency domain signals to obtain the transformation results. (4-3) IFFT is performed on the transformation result, that is, inverse fast Fourier transform, and corresponding transformation is taken to the low-frequency part CL and the high-frequency part CH respectively, and the low-frequency fusion image is obtained.
Figure BDA0003607076520000063
and high-frequency fusion images
Figure BDA0003607076520000064
(4-4) Perform FFT on the fusion result, that is, fast Fourier transform, perform frequency domain non-subsampling contourlet reconstruction transformation on the whole process, and obtain the result of the liver CT fusion image of the section; and (4-5) Select in turn For another arterial phase liver CT image and the venous phase liver CT image in the same section of the arterial phase liver CT image sequence image group, repeat steps (4-2) to (4-4) until at least ten images are acquired Liver CT fusion images.

其中,步骤(4)的频域非下采样轮廓波变换能够分解出不同频率下的图像信息,可以分为高频和低频两个部分,其中高频部分是经过方向滤波器变换得到的各频率、各方向信号,而低频部分则是经过第一次金字塔分解生成的低频信号,由于之前的分解均是在频域中进行,因此这时需要对分解得到的图像进行依次IFFT变换(逆快速傅里叶变换),将频域的结果转换到时域上来,才能进行接下来的操作。Among them, the non-subsampling contourlet transform in the frequency domain in step (4) can decompose the image information at different frequencies, which can be divided into two parts: high frequency and low frequency, wherein the high frequency part is the frequency obtained by the directional filter transformation , signals in each direction, and the low-frequency part is the low-frequency signal generated by the first pyramid decomposition. Since the previous decomposition was carried out in the frequency domain, it is necessary to perform sequential IFFT transformation on the decomposed image (inverse fast Fourier transform) Lie transform), convert the result in the frequency domain to the time domain, and then proceed to the next operation.

1)低频融合规则1) Low frequency fusion rules

为了方便表示,设两幅待融合源图像分别为C1(x,y)和C2(x,y)

Figure BDA0003607076520000061
表示低频融合后的图像结果,由于在图像融合之前,两幅图像已经经过了诸如去噪、配准、灰度矫正等处理,因此可以直接在低频部分对两幅图像进行操作。For convenience of representation, let the two source images to be fused are C 1(x,y) and C 2(x,y) respectively,
Figure BDA0003607076520000061
Represents the image result after low-frequency fusion. Since the two images have undergone processing such as denoising, registration, and grayscale correction before image fusion, the two images can be directly manipulated in the low-frequency part.

因为经过多尺度分解,图像的低频信息主要决定了它的大致轮廓,而高频信息则是决定融合结果清晰度的关键,因此两幅图像经多尺度分解后的低频系数之间的差异远远小于高频系数之间的差异,故小波低频系数的融合可以表示为:Because after multi-scale decomposition, the low-frequency information of the image mainly determines its general outline, and the high-frequency information is the key to determine the clarity of the fusion result. Therefore, the difference between the low-frequency coefficients of the two images after multi-scale decomposition is far is smaller than the difference between high frequency coefficients, so the fusion of wavelet low frequency coefficients can be expressed as:

Figure BDA0003607076520000062
Figure BDA0003607076520000062

式中,上标L即代表了图像为低频(Low Frequency)信号,α和β作为低频融合系数,在本发明中,α=β=0.5。In the formula, the superscript L represents that the image is a low frequency (Low Frequency) signal, and α and β are used as low frequency fusion coefficients. In the present invention, α=β=0.5.

2)高频融合规则2) High frequency fusion rules

高频部分可以反应图像细节。在图像的边缘,期再高频部分的分解结果数值较大,而非边缘部分则较低。因此,为了尽可能保持两幅图像的边缘特征,本发明采取基于区域能量的高频图像融合方式,即分别计算比较不同方向滤波结果产生的图像进行3×3或者5×5区域采样的像素能量大小E,通过设定合适的阈值,由下面的公式确定:High frequency parts can reflect image details. At the edge of the image, the decomposition result of the high-frequency part of the period is larger, and the non-edge part is lower. Therefore, in order to keep the edge features of the two images as much as possible, the present invention adopts a high-frequency image fusion method based on regional energy, that is, the pixel energy of the images generated by comparing the filtering results in different directions for sampling 3×3 or 5×5 regions is calculated respectively. The size E, by setting an appropriate threshold, is determined by the following formula:

Figure BDA0003607076520000071
Figure BDA0003607076520000071

Figure BDA0003607076520000072
Figure BDA0003607076520000072

式中,上标H表示图像为高频信号,能量符合度函数为:In the formula, the superscript H indicates that the image is a high-frequency signal, and the energy conformity function is:

Figure BDA0003607076520000073
Figure BDA0003607076520000073

这里的R(x,y)范围在0和1之间。并且,T是能量符合度的阈值,且ω12=1。按照上式规则进行运算,生成的融合图像的边缘信息得到很好的保留,并且,通过阈值的选择,可以在一定程度上抑制图像所残存的高频噪声。Here R(x,y) ranges between 0 and 1. And, T is the threshold of the energy compliance, and ω 12 =1. According to the above formula, the edge information of the generated fused image is well preserved, and through the selection of the threshold, the residual high-frequency noise in the image can be suppressed to a certain extent.

可选择地,步骤(5)包括:(5-1)设定等值面的值,提取出至少十幅肝脏CT融合图像中肝脏的目标轮廓,计算肝脏轮廓的面积,寻找不同截面肝脏轮廓之间的顺序关系并匹配;(5-2)先读取至少十幅肝脏CT融合图像中的两幅肝脏CT融合图像中的肝脏轮廓,然后再每次读入一张相邻的肝脏CT融合图像的切片,每张切片上的像素点中相邻的四个和对应的下一张切片的四个像素点构成一个立方体,该立方体称为一个体素,然后从左到右、从前至后顺序依次处理一层中的全部相邻立方体,判别边界体素,抽取等值面,然后处理完一层后以相同的方式再继续读入下一张相邻的肝脏CT融合图像的切片,直至处理完所有的切片后提取等值面,算法结束,得到肝脏三维融合CT图像。Optionally, step (5) includes: (5-1) setting the value of the isosurface, extracting the target contour of the liver in at least ten liver CT fusion images, calculating the area of the liver contour, and finding the difference between the liver contours of different sections. (5-2) First read the liver contours in two liver CT fusion images of at least ten liver CT fusion images, and then read a slice of adjacent liver CT fusion images each time , the adjacent four of the pixels on each slice and the four pixels of the corresponding next slice form a cube, which is called a voxel, and then processed sequentially from left to right and front to back All adjacent cubes in one layer, identify boundary voxels, extract isosurfaces, and then continue to read the next adjacent slice of liver CT fusion image in the same way after processing one layer, until all slices are processed. After the isosurface is extracted, the algorithm ends, and the three-dimensional fusion CT image of the liver is obtained.

本发明的第二个目的在于提供一种肝脏医学图像配准与融合系统,其包括:图像采集装置,其用于获得对于同一个肝脏的动脉期肝脏CT图像序列图组及静脉期肝脏CT图像序列图组,动脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少十幅动脉期肝脏CT图像,静脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少三十幅静脉期肝脏CT图像;图像预处理装置,其与图像采集装置通信连接,用于依次对至少十幅动脉期肝脏CT图像及至少三十幅静脉期肝脏CT图像进行预处理;图像配准装置,其与预处理装置通信连接,用于对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像,依次利用基于联合直方图的多分辨率CT图像配准方法进行配准,在静脉期肝脏CT图像序列图组中找到与其取自相同截面的静脉期肝脏CT图像,获取与至少十幅动脉期肝脏CT图像配准的至少十幅静脉期肝脏CT图像;图像融合装置,其与图像配准装置通信连接,用于依次对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像及与其配准的一幅静脉期肝脏CT图像进行基于图形处理器硬件加速的频域非下采样轮廓波变换实现图像融合,获取至少十幅肝脏CT融合图像;以及三维重建装置,其与图像融合装置通信连接,用于对至少十幅肝脏CT融合图像进行序列三维重建,得到肝脏三维融合CT图像。The second object of the present invention is to provide a liver medical image registration and fusion system, which includes: an image acquisition device for obtaining an arterial phase liver CT image sequence map group and a venous phase liver CT image for the same liver Sequence diagram group, the arterial phase liver CT image sequence diagram group includes at least ten arterial phase liver CT images taken from different sections of the same liver, and the venous phase liver CT image sequence diagram group includes the same liver taken from different sections at least thirty venous phase liver CT images; an image preprocessing device, which is connected in communication with the image acquisition device, and is used to sequentially preprocess at least ten arterial phase liver CT images and at least thirty venous phase liver CT images; An image registration device, which is connected in communication with the preprocessing device, is used for sequentially using a multi-resolution CT image registration method based on joint histogram for each arterial phase liver CT image in the arterial phase liver CT image sequence map group Perform registration, find the venous phase liver CT images from the same section in the venous phase liver CT image sequence map group, and obtain at least ten venous phase liver CT images registered with at least ten arterial phase liver CT images; image The fusion device is connected in communication with the image registration device, and is used for sequentially performing graphics-based processing on each arterial phase liver CT image in the arterial phase liver CT image sequence map group and a venous phase liver CT image registered therewith hardware-accelerated frequency-domain non-subsampling contourlet transform to achieve image fusion to obtain at least ten liver CT fusion images; and a three-dimensional reconstruction device, which is connected in communication with the image fusion device and used to sequence at least ten liver CT fusion images 3D reconstruction to obtain a 3D fusion CT image of the liver.

其中,图像采集装置设置于每个通过互联网以特定注册用户帐号登入肝脏医学图像配准与融合系统的用户终端上,图像采集装置包括用于登入用户上传肝脏CT图像数据及其特定肝脏来源信息的上传单元、以及与肝脏数据库通信连接的以将肝脏来源信息及来自三维重建装置的肝脏三维图像共同存储于肝脏数据库的下载单元。The image acquisition device is installed on each user terminal that logs in to the liver medical image registration and fusion system with a specific registered user account through the Internet. The image acquisition device includes a log-in user to upload liver CT image data and its specific liver source information. An uploading unit, and a downloading unit connected in communication with the liver database to store the liver source information and the three-dimensional image of the liver from the three-dimensional reconstruction device together in the liver database.

优选地,肝脏的来源信息至少包含:患病类型、患者性别、患者年龄、生活地区以及就诊医院。Preferably, the source information of the liver at least includes: the type of disease, the gender of the patient, the age of the patient, the living area and the hospital for treatment.

更优选地,肝脏的来源信息还可以包含:患者生活习惯、生化检查信息、患者典型症状、体征、医学图像、影像诊断结果、治疗方案、不良反应及主治医师等。More preferably, the source information of the liver may also include: the patient's living habits, biochemical examination information, the patient's typical symptoms, signs, medical images, imaging diagnosis results, treatment plans, adverse reactions, and attending physicians.

可选择地,图像预处理装置包括:依次通信连接的用于对肝脏CT图像序列组中的每幅肝脏CT图像进行去噪声处理的去噪单元、进行对比度增强处理的增强单元、以及进行靶点区域分隔处理的分隔单元。Optionally, the image preprocessing device includes: a denoising unit for performing denoising processing on each liver CT image in the liver CT image sequence group, an enhancement unit for performing contrast enhancement processing, and a target point, which are sequentially connected in communication Separation unit for zone separation processing.

可选择地,图像配准装置包括:分辨处理单元,其用于确定动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像作为待配准的动脉期肝脏CT图像,选择静脉期肝脏CT图像序列图组中的一幅静脉期肝脏CT图像作为待配准的静脉期肝脏CT图像,对待配准的动脉期肝脏CT图像及静脉期肝脏CT图像分别进行多分辨率处理,构成含有三层的动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔,其中,动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的顶层图像分辨率最小,最底层为原始图像;刚体变换单元,其与分辨处理单元通信连接,用于对动脉期肝脏CT图像金字塔的顶层图像的指定区域进行几何坐标刚体变换得到新区域;坐标获取单元,其与刚体变换单元通信连接,用于通过三次B样条插值方法得到静脉期肝脏CT图像金字塔的顶层图像在刚体变换单元获取的新区域的坐标;函数获取单元,其与坐标获取单元通信连接,用于利用基于联合直方图的相似性测度计算动脉期肝脏CT图像金字塔的顶层图像与插值图之间的相似度,得到相似度函数;参数获取单元,其与函数获取单元通信连接,用于将函数获取单元得到的相似度函数输入至粒子群算法优化算法中进行最优化计算得到最优变换参数,并再启动刚体变换单元、坐标获取单元、以及函数获取单元,直到取得最大值;再处理单元,其与参数获取单元通信连接,用于将最优变换参数作为鲍威尔算法搜索的起始点,分别对动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的最后两层图像进行处理,并再启动刚体变换单元、坐标获取单元、函数获取单元、以及参数获取单元;以及图像输出单元,其与再处理单元通信连接,用于输出静脉期肝脏CT图像在最终变换下的配准图像。Optionally, the image registration device includes: a resolution processing unit, which is configured to determine an arterial phase liver CT image in the arterial phase liver CT image sequence map group as the arterial phase liver CT image to be registered, and select the venous phase liver CT image. A venous phase liver CT image in the CT image sequence map group is used as the venous phase liver CT image to be registered, and the arterial phase liver CT image and the venous phase liver CT image to be registered are respectively subjected to multi-resolution processing. The arterial phase liver CT image pyramid and the venous phase liver CT image pyramid, in which the top image resolution of the arterial phase liver CT image pyramid and the venous phase liver CT image pyramid is the smallest, and the bottom layer is the original image; the rigid body transformation unit, which is the same as The resolution processing unit is communicatively connected, and is used for performing geometric coordinate rigid body transformation on the designated area of the top-level image of the liver CT image pyramid in the arterial phase to obtain a new area; the coordinate acquiring unit is communicatively connected with the rigid body transformation unit, and is used for interpolation through cubic B-splines The method obtains the coordinates of the top image of the venous phase liver CT image pyramid in the new area acquired by the rigid body transformation unit; the function acquisition unit, which is connected in communication with the coordinate acquisition unit, is used to calculate the arterial phase liver CT using the similarity measure based on the joint histogram. The similarity between the top-level image of the image pyramid and the interpolation map is used to obtain the similarity function; the parameter acquisition unit is connected in communication with the function acquisition unit, and is used to input the similarity function obtained by the function acquisition unit into the particle swarm optimization algorithm. Carry out the optimization calculation to obtain the optimal transformation parameters, and then start the rigid body transformation unit, the coordinate acquisition unit, and the function acquisition unit until the maximum value is obtained; the reprocessing unit, which is connected in communication with the parameter acquisition unit, is used to convert the optimal transformation parameters. As the starting point of Powell's algorithm search, the last two images of the liver CT image pyramid in the arterial phase and the last two layers of the liver CT image pyramid in the venous phase are processed, and the rigid body transformation unit, coordinate acquisition unit, function acquisition unit, and parameter acquisition unit are activated again. ; and an image output unit, which is connected in communication with the reprocessing unit and is used for outputting a registered image of the venous phase liver CT image under the final transformation.

可选择地,图像融合装置包括:图像选择单元,其用于选择动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像及与其处于同一截面的静脉期肝脏CT图像;图像频域单元,其与图像选择单元通信连接,用于对选择的动脉期肝脏CT图像及静脉期肝脏CT图像进行快速傅里叶变换,得到图像频域信号,对图像频域信号分别进行频域非下采样轮廓波分解变换,得到变换结果;频域融合单元,其与图像频域单元通信连接,用于对变换结果进行逆快速傅里叶变换,分别对低频部分CL和高频部分CH采取相应的变换,得到低频融合图像

Figure BDA0003607076520000091
和高频融合图像
Figure BDA0003607076520000092
重建变换单元,其与频域融合单元通信连接,用于对低频融合图像
Figure BDA0003607076520000093
和高频融合图像
Figure BDA0003607076520000094
进行快速傅里叶变换,对整个过程进行频域非下采样轮廓波重建变换,得到该截面的肝脏CT融合图像结果。Optionally, the image fusion device includes: an image selection unit for selecting an arterial phase liver CT image and a venous phase liver CT image in the same section of the arterial phase liver CT image sequence image group; an image frequency domain unit , which is connected in communication with the image selection unit, and is used to perform fast Fourier transform on the selected arterial phase liver CT images and venous phase liver CT images to obtain image frequency domain signals, and perform frequency domain non-subsampling on the image frequency domain signals respectively. The contourlet is decomposed and transformed to obtain the transformation result; the frequency domain fusion unit, which is connected in communication with the image frequency domain unit, is used to perform inverse fast Fourier transform on the transformation result, and take corresponding steps for the low-frequency part CL and the high-frequency part CH respectively. transformation to obtain a low-frequency fusion image
Figure BDA0003607076520000091
and high-frequency fusion images
Figure BDA0003607076520000092
The reconstruction transform unit, which is connected in communication with the frequency domain fusion unit, is used to fuse the low-frequency image
Figure BDA0003607076520000093
and high-frequency fusion images
Figure BDA0003607076520000094
Fast Fourier transform is performed, and the whole process is reconstructed by non-subsampling contourlet in frequency domain, and the result of liver CT fusion image of this section is obtained.

可选择地,三维重建装置包括:轮廓匹配单元,其用于设定等值面的值,提取出至少十幅肝脏CT融合图像中肝脏的目标轮廓,计算肝脏轮廓的面积,寻找不同截面肝脏轮廓之间的顺序关系并匹配;MC重建单元,其与轮廓匹配单元通信连接,用于先读取至少十幅肝脏CT融合图像中的两幅肝脏CT融合图像中的肝脏轮廓,然后再每次读入一张相邻的肝脏CT融合图像的切片,每张切片上的像素点中相邻的四个和对应的下一张切片的四个像素点构成一个立方体,该立方体称为一个体素,然后从左到右、从前至后顺序依次处理一层中的全部相邻立方体,判别边界体素,抽取等值面,然后处理完一层后以相同的方式再继续读入下一张相邻的肝脏CT融合图像的切片,直至处理完所有的切片后提取等值面,算法结束,得到肝脏三维融合CT图像。Optionally, the three-dimensional reconstruction device includes: a contour matching unit, which is used to set the value of the isosurface, extract the target contour of the liver in at least ten liver CT fusion images, calculate the area of the liver contour, and find the liver contours of different sections. The sequence relationship and matching between them; the MC reconstruction unit, which is connected in communication with the contour matching unit, is used to first read the liver contours in the two liver CT fusion images in the at least ten liver CT fusion images, and then read the liver contours each time. Into a slice of adjacent liver CT fusion images, the adjacent four pixels on each slice and the corresponding four pixels of the next slice form a cube, which is called a voxel, and then from the Process all adjacent cubes in one layer sequentially from left to right and from front to back, identify boundary voxels, extract isosurfaces, and then continue to read the next adjacent liver CT fusion after processing one layer in the same way The slice of the image, until all slices are processed, the isosurface is extracted, the algorithm ends, and the three-dimensional fusion CT image of the liver is obtained.

其中,MC重建单元中根据MC算法抽取特定肝脏的肝脏CT图像的等值面实现特定肝脏的三维重建。MC重建单元采用MC算法时从每一个体素获取它内部的等值面如下:每一个体素具有八个顶点,这八个顶点的灰度值是可以直接根据输入切片的像素值获得的,要抽取的等值面的阈值也需要用户在计算之前事先给定。在这八个顶点中,我们将灰度值大于给定的阈值的顶点标记为黑色,而灰度值小于阈值的顶点不标记。Among them, the MC reconstruction unit extracts the isosurface of the liver CT image of the specific liver according to the MC algorithm to realize the three-dimensional reconstruction of the specific liver. When the MC reconstruction unit adopts the MC algorithm, it obtains its internal isosurface from each voxel as follows: each voxel has eight vertices, and the grayscale values of these eight vertices can be obtained directly from the pixel values of the input slice, The threshold of the isosurface to be extracted also needs to be given by the user before the calculation. Among these eight vertices, we mark the vertices whose gray value is greater than the given threshold as black, and the vertices whose gray value is less than the threshold are not marked.

显然在如果一个立方体中同时存在“已标记”和“未标记”的点,那么这个立方体内就必然存在等值面。除去全标记和全部标记的体素不包含等值面的情况,一个体素立方体中的8个顶点都可能有“标记”和“未标记”两种状态,如果不考虑等值点在立方体边上的位置,一个体素上等值面的分布情况总共的可能有256种。由于立方体旋转后不影响等值面的拓扑结构,所以可以将立方体中具有旋转对称性的情况去除。另外,所有的“未标记”和“已标记”可以进行互换,这样也不会改变等值面的拓扑结构。这样只需要15种基本立方体就可以表示全部256种可能的情况。将这15种情况构造出一个长度为256的索引表,这个索引表记录了一个体素内的等值面的256种可能的连接方式。在获得八个顶点的标记情况后,根据标记情况,得出一个0~15之间的索引值,然后根据该索引值直接对比索引表就可知道等值点在体素立方体的哪条边上,并且还可以从索引表中获得该体素中等值点的连接方式,这时候就可以将等值点连接起来形成等值面。Obviously, if there are both "marked" and "unmarked" points in a cube, then there must be isosurfaces in the cube. Except for the cases where all marked and all marked voxels do not contain isosurfaces, all 8 vertices in a voxel cube may have two states of "marked" and "unmarked". There are a total of 256 possible distributions of isosurfaces on a voxel. Since the rotation of the cube does not affect the topology of the isosurface, the situation with rotational symmetry in the cube can be removed. In addition, all "unmarked" and "marked" can be interchanged, which also does not change the topology of the isosurface. So only 15 basic cubes are needed to represent all 256 possible cases. The 15 cases are constructed into an index table with a length of 256, which records 256 possible connection methods of isosurfaces within a voxel. After obtaining the marking of the eight vertices, according to the marking, an index value between 0 and 15 is obtained, and then directly comparing the index table according to the index value can know which edge of the voxel cube the equivalent point is on. , and the connection method of the voxel's iso-value points can also be obtained from the index table. At this time, the iso-value points can be connected to form an iso-value surface.

可选择地,三维重建装置中进一步可以通过定义指定场景光照、视角以及焦点信息,绘制出肝脏三维融合CT图像实体。Optionally, the three-dimensional reconstruction device may further draw the liver three-dimensional fusion CT image entity by defining the illumination, viewing angle and focus information of the specified scene.

可选择地,作为原始二维图像信息的肝脏的处于两个相期的肝脏CT图像序列组与肝脏的三维图像一同保存于肝脏数据库中以便于用户研究分析。Optionally, two-phase liver CT image sequence groups of the liver as the original two-dimensional image information are stored in the liver database together with the three-dimensional images of the liver to facilitate user research and analysis.

此外,本发明在进行肝脏CT图像的多相融合过程中还可以选择其他可行的技术,例如HIS变换融合法、主分量分析融合法等图像融合法。In addition, the present invention can also select other feasible technologies in the process of multi-phase fusion of liver CT images, such as image fusion methods such as HIS transform fusion method and principal component analysis fusion method.

本发明的有益效果是:(1)、可匹配肝脏的同一位置的处于不同相期的CT图像,对其进行配准,有效提高了图像质量,利于诊断;(2)、图像融合过程中采用的频域非下采样轮廓波变换,不但具有多分辨率特性以及时频局部性,还具备更多的方向选择性和平移不变形,因此,本发明融合的肝脏CT图像中保留了更多的源图像再不同频率域的显著特征,融合图像更加清晰、完整;(3)、医生能够随时在肝脏数据库调取患者资料、查找所需数据以及影像资料,对于医生相关领域的的演示教学和职业成长有很大帮助。The beneficial effects of the present invention are as follows: (1), CT images in different phases at the same position of the liver can be matched and registered, which effectively improves the image quality and facilitates diagnosis; (2), in the process of image fusion, adopting The frequency-domain non-subsampling contourlet transform not only has multi-resolution characteristics and time-frequency locality, but also has more direction selectivity and translation without deformation. Therefore, the fused liver CT image of the present invention retains more The salient features of the source image and different frequency domains make the fusion image clearer and more complete; (3) Doctors can retrieve patient data, find the required data and image data from the liver database at any time, which is useful for demonstration teaching and occupation of doctors in related fields. Growth helps a lot.

附图说明Description of drawings

图1为本发明的肝脏医学图像配准与融合方法的步骤示意图。FIG. 1 is a schematic diagram of steps of the method for registration and fusion of liver medical images according to the present invention.

图2为本发明的肝脏医学图像配准与融合系统的构造示意图。FIG. 2 is a schematic structural diagram of the liver medical image registration and fusion system of the present invention.

图3为本发明的图像配准装置及图像融合装置的构造示意图。FIG. 3 is a schematic structural diagram of an image registration device and an image fusion device of the present invention.

具体实施方式Detailed ways

下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本发明,而不能理解为对本发明的限制。The following describes in detail the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present invention and should not be construed as limiting the present invention.

首先,请参照图1,作为一种非限制性实施方式,本发明的肝脏医学图像配准与融合方法,首先在步骤S1中,获得对于同一个肝脏的动脉期肝脏CT图像序列图组及静脉期肝脏CT图像序列图组,动脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少十幅动脉期肝脏CT图像,静脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少三十幅静脉期肝脏CT图像。接着,在步骤S2中,依次对至少十幅动脉期肝脏CT图像及至少三十幅静脉期肝脏CT图像进行预处理。随后,在步骤S3中,对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像,依次利用基于联合直方图的多分辨率CT图像配准方法进行配准,在静脉期肝脏CT图像序列图组中找到与其取自相同截面的静脉期肝脏CT图像,获取与至少十幅动脉期肝脏CT图像配准的至少十幅静脉期肝脏CT图像。然后,在步骤S4中,依次对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像及与其配准的一幅静脉期肝脏CT图像进行基于图形处理器硬件加速的频域非下采样轮廓波变换实现图像融合,获取至少十幅肝脏CT融合图像。最后,在步骤S5中,对至少十幅肝脏CT融合图像进行序列三维重建,得到肝脏三维融合CT图像。First, please refer to FIG. 1 , as a non-limiting embodiment, in the method for registration and fusion of liver medical images according to the present invention, firstly, in step S1 , a sequence map group of liver CT images and veins in the arterial phase of the same liver are obtained. The liver CT image sequence map group in the arterial phase, the arterial phase liver CT image sequence map group includes at least ten arterial phase liver CT images taken from different sections of the same liver, and the venous phase liver CT image sequence map group includes the same liver. At least thirty venous phase liver CT images were taken from different sections. Next, in step S2, at least ten liver CT images in the arterial phase and at least thirty liver CT images in the venous phase are sequentially preprocessed. Subsequently, in step S3, each arterial phase liver CT image in the arterial phase liver CT image sequence map group is sequentially registered using the multi-resolution CT image registration method based on the joint histogram. Find the venous phase liver CT images taken from the same section in the CT image sequence map group, and acquire at least ten venous phase liver CT images registered with at least ten arterial phase liver CT images. Then, in step S4 , perform frequency domain non-linear image processing based on graphics processor hardware acceleration for each arterial phase liver CT image in the arterial phase liver CT image sequence map group and a venous phase liver CT image registered with it in turn. Downsampling contourlet transform realizes image fusion, and obtains at least ten liver CT fusion images. Finally, in step S5, serial three-dimensional reconstruction is performed on at least ten liver CT fusion images to obtain liver three-dimensional fusion CT images.

在该非限制性实施方式中,步骤S2依次包括:对肝脏CT图像序列组中的每幅肝脏CT图像依次进行去噪声处理步骤、对比度增强处理步骤、以及靶点区域分隔处理步骤。In this non-limiting embodiment, step S2 sequentially includes: sequentially performing a denoising processing step, a contrast enhancement processing step, and a target area separation processing step on each liver CT image in the liver CT image sequence group.

作为一种非限制性实施方式,步骤S3具体包括:(3-1)确定动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像作为待配准的动脉期肝脏CT图像,选择静脉期肝脏CT图像序列图组中的一幅静脉期肝脏CT图像作为待配准的静脉期肝脏CT图像,对待配准的动脉期肝脏CT图像及静脉期肝脏CT图像分别进行多分辨率处理,构成含有三层的动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔,其中,动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的顶层图像分辨率最小,最底层为原始图像;(3-2)对动脉期肝脏CT图像金字塔的顶层图像的指定区域进行几何坐标刚体变换得到新区域;(3-3)通过三次B样条插值方法得到静脉期肝脏CT图像金字塔的顶层图像在步骤(3-2)获取的新区域的坐标;(3-4)利用基于联合直方图的相似性测度计算动脉期肝脏CT图像金字塔的顶层图像与插值图之间的相似度,得到相似度函数;(3-5)将步骤(3-4)得到的相似度函数输入至粒子群算法优化算法中进行最优化计算得到最优变换参数,重复步骤(3-2)~(3-4),直到取得最大值;(3-6)将最优变换参数作为鲍威尔算法搜索的起始点,分别对动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的最后两层图像进行处理,重复步骤(3-2)~(3-5);以及(3-7)输出静脉期肝脏CT图像在最终变换下的配准图像;经配准,获取与至少十幅动脉期肝脏CT图像配准的至少十幅静脉期肝脏CT图像。As a non-limiting implementation, step S3 specifically includes: (3-1) Determine an arterial phase liver CT image in the arterial phase liver CT image sequence map group as the arterial phase liver CT image to be registered, and select a vein A venous phase liver CT image in the sequence map group of liver CT images is used as the venous phase liver CT image to be registered. There are three layers of the arterial phase liver CT image pyramid and the venous phase liver CT image pyramid, of which the top image resolution of the arterial phase liver CT image pyramid and the venous phase liver CT image pyramid is the smallest, and the bottom layer is the original image; (3-2 ) Perform geometric coordinate rigid body transformation on the specified area of the top-level image of the liver CT image pyramid in the arterial phase to obtain a new area; (3-3) Obtain the top-level image of the liver CT image pyramid in the venous phase through the cubic B-spline interpolation method in step (3-3- 2) The acquired coordinates of the new region; (3-4) Using the similarity measure based on the joint histogram to calculate the similarity between the top-level image of the liver CT image pyramid in the arterial phase and the interpolation map to obtain a similarity function; (3- 5) Input the similarity function obtained in step (3-4) into the particle swarm optimization algorithm for optimization calculation to obtain the optimal transformation parameters, and repeat steps (3-2) to (3-4) until the maximum value is obtained (3-6) Take the optimal transformation parameter as the starting point of Powell’s algorithm search, and process the last two layers of the arterial phase liver CT image pyramid and the venous phase liver CT image pyramid respectively, and repeat steps (3-2)~ (3-5); and (3-7) outputting the registration image of the CT image of the liver in the venous phase under the final transformation; after the registration, obtain at least ten images of the liver in the venous phase that are registered with the at least ten CT images of the liver in the arterial phase CT images.

作为另一种非限制性实施方式,步骤S4具体包括:(4-1)选择动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像及与其处于同一截面的静脉期肝脏CT图像;(4-2)对选择的动脉期肝脏CT图像及静脉期肝脏CT图像进行快速傅里叶变换,得到图像频域信号,对图像频域信号分别进行频域非下采样轮廓波分解变换,得到变换结果;(4-3)对变换结果进行逆快速傅里叶变换,分别对低频部分CL和高频部分CH采取相应的变换,得到低频融合图像

Figure BDA0003607076520000131
和高频融合图像
Figure BDA0003607076520000132
(4-4)对低频融合图像
Figure BDA0003607076520000134
和高频融合图像
Figure BDA0003607076520000133
(融合结果)进行快速傅里叶变换,对整个过程进行频域非下采样轮廓波重建变换,得到该截面的肝脏CT融合图像结果;以及(4-5)依次选择动脉期肝脏CT图像序列图组中的其他的一幅动脉期肝脏CT图像及与其处于同一截面的静脉期肝脏CT图像,重复步骤(4-2)~(4-4),直至获取至少十幅肝脏CT融合图像。As another non-limiting embodiment, step S4 specifically includes: (4-1) selecting an arterial phase liver CT image and a venous phase liver CT image in the same section of the arterial phase liver CT image sequence map group; (4-2) Perform fast Fourier transform on the selected arterial phase liver CT images and venous phase liver CT images to obtain image frequency domain signals, and perform frequency domain non-subsampling contourlet decomposition transformation on the image frequency domain signals respectively to obtain Transform results; (4-3) Perform inverse fast Fourier transform on the transform results, and take corresponding transforms on the low-frequency part CL and the high-frequency part CH respectively to obtain a low-frequency fusion image
Figure BDA0003607076520000131
and high-frequency fusion images
Figure BDA0003607076520000132
(4-4) For low-frequency fusion images
Figure BDA0003607076520000134
and high-frequency fusion images
Figure BDA0003607076520000133
(Fusion result) Perform fast Fourier transform, perform frequency domain non-subsampling contourlet reconstruction transformation on the whole process, and obtain the result of the liver CT fusion image of the section; and (4-5) sequentially select the arterial phase liver CT image sequence diagram Repeat steps (4-2) to (4-4) for the other arterial phase liver CT image in the group and the venous phase liver CT image in the same section until at least ten liver CT fusion images are obtained.

步骤S5具体包括:(5-1)设定等值面的值,提取出至少十幅肝脏CT融合图像中肝脏的目标轮廓,计算肝脏轮廓的面积,寻找不同截面肝脏轮廓之间的顺序关系并匹配;(5-2)先读取至少十幅肝脏CT融合图像中的两幅肝脏CT融合图像中的肝脏轮廓,然后再每次读入一张相邻的肝脏CT融合图像的切片,每张切片上的像素点中相邻的四个和对应的下一张切片的四个像素点构成一个立方体,该立方体称为一个体素,然后从左到右、从前至后顺序依次处理一层中的全部相邻立方体,判别边界体素,抽取等值面,然后处理完一层后以相同的方式再继续读入下一张相邻的肝脏CT融合图像的切片,直至处理完所有的切片后提取等值面,算法结束,得到肝脏三维融合CT图像。Step S5 specifically includes: (5-1) setting the value of the isosurface, extracting the target contour of the liver in at least ten liver CT fusion images, calculating the area of the liver contour, finding the order relationship between the liver contours in different sections, and Matching; (5-2) First read the liver contours in two liver CT fusion images out of at least ten liver CT fusion images, and then read a slice of adjacent liver CT fusion images each time, and each slice is The adjacent four of the pixels and the corresponding four pixels of the next slice form a cube, which is called a voxel, and then process all the pixels in one layer sequentially from left to right and front to back. Adjacent cubes, discriminate the boundary voxels, extract the isosurface, and then continue to read the next adjacent slice of liver CT fusion image in the same way after processing one layer, until all the slices are processed and the isosurface is extracted , the algorithm ends, and the three-dimensional fusion CT image of the liver is obtained.

本发明提供的肝脏医学图像配准与融合系统,如图2所示,包括:图像采集装置10、图像预处理装置20、图像配准装置30、图像融合装置40、以及三维重建装置50。The liver medical image registration and fusion system provided by the present invention, as shown in FIG.

图像采集装置10用于获得对于同一个肝脏的动脉期肝脏CT图像序列图组及静脉期肝脏CT图像序列图组,动脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少十幅动脉期肝脏CT图像,静脉期肝脏CT图像序列图组包括对于同一个肝脏的取自不同截面的至少三十幅静脉期肝脏CT图像。The image acquisition device 10 is used to obtain an arterial phase liver CT image sequence map group and a venous phase liver CT image sequence map group for the same liver, and the arterial phase liver CT image sequence map group includes at least the same liver taken from different sections. The ten liver CT images in arterial phase and the CT image series in venous phase include at least thirty liver CT images in venous phase taken from different sections of the same liver.

图像预处理装置20与图像采集装置10通信连接,用于依次对至少十幅动脉期肝脏CT图像及至少三十幅静脉期肝脏CT图像进行预处理。The image preprocessing device 20 is connected in communication with the image acquisition device 10, and is used for sequentially preprocessing at least ten liver CT images in the arterial phase and at least thirty liver CT images in the venous phase.

图像配准装置30与预处理装置20通信连接,用于对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像,依次利用基于联合直方图的多分辨率CT图像配准方法进行配准,在静脉期肝脏CT图像序列图组中找到与其取自相同截面的静脉期肝脏CT图像,获取与至少十幅动脉期肝脏CT图像配准的至少十幅静脉期肝脏CT图像。The image registration device 30 is connected in communication with the preprocessing device 20, and is used for sequentially using the multi-resolution CT image registration method based on the joint histogram for each arterial phase liver CT image in the arterial phase liver CT image sequence group. Perform registration, find the venous phase liver CT images from the same section in the venous phase liver CT image sequence map group, and obtain at least ten venous phase liver CT images registered with at least ten arterial phase liver CT images.

图像融合装置40与图像配准装置30通信连接,用于依次对动脉期肝脏CT图像序列图组中的每一幅动脉期肝脏CT图像及与其配准的一幅静脉期肝脏CT图像进行基于图形处理器硬件加速的频域非下采样轮廓波变换实现图像融合,获取至少十幅肝脏CT融合图像。The image fusion device 40 is connected in communication with the image registration device 30, and is configured to sequentially perform graphics-based image-based image analysis on each arterial phase liver CT image in the arterial phase liver CT image sequence map group and a venous phase liver CT image registered therewith. The frequency domain non-subsampling contourlet transform accelerated by the processor implements image fusion, and obtains at least ten liver CT fusion images.

三维重建装置50与图像融合装置40通信连接,用于对至少十幅肝脏CT融合图像进行序列三维重建,得到肝脏三维融合CT图像。The three-dimensional reconstruction device 50 is connected in communication with the image fusion device 40, and is used for performing sequential three-dimensional reconstruction on at least ten liver CT fusion images to obtain liver three-dimensional fusion CT images.

如图2所示,在该非限制性实施方式中,图像预处理装置20包括:依次通信连接的用于对肝脏CT图像序列组中的每幅肝脏CT图像进行去噪声处理的去噪单元201、进行对比度增强处理的增强单元202、以及进行靶点区域分隔处理的分隔单元203。As shown in FIG. 2 , in this non-limiting embodiment, the image preprocessing apparatus 20 includes: a denoising unit 201 , which is sequentially connected in communication, for performing denoising processing on each liver CT image in the liver CT image sequence group , an enhancement unit 202 that performs contrast enhancement processing, and a separation unit 203 that performs target area separation processing.

作为又一种非限制性实施方式,如图3所示,图像配准装置30包括:分辨处理单元301、刚体变换单元302、坐标获取单元303、函数获取单元304、参数获取单元305、再处理单元306、以及图像输出单元307。As another non-limiting implementation, as shown in FIG. 3 , the image registration apparatus 30 includes: a resolution processing unit 301 , a rigid body transformation unit 302 , a coordinate obtaining unit 303 , a function obtaining unit 304 , a parameter obtaining unit 305 , and a reprocessing unit 303 . unit 306, and image output unit 307.

分辨处理单元301用于确定动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像作为待配准的动脉期肝脏CT图像,选择静脉期肝脏CT图像序列图组中的一幅静脉期肝脏CT图像作为待配准的静脉期肝脏CT图像,对待配准的动脉期肝脏CT图像及静脉期肝脏CT图像分别进行多分辨率处理,构成含有三层的动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔,其中,动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的顶层图像分辨率最小,最底层为原始图像。The discrimination processing unit 301 is configured to determine an arterial phase liver CT image in the arterial phase liver CT image sequence map group as the arterial phase liver CT image to be registered, and select a venous phase liver CT image sequence map group in the venous phase liver CT image sequence map group. The liver CT image is used as the venous phase liver CT image to be registered. The arterial phase liver CT image and the venous phase liver CT image to be registered are separately processed with multi-resolution to form a three-layer arterial phase liver CT image pyramid and venous phase liver CT image. In the liver CT image pyramid, the top layer of the arterial phase liver CT image pyramid and the venous phase liver CT image pyramid have the smallest resolution, and the bottom layer is the original image.

刚体变换单元302与分辨处理单元301通信连接,用于对动脉期肝脏CT图像金字塔的顶层图像的指定区域进行几何坐标刚体变换得到新区域。The rigid body transformation unit 302 is connected in communication with the resolution processing unit 301, and is configured to perform geometric coordinate rigid body transformation on a designated area of the top-level image of the liver CT image pyramid in the arterial phase to obtain a new area.

坐标获取单元303与刚体变换单元302通信连接,用于通过三次B样条插值方法得到静脉期肝脏CT图像金字塔的顶层图像在刚体变换单元获取的新区域的坐标。The coordinate obtaining unit 303 is connected in communication with the rigid body transforming unit 302, and is used for obtaining the coordinates of the top image of the venous phase liver CT image pyramid in the new region obtained by the rigid body transforming unit through the cubic B-spline interpolation method.

函数获取单元304与坐标获取单元303通信连接,用于利用基于联合直方图的相似性测度计算动脉期肝脏CT图像金字塔的顶层图像与插值图之间的相似度,得到相似度函数。The function obtaining unit 304 is connected in communication with the coordinate obtaining unit 303, and is configured to calculate the similarity between the top-level image of the liver CT image pyramid in the arterial phase and the interpolation map by using the similarity measure based on the joint histogram to obtain a similarity function.

参数获取单元305与函数获取单元304通信连接,用于将函数获取单元得到的相似度函数输入至粒子群算法优化算法中进行最优化计算得到最优变换参数,并再启动刚体变换单元302、坐标获取单元303、以及函数获取单元304,直到取得最大值。The parameter acquisition unit 305 is connected in communication with the function acquisition unit 304, and is used to input the similarity function obtained by the function acquisition unit into the particle swarm optimization algorithm for optimization calculation to obtain the optimal transformation parameters, and then start the rigid body transformation unit 302, coordinate The acquisition unit 303 and the function acquisition unit 304 until the maximum value is obtained.

再处理单元306与参数获取单元305通信连接,用于将最优变换参数作为鲍威尔算法搜索的起始点,分别对动脉期肝脏CT图像金字塔及静脉期肝脏CT图像金字塔的最后两层图像进行处理,并再启动刚体变换单元302、坐标获取单元303、函数获取单元304、以及参数获取单元305。The reprocessing unit 306 is connected in communication with the parameter acquisition unit 305, and is used to use the optimal transformation parameter as the starting point of the Powell algorithm search, and respectively process the last two layers of images of the arterial phase liver CT image pyramid and the venous phase liver CT image pyramid, And start the rigid body transformation unit 302 , the coordinate acquisition unit 303 , the function acquisition unit 304 , and the parameter acquisition unit 305 again.

图像输出单元307与再处理单元306通信连接,用于输出静脉期肝脏CT图像在最终变换下的配准图像。The image output unit 307 is connected in communication with the reprocessing unit 306, and is used for outputting the registered image of the liver CT image in the venous phase under the final transformation.

在该非限制性实施方式中,图像融合装置40包括:图像选择单元401、图像频域单元402、频域融合单元403、以及重建变换单元404。In this non-limiting embodiment, the image fusion apparatus 40 includes: an image selection unit 401 , an image frequency domain unit 402 , a frequency domain fusion unit 403 , and a reconstruction transformation unit 404 .

图像选择单元401用于选择动脉期肝脏CT图像序列图组中的一幅动脉期肝脏CT图像及与其处于同一截面的静脉期肝脏CT图像。The image selection unit 401 is configured to select an arterial phase liver CT image and a venous phase liver CT image in the same section of the arterial phase liver CT image sequence image group.

图像频域单元402与图像选择单元401通信连接,用于对选择的动脉期肝脏CT图像及静脉期肝脏CT图像进行快速傅里叶变换,得到图像频域信号,对图像频域信号分别进行频域非下采样轮廓波分解变换,得到变换结果。The image frequency domain unit 402 is connected in communication with the image selection unit 401, and is used to perform fast Fourier transform on the selected arterial phase liver CT image and venous phase liver CT image to obtain image frequency domain signals, and perform frequency domain frequency analysis on the image frequency domain signals respectively. Domain non-subsampling contourlet decomposition transform to obtain the transform result.

频域融合单元403与图像频域单元402通信连接,用于对变换结果进行逆快速傅里叶变换,分别对低频部分CL和高频部分CH采取相应的变换,得到低频融合图像

Figure BDA0003607076520000161
和高频融合图像
Figure BDA0003607076520000162
The frequency domain fusion unit 403 is connected in communication with the image frequency domain unit 402, and is used to perform an inverse fast Fourier transform on the transformation result, and take corresponding transformations on the low-frequency part CL and the high-frequency part CH respectively to obtain a low-frequency fusion image.
Figure BDA0003607076520000161
and high-frequency fusion images
Figure BDA0003607076520000162

重建变换单元404与频域融合单元403通信连接,用于对低频融合图像

Figure BDA0003607076520000163
和高频融合图像
Figure BDA0003607076520000164
进行快速傅里叶变换,对整个过程进行频域非下采样轮廓波重建变换,得到该截面的肝脏CT融合图像结果。The reconstruction and transformation unit 404 is connected in communication with the frequency domain fusion unit 403, and is used to fuse the low-frequency image
Figure BDA0003607076520000163
and high-frequency fusion images
Figure BDA0003607076520000164
Fast Fourier transform is performed, and the whole process is reconstructed by non-subsampling contourlet in frequency domain, and the result of liver CT fusion image of this section is obtained.

三维重建装置50包括:轮廓匹配单元501和MC重建单元502。The three-dimensional reconstruction device 50 includes: a contour matching unit 501 and an MC reconstruction unit 502 .

轮廓匹配单元501用于设定等值面的值,提取出至少十幅肝脏CT融合图像中肝脏的目标轮廓,计算肝脏轮廓的面积,寻找不同截面肝脏轮廓之间的顺序关系并匹配。The contour matching unit 501 is used to set the value of the isosurface, extract the target contour of the liver in at least ten liver CT fusion images, calculate the area of the liver contour, and find and match the order relationship between the liver contours in different sections.

MC重建单元502与轮廓匹配单元501通信连接,用于先读取至少十幅肝脏CT融合图像中的两幅肝脏CT融合图像中的肝脏轮廓,然后再每次读入一张相邻的肝脏CT融合图像的切片,每张切片上的像素点中相邻的四个和对应的下一张切片的四个像素点构成一个立方体,该立方体称为一个体素,然后从左到右、从前至后顺序依次处理一层中的全部相邻立方体,判别边界体素,抽取等值面,然后处理完一层后以相同的方式再继续读入下一张相邻的肝脏CT融合图像的切片,直至处理完所有的切片后提取等值面,算法结束,得到肝脏三维融合CT图像。The MC reconstruction unit 502 is connected in communication with the contour matching unit 501, and is configured to first read the liver contour in two liver CT fusion images of the at least ten liver CT fusion images, and then read in an adjacent liver CT fusion image each time. The slices, the adjacent four of the pixels on each slice and the corresponding four pixels of the next slice form a cube, the cube is called a voxel, and then the order from left to right, front to back Process all adjacent cubes in one layer in turn, identify boundary voxels, extract isosurfaces, and then continue to read the next adjacent slice of liver CT fusion image in the same way after processing one layer, until all the processing is done. The isosurface is extracted after slicing, the algorithm ends, and the three-dimensional fusion CT image of the liver is obtained.

尽管在此已详细描述本发明的优选实施方式,但要理解的是本发明并不局限于这里详细描述和示出的具体结构和步骤,在不偏离本发明的实质和范围的情况下可由本领域的技术人员实现其它的变型和变体。Although the preferred embodiments of the present invention have been described in detail herein, it is to be understood that the present invention is not limited to the specific structures and steps described and illustrated in detail herein, but can be implemented by the present invention without departing from the spirit and scope of the present invention. Other modifications and variations will occur to those skilled in the art.

Claims (10)

1. A liver medical image registration and fusion method is characterized by comprising the following steps:
(1) acquiring an arterial-phase liver CT image sequence map group and a venous-phase liver CT image sequence map group for the same liver, wherein the arterial-phase liver CT image sequence map group comprises at least ten arterial-phase liver CT images which are taken from different sections for the same liver, and the venous-phase liver CT image sequence map group comprises at least thirty venous-phase liver CT images which are taken from different sections for the same liver;
(2) sequentially preprocessing the at least ten arterial-stage liver CT images and the at least thirty venous-stage liver CT images;
(3) sequentially registering each arterial-stage liver CT image in the arterial-stage liver CT image sequence map group by using a multi-resolution CT image registration method based on a joint histogram, finding venous-stage liver CT images with the same cross section as that of the venous-stage liver CT image sequence map group in the venous-stage liver CT image sequence map group, and acquiring at least ten venous-stage liver CT images registered with the at least ten arterial-stage liver CT images;
(4) sequentially carrying out frequency domain non-subsampled contourlet transform based on hardware acceleration of a graphic processor on each arterial-phase liver CT image in the arterial-phase liver CT image sequence chart group and one venous-phase liver CT image registered with the arterial-phase liver CT image to realize image fusion, and obtaining at least ten liver CT fusion images; and
(5) and performing sequence three-dimensional reconstruction on the at least ten liver CT fusion images to obtain a liver three-dimensional fusion CT image.
2. A liver medical image registration and fusion method according to claim 1, wherein the step (2) comprises sequentially: and sequentially performing a denoising processing step, a contrast enhancement processing step and a target point region separation processing step on each liver CT image in the liver CT image sequence group.
3. The liver medical image registration and fusion method of claim 1, wherein step (3) comprises:
(3-1) determining one arterial-phase liver CT image in the arterial-phase liver CT image sequence map group as an arterial-phase liver CT image to be registered, selecting one venous-phase liver CT image in the venous-phase liver CT image sequence map group as a venous-phase liver CT image to be registered, and respectively performing multi-resolution processing on the arterial-phase liver CT image to be registered and the venous-phase liver CT image to form an arterial-phase liver CT image pyramid and a venous-phase liver CT image pyramid which comprise three layers, wherein the top image resolutions of the arterial-phase liver CT image pyramid and the venous-phase liver CT image pyramid are minimum, and the bottom layer is an original image;
(3-2) carrying out rigid body transformation on the geometric coordinates of the specified region of the top layer image of the artery-stage liver CT image pyramid to obtain a new region;
(3-3) obtaining the coordinates of the new region of the top-level image of the vein-phase liver CT image pyramid obtained in the step (3-2) by a cubic B spline interpolation method;
(3-4) calculating the similarity between the top-level image of the artery-stage liver CT image pyramid and the interpolation image by using the similarity measure based on the joint histogram to obtain a similarity function;
(3-5) inputting the similarity function obtained in the step (3-4) into a particle swarm optimization algorithm for optimization calculation to obtain an optimal transformation parameter, and repeating the steps (3-2) - (3-4) until a maximum value is obtained;
(3-6) taking the optimal transformation parameters as the initial points of the Bawell algorithm search, respectively processing the last two layers of images of the artery-stage liver CT image pyramid and the vein-stage liver CT image pyramid, and repeating the steps (3-2) - (3-5); and
(3-7) outputting a registration image of the venous-phase liver CT image under final transformation; and acquiring at least ten vein-phase liver CT images which are registered with the at least ten artery-phase liver CT images after registration.
4. A liver medical image registration and fusion method according to claim 3, wherein step (4) comprises:
(4-1) selecting one arterial-stage liver CT image and a venous-stage liver CT image which is positioned at the same section in the arterial-stage liver CT image sequence map group;
(4-2) carrying out fast Fourier transform on the selected artery-phase liver CT image and vein-phase liver CT image to obtain image frequency domain signals, and respectively carrying out frequency domain non-downsampling contour wavelength division decomposition transform on the image frequency domain signals to obtain a transform result;
(4-3) performing inverse fast Fourier transform on the transform result, and respectively performing inverse fast Fourier transform on the low-frequency part C L And a high frequency part C H Obtaining low-frequency fusion image by adopting corresponding transformation
Figure FDA0003607076510000021
And high frequency fused images
Figure FDA0003607076510000022
(4-4) fusing the images at the low frequency
Figure FDA0003607076510000023
And high frequency fused images
Figure FDA0003607076510000024
Performing fast Fourier transform, and performing frequency domain non-subsampled contourlet reconstruction transformation on the whole process to obtain a liver CT fusion image result of the section; and
and (4-5) sequentially selecting other arterial-stage liver CT images and venous-stage liver CT images which are positioned at the same section in the arterial-stage liver CT image sequence map group, and repeating the steps (4-2) - (4-4) until at least ten liver CT fusion images are obtained.
5. A liver medical image registration and fusion method as claimed in claim 3, wherein the step (5) comprises:
(5-1) setting the value of the isosurface, extracting the target contour of the liver in the at least ten liver CT fusion images, calculating the area of the liver contour, and searching the sequence relation among the liver contours with different sections and matching;
(5-2) reading the liver contour in two liver CT fusion images in the at least ten liver CT fusion images, reading in a slice of an adjacent liver CT fusion image every time, wherein four adjacent pixel points in each slice and four corresponding pixel points in a next slice form a cube, the cube is called a voxel, sequentially processing all adjacent cubes in a layer from left to right and from front to back, judging boundary voxels, extracting an isosurface, then continuously reading in the slice of the next adjacent liver CT fusion image in the same way after processing the layer, extracting the isosurface until all slices are processed, and finishing the algorithm to obtain the three-dimensional liver fusion CT image.
6. A liver medical image registration and fusion system, comprising:
the image acquisition device is used for acquiring an arterial-phase liver CT image sequence map group and a venous-phase liver CT image sequence map group of the same liver, wherein the arterial-phase liver CT image sequence map group comprises at least ten arterial-phase liver CT images of the same liver, which are taken from different sections, and the venous-phase liver CT image sequence map group comprises at least thirty venous-phase liver CT images of the same liver, which are taken from different sections;
the image preprocessing device is in communication connection with the image acquisition device and is used for sequentially preprocessing the at least ten arterial-stage liver CT images and the at least thirty venous-stage liver CT images;
the image registration device is in communication connection with the preprocessing device and is used for sequentially registering each arterial-phase liver CT image in the arterial-phase liver CT image sequence map group by using a multi-resolution CT image registration method based on a joint histogram, finding venous-phase liver CT images with the same cross section as the venous-phase liver CT images in the venous-phase liver CT image sequence map group and acquiring at least ten venous-phase liver CT images registered with the at least ten arterial-phase liver CT images;
the image fusion device is in communication connection with the image registration device and is used for sequentially carrying out frequency domain non-subsampled contourlet transform based on hardware acceleration of a graphic processor on each arterial-phase liver CT image in the arterial-phase liver CT image sequence map group and one venous-phase liver CT image registered with the same to realize image fusion and obtain at least ten liver CT fusion images; and
and the three-dimensional reconstruction device is in communication connection with the image fusion device and is used for performing sequence three-dimensional reconstruction on the at least ten liver CT fusion images to obtain liver three-dimensional fusion CT images.
7. Liver medical image registration and fusion system according to claim 6, characterized in that the image pre-processing means comprises: and the denoising unit, the enhancement unit and the separation unit are sequentially connected in a communication manner and are used for denoising each liver CT image in the liver CT image sequence group, performing contrast enhancement processing and performing target region separation processing.
8. Liver medical image registration and fusion system according to claim 7, characterized in that the image registration means comprises:
the resolution processing unit is used for determining one arterial-phase liver CT image in the arterial-phase liver CT image sequence map group as an arterial-phase liver CT image to be registered, selecting one venous-phase liver CT image in the venous-phase liver CT image sequence map group as a venous-phase liver CT image to be registered, and respectively performing multi-resolution processing on the arterial-phase liver CT image to be registered and the venous-phase liver CT image to form an arterial-phase liver CT image pyramid and a venous-phase liver CT image pyramid which comprise three layers, wherein the top-layer image resolutions of the arterial-phase liver CT image pyramid and the venous-phase liver CT image pyramid are the minimum, and the bottom layer is an original image;
the rigid body transformation unit is in communication connection with the resolution processing unit and is used for performing rigid body transformation on geometric coordinates on a specified region of the top-level image of the artery-stage liver CT image pyramid to obtain a new region;
the coordinate acquisition unit is in communication connection with the rigid body transformation unit and is used for obtaining the coordinates of the top-level image of the vein-phase liver CT image pyramid in the new region acquired by the rigid body transformation unit through a cubic B-spline interpolation method;
the function acquisition unit is in communication connection with the coordinate acquisition unit and is used for calculating the similarity between the top-level image of the artery-stage liver CT image pyramid and the interpolation image by utilizing the similarity measure based on the joint histogram to obtain a similarity function;
the parameter acquisition unit is in communication connection with the function acquisition unit and is used for inputting the similarity function obtained by the function acquisition unit into a particle swarm optimization algorithm for optimization calculation to obtain an optimal transformation parameter and then starting the rigid body transformation unit, the coordinate acquisition unit and the function acquisition unit until a maximum value is obtained;
the reprocessing unit is in communication connection with the parameter acquiring unit and is used for respectively processing the last two layers of images of the arterial-stage liver CT image pyramid and the venous-stage liver CT image pyramid by taking the optimal transformation parameter as a starting point of the Bawell's algorithm search and restarting the rigid body transformation unit, the coordinate acquiring unit, the function acquiring unit and the parameter acquiring unit; and
and the image output unit is connected with the reprocessing unit in a communication mode and is used for outputting a registration image of the venous-phase liver CT image under the final transformation.
9. Liver medical image registration and fusion system according to claim 8, characterized in that the image fusion means comprises:
the image selection unit is used for selecting one artery-phase liver CT image in the artery-phase liver CT image sequence map group and a vein-phase liver CT image which is positioned in the same section with the artery-phase liver CT image;
the image frequency domain unit is in communication connection with the image selection unit and is used for performing fast Fourier transform on the selected arterial-period liver CT image and the selected venous-period liver CT image to obtain image frequency domain signals, and performing frequency domain non-downsampling contour wavelength division decomposition transform on the image frequency domain signals to obtain transform results;
a frequency domain fusion unit, which is connected with the image frequency domain unit in communication and is used for carrying out inverse fast Fourier transform on the transform result and respectively carrying out inverse fast Fourier transform on the low-frequency part C L And a high frequency part C H Obtaining low-frequency fusion image by adopting corresponding transformation
Figure FDA0003607076510000051
And high frequency fused images
Figure FDA0003607076510000052
A reconstruction transformation unit, communicatively connected to the frequency domain fusion unit, for fusing the images at the low frequency
Figure FDA0003607076510000053
And high frequency fused images
Figure FDA0003607076510000054
And performing fast Fourier transform, and performing frequency domain non-subsampled contourlet reconstruction transformation on the whole process to obtain a liver CT fusion image result of the section.
10. The liver medical image registration and fusion system of claim 8, wherein the three-dimensional reconstruction device comprises:
the contour matching unit is used for setting the value of an isosurface, extracting the target contour of the liver in the at least ten liver CT fusion images, calculating the area of the liver contour, searching the sequence relation among the liver contours with different sections and matching;
and the MC reconstruction unit is in communication connection with the contour matching unit and is used for reading the liver contour in two liver CT fusion images in the at least ten liver CT fusion images, reading slices of one adjacent liver CT fusion image every time, forming a cube by four adjacent pixel points in each slice and four pixel points of the corresponding next slice, wherein the cube is called a voxel, sequentially processing all adjacent cubes in one layer from left to right and from front to back, distinguishing boundary voxels, extracting an isosurface, continuously reading slices of the next adjacent liver CT fusion image in the same way after processing one layer, extracting the isosurface until all slices are processed, finishing the algorithm and obtaining the three-dimensional liver fusion CT image.
CN202210422530.XA 2022-04-21 2022-04-21 Liver medical image registration and fusion method and system Withdrawn CN114862773A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210422530.XA CN114862773A (en) 2022-04-21 2022-04-21 Liver medical image registration and fusion method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210422530.XA CN114862773A (en) 2022-04-21 2022-04-21 Liver medical image registration and fusion method and system

Publications (1)

Publication Number Publication Date
CN114862773A true CN114862773A (en) 2022-08-05

Family

ID=82632340

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210422530.XA Withdrawn CN114862773A (en) 2022-04-21 2022-04-21 Liver medical image registration and fusion method and system

Country Status (1)

Country Link
CN (1) CN114862773A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20240080581A (en) * 2022-11-30 2024-06-07 숭실대학교산학협력단 Artificial intelligence based multi-phase liver ct registration apparatus and method
CN118172252A (en) * 2024-01-26 2024-06-11 杭州电子科技大学 PET image and CT image fusion device and method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20240080581A (en) * 2022-11-30 2024-06-07 숭실대학교산학협력단 Artificial intelligence based multi-phase liver ct registration apparatus and method
KR102756989B1 (en) 2022-11-30 2025-01-21 숭실대학교 산학협력단 Artificial intelligence based multi-phase liver ct registration apparatus and method
CN118172252A (en) * 2024-01-26 2024-06-11 杭州电子科技大学 PET image and CT image fusion device and method

Similar Documents

Publication Publication Date Title
CN107886508B (en) Differential subtraction method and medical image processing method and system
CN110310281A (en) A method for detection and segmentation of lung nodules in virtual medicine based on Mask-RCNN deep learning
EP3447733B1 (en) Selective image reconstruction
US20030099389A1 (en) Pleural nodule detection from CT thoracic images
CN112215844A (en) MRI multimodal image segmentation method and system based on ACU-Net
CN105912874A (en) Liver three-dimensional database system constructed on the basis of DICOM (Digital Imaging and Communications in Medicine) medical image
Yao et al. Advances on pancreas segmentation: a review
CN116580068B (en) Multi-mode medical registration method based on point cloud registration
Chang et al. 3-D snake for US in margin evaluation for malignant breast tumor excision using mammotome
Larrey-Ruiz et al. Automatic image-based segmentation of the heart from CT scans
CN115830016A (en) Medical image registration model training method and equipment
CN114862773A (en) Liver medical image registration and fusion method and system
US20060023927A1 (en) GGN segmentation in pulmonary images for accuracy and consistency
CN116363181A (en) A Feature-Based Algorithm for Liver Registration of CT and Ultrasound Images
Hao et al. Magnetic resonance image segmentation based on multi-scale convolutional neural network
CN119919401B (en) Auxiliary detection system and method for breast abnormality
Liu et al. Progressive residual learning with memory upgrade for ultrasound image blind super-resolution
CN108022230B (en) Kidney multi-phase CT image fusion system
Edwin et al. Liver and tumour segmentation from abdominal CT images using adaptive threshold method
Ocal et al. Prostate segmentation via dynamic fusion model
CN116580033B (en) Multi-mode medical image registration method based on image block similarity matching
Ogiela et al. Computer analysis of gallbladder ultrasonic images towards recognition of pathological lesions
Shen et al. Promptable counterfactual diffusion model for unified brain tumor segmentation and generation with mris
CN117853720A (en) Mammary gland image segmentation system, method and computer storage medium
Marti et al. Two-dimensional–three-dimensional correspondence in mammography

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20220805

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载