US20230108647A1 - Method and Apparatus for Calculating Blood Flow Rate in Coronary Artery, and Electronic Device - Google Patents
Method and Apparatus for Calculating Blood Flow Rate in Coronary Artery, and Electronic Device Download PDFInfo
- Publication number
- US20230108647A1 US20230108647A1 US17/802,838 US202117802838A US2023108647A1 US 20230108647 A1 US20230108647 A1 US 20230108647A1 US 202117802838 A US202117802838 A US 202117802838A US 2023108647 A1 US2023108647 A1 US 2023108647A1
- Authority
- US
- United States
- Prior art keywords
- main vessel
- coronary artery
- blood flow
- flow rate
- calculating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000004351 coronary vessel Anatomy 0.000 title claims abstract description 262
- 230000017531 blood circulation Effects 0.000 title claims abstract description 158
- 238000000034 method Methods 0.000 title claims abstract description 67
- 238000002583 angiography Methods 0.000 claims abstract description 164
- 230000008859 change Effects 0.000 claims abstract description 86
- 238000013135 deep learning Methods 0.000 claims abstract description 34
- 210000004204 blood vessel Anatomy 0.000 claims description 33
- 230000015654 memory Effects 0.000 claims description 33
- 230000000747 cardiac effect Effects 0.000 claims description 31
- 230000000544 hyperemic effect Effects 0.000 claims description 18
- 230000000284 resting effect Effects 0.000 claims description 18
- 238000009499 grossing Methods 0.000 claims description 8
- 238000007670 refining Methods 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 abstract description 18
- 238000010586 diagram Methods 0.000 description 14
- 230000008569 process Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 4
- 230000011218 segmentation Effects 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 239000002872 contrast media Substances 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002526 effect on cardiovascular system Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000011176 pooling Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
- G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/481—Diagnostic techniques involving the use of contrast agents
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/486—Diagnostic techniques involving generating temporal series of image data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/503—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of the heart
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/504—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of blood vessels, e.g. by angiography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/507—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for determination of haemodynamic parameters, e.g. perfusion CT
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5217—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data extracting a diagnostic or physiological parameter from medical diagnostic data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/486—Diagnostic techniques involving generating temporal series of image data
- A61B6/487—Diagnostic techniques involving generating temporal series of image data involving fluoroscopy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20021—Dividing image into blocks, subimages or windows
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20092—Interactive image processing based on input by user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30048—Heart; Cardiac
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
- G06T2207/30104—Vascular flow; Blood flow; Perfusion
Definitions
- the present invention relates to the technical field of computers, in particular to a method and apparatus for calculating the blood flow rate in a coronary artery, an electronic device and a computer storage medium.
- one object of the present invention is to provide a method for calculating the blood flow rate in a coronary artery, and by the calculation method, the automation of the calculation of the blood flow rate in a coronary artery is achieved, the calculated blood flow rate in a coronary artery is more accurate, and the calculation method is simple.
- Another object of the present invention is to provide a method for calculating blood flow reserve in a coronary artery, comprising the method for calculating the blood flow rate in a coronary artery.
- a third object of the present invention is to provide an apparatus for calculating the blood flow rate in a coronary artery used for implementing the method for calculating the blood flow rate in a coronary artery.
- the S 1 specifically comprises: acquiring the angiography image of the coronary artery, displaying type selection of the main vessel of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by a user, of the main vessel to obtain the segmented images of the main vessel.
- the S 1 further comprises: judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type on the basis of the type, selected by the user, of the main vessel; wherein
- the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel;
- the step of segmenting the angiography image of the coronary artery by using deep learning to obtain the segmented images of the main vessel specifically comprises:
- the S 2 specifically comprises:
- the S 3 specifically comprises:
- the S 31 specifically comprises:
- the S 32 specifically comprises:
- the section with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section;
- the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section;
- the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery are displayed, and a user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- the blood flow rate of the main vessel in the resting state and the blood flow rate of the main vessel in the hyperemic state are respectively calculated on the basis of the angiography image of the main vessel in the resting state and the angiography image of the coronary artery in the hyperemic state, wherein a time difference between the acquisition time of the angiography image of the coronary artery when the main vessel are in the resting state and the acquisition time of the angiography image of the coronary artery when the main vessel are in the hyperemic state is not greater than a first time threshold.
- a coronary artery angiography image segmenting module used for acquiring an angiography image of a coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of a main vessel;
- a length calculating module used for calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel; and a blood flow rate calculating module, used for obtaining the blood flow rate of the main vessel on the basis of the calculated change of the lengths of the main vessel with time.
- the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, and the display apparatus is used for displaying type selection of the main vessel of the coronary artery for a user;
- the coronary artery angiography image segmenting module is used for acquiring the angiography image of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by the user, of the main vessel to obtain the segmented images of the main vessel.
- the coronary artery angiography image segmenting module is used for judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type on the basis of the type, selected by the user, of the main vessel; wherein
- the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel;
- the display apparatus is used for displaying a prompt message for the user.
- the coronary artery angiography image segmenting module is used for acquiring feature maps with different resolutions of the angiography image of the coronary artery by means of an encoder structure of a U-Net model, and then refining and combining the feature maps with different resolutions by utilizing a RefineNet module to obtain the segmented images of the main vessel.
- the length calculating module is used for extracting the segmented images of the main vessel to obtain an angiography image of a blood vessel skeleton, calculating the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton to obtain the lengths of the main vessel in pixels, and calculating in combination with a calibration factor of the image to obtain the actual physical length of the main vessel.
- the blood flow rate calculating module is used for obtaining a change curve of the lengths of the main vessel with time by taking time as an abscissa and taking the lengths of the main vessel in the segmented images of the main vessel as an ordinate, selecting a preset section of the change curve of the lengths of the main vessel with time, and calculating the slope of the preset section to obtain the blood flow rate of the main vessel.
- the blood flow rate calculating module is used for obtaining a change curve of the lengths of the main vessel with frame number by taking the frame number of the segmented images of the main vessel as an abscissa and taking the actual length of the main vessel as an ordinate, and converting the abscissa in the change curve of the lengths of the main vessel with frame number into time on the basis of frame frequency information to obtain the change curve of the lengths of the main vessel with time.
- the blood flow rate calculating module is used for smoothing the change curve of the lengths of the main vessel with time to obtain a smooth curve of the change curve of the lengths of the main vessel with time; obtaining the maximum value of the lengths of the main vessel on the smooth curve; selecting the section, with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section; judging whether the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section; and performing straight line fitting on the preset section, and calculating the slope of a straight line obtained by fitting to obtain the blood flow rate of the main vessel.
- the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, the display apparatus is used for displaying the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery for the user, and the user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- An electronic device for calculating the blood flow rate in a coronary artery comprises: one or more processors; and
- one or more memories storing computer readable codes, wherein the computer readable codes implement the method for calculating the blood flow rate in a coronary artery according to any one of the embodiments mentioned above when executed by the one or more processors.
- a computer storage medium stores computer readable codes, and the computer readable codes implement the method for calculating the blood flow rate in a coronary artery according to any one of the embodiments mentioned above when executed by one or more processors.
- the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, then the blood flow rate of the main vessel is obtained on the basis of the change of the lengths of the main vessel with time, by the calculation method, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple.
- FIG. 1 is a flowchart of a method for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of segmenting an angiography image of a coronary artery to obtain segmented images of main vessel;
- FIG. 3 is a structural schematic diagram of an existing U-Net model
- FIG. 4 is a structural schematic diagram of an existing RefineNet model
- FIG. 5 is a structural schematic diagram of Refine-UNet used for segmenting an angiography image of a coronary artery according to an embodiment of the present invention
- FIG. 6 shows an angiography image of a single-pixel-width blood vessel skeleton obtained by extracting segmented images of main vessel according to an embodiment of the present invention
- FIG. 7 is a schematic diagram of a change curve over time to lengths of main vessel and a smooth curve according to an embodiment of the present invention
- FIG. 8 shows an electrocardiogram in one cardiac cycle
- FIG. 9 is a schematic diagram of a first display interface displayed by a display apparatus according to an embodiment of the present invention.
- FIG. 10 is a schematic diagram of a second display interface displayed by a display apparatus according to an embodiment of the present invention.
- FIG. 11 is a schematic diagram of a third display interface displayed by a display apparatus according to an embodiment of the present invention.
- FIG. 12 is a schematic diagram of a fourth display interface displayed by a display apparatus according to an embodiment of the present invention.
- FIG. 13 is a schematic diagram of a fifth display interface displayed by a display apparatus according to an embodiment of the present invention.
- FIG. 14 is a structural schematic diagram of an apparatus for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention.
- FIG. 15 is a structural schematic diagram of an electronic device according to an embodiment of the present invention.
- module can refer to or include an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable hardware components that provide the described functionality, or can be part of these hardware components.
- ASIC application specific integrated circuit
- processor shared, dedicated, or group
- memory that executes one or more software or firmware programs
- combinational logic circuit and/or other suitable hardware components that provide the described functionality, or can be part of these hardware components.
- the processor can be a microprocessor, a digital signal processor, a microcontroller, or the like, and/or any combination thereof.
- the processor can be a single-core processor, a multi-core processor, and the like, and/or any combination thereof.
- a method for calculating the blood flow rate in a coronary artery comprises the following steps.
- the main vessel in the angiography image of the coronary artery need to be segmented to obtain segmented images of the main vessel.
- the traditional image processing methods such as Gabor filtering and Hessian matrix are very sensitive to all blood-vessel-like structures and cannot distinguish main vessel from side vessels. Therefore, a method of deep learning is utilized, the main vessel and the side vessels are distinguished by utilizing the strong characteristic extraction capability of the deep neural network, and only the main vessel is segmented, so that the subsequent process of calculating the lengths of the main vessel is greatly simplified.
- each frame of the acquired angiography image of the coronary artery is used as an input of a deep neural network
- the deep neural network outputs a segmented image, having the same size as the original image, of a main vessel
- the segmented image of the main vessel has a pixel value of 1 (shown in white in FIG. 2 ) at a position corresponding to the position of the main vessel on the original image, and has a pixel value of 0 (shown in black in FIG. 2 ) at other positions.
- the S 1 specifically comprises: acquiring the angiography image of the coronary artery, displaying type selection of the main vessel of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by a user, of the main vessel to obtain the segmented images of the main vessel.
- the main vessel of the coronary artery comprise an anterior descending branch blood vessel, a circumflex branch blood vessel and a right coronary artery blood vessel
- a display apparatus can be used for displaying for the user which specific main vessel is selected from the anterior descending branch blood vessel, the circumflex branch blood vessel and the right coronary artery blood vessel, and the angiography image of the coronary artery is segmented by using deep learning according to the type, selected by the user, of the main vessel to obtain the segmented images of a certain main vessel.
- the type of the main vessel can be automatically identified from the angiography image of the coronary artery, and then the angiography image of the coronary artery can be segmented by using deep learning to obtain the segmented images of a certain main vessel.
- the S 1 further comprises: judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type or not on the basis of the type, selected by the user, of the main vessel; wherein
- the angiography image of the coronary artery is segmented by using deep learning to obtain segmented images of the main vessel;
- a display apparatus can be used for displaying the type selection of the main vessel of the coronary artery for the user, whether the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type or not is judged on the basis of the type, selected by the user, of the main vessel, wherein if the projection angle of the angiography image of the coronary artery is not within the required angle range of the main vessel of this type, the display apparatus displays the prompt message for the user to prompt that the projection angle of the angiography image of the coronary artery is not within the acceptable angle range of the main vessel of this type.
- the accuracy of the calculated blood flow rate of the main vessel can be ensured by judging whether the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type or not.
- the step of segmenting the angiography image of the coronary artery by using deep learning to obtain the segmented images of the main vessel specifically comprises:
- an existing U-Net model utilizes the structure of an encoder-decoder, as shown in FIG. 3 , an original image is convolved twice to obtain a 64-channel feature map, the resolution of the feature map is the same as that of the original image, the resolution of the 64-channel feature map is reduced to half of the original resolution by a max pooling operation, features are further extracted by convolution to obtain a 128-channel feature map of a second layer, and the above processes are repeated to obtain five feature maps with different resolutions, which is an encoding process, the process aims to extract high-level semantic information (low-resolution feature map) and low-level structural information (high-resolution feature map), then a decoding process is entered, the low-resolution feature map is up-sampled to a high-resolution feature map, and the high-resolution feature map is spliced with the high-resolution feature map of the previous stage, after features are extracted by convolution, and upsampling and splicing operations are carried out again until the feature
- An existing RefineNet model is similar to the U-Net model, and as shown in FIG. 4 , the existing RefineNet model can receive feature map inputs of different scales, and combine and refine the feature maps of different scales, so that the feature maps can be conveniently processed subsequently.
- the existing RefineNet model is mainly different from the U-Net model in two aspects: an encoder of the RefineNet model uses a ResNet structure popular in the semantic segmentation field, and an encoder of the U-Net model simply uses convolution to extract features; and the RefineNet model uses an original RefineNet module in the decoder, and the module can better refine information of the low-resolution feature map and the high-resolution feature map.
- FIG. 5 shows a structural schematic diagram of Refine-UNet used for segmenting the angiography image of the coronary artery in the present invention
- the types of feature maps with different resolutions of the angiography image of the coronary artery obtained by the encoder structure of the U-Net model are determined according to actual needs, for example, 5 types, 3 types, 7 types, and the like can be used.
- the encoder structure of the U-Net model only uses convolution to obtain feature maps with different resolutions of the angiography image of the coronary artery, thereby avoiding waste of calculating resources and increasing the calculating speed; and the RefineNet module is utilized to refine and then combine the feature maps with high resolution and low resolution, thereby more efficiently utilizing high-level semantic information and low-level structural information and enhancing the accuracy of segmentation.
- the S 2 specifically comprises:
- the obtained segmented images of the main vessel can be extracted to obtain the single-pixel-width angiography image of the blood vessel skeleton.
- the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton can be calculated by a Fast Marching algorithm.
- the angiography image of the blood vessel skeleton is obtained by extraction, the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton is calculated to obtain the length of the main vessel, the accuracy of the calculated length of the main vessel is improved, and the accuracy of the calculated blood flow rate of the coronary artery is also improved.
- the S 3 specifically comprises:
- the change curve of the lengths of the main vessel with time generally presents a gentle-ascending-gentle “S” shape, in the front section of the sequence of the angiography image of the coronary artery, the main vessel are invisible under X-ray due to the fact that a contrast agent is not injected into the coronary artery, the calculated lengths of the main vessel are generally 0 at the moment, and in the rear section of the sequence of the angiography image of the coronary artery, filling of the contrast agent in the coronary artery is finished, and the calculated lengths of the main vessel are the complete lengths of the main vessel and do not change.
- the S 31 specifically comprises:
- the S 32 specifically comprises:
- a certain noise generally exists on the change curve of the lengths of the main vessel with time, so that the change curve of the lengths of the main vessel with time can be smoothed, and a K-order bezier curve can be used for smoothing the change curve of the lengths of the main vessel with time.
- the minimum value of the preset value can be 0-20%, and the maximum value of the preset value can be 80-90%.
- the electrocardiogram of a normal cardiac cycle is shown in FIG. 8 , wherein fluctuation of QRS wave is significantly higher than that of other waves, the peak of the QRS wave can be detected quickly by using a threshold or other methods, and the time of one cardiac cycle can be obtained according to the time interval between two adjacent QRS waves.
- a linear least square method is used for performing straight line fitting on the preset section, and the slope of the straight line obtained by fitting is the blood flow rate of the main vessel.
- the preset section of the change curve of the lengths of the main vessel with time is obtained by the above method, and the blood flow rate of the main vessel is further obtained, so that the calculated blood flow rate of the main vessel is more accurate.
- the preset section can be obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- the blood flow rate of the main vessel generally has differences at different stages of the cardiac cycle
- a section of the change curve of the lengths of the main vessel with time corresponding to one cardiac cycle is used as the preset section, so that the calculated blood flow rate of the main vessel is more accurate.
- the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, then the blood flow rate of the main vessel is obtained on the basis of change of the lengths of the main vessel with time, by the calculation method, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple.
- the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery are displayed, and a user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- a display apparatus can be used for displaying the change curve of the lengths of the main vessel with time and the electrocardio information of the coronary artery corresponding to the change curve for the user, the blood flow rate, obtained by performing straight line fitting on the preset section, of the main vessel is displayed, as shown in FIG. 10 , the user can check different frames of the angiography image of the coronary artery by scrolling a mouse wheel or clicking any position on the change curve in a right image window of a display interface, as shown in FIG.
- the right image window of the display interface can also be switched to a multi-window mode by clicking a certain function icon by means of a mouse, so as to check the angiography image of the coronary artery corresponding to the preset section, the selected preset section is verified, if the selected preset section is unreasonable, the selected preset section is adjusted manually, and the blood flow rate, displayed on the display interface, of the main vessel is updated in real time according to the selected preset section.
- the user can manually adjust the selected preset section, so as to ensure the reasonability of the selected preset section and further ensure that the blood flow rate of the coronary artery is more accurate.
- a method for calculating blood flow reserve of a coronary artery comprising the method for calculating the blood flow rate of a coronary artery comprises the following steps:
- one sequence of the angiography image of the coronary artery is selected, the blood flow rate of the main vessel in one state is calculated by using the method for calculating the blood flow rate in a coronary artery, as shown in FIG. 12 , an icon (CFR icon) for calculating blood flow reserve of the coronary artery on the display interface of the display apparatus is clicked, then, another sequence of the angiography image of the coronary artery is selected, the state of the main vessel in the other sequence of the angiography image of the coronary artery is opposite to the state of the main vessel in the one sequence of the angiography image of the coronary artery, the display apparatus displays the type selection of the state (a resting state or a hyperemic state) of the main vessel in the other sequence of the angiography image of the coronary artery for the user, the state of the main vessel in the one sequence of the angiography image of the coronary artery is determined according to the selection of the user, then the blood flow rate of the main vessel in another state is
- the blood flow rate of the main vessel in the resting state and the blood flow rate of the main vessel in the hyperemic state are respectively calculated on the basis of the angiography image of the main vessel in the resting state and the angiography image of the coronary artery in the hyperemic state, wherein a time difference between the acquisition time of the angiography image of the coronary artery when the main vessel are in the resting state and the acquisition time of the angiography image of the coronary artery when the main vessel are in the hyperemic state is not greater than a first time threshold.
- the first time threshold can be 7 days, or 15 days, or the like and is determined according to the actual situation, and the time difference between the acquisition time of the angiography image of the coronary artery when the main vessel are in the resting state and the acquisition time of the angiography image of the coronary artery when the main vessel are in the hyperemic state is not greater than the first time threshold, so that the accuracy of the calculated blood flow reserve of the coronary artery can be ensured.
- the automation of the calculation of the blood flow reserve of the coronary artery is realized, the calculated blood flow reserve of the coronary artery is more accurate, and the calculation method is simple.
- an apparatus for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention for implementing the method for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention comprises a coronary artery angiography image segmenting module 20 , a length calculating module 30 and a blood flow rate calculating module 40 .
- the coronary artery angiography image segmenting module 20 is used for acquiring an angiography image of the coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of a main vessel.
- the length calculating module 30 is used for calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel.
- the blood flow rate calculating module 40 is used for obtaining the blood flow rate of the main vessel on the basis of the calculated change of the lengths of the main vessel with time.
- the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, and the display apparatus is used for displaying type selection of the main vessel of the coronary artery for a user;
- the coronary artery angiography image segmenting module 20 is used for acquiring the angiography image of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by the user, of the main vessel to obtain the segmented images of the main vessel.
- the coronary artery angiography image segmenting module 20 is used for judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type or not on the basis of the type, selected by the user, of the main vessel; wherein
- the angiography image of the coronary artery is segmented by using deep learning, and the segmented images of the main vessel are obtained;
- the display apparatus is used for displaying a prompt message for the user.
- the coronary artery angiography image segmenting module 20 is used for acquiring feature maps with different resolutions of the angiography image of the coronary artery by means of an encoder structure of a U-Net model, and then refining and combining the feature maps with different resolutions by utilizing a RefineNet module to obtain the segmented images of the main vessel.
- the length calculating module 30 is used for extracting the segmented images of the main vessel to obtain an angiography image of a blood vessel skeleton, calculating the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton to obtain the lengths of the main vessel in pixels, and calculating in combination with a calibration factor of the image to obtain the actual physical length of the main vessel.
- the blood flow rate calculating module 40 is used for obtaining a change curve of the length of the main vessel with time by taking time as an abscissa and taking the lengths of the main vessel in the segmented images of the main vessel as an ordinate, selecting a preset section of the change curve of the lengths of the main vessel with time, and calculating the slope of the preset section to obtain the blood flow rate of the main vessel.
- the blood flow rate calculating module 40 is used for obtaining a change curve of the lengths of the main vessel with frame number by taking the frame number of the segmented images of the main vessel as an abscissa and taking the actual lengths of the main vessel as an ordinate, and converting the abscissa in the change curve of the lengths of the main vessel with frame number into time on the basis of frame frequency information to obtain the change curve of the lengths of the main vessel with time.
- the blood flow rate calculating module 40 is used for smoothing the change curve of the lengths of the main vessel with time to obtain a smooth curve of the change curve of the lengths of the main vessel with time; obtaining the maximum value of the lengths of the main vessel on the smooth curve; selecting the section, with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section; judging whether the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section; and
- the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, the display apparatus is used for displaying the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery for the user, and the user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, and further the blood flow rate of the main vessel is obtained on the basis of the change of the lengths of the main vessel with time, by the apparatus for calculating the blood flow rate of the coronary artery, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple.
- the present application further provides an electronic device 1400 , the electronic device 1400 comprises one or more processors 1401 and one or more memories 1402 , and the memories 1402 store computer readable codes,
- the S 1 specifically comprises: acquiring the angiography image of the coronary artery, displaying type selection of the main vessel of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by the user, of the main vessel to obtain the segmented images of the main vessel.
- the S 1 further comprises: judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type or not on the basis of the type, selected by the user, of the main vessel; wherein
- the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel;
- the step of segmenting the angiography image of the coronary artery by using deep learning to obtain the segmented images of the main vessel specifically comprises:
- the S 2 specifically comprises:
- the S 3 specifically comprises:
- the S 31 specifically comprises:
- the S 32 specifically comprises:
- the section with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section;
- the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section;
- the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery are displayed, and the user checks the angiography image of the coronary artery corresponding to the preset section and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- the electronic device 1400 further comprises a network interface 1403 , an input device 1404 , a hard disk 1405 , and a display device 1406 .
- the various interfaces and devices described above can be interconnected by bus architecture.
- the bus architecture can comprise any number of interconnected buses and bridges. Specifically, the bus architecture can connect various circuits of one or more central processing units (CPUs) represented by the processor 1401 , and various circuits of one or more memories 1402 represented by the memory 1402 together.
- the bus architecture can also connect various other circuits such as peripherals, voltage regulators and power management circuits. It will be appreciated that the bus architecture is used for implementing connection communication between these components.
- the bus architecture comprises a power bus, a control bus, and a status signal bus in addition to a data bus, all of the above content is well known in the art and therefore will not be described in detail herein.
- the network interface 1403 can be connected to a network (such as the Internet and the local area network), and related data can be acquired from the network, and be stored in the hard disk 1405 .
- a network such as the Internet and the local area network
- the input device 1404 can receive various instructions input by an operator, and transmit the instructions to the processor 1401 for execution.
- the input device 1404 can comprise a keyboard or a clicking device (such as a mouse, a trackball, a touch panel, or a touch screen and the like).
- the display device 1406 can display a result obtained by the processor 1401 executing the instructions.
- the memory 1402 is used for storing programs and data which are necessary for running of an operating system 14021 , and data such as intermediate results in the calculating process of the processor 1401 .
- the memory 1402 in the embodiments of the present application can be either a volatile memory or a nonvolatile memory, or can comprise both a volatile memory and a nonvolatile memory.
- the nonvolatile memory can be a read only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), or a flash memory.
- the volatile memory can be a random access memory (RAM), which acts as an external cache memory.
- RAM random access memory
- the memory 1402 stores the following elements, executable modules or data structures, or a subset or expanded set thereof: the operating system 14021 and an application 14014 .
- the operating system 14021 comprises various system programs, such as a framework layer, a core library layer and a driver layer, and is used for implementing various basic services and processing hardware-based tasks.
- the application 14014 comprises various applications, such as a browser, and is used for implementing various application services. Programs that implement methods of embodiments of the present application can be included in the application 14014 .
- the method disclosed in the above embodiments of the present application can be applied to the processor 1401 , or can be implemented by the processor 1401 .
- the processor 1401 can be an integrated circuit chip having signal processing capabilities. In the implementation process, the steps of the above method can be performed by integrated logic circuits in the form of hardware or instructions in the form of software in the processor 1401 .
- the processor 1401 can be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device and discrete hardware component, and can implement or perform the methods, steps, and logic block diagrams disclosed in the embodiments of the present application.
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- a general purpose processor can be a microprocessor or the processor can be any conventional processor or the like.
- the steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor.
- the software modules can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory and a register.
- the storage medium is located in the memory 1402 , and the processor 1401 reads the information in the memory 1402 , and implements the steps of the above method in combination with the hardware thereof.
- processing units can be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units used for performing the functions described in the present application, or a combination thereof.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGAs field programmable gate arrays
- general purpose processors controllers, micro-controllers, microprocessors, other electronic units used for performing the functions described in the present application, or a combination thereof.
- the techniques described herein can be implemented by means of modules (such as procedures and functions) that perform the functions described herein.
- the software codes can be stored in a memory and executed by a processor.
- the memory can be implemented within the processor or external to the processor.
- the electronic device 1400 by the electronic device 1400 , the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, then the blood flow rate of the main vessel is obtained on the basis of the change of the lengths of the main vessel with time, by the electronic device for calculating the blood flow rate in a coronary artery, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple.
- an embodiment of the present application further provides a computer storage medium, the computer storage medium stores computer readable codes, and the computer readable codes perform the following processing when executed by one or more processors:
- the computer storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
- the disclosed method and apparatus can be implemented in other manners.
- the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one type of logical functional division, and other divisions can be realized in practice, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored, or not executed.
- the shown or discussed mutual coupling or direct coupling or communication connection can be indirect coupling or communication connection through some interfaces, devices or units, and can be in an electrical, mechanical or other form.
- functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be separately and physically included, or two or more units can be integrated into one unit.
- the integrated unit can be implemented in the form of hardware, or in the form of hardware plus a software functional unit.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Surgery (AREA)
- High Energy & Nuclear Physics (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Quality & Reliability (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Dentistry (AREA)
- Geometry (AREA)
- Vascular Medicine (AREA)
- Physiology (AREA)
- Cardiology (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Image Analysis (AREA)
Abstract
Description
- The present invention relates to the technical field of computers, in particular to a method and apparatus for calculating the blood flow rate in a coronary artery, an electronic device and a computer storage medium.
- In recent years, many methods for calculating FFR (fractional flow reserve) and CFR (coronary flow reserve) of a coronary artery on the basis of cardiovascular images have been proposed, wherein the blood flow rate in a coronary artery is an important condition for the calculation of FFR and CFR, and the current method for calculating the blood flow rate in a coronary artery mainly comprises the TIMI frame counting method, but the method requires manual measurement by a doctor and is complicated to operate.
- In order to solve the above technical problem, one object of the present invention is to provide a method for calculating the blood flow rate in a coronary artery, and by the calculation method, the automation of the calculation of the blood flow rate in a coronary artery is achieved, the calculated blood flow rate in a coronary artery is more accurate, and the calculation method is simple.
- Another object of the present invention is to provide a method for calculating blood flow reserve in a coronary artery, comprising the method for calculating the blood flow rate in a coronary artery.
- A third object of the present invention is to provide an apparatus for calculating the blood flow rate in a coronary artery used for implementing the method for calculating the blood flow rate in a coronary artery.
- In order to achieve the above-mentioned objects, the present invention adopts the following technical solutions:
- the method for calculating the blood flow rate in a coronary artery according to an embodiment of a first aspect of the present invention comprises:
- S1, acquiring an angiography image of a coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of main vessel;
- S2, calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel; and
- S3, obtaining the blood flow rate in the main vessel on the basis of the calculated change of the lengths of the main vessel with time.
- Preferably, the S1 specifically comprises: acquiring the angiography image of the coronary artery, displaying type selection of the main vessel of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by a user, of the main vessel to obtain the segmented images of the main vessel.
- Preferably, the S1 further comprises: judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type on the basis of the type, selected by the user, of the main vessel; wherein
- if the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type, the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel; and
- if the projection angle of the angiography image of the coronary artery is not within the required angle range of the main vessel of this type, a prompt message is displayed.
- Preferably, the step of segmenting the angiography image of the coronary artery by using deep learning to obtain the segmented images of the main vessel specifically comprises:
- acquiring a plurality of feature maps with different resolutions of the angiography image of the coronary artery by means of an encoder structure of a U-Net model, and further refining and combining the plurality of feature maps with different resolutions by utilizing a RefineNet module to obtain the segmented images of the main vessel.
- Preferably, the S2 specifically comprises:
- S21, extracting the segmented images of the main vessel to obtain an angiography image of a blood vessel skeleton; and
- S22, calculating the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton to obtain the lengths of the main vessel in pixels, and calculating in combination with a calibration factor of the image to obtain the actual physical length of the main vessel.
- Preferably, the S3 specifically comprises:
- S31, obtaining a change curve of the lengths of the main vessel with time by taking time as an abscissa and taking the lengths of the main vessel in the segmented images of the main vessel as an ordinate; and
- S32, selecting a preset section of the change curve of the lengths of the main vessel with time, and calculating the slope of the preset section to obtain the blood flow rate of the main vessel.
- Preferably, the S31 specifically comprises:
- S311, obtaining a change curve of the lengths of the main vessel with frame number by taking the frame number of the segmented images of the main vessel as an abscissa and taking the actual lengths of the main vessel as an ordinate; and
- S312, converting the abscissa in the change curve of the lengths of the main vessel with frame number into time on the basis of frame frequency information to obtain the change curve of the lengths of the main vessel with time.
- Preferably, the S32 specifically comprises:
- smoothing the change curve of the lengths of the main vessel with time to obtain a smooth curve of the change curve of the lengths of the main vessel with time;
- obtaining the maximum value of the lengths of the main vessel on the smooth curve, and selecting the section, with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section;
- judging whether the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section; and
- performing straight line fitting on the preset section, and calculating the slope of a straight line obtained by fitting to obtain the blood flow rate of the main vessel.
- Preferably, if the preselected section contains one cardiac cycle, the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- Preferably, the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery are displayed, and a user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- A method for calculating blood flow reserve in a coronary artery according to an embodiment of a second aspect of the present invention comprises:
- calculating the blood flow rate of the main vessel in a resting state and the blood flow rate of the main vessel in a hyperemic state respectively by the method for calculating the blood flow rate in a coronary artery according to any one of the embodiments mentioned above, and obtaining the blood flow reserve of the coronary artery according to the calculated blood flow rate of the main vessel in the resting state and the calculated blood flow rate of the main vessel in the hyperemic state.
- Preferably, by the method for calculating the blood flow rate in a coronary artery, the blood flow rate of the main vessel in the resting state and the blood flow rate of the main vessel in the hyperemic state are respectively calculated on the basis of the angiography image of the main vessel in the resting state and the angiography image of the coronary artery in the hyperemic state, wherein a time difference between the acquisition time of the angiography image of the coronary artery when the main vessel are in the resting state and the acquisition time of the angiography image of the coronary artery when the main vessel are in the hyperemic state is not greater than a first time threshold.
- An apparatus for calculating the blood flow rate in a coronary artery according to an embodiment of a third aspect of the present invention comprises:
- a coronary artery angiography image segmenting module, used for acquiring an angiography image of a coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of a main vessel;
- a length calculating module, used for calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel; and a blood flow rate calculating module, used for obtaining the blood flow rate of the main vessel on the basis of the calculated change of the lengths of the main vessel with time.
- Preferably, the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, and the display apparatus is used for displaying type selection of the main vessel of the coronary artery for a user;
- the coronary artery angiography image segmenting module is used for acquiring the angiography image of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by the user, of the main vessel to obtain the segmented images of the main vessel.
- Preferably, the coronary artery angiography image segmenting module is used for judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type on the basis of the type, selected by the user, of the main vessel; wherein
- if the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type, the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel; and
- if the projection angle of the angiography image of the coronary artery is not within the required angle range of the main vessel of this type, the display apparatus is used for displaying a prompt message for the user.
- Preferably, the coronary artery angiography image segmenting module is used for acquiring feature maps with different resolutions of the angiography image of the coronary artery by means of an encoder structure of a U-Net model, and then refining and combining the feature maps with different resolutions by utilizing a RefineNet module to obtain the segmented images of the main vessel.
- Preferably, the length calculating module is used for extracting the segmented images of the main vessel to obtain an angiography image of a blood vessel skeleton, calculating the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton to obtain the lengths of the main vessel in pixels, and calculating in combination with a calibration factor of the image to obtain the actual physical length of the main vessel.
- Preferably, the blood flow rate calculating module is used for obtaining a change curve of the lengths of the main vessel with time by taking time as an abscissa and taking the lengths of the main vessel in the segmented images of the main vessel as an ordinate, selecting a preset section of the change curve of the lengths of the main vessel with time, and calculating the slope of the preset section to obtain the blood flow rate of the main vessel.
- Preferably, the blood flow rate calculating module is used for obtaining a change curve of the lengths of the main vessel with frame number by taking the frame number of the segmented images of the main vessel as an abscissa and taking the actual length of the main vessel as an ordinate, and converting the abscissa in the change curve of the lengths of the main vessel with frame number into time on the basis of frame frequency information to obtain the change curve of the lengths of the main vessel with time.
- Preferably, the blood flow rate calculating module is used for smoothing the change curve of the lengths of the main vessel with time to obtain a smooth curve of the change curve of the lengths of the main vessel with time; obtaining the maximum value of the lengths of the main vessel on the smooth curve; selecting the section, with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section; judging whether the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section; and performing straight line fitting on the preset section, and calculating the slope of a straight line obtained by fitting to obtain the blood flow rate of the main vessel.
- Preferably, if the preselected section contains one cardiac cycle, then the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- Preferably, the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, the display apparatus is used for displaying the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery for the user, and the user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- An electronic device for calculating the blood flow rate in a coronary artery according to an embodiment of the fourth aspect of the present invention comprises: one or more processors; and
- one or more memories, storing computer readable codes, wherein the computer readable codes implement the method for calculating the blood flow rate in a coronary artery according to any one of the embodiments mentioned above when executed by the one or more processors.
- A computer storage medium according to an embodiment of a fifth aspect of the present invention stores computer readable codes, and the computer readable codes implement the method for calculating the blood flow rate in a coronary artery according to any one of the embodiments mentioned above when executed by one or more processors.
- The beneficial effects of the prevent invention lie in that:
- the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, then the blood flow rate of the main vessel is obtained on the basis of the change of the lengths of the main vessel with time, by the calculation method, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple.
- The foregoing description is only an overview of the technical solutions of the present invention, and in order to enable the technical means of the present invention to be more clearly understood and be implemented in accordance with the contents of the description, preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.
-
FIG. 1 is a flowchart of a method for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention; -
FIG. 2 is a schematic diagram of segmenting an angiography image of a coronary artery to obtain segmented images of main vessel; -
FIG. 3 is a structural schematic diagram of an existing U-Net model; -
FIG. 4 is a structural schematic diagram of an existing RefineNet model; -
FIG. 5 is a structural schematic diagram of Refine-UNet used for segmenting an angiography image of a coronary artery according to an embodiment of the present invention; -
FIG. 6 shows an angiography image of a single-pixel-width blood vessel skeleton obtained by extracting segmented images of main vessel according to an embodiment of the present invention; -
FIG. 7 is a schematic diagram of a change curve over time to lengths of main vessel and a smooth curve according to an embodiment of the present invention; -
FIG. 8 shows an electrocardiogram in one cardiac cycle; -
FIG. 9 is a schematic diagram of a first display interface displayed by a display apparatus according to an embodiment of the present invention; -
FIG. 10 is a schematic diagram of a second display interface displayed by a display apparatus according to an embodiment of the present invention; -
FIG. 11 is a schematic diagram of a third display interface displayed by a display apparatus according to an embodiment of the present invention; -
FIG. 12 is a schematic diagram of a fourth display interface displayed by a display apparatus according to an embodiment of the present invention; -
FIG. 13 is a schematic diagram of a fifth display interface displayed by a display apparatus according to an embodiment of the present invention; -
FIG. 14 is a structural schematic diagram of an apparatus for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention; and -
FIG. 15 is a structural schematic diagram of an electronic device according to an embodiment of the present invention. - The specific embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. The following embodiments are only intended to illustrate the present invention, but are not intended to limit the scope of the present invention.
- It will be appreciated that as used herein, the term “module” can refer to or include an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable hardware components that provide the described functionality, or can be part of these hardware components.
- It will be appreciated that in embodiments of the present invention, the processor can be a microprocessor, a digital signal processor, a microcontroller, or the like, and/or any combination thereof. According to another aspect, the processor can be a single-core processor, a multi-core processor, and the like, and/or any combination thereof.
- As shown in
FIG. 1 , a method for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention comprises the following steps. - S1, acquiring an angiography image of the coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of main vessel.
- Specifically, since only the blood flow rate in main vessel is paid attention to when the blood flow rate of a coronary artery is calculated, only the main vessel in the angiography image of the coronary artery need to be segmented to obtain segmented images of the main vessel. However, the traditional image processing methods such as Gabor filtering and Hessian matrix are very sensitive to all blood-vessel-like structures and cannot distinguish main vessel from side vessels. Therefore, a method of deep learning is utilized, the main vessel and the side vessels are distinguished by utilizing the strong characteristic extraction capability of the deep neural network, and only the main vessel is segmented, so that the subsequent process of calculating the lengths of the main vessel is greatly simplified.
- As shown in
FIG. 2 , each frame of the acquired angiography image of the coronary artery is used as an input of a deep neural network, the deep neural network outputs a segmented image, having the same size as the original image, of a main vessel, the segmented image of the main vessel has a pixel value of 1 (shown in white inFIG. 2 ) at a position corresponding to the position of the main vessel on the original image, and has a pixel value of 0 (shown in black inFIG. 2 ) at other positions. - Preferably, the S1 specifically comprises: acquiring the angiography image of the coronary artery, displaying type selection of the main vessel of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by a user, of the main vessel to obtain the segmented images of the main vessel.
- Specifically, the main vessel of the coronary artery comprise an anterior descending branch blood vessel, a circumflex branch blood vessel and a right coronary artery blood vessel, a display apparatus can be used for displaying for the user which specific main vessel is selected from the anterior descending branch blood vessel, the circumflex branch blood vessel and the right coronary artery blood vessel, and the angiography image of the coronary artery is segmented by using deep learning according to the type, selected by the user, of the main vessel to obtain the segmented images of a certain main vessel. In addition, in other embodiments of the present invention, the type of the main vessel can be automatically identified from the angiography image of the coronary artery, and then the angiography image of the coronary artery can be segmented by using deep learning to obtain the segmented images of a certain main vessel.
- Preferably, the S1 further comprises: judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type or not on the basis of the type, selected by the user, of the main vessel; wherein
- if the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type, the angiography image of the coronary artery is segmented by using deep learning to obtain segmented images of the main vessel; and
- if the projection angle of the angiography image of the coronary artery is not within the required angle range of the main vessel of this type, a prompt message is displayed.
- Specifically, as shown in
FIG. 9 , after the angiography image of the coronary artery is acquired, a display apparatus can be used for displaying the type selection of the main vessel of the coronary artery for the user, whether the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type or not is judged on the basis of the type, selected by the user, of the main vessel, wherein if the projection angle of the angiography image of the coronary artery is not within the required angle range of the main vessel of this type, the display apparatus displays the prompt message for the user to prompt that the projection angle of the angiography image of the coronary artery is not within the acceptable angle range of the main vessel of this type. - The accuracy of the calculated blood flow rate of the main vessel can be ensured by judging whether the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type or not.
- Preferably, the step of segmenting the angiography image of the coronary artery by using deep learning to obtain the segmented images of the main vessel specifically comprises:
- acquiring a plurality of feature maps with different resolutions of the angiography image of the coronary artery by means of an encoder structure of a U-Net model, and further refining and combining the plurality of feature maps with different resolutions by utilizing a RefineNet module to obtain the segmented images of the main vessel.
- Specifically, an existing U-Net model utilizes the structure of an encoder-decoder, as shown in
FIG. 3 , an original image is convolved twice to obtain a 64-channel feature map, the resolution of the feature map is the same as that of the original image, the resolution of the 64-channel feature map is reduced to half of the original resolution by a max pooling operation, features are further extracted by convolution to obtain a 128-channel feature map of a second layer, and the above processes are repeated to obtain five feature maps with different resolutions, which is an encoding process, the process aims to extract high-level semantic information (low-resolution feature map) and low-level structural information (high-resolution feature map), then a decoding process is entered, the low-resolution feature map is up-sampled to a high-resolution feature map, and the high-resolution feature map is spliced with the high-resolution feature map of the previous stage, after features are extracted by convolution, and upsampling and splicing operations are carried out again until the feature map is spliced with the feature map with the highest resolution, and the number of channels is adjusted by 1×1 convolution to obtain the required segmentation result. - An existing RefineNet model is similar to the U-Net model, and as shown in
FIG. 4 , the existing RefineNet model can receive feature map inputs of different scales, and combine and refine the feature maps of different scales, so that the feature maps can be conveniently processed subsequently. - The existing RefineNet model is mainly different from the U-Net model in two aspects: an encoder of the RefineNet model uses a ResNet structure popular in the semantic segmentation field, and an encoder of the U-Net model simply uses convolution to extract features; and the RefineNet model uses an original RefineNet module in the decoder, and the module can better refine information of the low-resolution feature map and the high-resolution feature map.
-
FIG. 5 shows a structural schematic diagram of Refine-UNet used for segmenting the angiography image of the coronary artery in the present invention, and it should be noted that the types of feature maps with different resolutions of the angiography image of the coronary artery obtained by the encoder structure of the U-Net model are determined according to actual needs, for example, 5 types, 3 types, 7 types, and the like can be used. - The encoder structure of the U-Net model only uses convolution to obtain feature maps with different resolutions of the angiography image of the coronary artery, thereby avoiding waste of calculating resources and increasing the calculating speed; and the RefineNet module is utilized to refine and then combine the feature maps with high resolution and low resolution, thereby more efficiently utilizing high-level semantic information and low-level structural information and enhancing the accuracy of segmentation.
- S2, calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel.
- Preferably, the S2 specifically comprises:
- S21, extracting the segmented images of the main vessel to obtain an angiography image of a blood vessel skeleton.
- Specifically, as shown in
FIG. 6 , the obtained segmented images of the main vessel can be extracted to obtain the single-pixel-width angiography image of the blood vessel skeleton. - S22, calculating the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton to obtain the lengths of the main vessel in pixels, and calculating in combination with the calibration factor of the image to obtain the actual physical length of the main vessel.
- Specifically, the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton can be calculated by a Fast Marching algorithm.
- The angiography image of the blood vessel skeleton is obtained by extraction, the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton is calculated to obtain the length of the main vessel, the accuracy of the calculated length of the main vessel is improved, and the accuracy of the calculated blood flow rate of the coronary artery is also improved.
- S3, obtaining the blood flow rate of the main vessel on the basis of the calculated change of the lengths of the main vessel with time.
- Preferably, the S3 specifically comprises:
- S31, obtaining a change curve of the lengths of the main vessel with time by taking time as an abscissa and taking the lengths of the main vessel in the segmented images of the main vessel as an ordinate;
- specifically, as shown in
FIG. 7 , the change curve of the lengths of the main vessel with time generally presents a gentle-ascending-gentle “S” shape, in the front section of the sequence of the angiography image of the coronary artery, the main vessel are invisible under X-ray due to the fact that a contrast agent is not injected into the coronary artery, the calculated lengths of the main vessel are generally 0 at the moment, and in the rear section of the sequence of the angiography image of the coronary artery, filling of the contrast agent in the coronary artery is finished, and the calculated lengths of the main vessel are the complete lengths of the main vessel and do not change. - Preferably, the S31 specifically comprises:
- S311, obtaining a change curve of the lengths of the main vessel with frame number by taking the frame number of the segmented images of the main vessel as an abscissa and taking the actual lengths of the main vessel as an ordinate; and
- S312, converting the abscissa in the change curve of the lengths of the main vessel with frame number into time on the basis of frame frequency information to obtain the change curve of the lengths of the main vessel with time.
- S32, selecting a preset section of the change curve of the lengths of the main vessel with time, and calculating the slope of the preset section to obtain the blood flow rate of the main vessel.
- Preferably, the S32 specifically comprises:
- S321, smoothing the change curve of the lengths of the main vessel with time to obtain a smooth curve of the change curve of the lengths of the main vessel with time.
- Specifically, due to heart beat, blood vessel segmentation error and other reasons, a certain noise generally exists on the change curve of the lengths of the main vessel with time, so that the change curve of the lengths of the main vessel with time can be smoothed, and a K-order bezier curve can be used for smoothing the change curve of the lengths of the main vessel with time.
- S322, obtaining the maximum value of the lengths of the main vessel on the smooth curve, and selecting the section, with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section.
- Preferably, the minimum value of the preset value can be 0-20%, and the maximum value of the preset value can be 80-90%.
- S323, judging whether the preselected section contains one cardiac cycle or not according to electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section.
- Specifically, the electrocardiogram of a normal cardiac cycle is shown in
FIG. 8 , wherein fluctuation of QRS wave is significantly higher than that of other waves, the peak of the QRS wave can be detected quickly by using a threshold or other methods, and the time of one cardiac cycle can be obtained according to the time interval between two adjacent QRS waves. - S324, performing straight line fitting on the preset section, and calculating the slope of a straight line obtained by fitting to obtain the blood flow rate of the main vessel.
- Specifically, a linear least square method is used for performing straight line fitting on the preset section, and the slope of the straight line obtained by fitting is the blood flow rate of the main vessel.
- Therefore, the preset section of the change curve of the lengths of the main vessel with time is obtained by the above method, and the blood flow rate of the main vessel is further obtained, so that the calculated blood flow rate of the main vessel is more accurate.
- Preferably, if the preselected section contains one cardiac cycle, then the preset section can be obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- Specifically, since the blood flow rate of the main vessel generally has differences at different stages of the cardiac cycle, a section of the change curve of the lengths of the main vessel with time corresponding to one cardiac cycle is used as the preset section, so that the calculated blood flow rate of the main vessel is more accurate.
- The angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, then the blood flow rate of the main vessel is obtained on the basis of change of the lengths of the main vessel with time, by the calculation method, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple.
- Preferably, the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery are displayed, and a user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- Specifically, as shown in
FIG. 10 andFIG. 11 , a display apparatus can be used for displaying the change curve of the lengths of the main vessel with time and the electrocardio information of the coronary artery corresponding to the change curve for the user, the blood flow rate, obtained by performing straight line fitting on the preset section, of the main vessel is displayed, as shown inFIG. 10 , the user can check different frames of the angiography image of the coronary artery by scrolling a mouse wheel or clicking any position on the change curve in a right image window of a display interface, as shown inFIG. 11 , the right image window of the display interface can also be switched to a multi-window mode by clicking a certain function icon by means of a mouse, so as to check the angiography image of the coronary artery corresponding to the preset section, the selected preset section is verified, if the selected preset section is unreasonable, the selected preset section is adjusted manually, and the blood flow rate, displayed on the display interface, of the main vessel is updated in real time according to the selected preset section. - When the user thinks that an automatically selected preset section is unreasonably selected, the user can manually adjust the selected preset section, so as to ensure the reasonability of the selected preset section and further ensure that the blood flow rate of the coronary artery is more accurate.
- A method for calculating blood flow reserve of a coronary artery comprising the method for calculating the blood flow rate of a coronary artery comprises the following steps:
- calculating the blood flow rate of the main vessel in a resting state and the blood flow rate of the main vessel in a hyperemic state by the method for calculating the blood flow rate in a coronary artery according to any one of the embodiments mentioned above, and obtaining the blood flow reserve of the coronary artery according to the calculated blood flow rate of the main vessel in the resting state and the calculated blood flow rate of the main vessel in the hyperemic state.
- Specifically, one sequence of the angiography image of the coronary artery is selected, the blood flow rate of the main vessel in one state is calculated by using the method for calculating the blood flow rate in a coronary artery, as shown in
FIG. 12 , an icon (CFR icon) for calculating blood flow reserve of the coronary artery on the display interface of the display apparatus is clicked, then, another sequence of the angiography image of the coronary artery is selected, the state of the main vessel in the other sequence of the angiography image of the coronary artery is opposite to the state of the main vessel in the one sequence of the angiography image of the coronary artery, the display apparatus displays the type selection of the state (a resting state or a hyperemic state) of the main vessel in the other sequence of the angiography image of the coronary artery for the user, the state of the main vessel in the one sequence of the angiography image of the coronary artery is determined according to the selection of the user, then the blood flow rate of the main vessel in another state is calculated, the blood flow reserve of the coronary artery is obtained according to the calculated blood flow rate of the main vessel in the resting state and the calculated blood flow rate of the main vessel in the hyperemic state, and as shown inFIG. 13 , the blood flow reserve of the coronary artery is displayed. - Preferably, by the method for calculating the blood flow rate in a coronary artery, the blood flow rate of the main vessel in the resting state and the blood flow rate of the main vessel in the hyperemic state are respectively calculated on the basis of the angiography image of the main vessel in the resting state and the angiography image of the coronary artery in the hyperemic state, wherein a time difference between the acquisition time of the angiography image of the coronary artery when the main vessel are in the resting state and the acquisition time of the angiography image of the coronary artery when the main vessel are in the hyperemic state is not greater than a first time threshold.
- Specifically, the first time threshold can be 7 days, or 15 days, or the like and is determined according to the actual situation, and the time difference between the acquisition time of the angiography image of the coronary artery when the main vessel are in the resting state and the acquisition time of the angiography image of the coronary artery when the main vessel are in the hyperemic state is not greater than the first time threshold, so that the accuracy of the calculated blood flow reserve of the coronary artery can be ensured.
- By the method for calculating the blood flow reserve of the coronary artery, the automation of the calculation of the blood flow reserve of the coronary artery is realized, the calculated blood flow reserve of the coronary artery is more accurate, and the calculation method is simple.
- As shown in
FIG. 14 , an apparatus for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention for implementing the method for calculating the blood flow rate in a coronary artery according to an embodiment of the present invention comprises a coronary artery angiographyimage segmenting module 20, alength calculating module 30 and a blood flowrate calculating module 40. - The coronary artery angiography
image segmenting module 20 is used for acquiring an angiography image of the coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of a main vessel. - The
length calculating module 30 is used for calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel. - The blood flow
rate calculating module 40 is used for obtaining the blood flow rate of the main vessel on the basis of the calculated change of the lengths of the main vessel with time. - Preferably, the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, and the display apparatus is used for displaying type selection of the main vessel of the coronary artery for a user;
- the coronary artery angiography
image segmenting module 20 is used for acquiring the angiography image of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by the user, of the main vessel to obtain the segmented images of the main vessel. - Preferably, the coronary artery angiography
image segmenting module 20 is used for judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type or not on the basis of the type, selected by the user, of the main vessel; wherein - if the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type, the angiography image of the coronary artery is segmented by using deep learning, and the segmented images of the main vessel are obtained; and
- if the projection angle of the angiography image of the coronary artery is not within the required angle range of the main vessel of this type, the display apparatus is used for displaying a prompt message for the user.
- Preferably, the coronary artery angiography
image segmenting module 20 is used for acquiring feature maps with different resolutions of the angiography image of the coronary artery by means of an encoder structure of a U-Net model, and then refining and combining the feature maps with different resolutions by utilizing a RefineNet module to obtain the segmented images of the main vessel. - Preferably, the
length calculating module 30 is used for extracting the segmented images of the main vessel to obtain an angiography image of a blood vessel skeleton, calculating the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton to obtain the lengths of the main vessel in pixels, and calculating in combination with a calibration factor of the image to obtain the actual physical length of the main vessel. - Preferably, the blood flow
rate calculating module 40 is used for obtaining a change curve of the length of the main vessel with time by taking time as an abscissa and taking the lengths of the main vessel in the segmented images of the main vessel as an ordinate, selecting a preset section of the change curve of the lengths of the main vessel with time, and calculating the slope of the preset section to obtain the blood flow rate of the main vessel. - Preferably, the blood flow
rate calculating module 40 is used for obtaining a change curve of the lengths of the main vessel with frame number by taking the frame number of the segmented images of the main vessel as an abscissa and taking the actual lengths of the main vessel as an ordinate, and converting the abscissa in the change curve of the lengths of the main vessel with frame number into time on the basis of frame frequency information to obtain the change curve of the lengths of the main vessel with time. - Preferably, the blood flow
rate calculating module 40 is used for smoothing the change curve of the lengths of the main vessel with time to obtain a smooth curve of the change curve of the lengths of the main vessel with time; obtaining the maximum value of the lengths of the main vessel on the smooth curve; selecting the section, with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section; judging whether the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section; and - performing straight line fitting on the preset section, and calculating the slope of a straight line obtained by fitting to obtain the blood flow rate of the main vessel.
- Preferably, if the preselected section contains one cardiac cycle, then the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- Preferably, the apparatus for calculating the blood flow rate in a coronary artery further comprises a display apparatus, the display apparatus is used for displaying the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery for the user, and the user checks the angiography image of the coronary artery corresponding to the preset section, and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- The angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, and further the blood flow rate of the main vessel is obtained on the basis of the change of the lengths of the main vessel with time, by the apparatus for calculating the blood flow rate of the coronary artery, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple.
- As shown in
FIG. 15 , based on the inventive concept the same as that of the method for calculating the blood flow rate in a coronary artery, the present application further provides anelectronic device 1400, theelectronic device 1400 comprises one ormore processors 1401 and one ormore memories 1402, and thememories 1402 store computer readable codes, - wherein the computer readable codes perform the following processing when executed by the one or more processors 1401:
- S1, acquiring an angiography image of the coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of main vessel;
- S2, calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel; and
- S3, obtaining the blood flow rate of the main vessel on the basis of the calculated change of the lengths of the main vessel with time.
- Preferably, the S1 specifically comprises: acquiring the angiography image of the coronary artery, displaying type selection of the main vessel of the coronary artery, and segmenting the angiography image of the coronary artery by using deep learning on the basis of the type, selected by the user, of the main vessel to obtain the segmented images of the main vessel.
- Preferably, the S1 further comprises: judging whether the projection angle of the angiography image of the coronary artery is within a required angle range of the main vessel of this type or not on the basis of the type, selected by the user, of the main vessel; wherein
- if the projection angle of the angiography image of the coronary artery is within the required angle range of the main vessel of this type, the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel; and
- if the projection angle of the angiography image of the coronary artery is not within the required angle range of the main vessel of this type, a prompt message is displayed.
- Preferably, the step of segmenting the angiography image of the coronary artery by using deep learning to obtain the segmented images of the main vessel specifically comprises:
- acquiring a plurality of feature maps with different resolutions of the angiography image of the coronary artery by means of an encoder structure of a U-Net model, and further refining and combining the plurality of feature maps with different resolutions by utilizing a RefineNet module to obtain the segmented images of the main vessel.
- Preferably, the S2 specifically comprises:
- S21, extracting the segmented images of the main vessel to obtain an angiography image of a blood vessel skeleton; and
- S22, calculating the length of the blood vessel skeleton in the angiography image of the blood vessel skeleton to obtain the lengths of the main vessel in pixels, and calculating in combination with a calibration factor of the image to obtain the actual physical length of the main vessel.
- Preferably, the S3 specifically comprises:
- S31, obtaining a change curve of the lengths of the main vessel with time by taking time as an abscissa and taking the lengths of the main vessel in the segmented images of the main vessel as an ordinate; and
- S32, selecting a preset section of the change curve of the lengths of the main vessel with time, and calculating the slope of the preset section to obtain the blood flow rate of the main vessel.
- Preferably, the S31 specifically comprises:
- S311, obtaining a change curve of the lengths of the main vessel with frame number by taking the frame number of the segmented images of the main vessel as an abscissa and taking the actual lengths of the main vessel as an ordinate; and
- S312, converting the abscissa in the change curve of the lengths of the main vessel with frame number into time on the basis of frame frequency information to obtain the change curve of the lengths of the main vessel with time.
- Preferably, the S32 specifically comprises:
- smoothing the change curve of the lengths of the main vessel with time to obtain a smooth curve of the change curve of the lengths of the main vessel with time;
- obtaining the maximum value of the lengths of the main vessel on the smooth curve, and selecting the section, with the lengths of the main vessel on the smooth curve being a preset value of the maximum value of the lengths of the main vessel, as a preset section area, wherein the section, opposite to the preset section area on the smooth curve, of the change curve of the lengths of the main vessel with time is a preselected section;
- judging whether the preselected section contains one cardiac cycle or not according to the electrocardio information of the coronary artery corresponding to the preselected section, wherein if the preselected section does not contain one cardiac cycle, it is determined that the preselected section is the preset section; and
- performing straight line fitting on the preset section, and calculating the slope of a straight line obtained by fitting to obtain the blood flow rate of the main vessel.
- Preferably, if the preselected section contains one cardiac cycle, then the preset section is obtained by extending toward two ends of the preselected section by the length of half of the cardiac cycle respectively by taking the center of the preselected section as a starting point.
- Preferably, the change curve of the lengths of the main vessel with time, the angiography image of the coronary artery and the electrocardio information of the coronary artery corresponding to the angiography image of the coronary artery are displayed, and the user checks the angiography image of the coronary artery corresponding to the preset section and the electrocardio information of the coronary artery, verifies the selected preset section, and manually adjusts the selected preset section if the preset section is unreasonably selected.
- Further, the
electronic device 1400 further comprises anetwork interface 1403, aninput device 1404, ahard disk 1405, and adisplay device 1406. - The various interfaces and devices described above can be interconnected by bus architecture. The bus architecture can comprise any number of interconnected buses and bridges. Specifically, the bus architecture can connect various circuits of one or more central processing units (CPUs) represented by the
processor 1401, and various circuits of one ormore memories 1402 represented by thememory 1402 together. The bus architecture can also connect various other circuits such as peripherals, voltage regulators and power management circuits. It will be appreciated that the bus architecture is used for implementing connection communication between these components. The bus architecture comprises a power bus, a control bus, and a status signal bus in addition to a data bus, all of the above content is well known in the art and therefore will not be described in detail herein. - The
network interface 1403 can be connected to a network (such as the Internet and the local area network), and related data can be acquired from the network, and be stored in thehard disk 1405. - The
input device 1404 can receive various instructions input by an operator, and transmit the instructions to theprocessor 1401 for execution. Theinput device 1404 can comprise a keyboard or a clicking device (such as a mouse, a trackball, a touch panel, or a touch screen and the like). - The
display device 1406 can display a result obtained by theprocessor 1401 executing the instructions. - The
memory 1402 is used for storing programs and data which are necessary for running of anoperating system 14021, and data such as intermediate results in the calculating process of theprocessor 1401. - It will be appreciated that the
memory 1402 in the embodiments of the present application can be either a volatile memory or a nonvolatile memory, or can comprise both a volatile memory and a nonvolatile memory. The nonvolatile memory can be a read only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which acts as an external cache memory. Thememory 1402 of the apparatus and method the described herein is intended to include, without being limited to, these and any other suitable types of memories. - In some embodiments, the
memory 1402 stores the following elements, executable modules or data structures, or a subset or expanded set thereof: theoperating system 14021 and anapplication 14014. - The
operating system 14021 comprises various system programs, such as a framework layer, a core library layer and a driver layer, and is used for implementing various basic services and processing hardware-based tasks. Theapplication 14014 comprises various applications, such as a browser, and is used for implementing various application services. Programs that implement methods of embodiments of the present application can be included in theapplication 14014. - The method disclosed in the above embodiments of the present application can be applied to the
processor 1401, or can be implemented by theprocessor 1401. Theprocessor 1401 can be an integrated circuit chip having signal processing capabilities. In the implementation process, the steps of the above method can be performed by integrated logic circuits in the form of hardware or instructions in the form of software in theprocessor 1401. Theprocessor 1401 can be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device and discrete hardware component, and can implement or perform the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general purpose processor can be a microprocessor or the processor can be any conventional processor or the like. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory and a register. The storage medium is located in thememory 1402, and theprocessor 1401 reads the information in thememory 1402, and implements the steps of the above method in combination with the hardware thereof. - It will be appreciated that the embodiments described herein can be implemented by hardware, software, firmware, middleware, microcode, or a combination thereof. For implementation by hardware, processing units can be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units used for performing the functions described in the present application, or a combination thereof.
- With regard to implementation by software, the techniques described herein can be implemented by means of modules (such as procedures and functions) that perform the functions described herein. The software codes can be stored in a memory and executed by a processor. The memory can be implemented within the processor or external to the processor.
- In the embodiments of the present application, by the
electronic device 1400, the angiography image of the coronary artery is segmented by using deep learning to obtain the segmented images of the main vessel, the length of the main vessel in each image frame are calculated, then the blood flow rate of the main vessel is obtained on the basis of the change of the lengths of the main vessel with time, by the electronic device for calculating the blood flow rate in a coronary artery, the automation of the calculation of the blood flow rate of the coronary artery is realized, the calculated blood flow rate of the coronary artery is more accurate, and the calculation method is simple. - In addition, an embodiment of the present application further provides a computer storage medium, the computer storage medium stores computer readable codes, and the computer readable codes perform the following processing when executed by one or more processors:
- S1, acquiring an angiography image of the coronary artery, segmenting the angiography image of the coronary artery by using deep learning, and obtaining segmented images of main vessel;
- S2, calculating the length of the main vessel in each segmented image frame on the basis of the segmented images of the main vessel; and
- S3, obtaining the blood flow rate of the main vessel on the basis of the calculated change of the lengths of the main vessel with time.
- When the computer readable codes are executed by the processor, various processes of the above embodiments of the method for calculating the blood flow rate in a coronary artery are implemented, the same technical effects can be achieved, and in order to avoid repetition, detailed processes will not be described here again. The computer storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
- In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus can be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one type of logical functional division, and other divisions can be realized in practice, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection can be indirect coupling or communication connection through some interfaces, devices or units, and can be in an electrical, mechanical or other form.
- In addition, functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be separately and physically included, or two or more units can be integrated into one unit. The integrated unit can be implemented in the form of hardware, or in the form of hardware plus a software functional unit.
- The technical features of the above described embodiments can be arbitrarily combined. In order to simplify the description, all possible combinations of the technical features in the above described embodiments are not described. However, as long as these combinations of the technical features do not have contradictions, these combinations should all be considered to be within the scope described in the description.
- The above described embodiments express only several embodiments of the present invention, which are described in a more specific and detailed manner, but cannot therefore be understood as a limitation to the scope of the invention patent. It should be pointed out that for those of ordinary skill in the art, on the premise of not departing from the concept of the present invention, several modifications and improvements can be made to the present invention, ad all belong to the scope of protection of the present invention. Therefore, the scope of protection of the invention patent should be subject to the attached claims.
Claims (23)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010134217.7A CN111369519B (en) | 2020-03-02 | 2020-03-02 | Method and device for calculating blood flow velocity of coronary artery and electronic equipment |
CN202010134217.7 | 2020-03-02 | ||
PCT/CN2021/073277 WO2021175039A1 (en) | 2020-03-02 | 2021-01-22 | Method and apparatus for calculating blood flow rate in coronary artery, and electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230108647A1 true US20230108647A1 (en) | 2023-04-06 |
Family
ID=71206516
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/802,838 Pending US20230108647A1 (en) | 2020-03-02 | 2021-01-22 | Method and Apparatus for Calculating Blood Flow Rate in Coronary Artery, and Electronic Device |
Country Status (5)
Country | Link |
---|---|
US (1) | US20230108647A1 (en) |
EP (1) | EP4104766B1 (en) |
JP (1) | JP7445779B2 (en) |
CN (2) | CN111369519B (en) |
WO (1) | WO2021175039A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116205917A (en) * | 2023-04-28 | 2023-06-02 | 杭州脉流科技有限公司 | Method, device, computer device and storage medium for obtaining coronary blood flow reserve |
CN116206162A (en) * | 2023-04-28 | 2023-06-02 | 杭州脉流科技有限公司 | Coronary blood flow reserve acquisition method, device and equipment based on contrast image |
US20230281822A1 (en) * | 2022-03-03 | 2023-09-07 | Industry-Acadamic Cooperation Foundation, Yonsei University | Segmentation system and method of an ascending aorta and a coronary artery from ccta using a hybrid approach |
US11776240B1 (en) * | 2023-01-27 | 2023-10-03 | Fudan University | Squeeze-enhanced axial transformer, its layer and methods thereof |
US12039685B2 (en) | 2019-09-23 | 2024-07-16 | Cathworks Ltd. | Methods, apparatus, and system for synchronization between a three-dimensional vascular model and an imaging device |
US12079994B2 (en) | 2019-04-01 | 2024-09-03 | Cathworks Ltd. | Methods and apparatus for angiographic image selection |
US12138027B2 (en) | 2016-05-16 | 2024-11-12 | Cath Works Ltd. | System for vascular assessment |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111369519B (en) * | 2020-03-02 | 2021-09-17 | 博动医学影像科技(上海)有限公司 | Method and device for calculating blood flow velocity of coronary artery and electronic equipment |
CN112309542B (en) * | 2020-07-27 | 2021-06-15 | 李星阳 | Heart bypass mode selection system |
CN112674736B (en) * | 2021-01-08 | 2023-07-25 | 上海博动医疗科技股份有限公司 | Monitoring display method and system for automatically evaluating vascular deformation |
CN113706559A (en) * | 2021-09-13 | 2021-11-26 | 复旦大学附属中山医院 | Blood vessel segmentation extraction method and device based on medical image |
KR20240131843A (en) * | 2023-02-24 | 2024-09-02 | 주식회사 메디픽셀 | Method and system for computing blood flow velocity based on medical image |
CN119338803B (en) * | 2024-12-18 | 2025-04-04 | 深圳睿心智能医疗科技有限公司 | Method for determining blood vessel flow velocity and computer equipment |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080262346A1 (en) * | 2004-12-08 | 2008-10-23 | Tsuriel Assis | Method And Apparatus For Blood Vessel Parameter Determinations |
US20100172567A1 (en) * | 2007-04-17 | 2010-07-08 | Prokoski Francine J | System and method for using three dimensional infrared imaging to provide detailed anatomical structure maps |
US20150269352A1 (en) * | 2014-03-24 | 2015-09-24 | Heartflow, Inc. | Systems and methods for modeling changes in patient-specific blood vessel geometry and boundary conditions |
US20180235573A1 (en) * | 2017-02-21 | 2018-08-23 | General Electric Company | Systems and methods for intervention guidance using a combination of ultrasound and x-ray imaging |
US20180310888A1 (en) * | 2015-12-02 | 2018-11-01 | Siemens Healthcare Gmbh | Personalized assessment of patients with acute coronary syndrome |
US10282841B1 (en) * | 2011-01-03 | 2019-05-07 | The United States Of America As Represented By The Administrator Of The Nasa | Bioinformatic analysis of vascular patterning |
US20190155973A1 (en) * | 2017-11-02 | 2019-05-23 | Airworks Solutions, Inc. | Methods and apparatus for automatically defining computer-aided design files using machine learning, image analytics, and/or computer vision |
US20190261945A1 (en) * | 2018-02-26 | 2019-08-29 | Siemens Medical Solutions Usa, Inc. | Three-Dimensional Segmentation from Two-Dimensional Intracardiac Echocardiography Imaging |
US20190387981A1 (en) * | 2018-06-26 | 2019-12-26 | General Electric Company | System and method for evaluating blood flow in a vessel |
CN110786840A (en) * | 2019-11-04 | 2020-02-14 | 苏州润迈德医疗科技有限公司 | Method, device and storage medium for obtaining blood vessel evaluation parameter based on physiological parameter |
US20210298706A1 (en) * | 2018-07-24 | 2021-09-30 | Pulse Medical Imaging Technology (Shanghai) Co. Ltd. | Method and apparatus for processing blood vessel image, storage medium, and imaging device |
US11141123B2 (en) * | 2014-12-02 | 2021-10-12 | Koninklijke Philips N.V. | Fractional flow reserve determination |
US20210382497A1 (en) * | 2019-02-26 | 2021-12-09 | Imperial College Of Science, Technology And Medicine | Scene representation using image processing |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
IN2013KO01322A (en) | 2013-11-22 | 2015-05-29 | Siemens Medical Solutions | |
CN105096388B (en) * | 2014-04-23 | 2019-02-05 | 北京冠生云医疗技术有限公司 | Coronary flow analogue system and method based on Fluid Mechanics Computation |
CN105326486B (en) * | 2015-12-08 | 2017-08-25 | 博动医学影像科技(上海)有限公司 | Vascular pressure difference and the computational methods and system of blood flow reserve fraction |
CN105559810B (en) * | 2015-12-10 | 2017-08-08 | 博动医学影像科技(上海)有限公司 | The computational methods of vascular units time CBF and VPV |
US10206646B2 (en) | 2016-03-10 | 2019-02-19 | Siemens Healthcare Gmbh | Method and system for extracting centerline representation of vascular structures in medical images via optimal paths in computational flow fields |
EP3375364B1 (en) * | 2017-01-23 | 2024-08-28 | Shanghai United Imaging Healthcare Co., Ltd. | System and method for analyzing blood flow state |
CN110226923B (en) * | 2018-03-05 | 2021-12-14 | 苏州润迈德医疗科技有限公司 | Method for measuring fractional flow reserve without vasodilator |
CN109754402B (en) * | 2018-03-15 | 2021-11-19 | 京东方科技集团股份有限公司 | Image processing method, image processing apparatus, and storage medium |
CN110448319B (en) * | 2018-05-08 | 2023-04-28 | 上海博动医疗科技股份有限公司 | Blood flow velocity calculation method based on contrast image and coronary artery |
CN109065170B (en) | 2018-06-20 | 2021-11-19 | 博动医学影像科技(上海)有限公司 | Method and device for acquiring blood vessel pressure difference |
CN109509192B (en) * | 2018-10-18 | 2023-05-30 | 天津大学 | Semantic segmentation network integrating multi-scale feature space and semantic space |
CN109686450A (en) * | 2018-12-22 | 2019-04-26 | 北京工业大学 | A kind of Coronary Blood Flow Reserve score calculation method based on ultrasound and CT imaging technique |
CN109805949B (en) | 2019-03-19 | 2020-05-22 | 苏州润迈德医疗科技有限公司 | Method for calculating fractional flow reserve based on pressure sensor and contrast image |
CN109907772B (en) * | 2019-04-15 | 2020-11-10 | 博动医学影像科技(上海)有限公司 | Method and device for obtaining coronary blood flow volume and blood flow velocity |
CN110136147A (en) * | 2019-05-21 | 2019-08-16 | 湖北工业大学 | A method, device and storage medium for segmenting medical images based on U-Net model |
CN110335670A (en) * | 2019-06-10 | 2019-10-15 | 北京深睿博联科技有限责任公司 | Image processing method and device for the classification of epiphysis grade |
CN110350958B (en) * | 2019-06-13 | 2021-03-16 | 东南大学 | CSI multi-time rate compression feedback method of large-scale MIMO based on neural network |
CN110674824A (en) * | 2019-09-26 | 2020-01-10 | 五邑大学 | Finger vein segmentation method and device based on R2U-Net and storage medium |
CN111369519B (en) * | 2020-03-02 | 2021-09-17 | 博动医学影像科技(上海)有限公司 | Method and device for calculating blood flow velocity of coronary artery and electronic equipment |
-
2020
- 2020-03-02 CN CN202010134217.7A patent/CN111369519B/en active Active
- 2020-03-02 CN CN202110830640.5A patent/CN113487588B/en active Active
-
2021
- 2021-01-22 EP EP21765234.6A patent/EP4104766B1/en active Active
- 2021-01-22 JP JP2022551789A patent/JP7445779B2/en active Active
- 2021-01-22 US US17/802,838 patent/US20230108647A1/en active Pending
- 2021-01-22 WO PCT/CN2021/073277 patent/WO2021175039A1/en unknown
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080262346A1 (en) * | 2004-12-08 | 2008-10-23 | Tsuriel Assis | Method And Apparatus For Blood Vessel Parameter Determinations |
US20100172567A1 (en) * | 2007-04-17 | 2010-07-08 | Prokoski Francine J | System and method for using three dimensional infrared imaging to provide detailed anatomical structure maps |
US10282841B1 (en) * | 2011-01-03 | 2019-05-07 | The United States Of America As Represented By The Administrator Of The Nasa | Bioinformatic analysis of vascular patterning |
US20150269352A1 (en) * | 2014-03-24 | 2015-09-24 | Heartflow, Inc. | Systems and methods for modeling changes in patient-specific blood vessel geometry and boundary conditions |
US11141123B2 (en) * | 2014-12-02 | 2021-10-12 | Koninklijke Philips N.V. | Fractional flow reserve determination |
US20180310888A1 (en) * | 2015-12-02 | 2018-11-01 | Siemens Healthcare Gmbh | Personalized assessment of patients with acute coronary syndrome |
US20180235573A1 (en) * | 2017-02-21 | 2018-08-23 | General Electric Company | Systems and methods for intervention guidance using a combination of ultrasound and x-ray imaging |
US20190155973A1 (en) * | 2017-11-02 | 2019-05-23 | Airworks Solutions, Inc. | Methods and apparatus for automatically defining computer-aided design files using machine learning, image analytics, and/or computer vision |
US20190261945A1 (en) * | 2018-02-26 | 2019-08-29 | Siemens Medical Solutions Usa, Inc. | Three-Dimensional Segmentation from Two-Dimensional Intracardiac Echocardiography Imaging |
US20190387981A1 (en) * | 2018-06-26 | 2019-12-26 | General Electric Company | System and method for evaluating blood flow in a vessel |
US20210298706A1 (en) * | 2018-07-24 | 2021-09-30 | Pulse Medical Imaging Technology (Shanghai) Co. Ltd. | Method and apparatus for processing blood vessel image, storage medium, and imaging device |
US20210382497A1 (en) * | 2019-02-26 | 2021-12-09 | Imperial College Of Science, Technology And Medicine | Scene representation using image processing |
CN110786840A (en) * | 2019-11-04 | 2020-02-14 | 苏州润迈德医疗科技有限公司 | Method, device and storage medium for obtaining blood vessel evaluation parameter based on physiological parameter |
Non-Patent Citations (7)
Title |
---|
Chen, Xueying, Rong Zhang, and Pingkun Yan. "Feature fusion encoder decoder network for automatic liver lesion segmentation." 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019). IEEE, 2019. (Year: 2019) * |
Dinesh, P., and Ramanathan Lakshmanan. "Deep Learning-Driven Citrus Disease Detection: A Novel Approach with DeepOverlay L-UNet and VGG-RefineNet." (Year: 2024) * |
Machine Translation of CN 110786840 A (Year: 2020) * |
Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. "U-net: Convolutional networks for biomedical image segmentation."–MICCAI 2015: 18th international conference, proceedings, part III 18. Springer International Publishing, 2015. (Year: 2015) * |
Sivasubramanian, Arrun, Jayanth Mohan, and V. Sowmya. "CASe_UNet: Multi-level Multi-scale UNet for Medical Image Segmentation." International Conference on Computer Vision, High-Performance Computing, Smart Devices, and Networks. Singapore: Springer Nature Singapore, 2023. (Year: 2023) * |
Tsai TH, Huang SA. Refined U-net: A new semantic technique on hand segmentation. Neurocomputing. 2022 Jul 21;495:1-0. (Year: 2022) * |
Ueda D, Shimazaki A, Miki Y. Technical and clinical overview of deep learning in radiology. Japanese journal of radiology. 2019 Jan 25;37:15-33. (Year: 2019) * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US12138027B2 (en) | 2016-05-16 | 2024-11-12 | Cath Works Ltd. | System for vascular assessment |
US12079994B2 (en) | 2019-04-01 | 2024-09-03 | Cathworks Ltd. | Methods and apparatus for angiographic image selection |
US12039685B2 (en) | 2019-09-23 | 2024-07-16 | Cathworks Ltd. | Methods, apparatus, and system for synchronization between a three-dimensional vascular model and an imaging device |
US20230281822A1 (en) * | 2022-03-03 | 2023-09-07 | Industry-Acadamic Cooperation Foundation, Yonsei University | Segmentation system and method of an ascending aorta and a coronary artery from ccta using a hybrid approach |
US12198350B2 (en) * | 2022-03-03 | 2025-01-14 | Industry-Academic Cooperation Foundation, Yonsei University | Segmentation system and method of an ascending aorta and a coronary artery from CCTA using a hybrid approach |
US11776240B1 (en) * | 2023-01-27 | 2023-10-03 | Fudan University | Squeeze-enhanced axial transformer, its layer and methods thereof |
CN116205917A (en) * | 2023-04-28 | 2023-06-02 | 杭州脉流科技有限公司 | Method, device, computer device and storage medium for obtaining coronary blood flow reserve |
CN116206162A (en) * | 2023-04-28 | 2023-06-02 | 杭州脉流科技有限公司 | Coronary blood flow reserve acquisition method, device and equipment based on contrast image |
Also Published As
Publication number | Publication date |
---|---|
CN111369519A (en) | 2020-07-03 |
WO2021175039A1 (en) | 2021-09-10 |
JP2023516013A (en) | 2023-04-17 |
EP4104766A1 (en) | 2022-12-21 |
CN113487588A (en) | 2021-10-08 |
CN113487588B (en) | 2024-03-22 |
EP4104766A4 (en) | 2023-09-13 |
JP7445779B2 (en) | 2024-03-07 |
CN111369519B (en) | 2021-09-17 |
EP4104766B1 (en) | 2025-01-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230108647A1 (en) | Method and Apparatus for Calculating Blood Flow Rate in Coronary Artery, and Electronic Device | |
CN103914852B (en) | DICOM medical images kinematic nonlinearity based on CUDA adjusts window method | |
CN112465834B (en) | Blood vessel segmentation method and device | |
WO2022032824A1 (en) | Image segmentation method and apparatus, device, and storage medium | |
JPH10187936A (en) | Image processor | |
CN106097347A (en) | A kind of multimodal medical image registration and method for visualizing | |
CN112381811B (en) | Method, device and equipment for realizing medical image data annotation | |
CN111091561A (en) | Method, system, device and storage medium for extracting nerve fibers of region of interest | |
CN111754511A (en) | Liver blood vessel segmentation method and device based on deep learning and storage medium | |
CN112348861B (en) | Image processing method, device, equipment and storage medium | |
CN111260619A (en) | Tongue body automatic segmentation method based on U-net model | |
CN112950734B (en) | Coronary reconstruction method, device, electronic equipment and storage medium | |
CN112801964B (en) | Multi-label intelligent detection method, device, equipment and medium for lung CT image | |
CN109685143A (en) | A kind of thyroid gland technetium sweeps the identification model construction method and device of image | |
CN116363314A (en) | Labeling method, labeling device, electronic equipment and computer-readable storage medium | |
CN116030256A (en) | Small object segmentation method, small object segmentation system, device and medium | |
CN110619668B (en) | Image abstraction method and device and terminal equipment | |
CN115272361A (en) | Myoma biological tissue segmentation method and electronic equipment | |
CN112767508A (en) | Pseudo color display method, system, device, and medium for respiratory gated image | |
CN114663345B (en) | Fixed point measurement method, fixed point measurement device, electronic equipment and storage medium | |
US20230210473A1 (en) | Clinical diagnostic and patient information systems and methods | |
CN118280533B (en) | Arrival time parameter imaging method, device and product for ultrasound contrast imaging video | |
CN114546199B (en) | Image processing method, device, electronic equipment and storage medium | |
CN113744586B (en) | Magnetic resonance imaging auxiliary information display method, device, equipment and storage medium | |
Tong et al. | STAU-Net: A Spatial Structure Attention Network for 3D Coronary Artery Segmentation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SHANGHAI PULSE MEDICAL TECHNOLOGY, INC., CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TU, SHENGXIAN;ZHAO, QIUYANG;GUTIERREZ-CHICO, JUAN LUIS;AND OTHERS;REEL/FRAME:061171/0702 Effective date: 20220826 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |