+

WO2018167816A1 - Appareil d'imagerie - Google Patents

Appareil d'imagerie Download PDF

Info

Publication number
WO2018167816A1
WO2018167816A1 PCT/JP2017/009933 JP2017009933W WO2018167816A1 WO 2018167816 A1 WO2018167816 A1 WO 2018167816A1 JP 2017009933 W JP2017009933 W JP 2017009933W WO 2018167816 A1 WO2018167816 A1 WO 2018167816A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
region
image processing
weak change
area
Prior art date
Application number
PCT/JP2017/009933
Other languages
English (en)
Japanese (ja)
Inventor
晴雄 宇野
Original Assignee
株式会社島津製作所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社島津製作所 filed Critical 株式会社島津製作所
Priority to JP2019505314A priority Critical patent/JP6638859B2/ja
Priority to PCT/JP2017/009933 priority patent/WO2018167816A1/fr
Publication of WO2018167816A1 publication Critical patent/WO2018167816A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B10/00—Instruments for taking body samples for diagnostic purposes; Other methods or instruments for diagnosis, e.g. for vaccination diagnosis, sex determination or ovulation-period determination; Throat striking implements

Definitions

  • the present invention relates to an imaging apparatus, and more particularly to an imaging apparatus including an image processing unit that performs predetermined image processing on a captured image.
  • an imaging apparatus including an image processing unit that performs predetermined image processing on a captured image is known.
  • Such an imaging apparatus is disclosed in, for example, Japanese Patent Application Laid-Open No. 2015-188559.
  • Japanese Patent Application Laid-Open No. 2015-188559 discloses a camera (imaging unit) that captures infrared rays (fluorescence) generated from a contrast medium injected into an imaging target by irradiating infrared rays (excitation light), and an image is captured by the camera.
  • a medical imaging apparatus image processing apparatus including an image processing unit that performs image processing on the infrared rays and a display unit that displays an infrared image that has been subjected to image processing is disclosed. Then, an infrared image of the contrast agent displayed on the display unit is judged and diagnosed by a doctor's visual (visual).
  • the present invention has been made to solve the above-described problems, and one object of the present invention is to suppress the occurrence of oversight by a user in an area where the change in luminance value is small. It is providing the imaging device which can display an image on.
  • an imaging apparatus includes an imaging unit for imaging an imaging target, and image processing for processing an image of the imaging target captured by the imaging unit. And a control unit that controls the imaging unit and causes the display unit to display an image captured by the imaging unit, and the image processing unit is a region where a change in luminance value has occurred in the image captured by the imaging unit Among these, a weak change area where a change in luminance value smaller than the first threshold value is determined is determined, and predetermined image processing for sharpening is performed on an area near the weak change area.
  • the control unit is configured to cause the display unit to display an image on which predetermined image processing has been performed on a region in the vicinity of the weak change region.
  • the image processing unit is smaller than the first threshold value in the region where the luminance value has changed in the image captured by the imaging unit.
  • a weak change area where a change in luminance value has occurred is determined, and predetermined image processing for sharpening is performed on an area in the vicinity of the weak change area, and the control unit is set in an area in the vicinity of the weak change area.
  • the display unit is configured to display an image on which predetermined image processing for sharpening has been performed. As a result, the area in the vicinity of the weak change area is sharpened, and therefore, an area over which the change in the brightness value occurs among areas where the change in the brightness value is small (weak change area) is overlooked by the user. An image can be displayed so as to suppress this.
  • “change in luminance value” indicates a change in luminance value from a certain reference image (for example, an image in an initial state).
  • the image processing unit is preferably configured to perform predetermined image processing for emphasizing the weak change region on a region other than the weak change region near the weak change region. Yes.
  • an area where the change in luminance value is relatively small without changing information on the area where the luminance value has changed (relative luminance or the like)
  • An image can be displayed so as to suppress the occurrence of oversight by the user.
  • the image processing unit is configured to perform predetermined image processing for emphasizing the weak change region by surrounding the region near the weak change region with a frame line.
  • predetermined image processing for emphasizing the weak change region by surrounding the region near the weak change region with a frame line.
  • the image processing unit is other than the weak change region in the vicinity of the weak change region.
  • This area is configured to perform predetermined image processing for emphasizing the weakly changed area by painting the area with a predetermined color.
  • an area with a relatively small change in luminance value (weakly changing area) is filled with a color without changing information on the area in which the luminance value has changed (such as relative luminance).
  • the image can be displayed so as to suppress the occurrence of oversight by the user by color painting.
  • the image processing unit is other than the weak change region in the vicinity of the weak change region.
  • predetermined image processing for emphasizing the weak change area is performed.
  • an area with a relatively small change in luminance value (weakly changing area) is highlighted by blinking without changing information on the area in which the luminance value has changed (relative luminance, etc.).
  • the image can be displayed so as to suppress the occurrence of oversight by the user by blinking.
  • the image preferably includes a first image for displaying the entire imaged object and a second image for displaying a specific area of the imaged object
  • the image processing unit discriminates a weak change region in the second image picked up by the image pickup unit from among regions where the luminance value has changed, and a predetermined region for sharpening the region near the weak change region.
  • the control unit is configured to perform image processing, and the control unit superimposes the first image and the second image that has been subjected to predetermined image processing for sharpening the weakly changed region. An image is displayed on the display unit.
  • the 1st image which images the whole to-be-photographed object by visible light, and fluorescence of the contrast agent excited by near-infrared light are imaged, for example.
  • the entire object to be imaged indicates the entire image capturing range of the object to be imaged, and does not mean the entire object to be imaged itself.
  • the image processing unit is preferably configured to perform a thinning process for changing the weakly changed region into a line image.
  • a thinning process for changing the weakly changed region into a line image.
  • “change to a line image” means, for example, image processing in which a portion (peripheral portion) that becomes the edge of a certain image (region) is cut and only a portion that becomes a skeleton of the image (region) is left. Is shown.
  • the image processing unit preferably has a second smaller value than the first threshold value among the weakly changed regions in which the luminance value changes smaller than the first threshold value.
  • the image processing unit performs a process of determining a weak change region when the change amount of the luminance value is equal to or less than the first threshold value and equal to or greater than the lower limit value. It is configured. With this configuration, it is possible to suppress the display of an image in which predetermined image processing for sharpening is erroneously performed on an area in which a luminance value has slightly changed due to noise. .
  • the imaging device it is preferable to input at least one of a parameter for determining the weak change region and a parameter related to how to perform predetermined image processing for sharpening.
  • a parameter for determining the weak change region it is preferable to input at least one of a parameter for determining the weak change region and a parameter related to how to perform predetermined image processing for sharpening.
  • the imaging device preferably further includes a display unit, and the display unit is a predetermined image for sharpening the weak change region with respect to a region other than the weak change region near the weak change region.
  • the processed image is configured to be displayed.
  • the imaging unit includes a fluorescent image that is an image including fluorescence generated from a contrast agent injected into a blood vessel or a lymph vessel of the imaging target, and a visible image that is an image of visible light of the imaging target.
  • the image processing unit is configured to be able to continuously capture images, and in the fluorescence image captured by the imaging unit, while the contrast agent is flowing, the weakly changing region of the fluorescence image is determined.
  • the predetermined image processing for sharpening the weak change region is performed in real time on the region other than the weak change region in the vicinity of the weak change region.
  • a superimposed image obtained by superimposing a fluorescent image on which a predetermined image processing for sharpening is performed on a change area is configured to be displayed in real time.
  • the visible image which images the whole to-be-photographed object by visible light
  • the fluorescence image which images fluorescence of the contrast agent excited by the near-infrared light
  • a user such as a doctor immediately diagnoses during surgery. be able to.
  • the time required for surgery or the like can be shortened.
  • predetermined image processing for sharpening is performed on a region where the fluorescence of the contrast agent is relatively weak (weakly changed region), so the flow of the contrast agent is weak.
  • a superimposed image can be displayed in such a weak change area so as to prevent an oversight by a user such as a doctor.
  • blood vessels and “lymphatic vessels” are broad concepts including the entire vascular system and lymphatic system.
  • lymphatic vessels include lymph nodes.
  • an imaging device capable of displaying an image so as to suppress an oversight by a user from occurring in an area where the change in luminance value is small.
  • FIG. 1 is a block diagram illustrating an overall configuration of an imaging apparatus according to an embodiment of the present invention. It is a figure explaining a mode that the imaging device by one Embodiment of this invention is used. It is an example of the image displayed on the small monitor and external monitor by one Embodiment of this invention. It is a figure explaining the weak change area
  • the imaging apparatus 100 is a medical imaging apparatus that is used for angiography and lymphatic imaging in, for example, surgery or examination.
  • the imaging apparatus 100 can be used for a blood vessel suture operation or a breast cancer sentinel lymph node operation.
  • it is used by a user U (doctor or the like) to confirm (evaluate) the flow of lymph.
  • a user U doctor or the like
  • blood stagnation or backflow may occur in a blood vessel that has been sutured without problems with visual observation with visible light. Confirming that the flow is in progress.
  • the imaging apparatus 100 includes a housing C, an arm unit A, an imaging unit 1, a small monitor 2, a control unit 3, a storage unit 4, and an image processing unit 5. And a wheel portion 6 and an input portion 7.
  • the imaging unit 1 is supported by the arm part A.
  • the small monitor 2 and the arm part A are provided in the upper part of the housing C.
  • the control unit 3, the storage unit 4, and the image processing unit 5 are provided inside the housing C.
  • the wheel unit 6 is provided in the lower part of the housing C.
  • the input unit 7 is provided on the front surface of the housing C.
  • the imaging apparatus 100 is connected to an external monitor M and configured to exchange information (image data and the like).
  • the imaging unit 1 is an example of the “imaging unit” in the claims.
  • the small monitor 2 and the external monitor M are examples of the “display unit” in the claims.
  • the small monitor 2 is an example of a “display unit” included in the imaging device of the claims.
  • the imaging apparatus 100 extracts a visible image Xa (visible light image, see FIG. 3) and a fluorescent image Xb (fluorescence image, see FIG. 3) of the object P (see FIG. 2), and extracts the visible image that has been extracted.
  • a superimposed image Xc obtained by combining Xa and the fluorescence image Xb is output.
  • the visible image Xa displays the entire object to be imaged P (within the imaging range).
  • the fluorescent image Xb is a region (specific region) to which the contrast agent of the imaging target P is administered, which is imaged by near-infrared light having a wavelength that cannot be visually recognized by the naked eye (visually) of the user U (doctor or the like). Is displayed.
  • the visible image Xa and the fluorescent image Xb are examples of the “first image” and the “second image” in the claims, respectively.
  • the imaging unit 1 includes a visible light irradiation unit 11, a near infrared light irradiation unit 12, and a camera unit 13.
  • a plurality of visible light irradiation units 11 and near infrared light irradiation units 12 are arranged so as to surround the periphery of the lens unit 13a of the camera unit 13, and are alternately arranged in a certain pattern (for example, near the visible light irradiation unit 11 and the near light irradiation unit 11).
  • the infrared light irradiators 12 are arranged in an annular shape so that the infrared light irradiators 12 are alternately arranged one by one.
  • the camera unit 13 further includes a beam splitter (not shown) and two imaging element units (not shown) inside.
  • External light information reflected from the surface of the skin S and fluorescence from the contrast agent
  • the visible image Xa and the fluorescent image Xb are continuously captured by the imaging element unit corresponding to each wavelength of the separated external light.
  • the imaging unit 1 is a fluorescence that is an image including a visible image Xa that is a visible light image of the imaging target and fluorescence generated from a contrast agent injected into the blood vessel or lymphatic vessel (lymph node) of the imaging target P.
  • the image Xb can be continuously captured in the form of a moving image.
  • the arrangement of the visible light irradiation unit 11, the beam splitter, and the imaging element unit corresponding to the wavelength of visible light may be omitted.
  • the visible light irradiation part 11 and the near-infrared light irradiation part 12 contain a light emitting diode (LED), for example.
  • the imaging element unit includes, for example, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor: complementary metal oxide semiconductor) image sensor, and the like.
  • the excitation light irradiated from the near infrared light irradiation unit 12 has a wavelength of 780 to 800 nm, for example.
  • the fluorescence generated from the contrast agent (fluorescent agent) administered to the imaging target P has a wavelength of 800 to 850 nm, for example.
  • the contrast agent (fluorescent agent) for example, indocyanine green (ICG) which is a fluorescent dye is used.
  • ICG indocyanine green
  • the excitation light is, for example, near infrared light having a wavelength of 800 nm to 820 nm, and the fluorescence generated from indocyanine green (ICG) is about 830 nm.
  • the region (pixel) in which the near-infrared light in the fluorescence image Xb (contrast agent fluorescence) is detected is For example, it is colored and displayed in an appropriate visible color such as white, blue, or green so that it can be easily distinguished from the color (for example, the color of skin or blood) of the imaging target P (human body) in the visible image Xa. Is done.
  • the visible light (white light) emitted from the visible light irradiation unit 11 is reflected on the surface of the skin S of the imaging target P, and then captured by an imaging element unit (not shown) and displayed as a visible image Xa. Is done.
  • the arm part A expands and contracts while being bent and freely changes the position of the imaging unit 1 to be supported in order to capture the imaging target region of the imaging target P (patient) in the imaging range. It is comprised so that it can be moved.
  • the imaging unit 1 can be freely moved by the user U (doctor or the like) grasping and pulling the grip portion (not shown) of the imaging unit 1 by hand.
  • the position of the imaging unit 1 is fixed at a position where the user U (doctor or the like) releases his / her hand.
  • the arm part A may be driven (moved) by electric power.
  • the small monitor 2 included in the imaging apparatus 100 is disposed on the upper portion of the housing C, and an external monitor M provided separately from the imaging apparatus 100 operates on the imaging target P (patient). It arrange
  • the input unit 7 (described later) ) Can be set.
  • a plurality of external monitors M may be arranged, and the arrangement may be omitted.
  • the small monitor 2 and the external monitor M display the visible image Xa, the fluorescence image Xb, and the superimposed image Xc output from the control unit 3 in real time as shown in FIG. Is configured to be possible.
  • the small monitor 2 and the external monitor M can change and display the arrangement order and the sizes of the visible image Xa, the fluorescent image Xb, and the superimposed image Xc.
  • the small monitor 2 and the external monitor M can also display a selected specific image, for example, by displaying only the superimposed image Xc.
  • Each image in FIG. 3 is an image of a female breast.
  • the control unit 3 is configured by an information processing apparatus such as a PC (personal computer).
  • the control unit 3 includes a CPU (Central Processing Unit) and the like.
  • the control unit 3 causes the PC to function as the control unit 3 of the imaging apparatus 100 by executing a control program stored in the storage unit 4 (described later).
  • the control unit 3 controls the irradiation intensity of visible light and near-infrared light by the imaging unit 1, controls to output parameters (described later) input to the input unit 7 to the image processing unit 5, and the arm unit A. Control for driving the wheel unit 6 and control for displaying the image data output from the image processing unit 5 on the small monitor 2 and the external monitor M are performed.
  • the storage unit 4 includes an HDD (hard disk drive), a memory, and the like, and stores (records) an image captured by the imaging unit 1, an image processed by the image processing unit 5 (described later), and the like.
  • the storage unit 4 stores various programs executed by the control unit 3 and the image processing unit 5. Note that the various images include moving images that are continuously captured.
  • the image processing unit 5 acquires the visible image Xa and the fluorescence image Xb based on the image data (detected signal) acquired by the imaging element unit (not shown) of the imaging unit 1.
  • the image processing unit 5 performs predetermined image processing (described later) for sharpening in a region (weakly changed region) in the vicinity of a region where the change in luminance value of the contrast agent in the fluorescent image Xb is small.
  • the image processing unit 5 generates a superimposed image Xc obtained by superimposing the visible image Xa and the fluorescent image Xb, and displays the superimposed image Xc on the small monitor 2 and the external monitor M via the control unit 3.
  • the image processing unit 5 also performs processing for adjusting luminance values, color tone, and contrast of various images as a whole, processing for removing noise in the image, processing for GUI (graphical user interface) other than the captured image, and the like. May be performed.
  • the wheel unit 6 is easily moved by the user U (doctor or the like) pushing the imaging device 100 by hand, or by driving a drive unit (not shown) connected to the wheel unit 6. It is provided to make it possible. Note that the imaging apparatus 100 may have a stationary configuration without the wheel unit 6.
  • the input unit 7 is configured to accept input of parameters for discriminating the weak change region (described later) and parameters relating to how to perform predetermined image processing (described later). Has been.
  • the input unit 7 has a size of an area in the vicinity of the weak change area designated to emphasize the weak change area by the user U including a doctor, an assistant, an operator (engineer), and the like. For determining the size of the margin (margin portion) of the weakly changing region (see margin RM in FIG. 8). Further, the input unit 7 receives input of parameters relating to the thickness of the frame line displayed for emphasizing the weak change region, the size of the luminance value of the frame line, the color of the frame line, and the like. In addition, the input unit 7 is colored and painted to emphasize the weak change region, and the fill color, the display luminance value, and the blink for the portion other than the weak change region near the weak change region to be blinked.
  • the input unit 7 receives input of parameters relating to setting of values such as the first threshold value Th1, the second threshold value Th2, and the lower limit value ThL. Further, the input unit 7 receives an input of a parameter relating to how much the target area is to be thinned by thinning (to make a line image). In addition, the input unit 7 sets an exceptional region (for example, a region that is not a target for treatment or inspection) in which predetermined image processing (described later) for sharpening such as thinning and highlighting is not performed in the fluorescent image Xb. Accepts input of parameters.
  • the input unit 7 is configured to accept other input operations on the imaging apparatus 100. For example, in addition to the above, the input unit 7 adjusts the irradiation intensity and irradiation range of the visible light irradiation unit 11 and the near-infrared light irradiation unit 12 based on the input operation, and starts and stops irradiation, imaging Input operations relating to adjustment of imaging sensitivity by the unit 1, driving of the arm unit A, adjustment of image display brightness of the small monitor 2 and the external monitor M, display methods of various images, and the like are accepted.
  • the input unit 7 includes input devices such as a keyboard, a mouse, and a touch panel, for example.
  • the imaging apparatus 100 clearly displays various images so as to suppress the occurrence of oversight by the user U (physician or the like) in an area where the change in luminance value is small (an area where the contrast agent flow is weak).
  • the image After performing predetermined image processing for conversion, it is configured to support the confirmation work using the contrast agent that relied on the visual judgment of the user U (doctor or the like). Yes.
  • the image processing unit 5 has a luminance value smaller than the first threshold Th1 in the region where the luminance value has changed in the fluorescent image Xb captured by the imaging unit 1.
  • a weak change area in which a change has occurred is discriminated, and predetermined image processing for sharpening is performed on an area near the weak change area.
  • the image processing unit 5 determines the weak change region of the fluorescent image Xb in the fluorescence image Xb captured by the imaging unit 1 while the contrast agent is being flown, and also weakens in the vicinity of the weak change region. For areas other than the change area, predetermined image processing for sharpening the weak change area is performed in real time.
  • the fluorescence image Xb has a weak flow region (weakly changing region) P1 in which the luminance change due to the fluorescence of the contrast agent is small and the luminance change due to the fluorescence of the contrast agent is large.
  • the user U may overlook the weak flow region (weakly changing region) P1, and therefore image processing (thinning processing and enhancement processing described later) is performed. Is called.
  • the body line of the imaging target P represented by the dotted line in FIG. 4 is not actually captured in the fluorescent image Xb but is captured by the visible image Xa.
  • the image processing unit 5 is smaller in real time than the first threshold value Th1 (see FIG. 6), among the pixels of the fluorescent image Xb, compared to the first threshold value Th1 (see FIG. 6).
  • a pixel region is determined as a weak change region, and thinning processing (see FIGS. 5 and 7) and enhancement processing (see FIGS. 6 and 7), which are predetermined image processing for sharpening, are performed on the weak change region.
  • the first threshold value Th1 may be set as an absolute value, for example, or may be set as a value of a certain percentage (%) with respect to the maximum luminance value of the pixels in the fluorescent image Xb.
  • a histogram of the luminance values of the pixels in the fluorescent image Xb may be acquired and set as a value that includes up to a certain percentage (%) of pixels in the histogram. Further, the parameter relating to the first threshold value Th1 can be changed by the user U (doctor or the like) via the input unit 7.
  • the image processing unit 5 is configured to perform a thinning process for changing the weakly changed region into a line image in the fluorescent image Xb.
  • the width of the lymphatic vessel (blood vessel) P0 is W1
  • the width of the spread of the fluorescence L2 from the contrast agent to be imaged widens as W2.
  • the image processing unit 5 relatively reduces the luminance value of the pixel in the peripheral portion of the target region (the skirt portion in the graph) ( Alternatively, a thinning (line imaging) process is performed in which the portion (peripheral portion) that becomes the edge of the target region is cut and only the portion that becomes the skeleton of the region is left. At this time, the image processing unit 5 does not change the luminance value of the portion serving as the skeleton of the region. As a result, as shown in FIGS. 7A and 7B, the region of the contrast agent that is blurred and spread in the fluorescent image Xb becomes a tubular region that is sharpened and extracted.
  • the image processing unit 5 is configured to perform a thinning process for forming a line image on the display of pixels in which a luminance change stronger than the weakly changing region is generated in the region where the luminance value has changed. May be. Thereby, as shown in FIGS. 7A and 7B, thinning is performed not only in the region where the change in luminance value is small, but also in the region where the change in luminance value is large. As a whole, blurring of the contrast medium becomes sharp and clear.
  • the image processing unit 5 in the fluorescent image Xb is less than the first threshold value Th1 in the weak change region in which the luminance value change smaller than the first threshold value Th1 occurs.
  • a first weak change region in which a change in luminance value smaller than the small second threshold value Th2 occurs is discriminated from other second weak change regions, and the first weak change region in the vicinity of the first weak change region is discriminated.
  • Predetermined image processing is performed to emphasize regions other than the first weak change region more strongly than regions other than the second weak change region in the vicinity of the second weak change region.
  • the image processing unit 5 is configured to perform a process of determining a weak change region when the change amount of the luminance value is equal to or less than the first threshold value Th1 and equal to or greater than the lower limit value ThL.
  • first threshold value Th1> second threshold value Th2> lower limit value ThL there is a relationship of first threshold value Th1> second threshold value Th2> lower limit value ThL.
  • the image processing unit 5 determines a pixel having a luminance value less than the second threshold Th2 and greater than or equal to the lower limit ThL as the first weak change region, and is less than the first threshold Th1 and the second threshold.
  • a pixel having a luminance value equal to or greater than the value Th2 is determined as the second weak change region, and predetermined image processing (described later) for emphasis is performed.
  • the enhancement process is not performed on a pixel in which a change in luminance value smaller than the lower limit value ThL that appears irregularly due to noise or the like occurs.
  • the image processing unit 5 is configured to perform predetermined image processing for emphasizing the weak change region on regions other than the weak change region near the weak change region.
  • the image processing unit 5 is configured to perform image processing so as not to hinder the display of pixels in which the luminance change is stronger than the weak change region among the regions where the luminance value has changed. .
  • the fluorescence image Xb and the superimposed image Xc the information on the fluorescence of the contrast agent flowing through the blood vessels and lymph vessels (lymph nodes) (luminance values, etc.) is accurately displayed without being distorted, and the weakly changed region is emphasized. Is displayed.
  • the flow of the contrast agent in FIG. 6 has already been thinned.
  • the image processing unit 5 surrounds a region near the weak change region with a frame line, paints a region other than the weak change region near the weak change region in a predetermined color, and weakly changes the region. By flashing areas other than the weak change area in the vicinity of, predetermined image processing for emphasizing the weak change area is performed.
  • the first weak change region where the change in the luminance value is larger than the lower limit value ThL and smaller than the second threshold value Th2, and the second threshold value.
  • the second weakly changed regions in which the luminance value changes that are larger and smaller than the first threshold value Th1 are emphasized.
  • the emphasis processing sets the surrounding area (neighboring area) so as to leave a certain distance from the area to be emphasized, and displays the pixels at the edge of the surrounding area with a frame line, and the inside of the surrounding area These pixels are colored by avoiding the pixels in the region to be emphasized, and the pixels in the colored region are blinked at a constant cycle. Thereby, the image processing unit 5 does not change the information (relative luminance value, chromaticity value, etc.) of the first and second weak change areas to be emphasized, without changing the first and second weak areas. Highlight the change area.
  • the first weak change region is emphasized more strongly than the second weak change region.
  • the thickness of the border line of the first weak change region, the brightness of the color to be filled, the blinking speed, and the like are configured to be larger than those of the second weak change region.
  • the first weak change region and the second weak change region are used to determine which of the fill color of the border line and the adjacent region, the drawing of the border line, the fill of the color and the emphasis by blinking, etc. You may change between.
  • the filled color is a different color (for example, a complementary color or a dark achromatic color) that is distinguishable from the color that is colored when the weakly changed region (near-infrared light detection region) in the fluorescent image Xb is displayed. It is comprised so that. It should be noted that the range in which the color is filled may be slightly spaced from the weakly changed region (colored with a spacing).
  • the shape of the area where the frame line and the color fill (flashing) are displayed is configured to be a quadrangle.
  • the size of the area where the frame line and the color fill (flashing) are displayed is, for example, constant from the left and right (X direction) and up and down (Y direction) ends of the weak change area, as shown in FIG. Are determined so as to be separated by a margin RM (margin). Note that the size of the frame line and the area where the color fill (flashing) is displayed are not only the size of the margin RM (margin), but also other frame lines (color fill area) or weak change areas.
  • the region does not overlap with the region where the luminance value has changed (the region of the contrast agent in which the luminance value has changed larger than the first threshold Th1).
  • the margin RM is an example of the “parameter” in the claims.
  • the control unit 3 superimposes the visible image Xa, the fluorescent image Xb, and the visible image Xa on the fluorescent image Xb on which the predetermined image processing for sharpening is performed on the weakly changed region.
  • the superimposed image Xc is displayed on the small monitor 2 and the external monitor M (see FIG. 3). Note that, in the fluorescent image Xb and the superimposed image Xc displayed on the small monitor 2 and the external monitor M, for example, the thinning process is performed on both the fluorescent image Xb and the superimposed image Xc, and a predetermined value for emphasis is given. Image processing (frame drawing, color painting, and blinking) is performed only on the superimposed image Xc. That is, the image of FIG. 7B is displayed as the fluorescence image Xb, and the image of FIG. 7C is displayed as the superimposed image Xc as shown in FIG.
  • the image processing unit 5 causes the luminance smaller than the first threshold Th1 in the region where the luminance value changes in the fluorescent image Xb captured by the imaging unit 1.
  • a weak change region in which a change in value has occurred is discriminated, and predetermined image processing for sharpening is performed on a region in the vicinity of the weak change region, and the control unit 3 is set in a region in the vicinity of the weak change region.
  • the fluorescent image Xb and the superimposed image Xc that have been subjected to predetermined image processing for sharpening are configured to be displayed on the small monitor 2 and the external monitor M.
  • the fluorescent image Xb (superimposed image Xc) can be displayed so as to suppress the occurrence of oversight.
  • the user U when the user U (doctor or the like) performs an operation or the like while observing the fluorescence of the contrast agent in the blood vessels or lymph vessels displayed on the external monitor M or the like, the user U (doctor or the like) flows the contrast agent. If this is missed, it may cause re-administration (re-examination) of the contrast medium or re-operation.
  • the user U In order to reduce the burden on the imaging target P (patient) due to an increase in the operation time or the like when performing surgery or the like, the user U (doctor or the like) There is a situation in which it is necessary to make a judgment while observing the flow of the contrast medium in the imaging region in real time without reconsideration by rewinding the moving image).
  • the imaging device 100 of the present embodiment as a medical imaging device, the user U (doctor or the like) misses the contrast agent image, and the contrast is increased. Re-administration of drugs, re-operation, re-examination, etc. can be suppressed. As a result, it is possible to suppress adverse health effects on the imaging target P (patient).
  • the contrast agent is re-administered or imaged (displayed), and the image (movie) is taken back and viewed again.
  • the burden on the patient (imaged object P) can be reduced by increasing the length.
  • the image processing unit 5 is configured to perform predetermined image processing for emphasizing the weak change region with respect to regions other than the weak change region in the vicinity of the weak change region. .
  • the user U (with respect to the region (weak change region) in which the change in luminance value is relatively small (weak change region) without changing the information on the region in which the change in luminance value has occurred (relative luminance or the like).
  • the fluorescent image Xb and the superimposed image Xc can be displayed so as to suppress oversight by a doctor or the like.
  • the image processing unit 5 performs predetermined image processing for emphasizing the weak change region by surrounding the region near the weak change region in the superimposed image Xc with a frame line.
  • predetermined image processing for emphasizing the weak change region by surrounding the region near the weak change region in the superimposed image Xc with a frame line.
  • the image processing unit 5 emphasizes the weak change region by painting a region other than the weak change region near the weak change region in the superimposed image Xc with a predetermined color. It is configured to perform predetermined image processing. Thereby, without changing the information (relative luminance, etc.) of the area where the luminance value has changed, the area where the luminance value change is relatively small (weakly changing area) is emphasized by color painting,
  • the superimposed image Xc can be displayed so as to suppress the occurrence of oversight by the user U (such as a doctor) by color filling.
  • the image processing unit 5 causes the predetermined image to emphasize the weak change region by blinking the region other than the weak change region in the vicinity of the weak change region in the superimposed image Xc. Configure to perform processing. Thereby, without changing information (relative luminance, etc.) of the area where the luminance value has changed, the area where the luminance value change is relatively small (weakly changing area) is highlighted by blinking, and the user
  • the superimposed image Xc can be displayed so as to suppress the occurrence of oversight by U (doctor or the like) by blinking.
  • the image acquired (captured) by the imaging unit 1 is the visible image Xa (first image) for displaying the entire captured object P and the captured object P.
  • the fluorescent image Xb (second image) for displaying the specific region of the image processing unit 5 in the fluorescent image Xb captured by the imaging unit 1
  • the weak change area is discriminated, and predetermined image processing for sharpening is performed on the area in the vicinity of the weak change area, and the control unit 3 sharpens the visible image Xa and the weak change area.
  • the superimposed image Xc obtained by superimposing the fluorescent image Xb on which predetermined image processing has been performed is displayed on the small monitor 2 and the external monitor M.
  • a visible image Xa that captures the entire imaging object P with visible light
  • a fluorescence image Xb that captures fluorescence of the contrast agent excited by near-infrared light (contrast agent region of the imaging object P).
  • predetermined image processing for sharpening is performed on the relatively weak fluorescence portion of the contrast agent in the fluorescence image Xb.
  • Superimposition is performed so as to suppress the occurrence of an oversight by a user U such as a doctor with respect to a region (weak variation region) in which a change in luminance value derived from the fluorescent image Xb in the superimposed image Xc seen by U is relatively small.
  • the image Xc can be displayed.
  • the image processing unit 5 is configured to perform a thinning process for changing a weakly changed region in the fluorescent image Xb into a line image.
  • a thinning process for changing a weakly changed region in the fluorescent image Xb into a line image.
  • the image processing unit 5 performs the first processing among the weak change regions in which the change in the luminance value smaller than the first threshold Th1 occurs in the superimposed image Xc.
  • the first weak change region is discriminated from the first weak change region in which the luminance value change smaller than the second threshold value Th2 smaller than the threshold value Th1 is generated, and the other second weak change region is determined.
  • Predetermined image processing is performed to emphasize regions other than the first weak change region near the region more strongly than regions other than the second weak change region near the second weak change region.
  • the image processing unit 5 causes the weak change when the amount of change in the luminance value is equal to or less than the first threshold Th1 and equal to or greater than the lower limit ThL in the superimposed image Xc. It is configured to perform processing for determining an area. Thereby, it is possible to suppress the display of the superimposed image Xc in which predetermined image processing for sharpening is erroneously performed on an area where the luminance value slightly changes due to noise.
  • the imaging apparatus 100 accepts parameters for determining the weakly changed region and parameters related to how to perform predetermined image processing for sharpening.
  • An input unit 7 is provided.
  • the imaging apparatus 100 includes the small monitor 2, and the small monitor 2 is clarified in the weak change region with respect to the region other than the weak change region near the weak change region.
  • the fluorescent image Xb and the superimposed image Xc that have been subjected to predetermined image processing for the display are displayed. Accordingly, the fluorescent image Xb in which predetermined image processing for sharpening is performed on a region (weakly changing region) in which a change in luminance value is relatively small by the small monitor 2 provided in the imaging device 100.
  • the superimposed image Xc can be visually recognized by the user U (doctor or the like).
  • the imaging unit 1 includes the fluorescence image Xb that is an image including fluorescence generated from the contrast agent injected into the blood vessel or lymphatic vessel of the imaging target P, and the imaging target P.
  • the visible image Xa which is an image of visible light, is configured to be continuously imaged, and the image processing unit 5 is in the process of flowing the contrast agent in the fluorescence image Xb captured by the imaging unit 1.
  • the weak change area of the fluorescent image Xb is discriminated, and predetermined image processing for sharpening the weak change area is performed in real time on areas other than the weak change area near the weak change area.
  • the small monitor 2 and the external monitor M display in real time a superimposed image Xc obtained by superimposing the visible image Xa and the fluorescent image Xb obtained by performing predetermined image processing for sharpening the weakly changed region.
  • a visible image Xa that captures the entire image pickup object P with visible light
  • a fluorescence image Xb that captures the fluorescence of the contrast agent excited by the near-infrared light (the contrast agent region of the image pickup object).
  • the imaging unit (imaging unit) 1 captures the visible image Xa (first image) and the fluorescence image Xb (second image), and the image processing unit 5 sharpens the fluorescence image Xb.
  • the present invention is not limited to this. In the present invention, one image may be captured by the imaging unit (imaging unit) 1.
  • the imaging apparatus 200 includes a reflected agent from the imaging target P and a contrast agent administered to the imaging target P by the imaging unit 10 as illustrated in FIGS. 9 and 10A. Is captured (acquired) as one image Xo.
  • the image processing unit 50 generates an area in which the luminance value changes before and after the contrast agent is flowed from the image Xo captured by the imaging unit 10 (the contrast agent that generates fluorescence). Pixel corresponding to the flow) is extracted.
  • the image processing unit 50 extracts a tubular region by thinning (line imaging) the region where the extracted luminance value changes, and the luminance value of the region where the luminance value changes changes.
  • a region where the change is small is determined.
  • the image processing unit 50 starts from the weak change area, the first weak change area where the change in luminance value is smaller (darker), and the second weak change where the change in luminance value is relatively large (relatively bright). Further distinguish the area.
  • the weak change region, the first weak change region, and the second weak change region are discriminated based on the first threshold value Th1, the second threshold value Th2, and the lower limit value ThL, as in the above embodiment. Is done.
  • the image processing unit 50 performs a process of emphasizing the first weak change area and the second weak change area so that the first weak change area is emphasized more strongly.
  • region is emphasized in the image Xo.
  • an image Xo in which the thinning process and the enhancement process have been performed on the weakly changed region in which the weak luminance value has changed is displayed on the small monitor 2 and the external monitor M by the control unit 30.
  • the structure and effect similar to the said embodiment while attaching
  • the image processing unit emphasizes the area excluding the weak change area in the vicinity of the weak change area and the thinning process for the weak change area in order to sharpen the weak change area.
  • the image processing unit may be configured to perform only one of the thinning process and the predetermined image process for emphasizing the weakly changed region.
  • the image processing unit when emphasizing the weak change area, draws a frame line in the vicinity of the weak change area, and fills and blinks colors in areas other than the weak change area in the vicinity of the weak change area.
  • the image processing unit may be configured to perform only one of frame drawing, color painting, and blinking. Further, the weakly changed region may be emphasized by predetermined image processing other than these.
  • the image processing unit determines the weak change region based on the first threshold value and the second threshold value, and the first weak change region and the second weak change region.
  • the image processing unit may be configured to determine only the weak change region based on only the first threshold value.
  • the image processing unit is arranged in three or more regions such as the first weak change region, the second weak change region, and the third weak change region based on the magnitude of the change amount of the luminance value. You may be comprised so that the discrimination
  • the image processing unit discriminates an area where the change amount of the luminance value is equal to or higher than the lower limit value as the weak change area is shown, but the present invention is not limited to this.
  • the image processing unit may not be provided with a lower limit value, and may be configured to discriminate all regions in which a change in luminance value smaller than the first threshold value has occurred as a weak change region.
  • an example in which the shape of the area in which the frame line or the color fill (flashing) is displayed is a quadrangle, but the present invention is not limited to this.
  • the shape of the area where the frame line or the color fill (flashing) is displayed may be other than a quadrangle (for example, an ellipse).
  • the shape of the area where the frame line or the color fill (flashing) is displayed corresponds to the shape of the weak change area to be emphasized (for example, the shape along the shape of the weak change area). ) May be determined.
  • an example is shown in which enhancement processing and thinning processing are performed on a superimposed image and only thinning processing is performed on a fluorescent image, but the present invention is not limited thereto.
  • a fluorescent image that has been highlighted may be displayed, or a fluorescent image that has not been thinned may be displayed.
  • the input unit is configured to accept both a parameter for determining the weakly changed region and a parameter related to how to perform predetermined image processing for sharpening.
  • it may be configured to accept only one of them.
  • the imaging device includes the input unit
  • the imaging device may not include the input unit
  • the imaging device includes a small monitor.
  • the imaging device may not include a small monitor.
  • the imaging apparatus is used as a medical imaging apparatus that captures a fluorescent image of a blood vessel or a lymph vessel (lymph node) of a human body that is an imaging target
  • the imaging device is used as a pipeline monitoring camera, images far-infrared light based on the temperature of the fluid flowing in the pipeline, and has a small change in luminance value (weak change region). It may be configured as a thermography (far-infrared light imaging) device that displays the image clearly.
  • the imaging device may be configured as a chemical inspection device that images light generated by a chemical reaction and sharpens and displays a region where the reaction is relatively weak and the change in luminance value is small.
  • the imaging device may be configured as a monitoring camera, a surgical microscope, or an endoscope.
  • the electromagnetic waves (light) imaged by the imaging unit (imaging unit) are not limited to near infrared light and visible light, but include medium and far infrared light, microwaves, ultraviolet light, X-rays, ⁇ rays, and the like. Radiation may be used.
  • Imaging unit Imaging unit
  • Small monitor display unit
  • Control unit 5 Image processing unit 7
  • Input unit 100, 200 Imaging device
  • External monitor display unit
  • P Imaged object P1, P2 Blood vessel or lymph vessel
  • P0 Lymph vessel RM margin
  • Th1 First threshold Th2 First Threshold value of 2 ThL Lower limit value
  • Xa Visible image first image
  • Xb Fluorescent image second image
  • Xc superimposed image Xo image

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Endoscopes (AREA)

Abstract

L'invention concerne un appareil d'imagerie (100) comprenant : une unité de traitement d'image (5) qui identifie, dans une image fluorescente (Xb) imagée par une unité d'imagerie (1), une région de petit changement dans laquelle s'est produit un changement de la valeur de luminosité plus petit qu'un premier seuil (Th1) parmi des régions dans lesquelles les valeurs de luminosité ont changé, et qui applique un traitement d'image prédéterminé destiné à l'affinage à la région à proximité de la région de petit changement ; et une unité de commande (3) qui amène un petit moniteur (2) et un moniteur externe (M) à afficher l'image après que le traitement d'image prédéterminé destiné à l'affinage a été appliqué à la région à proximité de la région de petit changement.
PCT/JP2017/009933 2017-03-13 2017-03-13 Appareil d'imagerie WO2018167816A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2019505314A JP6638859B2 (ja) 2017-03-13 2017-03-13 撮像装置
PCT/JP2017/009933 WO2018167816A1 (fr) 2017-03-13 2017-03-13 Appareil d'imagerie

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/009933 WO2018167816A1 (fr) 2017-03-13 2017-03-13 Appareil d'imagerie

Publications (1)

Publication Number Publication Date
WO2018167816A1 true WO2018167816A1 (fr) 2018-09-20

Family

ID=63521845

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/009933 WO2018167816A1 (fr) 2017-03-13 2017-03-13 Appareil d'imagerie

Country Status (2)

Country Link
JP (1) JP6638859B2 (fr)
WO (1) WO2018167816A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020156860A (ja) * 2019-03-27 2020-10-01 学校法人兵庫医科大学 脈管認識装置、脈管認識方法および脈管認識システム
JPWO2021024314A1 (fr) * 2019-08-02 2021-02-11

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015188559A (ja) * 2014-03-28 2015-11-02 株式会社島津製作所 医療用イメージング装置
JP2016087062A (ja) * 2014-11-04 2016-05-23 ローム株式会社 光学的生体イメージングシステム
JP2016112219A (ja) * 2014-12-16 2016-06-23 株式会社島津製作所 イメージング装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4949806B2 (ja) * 2006-11-10 2012-06-13 オンセミコンダクター・トレーディング・リミテッド 撮像装置及び画像信号処理装置
JP5294723B2 (ja) * 2008-06-26 2013-09-18 富士フイルム株式会社 画像取得装置
EP2863801B8 (fr) * 2012-06-21 2024-06-12 Stryker Corporation Quantification et analyse d'angiographie et de perfusion

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015188559A (ja) * 2014-03-28 2015-11-02 株式会社島津製作所 医療用イメージング装置
JP2016087062A (ja) * 2014-11-04 2016-05-23 ローム株式会社 光学的生体イメージングシステム
JP2016112219A (ja) * 2014-12-16 2016-06-23 株式会社島津製作所 イメージング装置

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020156860A (ja) * 2019-03-27 2020-10-01 学校法人兵庫医科大学 脈管認識装置、脈管認識方法および脈管認識システム
WO2020194942A1 (fr) * 2019-03-27 2020-10-01 学校法人兵庫医科大学 Dispositif de reconnaissance de vaisseaux sanguins, procédé de reconnaissance de vaisseaux sanguins et système de reconnaissance de vaisseaux sanguins
JP7312394B2 (ja) 2019-03-27 2023-07-21 学校法人兵庫医科大学 脈管認識装置、脈管認識方法および脈管認識システム
JPWO2021024314A1 (fr) * 2019-08-02 2021-02-11
WO2021024314A1 (fr) * 2019-08-02 2021-02-11 株式会社島津製作所 Dispositif d'assistance à un traitement médical et méthode d'assistance à un traitement médical
JP7306461B2 (ja) 2019-08-02 2023-07-11 株式会社島津製作所 治療支援装置および治療支援方法

Also Published As

Publication number Publication date
JPWO2018167816A1 (ja) 2019-11-07
JP6638859B2 (ja) 2020-01-29

Similar Documents

Publication Publication Date Title
US10098542B2 (en) Fundus observation apparatus
JP7009636B2 (ja) 内視鏡システム
CN107072644B (zh) 成像装置
JP6319448B2 (ja) イメージング装置
US20180220893A1 (en) Region of interest tracing apparatus
CN113827171B (zh) 内窥镜成像方法、内窥镜成像系统和软件程序产品
JPWO2020036109A1 (ja) 医用画像処理装置及び内視鏡システム並びに医用画像処理装置の作動方法
US12052526B2 (en) Imaging system having structural data enhancement for non-visible spectra
Yang et al. Development of an integrated multimodal optical imaging system with real-time image analysis for the evaluation of oral premalignant lesions
JP2016214507A (ja) イメージング装置
WO2018167816A1 (fr) Appareil d'imagerie
JP6485275B2 (ja) イメージング装置
US20180262735A1 (en) Diagnosis support apparatus for lesion, image processing method in the same apparatus, and medium storing program associated with the same method
CN112515690A (zh) 图像处理装置
JP2021186417A (ja) 治療支援装置および関心領域の設定方法
US11937898B2 (en) Time intensity curve measuring apparatus
WO2022038806A1 (fr) Système d'assistance thérapeutique et dispositif d'assistance thérapeutique
JP2018128759A (ja) テカリ領域除去装置
JP7478245B2 (ja) 医療画像装置及びその作動方法
JP5160958B2 (ja) 眼底撮影装置及び眼底画像処理装置
JP2016112219A (ja) イメージング装置
JP2016112220A (ja) イメージング装置
JP2022090759A (ja) 医用画像処理システム、医用画像処理システムの作動方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17901143

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019505314

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17901143

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载