US9277190B2 - Endoscope apparatus - Google Patents
Endoscope apparatus Download PDFInfo
- Publication number
- US9277190B2 US9277190B2 US13/896,881 US201313896881A US9277190B2 US 9277190 B2 US9277190 B2 US 9277190B2 US 201313896881 A US201313896881 A US 201313896881A US 9277190 B2 US9277190 B2 US 9277190B2
- Authority
- US
- United States
- Prior art keywords
- light
- wavelength
- narrowband
- image
- narrowband light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims abstract description 249
- 230000003595 spectral effect Effects 0.000 claims abstract description 149
- 238000010521 absorption reaction Methods 0.000 claims abstract description 51
- 230000002708 enhancing effect Effects 0.000 claims abstract description 10
- 238000005286 illumination Methods 0.000 claims description 101
- 210000004204 blood vessel Anatomy 0.000 claims description 94
- 102000001554 Hemoglobins Human genes 0.000 claims description 16
- 108010054147 Hemoglobins Proteins 0.000 claims description 16
- 230000031700 light absorption Effects 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 8
- 230000006870 function Effects 0.000 claims description 2
- 238000012935 Averaging Methods 0.000 claims 6
- 238000010586 diagram Methods 0.000 description 68
- 238000012986 modification Methods 0.000 description 47
- 230000004048 modification Effects 0.000 description 47
- 238000006243 chemical reaction Methods 0.000 description 41
- 210000001519 tissue Anatomy 0.000 description 38
- 238000000034 method Methods 0.000 description 20
- 239000008280 blood Substances 0.000 description 17
- 210000004369 blood Anatomy 0.000 description 17
- 238000003745 diagnosis Methods 0.000 description 17
- 210000004877 mucosa Anatomy 0.000 description 17
- 238000012937 correction Methods 0.000 description 16
- 239000002344 surface layer Substances 0.000 description 16
- 230000000875 corresponding effect Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 14
- 238000011282 treatment Methods 0.000 description 11
- 229910052724 xenon Inorganic materials 0.000 description 9
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 9
- 238000003780 insertion Methods 0.000 description 7
- 230000037431 insertion Effects 0.000 description 7
- 230000003902 lesion Effects 0.000 description 7
- 206010028980 Neoplasm Diseases 0.000 description 6
- 201000011510 cancer Diseases 0.000 description 6
- 230000001678 irradiating effect Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000005855 radiation Effects 0.000 description 5
- 210000004876 tela submucosa Anatomy 0.000 description 5
- 230000000295 complement effect Effects 0.000 description 4
- 238000001647 drug administration Methods 0.000 description 4
- MOFVSTNWEDAEEK-UHFFFAOYSA-M indocyanine green Chemical compound [Na+].[O-]S(=O)(=O)CCCCN1C2=CC=C3C=CC=CC3=C2C(C)(C)C1=CC=CC=CC=CC1=[N+](CCCCS([O-])(=O)=O)C2=CC=C(C=CC=C3)C3=C2C1(C)C MOFVSTNWEDAEEK-UHFFFAOYSA-M 0.000 description 4
- 229960004657 indocyanine green Drugs 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 101100345318 Arabidopsis thaliana MFP2 gene Proteins 0.000 description 3
- 101000896027 Rattus norvegicus 3-hydroxyacyl-CoA dehydrogenase Proteins 0.000 description 3
- 238000002835 absorbance Methods 0.000 description 3
- 239000006185 dispersion Substances 0.000 description 3
- 230000003211 malignant effect Effects 0.000 description 3
- 230000015654 memory Effects 0.000 description 3
- 230000035515 penetration Effects 0.000 description 3
- 101100233050 Caenorhabditis elegans ima-1 gene Proteins 0.000 description 2
- 101100233056 Caenorhabditis elegans ima-2 gene Proteins 0.000 description 2
- 210000000683 abdominal cavity Anatomy 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000000740 bleeding effect Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 210000002784 stomach Anatomy 0.000 description 2
- 238000012323 Endoscopic submucosal dissection Methods 0.000 description 1
- OAICVXFJPJFONN-UHFFFAOYSA-N Phosphorus Chemical compound [P] OAICVXFJPJFONN-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 210000000941 bile Anatomy 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000002224 dissection Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 210000003238 esophagus Anatomy 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 210000001035 gastrointestinal tract Anatomy 0.000 description 1
- 238000002350 laparotomy Methods 0.000 description 1
- 210000002429 large intestine Anatomy 0.000 description 1
- 239000010410 layer Substances 0.000 description 1
- 238000011328 necessary treatment Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 210000002700 urine Anatomy 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0655—Control therefor
-
- G06T5/009—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
- A61B1/0684—Endoscope light sources using light emitting diodes [LED]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4887—Locating particular structures in or on the body
- A61B5/489—Blood vessels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
Definitions
- the present invention relates to an endoscope apparatus and, more particularly, to an endoscope apparatus capable of displaying a blood vessel on an inside of a subject.
- an endoscope In a medical field, minimally invasive various kinds of tests and operations have been performed using an endoscope.
- a surgeon can insert the endoscope into a body cavity, observe an image of an object picked up by an image pickup apparatus provided at a distal end portion of an endoscope insertion portion, and, according to necessity, apply treatment to a lesion site using a treatment instrument inserted through a treatment instrument channel.
- An operation performed using the endoscope has an advantage that a physical burden on a patient is small because laparotomy and the like are not performed.
- An endoscope apparatus includes an endoscope, an image processing device connected to the endoscope, and an observation monitor.
- An image of a lesion site is picked up by an image pickup device provided at a distal end portion of an endoscope insertion portion.
- the image is displayed on the monitor.
- a surgeon can perform a diagnosis or necessary treatment while looking at the image displayed on the monitor.
- indocyanine green having a characteristic of an absorption peak in near infrared ray near a wavelength of 805 nm is injected into blood of a patient as a drug.
- ICG indocyanine green
- Infrared light near a wavelength of 805 nm and near 930 nm is irradiated on an object in time division manner from a light source device.
- a signal of an object image picked up by a CCD is inputted to a processor of the infrared endoscope apparatus.
- a device that allocates an image near a wavelength of 805 nm to a green signal (G), allocates an image near a wavelength of 930 nm to a blue signal (B), and outputs the signals to a monitor is proposed. Since the image of the infrared light near 805 nm often absorbed by the ICG is allocated to green, a surgeon can observe an infrared image during administration of the ICG at high contract.
- ESD endoscopic submucosal dissection
- a surgeon checks a position of such a blood vessel and performs treatment such as dissection.
- An endoscope apparatus includes: an illumination section configured to irradiate at least one or more illumination lights having a predetermined wavelength band on a subject; an image pickup section configured to pick up an image of return light from the subject based on irradiation by the illumination section; an image processing section configured to set a correction coefficient on the basis of change amounts concerning luminance values of a signal corresponding to a first wavelength band having a spectral characteristic of a narrowband and a signal corresponding to a second wavelength band having a spectral characteristic of a narrowband in which an absorption coefficient in the hemoglobin absorption characteristic is lower than the absorption coefficient of the signal corresponding to the first wavelength band and a scattering characteristic of the living tissue is suppressed more than the scattering characteristic of the signal corresponding to the first wavelength band between a wavelength band including a maximum value and a wavelength band including a minimum value on a hemoglobin light absorption characteristic of a living tissue of the subject and generate an image signal obtained by applying enhancement processing to the signal
- FIG. 1 is a configuration diagram showing a configuration of an endoscope apparatus according to a first embodiment of the present invention
- FIG. 2 is a diagram showing a configuration of a rotating filter 14 according to the first embodiment
- FIG. 3 is a diagram for explaining a flow of overall processing in narrowband light observation according to the first embodiment
- FIG. 4 is a diagram showing a light absorption characteristic of venous blood according to the first embodiment
- FIG. 5 is a diagram for explaining light propagation volumes in a living tissue of first narrowband light NL 1 ( ⁇ 1 ) and second narrowband light NL 2 ( ⁇ 2 ) according to the first embodiment;
- FIG. 6 is a diagram showing an example of an endoscopic image for explaining highlighting of a blood vessel in the endoscopic image according to the first embodiment
- FIG. 7 is a diagram showing a luminance level of a pixel value of a certain line LL in FIG. 6 ;
- FIG. 8 is a diagram showing a level of a luminance ratio U of each pixel of the line LL in FIG. 6 ;
- FIG. 9 is a diagram showing a level of an enhanced luminance ratio V of each pixel of the line LL in FIG. 6 ;
- FIG. 10 is a diagram showing a level of an enhanced luminance value of return light of narrowband light near a wavelength of 600 nm ( ⁇ 1 ) for each pixel of the line LL in FIG. 6 ;
- FIG. 11 is a diagram for explaining a flow of processing for an image obtained from an image pickup device 2 in an image processing section 101 according to the first embodiment
- FIG. 12 is a configuration diagram showing a configuration of an endoscope apparatus 1 A according to a second embodiment
- FIG. 13 is a diagram for explaining a flow of overall processing in narrowband light observation according to the second embodiment
- FIG. 14 is a diagram showing a spectral characteristic for explaining a case in which spectral image signals e 1 , e 2 , and e 3 of three narrowband lights are estimated from image signals B, G, and R of three wideband lights according to the second embodiment;
- FIG. 15 is a diagram showing a spectral characteristic for explaining a case in which spectral image signals of three narrowband lights are estimated from image signals of two wideband lights and an image signal of one narrowband light according to the second embodiment;
- FIG. 16 is a diagram showing a spectral characteristic for explaining a case in which one narrowband light Rn does not include narrowband light of an estimated spectrally estimated image signal according to the second embodiment
- FIG. 17 is a diagram showing a spectral characteristic for explaining a case in which spectrally estimated image signals of three narrowband lights are estimated from an image signal of one wideband light and image signals of two narrowband lights according to the second embodiment;
- FIG. 18 is a diagram showing a spectral characteristic for explaining a case in which spectrally estimated image signals of three narrowband lights are estimated from image signals of three narrowband lights according to the second embodiment
- FIG. 19 is a diagram showing a spectral characteristic for explaining a case in which spectral image signals of three narrowband lights are estimated from image signals of four narrowband lights according to the second embodiment;
- FIG. 20 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in an image processing section 101 A according to the second embodiment
- FIG. 21 is a diagram showing a configuration of a rotating filter 14 A according to a third embodiment
- FIG. 22 is a diagram for explaining a flow of overall processing in a special light observation mode according to the third embodiment.
- FIG. 23 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in an image processing section 101 B according to the third embodiment
- FIG. 24 is a diagram showing a spectral characteristic for explaining a case in which spectrally estimated image signals e 1 and e 3 of two narrowband lights are estimated from image signals B, G, and R of three (or two) wideband lights according to the third embodiment;
- FIG. 25 is a diagram showing a spectral characteristic for explaining a case in which an inter-band operation is performed between an image signal Rn of narrowband light near a wavelength of 600 nm ( ⁇ 1 ) and one spectrally estimated image signal e 2 according to the third embodiment;
- FIG. 26 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in the image processing section 101 B according to a modification 1 of the third embodiment;
- FIG. 27 is a diagram showing a spectral characteristic for explaining a case in which an inter-band operation is performed between an image signal Rn of narrowband light near a wavelength of 630 nm ( ⁇ 2 ) and one spectrally estimated image signal e 1 according to the modification 1 of the third embodiment;
- FIG. 28 is a diagram showing a spectral characteristic for explaining a case in which one spectrally estimated image signal e 2 is estimated from image signals Bn, Gn, Rn of three narrowband lights according to a modification 2 of the third embodiment;
- FIG. 29 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in the image processing section 101 B according to the modification 2 of the third embodiment;
- FIG. 30 is a diagram showing a spectral characteristic for explaining a case in which an inter-band operation is performed between an image signal Rn of narrowband light near a wavelength of 630 nm ( ⁇ 2 ) and one spectrally estimated image signal e 1 according to the modification 2 of the third embodiment;
- FIG. 31 is a diagram for explaining a configuration of a processing section configured to generate, from one of two narrowband lights, the other of the two narrowband lights according to a modification 6 common to the respective embodiments;
- FIG. 32 is a diagram showing a spectral characteristic for explaining narrowband light generated in a pseudo manner according to the modification 6 common to the respective embodiments;
- FIG. 33 is a diagram showing a light absorption characteristic of venous blood for explaining a modification 7 common to the respective embodiments;
- FIG. 34 is a schematic diagram of an image obtained by photographing an inside of an abdominal cavity of an animal using a spectral endoscope apparatus that can irradiate narrowband illumination light in time series at an interval of center wavelength of 10 nm;
- FIG. 35 is a graph in which, for a plurality of monochrome images shown in FIG. 34 , intensities (logarithmically displayed pixel values) on a Line-A in respective images.
- FIG. 1 is a configuration diagram showing the configuration of the endoscope apparatus according to the present embodiment.
- an endoscope apparatus 1 includes an electronic endoscope 3 including a CCD 2 , which is an image pickup device, as living body image information acquiring means or a living body image information acquiring section inserted into a body cavity to pick up an image of an intra-body cavity tissue, a light source device 4 configured to supply illumination light to the electronic endoscope 3 , and a video processor 7 configured to subject an image pickup signal from the CCD 2 of the electronic endoscope 3 to signal processing and display an endoscopic image on an observation monitor 5 .
- the endoscope apparatus 1 has two modes, i.e., a normal light observation mode and a narrowband light observation mode. Note that, in the following explanation, the normal light observation mode of the endoscope apparatus 1 is the same as the normal light observation mode in the past. Therefore, explanation of a configuration of the normal light observation mode is omitted.
- the narrowband light observation mode is mainly explained.
- the CCD 2 configures an image pickup section or image pickup means configured to receive return light of illumination light irradiated on a subject and pick up an image of the subject.
- the light source device 4 functioning as illumination means or an illumination section includes a Xenon lamp 11 configured to emit illumination light (white light), a heat radiation cut filter 12 configured to cut off heat radiation of the white light, a diaphragm device 13 configured to control a light amount of the white light transmitted through the heat radiation cut filter 12 , a rotating filter 14 functioning as band limiting means or a band limiting section configured to change the illumination light to frame-sequential light, a condensing lens 16 configured to condense the frame-sequential light, which is transmitted through the rotating filter 14 , on an incident surface of a light guide 15 disposed in the electronic endoscope 3 , and a control circuit 17 configured to control rotation of the rotating filter 14 .
- the Xenon lamp 11 , the rotating filter 14 , and the light guide 15 configure an irradiating section or irradiating means configured to irradiate the illumination light on the subject.
- FIG. 2 is a diagram showing a configuration of the rotating filter 14 .
- the rotating filter 14 is a filter configured to transmit light from the Xenon lamp 11 , which is a light source. As shown in FIG. 2 , the rotating filter 14 functioning as a wavelength band limiting section or wavelength band limiting means is configured in a disc shape and has a structure having a center as a rotation axis.
- the rotating filter 14 includes two filter groups.
- an R (red) filter section 14 r On an outer circumferential side of the rotating filter 14 , an R (red) filter section 14 r , a G (green) filter section 14 g , and a B (blue) filter section 14 b configuring a filter set for outputting frame-sequential light having a spectral characteristic for normal light observation are arranged along a circumferential direction as a first filter group.
- three filters 14 - 600 , 14 - 630 , and 14 - 540 configured to transmit lights having three predetermined narrowband wavelengths are arranged along the circumferential direction as a second filter group.
- the filter 14 - 600 is configured to transmit light near a wavelength of 600 nm ( ⁇ 1 ) as narrowband light.
- the filter 14 - 630 is configured to transmit light near a wavelength of 630 nm ( ⁇ 2 ) as narrowband light.
- the filter 14 - 540 is configured to transmit light near a wavelength of 540 nm ( ⁇ 3 ) as narrowband light.
- Near means that, in the case of “near a wavelength of 600 nm”, narrowband light having center wavelength of 600 nm and having a distribution of width in a range of, for example, 20 nm centering on the wavelength of 600 nm (i.e., wavelength of 590 nm to 610 nm before and after the wavelength of 600 nm). The same holds true concerning the other wavelengths, i.e., the wavelength of 630 nm and the wavelength of 540 nm explained below.
- the rotating filter 14 is arranged on an optical path extending from the Xenon lamp 11 , which is an emitting section of the illumination light, to an image pickup surface of the CCD 2 .
- the rotating filter 14 limits at least two (here, three) among a plurality of wavelength bands of the illumination light to be narrowed.
- the control circuit 17 controls a motor 18 for rotating the rotating filter 14 and controls the rotation of the rotating filter 14 .
- a rack 19 a is connected to the motor 18 .
- a not-shown motor is connected to a pinion 19 b .
- the rack 19 a is attached to be screwed in the pinion 19 b .
- the control circuit 17 can move the rotating filter 14 in a direction indicated by an arrow “d” by controlling rotation of the motor connected to the pinion 19 b . Therefore, the control circuit 17 controls, according to mode switching operation by a user explained below, the motor connected to the pinion 19 b to locate the first filter group on the optical path in the normal light observation mode and locate the second filter group on the optical path in the narrowband light observation mode.
- the light source device 4 configures illumination means or an illumination section configured to irradiate at least one or more illumination lights (here, three narrowband lights) having a predetermined wavelength band on a subject in the narrowband light observation mode.
- at least one (here, three) of the three illumination lights is narrowband light for highlighting a blood vessel in a deep part at 1 to 2 mm from a surface layer.
- the remaining one is narrowband light functioning as third illumination light that can be transmitted for a predetermined distance from a surface layer portion of the subject, here, by a range near the surface layer.
- the video processor 7 includes a CCD driving circuit 20 functioning as a CCD driver, an amplifier 22 , a process circuit 23 , an A/D converter 24 , a white balance circuit (hereinafter referred to as W. B) 25 , a selector 100 , an image processing section 101 , a selector 102 , a ⁇ correction circuit 26 , an enlarging circuit 27 , an enhancing circuit 28 , a selector 29 , synchronizing memories 30 , 31 , and 32 , an image processing circuit 33 , D/A converters 34 , 35 , and 36 , a timing generator (hereinafter referred to as T.
- T a timing generator
- G 37 , a mode changeover circuit 42 , a light-adjusting circuit 43 , and a light adjustment control parameter changeover circuit 44 , a control circuit 200 , and a combining circuit 201 functioning as display image generating means or a display image generating section.
- the CCD driving circuit 20 drives the CCD 2 provided in the electronic endoscope 3 to cause the CCD 2 to output a frame-sequential image pickup signal synchronizing with the rotation of the rotating filter 14 .
- the amplifier 22 amplifies a frame-sequential image pickup signal obtained by picking up an image of an intra-body cavity tissue with the CCD 2 via an objective optical system 21 provided at a distal end of the electronic endoscope 3 .
- the process circuit 23 applies correlated double sampling, noise removal, and the like to the frame-sequential image pickup signal amplified by the amplifier 22 .
- the A/D converter 24 converts the frame-sequential image pickup signal processed by the process circuit 23 into a frame-sequential image signal of a digital signal.
- the W. B 25 applies gain adjustment to the frame-sequential image signal digitized by the A/D converter 24 to equalize, for example, brightness of an R signal of the image signal and brightness of a B signal of the image signal with reference to a G signal of the image signal and executes white balance processing.
- white balance adjustment in the W. B 25 is performed with reference to luminance of return light of narrowband light near the wavelength of 600 nm.
- the selector 100 outputs the frame-sequential image signal, which is received from the W. B 25 to be apportioned to respective sections in the image processing section 101 .
- the image processing section 101 is an image signal processing section or image signal processing means configured to convert RGB image signals for normal light observation or three image signals for narrowband light observation, which are received from the selector 100 , into image signals for display.
- the image processing section 101 outputs image signals in the normal light observation mode and the narrowband light observation mode to the selector 102 according to a selection signal SS from the control circuit 200 based on a mode signal.
- the selector 102 sequentially outputs a frame-sequential image signal of an image signal for normal light observation and an image signal for narrowband light observation, which are received from the image processing section 101 , to the ⁇ correction circuit 26 and the combining circuit 201 .
- the ⁇ correction circuit 26 applies ⁇ correction processing to the frame-sequential image signal received from the selector 102 or the combining circuit 201 .
- the enlarging circuit 27 applies enlargement processing to the frame-sequential image signal subjected to the ⁇ correction processing by the ⁇ correction circuit 26 .
- the enhancing circuit 28 applies edge enhancement processing to the frame-sequential image signal subjected to the enlargement processing by the enlarging circuit 27 .
- the selector 29 and the synchronizing memories 30 , 31 , and 32 are sections for synchronizing the frame-sequential image signal from the enhancing circuit 28 .
- the image processing circuit 33 reads out respective frame sequential image signals stored in the synchronizing memories 30 , 31 , and 32 and performs moving image color shift correction processing and the like.
- the D/A converters 34 , 35 , and 36 convert an image signal received from the image processing circuit 33 into RGB analog video signals and output the RGB analog video signals to the observation monitor 5 .
- the T. G 37 inputs a synchronization signal synchronizing with the rotation of the rotating filter 14 from the control circuit 17 of the light source device 4 and outputs various timing signals to the respective circuits in the video processor 7 .
- a mode changeover switch 41 for switching the normal light observation mode and the narrowband light observation mode is provided in the electronic endoscope 2 .
- An output of the mode changeover switch 41 is outputted to the mode changeover circuit 42 in the video processor 7 .
- the mode changeover circuit 42 of the video processor 7 is configured to output control signals to the light adjustment control parameter changeover circuit 44 and the control circuit 200 .
- the light-adjusting circuit 43 is configured to control the diaphragm device 13 of the light source device 4 to perform proper brightness control on the basis of a light adjustment control parameter received from the light adjustment control parameter changeover circuit 44 and an image pickup signal processed by the process circuit 23 .
- the respective circuits in the video processor 7 execute predetermined processing corresponding to a designated mode. Processing corresponding to each of the normal light observation mode and the narrowband light observation mode is executed. A normal light observation image or a narrowband light observation image is displayed on the observation monitor 5 .
- the observation monitor 5 is, as explained below, display means or a display section configured to perform image display on the basis of an enhanced and corrected image signal.
- FIG. 3 is a diagram for explaining a flow of overall processing in narrowband light observation according to the present embodiment.
- a surgeon inserts an insertion portion of an endoscope into a body cavity and locates a distal end portion of the endoscope insertion portion near a lesion site under the normal light observation mode.
- the surgeon operates the mode changeover switch 41 to switch the endoscope apparatus 1 to the narrowband light observation mode.
- the control circuit 17 of the endoscope apparatus 1 controls the motor connected to the pinion 19 b to move a position of the rotating filter 14 . Further, the control circuit 200 controls the various circuits in the video processor 7 to perform image processing for observation by narrowband wavelength.
- illumination light having narrowband wavelength from an illumination light generating section 51 is emitted from a distal end portion of the insertion portion of the endoscope 3 , transmitted through a mucosal layer, and irradiated on a blood vessel 61 running in the submucosa and the muscularis intestinal.
- the illumination light generating section 51 includes the light source device 4 , the rotating filter 14 , the light guide 15 and the like and emits illumination light from a distal end of the endoscope insertion portion.
- narrowband light near a wavelength of 600 nm, narrowband light near a wavelength of 630 nm, and narrowband light near the wavelength of 540 nm are emitted from the light source device 4 continuously and in order and irradiated on an object.
- Each of reflected lights of the narrowband light near the wavelength of 600 nm, the narrowband light near the wavelength of 630 nm, and the narrowband light near the wavelength of 540 nm is received by a reflected light receiving section 52 , which is the CCD 2 .
- the CCD 2 outputs an image pickup signal of each of the reflected lights.
- the image pickup signal is supplied to the selector 100 via the amplifier 22 and the like.
- the selector 100 retains, according to predetermined timing from the T. G 37 , a first image signal P 1 near the wavelength of 600 nm, a second image signal P 2 near the wavelength of 630 nm, and a third image signal P 3 near the wavelength of 540 nm and supplies the image signals to the image processing section 101 .
- the image processing section 101 includes an enhancement processing section 101 a and a color conversion processing section 101 b for the narrowband light observation mode.
- the surgeon In ESD for dissecting and peeling off a submucosa of an inner wall of a digestive tract such as a stomach, an esophagus, or a large intestine in which a lesion site is present using the endoscope apparatus 1 , the surgeon has to see to it that the surgeon does not cut a relatively thick blood vessel in a tissue with an electric knife or the like.
- the surgeon sets the endoscope apparatus 1 in the narrowband light observation mode, the surgeon can clearly render a blood vessel under a surface of a living tissue.
- the enhancement processing section 101 a of the image processing section 101 shown in FIG. 1 image processing explained below for image enhancement for the blood vessel 61 is performed.
- respective image signals are allocated to respective channels for RGB of the observation monitor 5 and supplied to the selector 102 .
- the relatively thick blood vessel 61 in the mucosa deep part is displayed on a screen 5 a of the observation monitor 5 at high contrast. Therefore, the surgeon can apply the ESD to the lesion site while paying attention to the blood vessel 61 running in the submucosa and the muscularislitis, displayed on the observation monitor 5 .
- FIG. 4 is a diagram showing the light absorption characteristic of the venous blood.
- An ordinate of FIG. 4 indicates a molar absorbance coefficient (cm ⁇ 1 /M) and an abscissa indicates wavelength. Note that, although illumination lights of three narrowband lights are affected by a scattering characteristic of a living tissue itself, a scattering characteristic of the living tissue itself is a substantially monotonous decrease with respect to an increase in wavelength. Therefore, FIG. 4 is explained as an absorption characteristic of the living tissue.
- hemoglobin oxide HbO 2
- Hb reduced hemoglobin
- FIG. 4 shows a light absorption characteristic of the venous blood for each wavelength from 400 nm to about 800 nm. In a range from 550 nm to 750 nm, the absorption coefficient indicates a maximum value at a point of wavelength of about 576 nm and indicates a minimum value at a point of wavelength of 730 nm.
- the narrowband observation mode In the narrowband observation mode, three narrowband lights are irradiated. Return light of each of the narrowband lights is received by the CCD 2 .
- the narrowband light near the wavelength of 600 nm (hereinafter referred to as first narrowband light NL 1 ) is light in a wavelength band within a wavelength band R of a maximum value ACmax of the absorption characteristic (here, an absorption coefficient at wavelength of 576 nm) to a minimum value ACmin (here, an absorption coefficient at wavelength of 730 nm) of the hemoglobin.
- the narrowband light near the wavelength of 630 nm (hereinafter referred to as second narrowband light NL 2 ) is also light within the wavelength band R from the maximum value ACmax to the minimum value ACmin of the absorption characteristic of the hemoglobin.
- the narrowband light is light in a wavelength band, wavelength of which is longer than the wavelength of the first narrowband light NL 1 , an absorption coefficient of which is lower than the absorption coefficient of the first narrowband light NL 1 , and a scattering characteristic of a living tissue of which is suppressed more than the scattering characteristic of the first narrowband light NL 1 .
- the suppressed scattering characteristic means that a scattering coefficient decrease toward a long wavelength side.
- the light source device 4 irradiates the first illumination light NL 1 having a peak wavelength of a spectral characteristic between a wavelength band including the maximum value ACmax and the wavelength band at the minimum value ACmin in the absorption characteristic of the living tissue and the second illumination light NL 2 having a peak wavelength of a spectral characteristic that a value in an absorption characteristic is lower than the value of the image signal P 1 by the first illumination light NL 1 and a scattering characteristic of the living tissue is suppressed more than the scattering characteristic of the first illumination light NL 1 .
- the narrowband light near the wavelength of 540 nm (hereinafter referred to as third narrow-band light NL 3 ) is light in a wavelength band outside the wavelength band R of the maximum value ACmax to the minimum value ACmin of the absorption characteristic of the hemoglobin and is illumination light that can be transmitted for a predetermined distance from a surface region portion of a mucosal surface of the subject.
- the CCD 2 outputs image pickup signals for respective images of the three narrowband lights. Therefore, the respective images include a plurality of pixel signals based on respective return lights of the first, second, and third narrowband lights NL 1 , NL 2 , and NL 3 .
- FIG. 5 is a diagram for explaining a light propagation volume in the living tissue of the first narrowband light NL 1 ( ⁇ 1 ) and the second narrowband light NL 2 ( ⁇ 2 ).
- Each of the first narrowband light NL 1 and the second narrowband light NL 2 repeats a multiple scattering process in the living tissue.
- the first narrowband light NL 1 and the second narrowband light NL 2 are emitted from the mucosal surface as return lights.
- the first narrowband light NL 1 and the second narrowband light NL 2 respectively have mean free paths MFP 1 and MFP 2 .
- the mean free path MFP 1 of the first narrowband light NL 1 is shorter than the mean free path MFP 2 of the second narrowband light NL 2 .
- the first narrowband light NL 1 having the wavelength of 600 nm ( ⁇ 1 ) reaches near the blood vessel 61 .
- the second narrowband light NL 2 having the wavelength of 630 nm ( ⁇ 2 ) reaches a position slightly deeper than the blood vessel 61 . It is possible to perform highlighted display of a blood vessel image of a relatively deep part using such two narrowband lights and by performing enhancement processing explained below.
- the two narrowband lights used in the present embodiment i.e., the first narrowband light NL 1 and the second narrowband light NL 2 are relatively long-wave lights in a wavelength band of visible light in order to image the blood vessel 61 present in the deep part in the living tissue from a mucosal surface 62 . Accordingly, both of the first narrowband light NL 1 and the second narrowband light NL 2 can reach near the blood vessel 61 present in the relatively deep part in the living tissue from the mucosal surface 62 .
- the narrowband light near the wavelength of 600 nm ( ⁇ 1 ) is used as the first narrowband light NL 1 and the narrowband light near the wavelength of 630 nm ( ⁇ 2 ) is used as the second narrowband light NL 2 .
- the two narrowband lights used in the present embodiment i.e., the first narrowband light NL 1 and the second narrowband light NL 2 are lights having a relatively small wavelength difference between the two narrowband lights.
- lights having a small difference between the mean free paths MFP 1 and MFP 2 of the two narrowband path, i.e., the first narrowband light NL 1 and the second narrowband light NL 2 are selected.
- the mean free path is an average traveling distance of light and is a function of a scattering coefficient.
- the two narrowband lights used in the present embodiment i.e., the first narrowband light NL 1 and the second narrowband light NL 2
- lights having a relatively large difference in absorption between the two narrowband lights are selected, although the lights have a relatively small wavelength difference between the two narrowband lights.
- the narrowband light near the wavelength of 600 nm ( ⁇ 1 ) is used as the first narrowband light NL 1
- the narrowband light near the wavelength of 630 nm ( ⁇ 2 ) is used as the second narrowband light NL 2 .
- the narrowband light near the wavelength of 600 nm ( ⁇ 1 ) is used as the first narrowband light NL 1
- the narrowband light near the wavelength of 630 nm ( ⁇ 2 ) is used as the second narrowband light NL 2 .
- a difference between a molar absorbance coefficient DA 1 of the first narrowband light NL 1 and a molar absorbance coefficient DA 2 of the second narrowband light NL 2 is larger than a difference in absorption obtained when two narrowband lights having the same wavelength difference (e.g., 30 nm) (e.g., narrowband light near a wavelength of 700 nm and narrowband light near a wavelength of 730 nm) are selected.
- the two narrowband lights used in the present embodiment i.e., the first narrowband light NL 1 and the second narrowband light NL 2 are lights having a relatively small wavelength difference between the two narrowband lights and relatively large difference in absorption between the two narrowband lights.
- the two narrowband lights for example, capillaries at depth of several hundred microns from the surface layer, which are not desired to be displayed, are not displayed. Therefore, it is possible to highlight, with low noise, only a relatively thick blood vessel in a deep part of 1 to 2 mm, which is desired to be displayed.
- FIG. 34 is a schematic diagram of an image obtained by photographing an inside of an abdominal cavity of an animal using a spectral endoscope apparatus capable of irradiating narrowband illumination light in time series at an interval of center wavelength of 10 nm. More specifically, an image in which respective monochrome images of 540 nm, 600 nm, and 630 nm are respectively allocated to a B channel, a G channel, and an R channel is shown.
- a blood vessel V 1 and a blood vessel V 2 in the image are thick blood vessels running from an upper left direction to a lower right direction in the image. The blood vessel V 1 is deeper from a mucosal surface than the blood vessel V 2 .
- monochrome images of fifteen patterns in total are photographed at a step of 10 nm from 540 nm to 680 nm.
- FIG. 35 is a graph in which, with respect to a plurality of monochrome images shown in FIG. 34 , intensities (logarithmically displayed pixel values) on a Line-A in the respective images are shown on an ordinate.
- An abscissa in FIG. 35 indicates positions of pixels on the Line-A in the respective images. Positions of pixels of the blood vessel V 1 are present near 25 to 50 and positions of pixels of the blood vessel V 2 are present near 75 to 110. It is seen from FIG.
- illumination wavelengths at which the intensities attenuate in both the blood vessels i.e., the blood vessel V 2 present in a relatively shallow part and the blood vessel V 1 located in a deep part, i.e., wavelengths at which illumination lights are intensely absorbed in the blood vessel V 1 and the blood vessel V 2 are about 590 nm to 620 nm.
- narrowband lights at about 590 nm to 620 nm are important wavelength information.
- the blood vessel V 1 is present in a deep part of about 1 mm to 2 mm from the mucosal surface. Note that this experiment result substantially coincides with the theoretical calculation result by Beer-Lambert explained above (a relatively thick blood vessel can be displayed at high contrast by using narrowband lights at 15 nm before and after the wavelength of 600 nm).
- the illumination means or the illumination section including the light source device 4 irradiates the narrowband light NL 1 , which is the illumination light having the peak wavelength of the spectral characteristic between the wavelength band including the maximum value ACmax and the wavelength band at the minimum value ACmin in the absorption characteristic of the living tissue, and the narrowband light NL 2 , which is the illumination light having the peak wavelength of the spectral characteristic that the value in the absorption characteristic is lower than the value in the absorption characteristic of the return light by the narrowband light NL 1 and the scattering characteristic of the living tissue is suppressed more than the scattering characteristic of the return light by the narrowband light NL 1 .
- the illumination means or the illumination section including the light source device 4 also irradiates the third illumination light NL 3 that can be transmitted for the predetermined distance from the surface layer portion of the subject.
- FIG. 6 is a diagram showing an example of an endoscopic image for explaining highlighted display of a blood vessel in an endoscopic image.
- a blood vessel in a deep part of 1 to 2 mm from the surface layer portion is not displayed or is not easily displayed on the endoscopic image EI of the observation monitor 5 .
- the blood vessel in the narrowband light observation mode when a blood vessel in a deep part is present in the picked-up endoscopic image EI, the blood vessel is displayed on the endoscopic image EI. Processing by the image processing section 101 is explained assuming that, as shown in FIG. 6 , the blood vessel 61 (indicated by a dotted line) is present under a mucosal surface of a stomach.
- Respective images by the two narrowband lights NL 1 and NL 2 are inputted to the image processing section 101 .
- Each of the images is configured from a plurality of lines.
- Each of the lines includes a plurality of pixels.
- the enhancement processing section 101 a performs processing explained below for each line of the respective images.
- an inter-band operation is performed concerning two images obtained by irradiation of the first narrowband light NL 1 and the second narrowband light NL 2 .
- FIG. 7 is a diagram showing a luminance level of a pixel value of a certain line LL in FIG. 6 .
- An abscissa of FIG. 7 indicates pixel positions arranged along a line direction in the endoscopic image EI and an ordinate indicates luminance values of pixels in the respective pixel positions.
- a luminance value distribution RL 1 indicated by a solid line is a luminance profile, i.e., a luminance value distribution of return light of the first narrowband light NL 1 .
- a luminance value distribution RL 2 indicated by an alternate long and short dash line is a luminance value distribution of return light of the second narrowband light NL 2 .
- Luminance of the luminance value distribution RL 2 indicated by the alternate long and short dash line is higher than luminance of the luminance value distribution RL 1 indicated by the solid line. This is because an absorption coefficient of hemoglobin of the second narrowband light NL 2 is lower than the absorption coefficient of the first narrowband light NL 1 .
- the line LL includes n pixels from left. A range from pixel positions PP 1 to PP 2 on the line LL is a range in which the blood vessel 61 is present.
- a luminance value is low in a range RV of the pixel positions PP 1 to PP 2 in which the blood vessel 61 is present. This is because the first narrowband light NL 1 is intensely absorbed by hemoglobin of the blood vessel 61 . In lines other than the line LL, a luminance value of the return light of the first narrowband light NL 1 is also low in the range RV where the blood vessel 61 is present.
- a luminance value is substantially the same in ranges including the range RV from the pixel positions PP 1 to PP 2 in which the blood vessel 61 is present. This is because the second narrowband light NL 2 is transmitted through the blood vessel 1 and reaches an inside of a living tissue and returns without being much affected by absorption.
- a luminance value of the return light of the second narrowband light NL 2 is substantially the same in the ranges including the range RV in which the blood vessel 61 is present.
- an average value of luminance values (hereinafter referred to as average luminance) of a plurality of pixels on the line LL concerning the return light of the first narrowband light NL 1 is indicated by a dotted line AV 1 .
- An average luminance of luminance values of the plurality of pixels on the line LL concerning the return light of the second narrowband light NL 2 is indicated by a dotted line AV 2 .
- the enhancement processing section 101 a performs processing of the following Equation (1) concerning the respective pixels of each line shown in FIG. 7 :
- U ( Im ( ⁇ 1)/ Im ( ⁇ 2)) ⁇ K ⁇ 1 Equation (1)
- Im represents luminance of each pixel
- Im( ⁇ 1 ) represents a luminance value of the return light of the narrowband light near the wavelength of 600 nm ( ⁇ 1 )
- Im( ⁇ 2 ) represents a luminance value of the return light of the narrowband light near the wavelength of 630 nm ( ⁇ 2 )
- K represents a correction coefficient.
- K (AVE( ⁇ 2)/AVE( ⁇ 1)) Equation (2)
- AVE represents average luminance of the respective lines
- AVE( ⁇ 1 ) represents an average value of luminance values of the return light of the narrowband light near the wavelength of 600 nm ( ⁇ 1 )
- AVE( ⁇ 2 ) represents an average value of luminance values of the return light of the narrowband light near the wavelength of 630 nm ( ⁇ 2 ).
- the dotted line AV 1 indicates a line of AVE( ⁇ 1 ) and the dotted line AV 2 indicates a line of AVE( ⁇ 2 ).
- Average luminance of two images obtained by the irradiation of the first narrowband light NL 1 and the second narrowband light NL 2 is adjusted by the correction coefficient K.
- FIG. 8 is a diagram showing a level of the luminance ratio U of each pixel of the line LL in FIG. 6 .
- An abscissa of FIG. 8 indicates the pixel positions arranged along the line direction in the endoscopic image EI and an ordinate indicates the luminance ratio U of the pixels in the respective pixel positions. Since minus 1 ( ⁇ 1) is included in Equation (1), a distribution of the luminance ratio U is a distribution with 0 set as a reference. That is, in FIG. 8 , a luminance value distribution RL 3 indicated by a dotted line can be considered as a distribution obtained by correcting the luminance value of the return light of the first narrowband light NL 1 .
- Equation (3) A calculation by the following Equation (3) is applied to the luminance ratio U.
- V U ⁇ R Equation (3) where, V represents a corrected luminance ratio and R represents an enhancement coefficient, which is a parameter for designating a blood vessel enhancement level.
- FIG. 9 is a diagram showing a level of the enhanced luminance ratio V of each pixel of the line LL in FIG. 6 .
- An abscissa of FIG. 9 indicates the pixel positions arranged along the line direction in the endoscopic image EI and an ordinate indicates the luminance ratio U of the pixels in the pixel positions. That is, in FIG. 9 , as indicated by an arrow A 1 of an alternate long and short dash line, a luminance value distribution RL 4 indicated by a solid line can be considered as a distribution obtained by performing correction for enhancing the luminance value distribution RL 3 indicated by the dotted line.
- a luminance value is calculated according to the following Equation (4) from the luminance ratio V calculated according to Equation (3).
- ImA ( ⁇ 1) Im ( ⁇ 1) ⁇ ( V+ 1) Equation (4)
- ImA( ⁇ 1 ) represents a luminance value after correction of a luminance value of return light of the narrowband light near the wavelength 600 nm ( ⁇ 1 ).
- FIG. 10 is a diagram showing a level of an enhanced luminance value of the return light of the narrowband light near the wavelength of 600 nm ( ⁇ 1 ) of each pixel of the line LL in FIG. 6 .
- An abscissa of FIG. 10 indicates the pixel positions arranged along the line direction in the endoscopic image EI and an ordinate indicates a luminance value AB of the pixels in the respective pixel positions. That is, in FIG.
- a luminance value distribution RL 5 indicated by a solid line can be considered as a distribution obtained by performing correction for enhancing a luminance value distribution RL 1 indicated by an alternate long and two short dashes line.
- the enhancement processing section 101 a outputs an enhanced corrected image signal BEP 1 ( ⁇ 1 ) obtained by enhancing and correcting the first image signal P 1 ( ⁇ 1 ) according to the inter-band operation.
- enhancement processing may be performed according to a method explained below.
- enhancement of a blood vessel image is performed by calculating a ratio of luminance values of the respective pixels of the images having the two wavelengths and, for example, multiplying the luminance ratio with the correction coefficient.
- enhancement of a blood vessel image may be performed by, for example, as indicated by the following Equation (5), performing division of respective pixel values and multiplying a pixel value obtained by the irradiation of the first narrowband light NL 1 with a result of the division.
- ImA 1( ⁇ 1) Im ( ⁇ 1) ⁇ ( Im ( ⁇ 1)/ Im ( ⁇ 2)) Equation (5)
- ImA 1 ( ⁇ 1 ) represents a luminance value after correction of a luminance value of the return light of the narrowband light near the wavelength of 600 nm ( ⁇ 1 ).
- Contrast of the blood vessel in the deep part can also be expanded by the enhancement processing performed using the division indicated by Equation (5).
- enhancement processing may be performed by processing explained below.
- enhancement of a blood vessel image may be performed by, for example, as indicated by the following Equation (6), performing subtraction of respective pixel values and multiplying a pixel value obtained by the irradiation of the first narrowband light NL 1 with an absolute value of a result of the subtraction.
- ImA 2( ⁇ 1) Im ( ⁇ 1) ⁇
- ImA 2 ( ⁇ 1 ) represents a corrected luminance value of the return light of the narrowband light near the wavelength of 600 nm ( ⁇ 1 ).
- Contrast of the blood vessel in the deep part can also be expanded by the enhancement processing performed using the subtraction indicated by Equation (6).
- the image processing section 101 a configures image processing means or an image processing section configured to generate, after the image pickup by the image pickup means or the image pickup section, an image signal enhanced and corrected by applying processing for enhancing the first image signal P 1 ( ⁇ 1 ) on the basis of a change amount, i.e., a difference between the first image signal P 1 ( ⁇ 1 ) having the peak wavelength of the spectral characteristic between the wavelength band including the maximum value ACmax and the wavelength band at the minimum value ACmin in the absorption characteristic of the living tissue and the second image signal P 2 ( ⁇ 2 ) having the peak wavelength of the spectral characteristic that the value in the absorption characteristic is lower than the value in the absorption characteristic of the first image signal P 1 ( ⁇ 1 ) and the scattering characteristic of the living tissue is suppressed more than the scattering characteristic of the first image signal P 1 ( ⁇ 1 ).
- a change amount i.e., a difference between the first image signal P 1 ( ⁇ 1 ) having the peak wavelength of the spectral characteristic between the wavelength band including the
- the second image signal P 2 ( ⁇ 2 ), the third image signal P 3 ( ⁇ 3 ), and the enhanced corrected image signal BEP 1 ( ⁇ 1 ) are inputted to the color conversion processing section 101 b.
- processing for allocating the second image signal P 2 ( ⁇ 2 ), the third image signal P 3 ( ⁇ 3 ), and the enhanced corrected image signal BEP 1 ( ⁇ 1 ) to the RGB channels is performed.
- the luminance value ImA( ⁇ 1 ) of the enhanced corrected image signal BEP 1 ( ⁇ 1 ), the luminance value Im( ⁇ 2 ) of the second image signal P 2 ( ⁇ 2 ), and the luminance value Im( ⁇ 3 ) of the third image signal P 3 ( ⁇ 3 ) are allocated to the RGB channels according to the following Equation (7):
- Equation (7) since the relatively large blood vessel 61 in the deep part is displayed in a rather reddish color, the surgeon can easily find the blood vessel 61 .
- the narrowband light near the wavelength of 540 nm is used as the third narrowband light NL 3 , capillaries and bleeding present in a relatively shallow region from the surface of the living tissue are displayed substantially in a yellow color.
- Equation (8) may be used instead of the above Equation (7):
- Equation (8) since the blood vessel 61 in the deep part is displayed in a slightly bluish color or a bluish green color and capillaries in the surface layer are displayed in a red to brown color, the surgeon can easily find the blood vessel 61 and the capillaries.
- Equation (9) may be used instead of the above Equation (7):
- Equation (10) may be used instead of the above Equation (7).
- ⁇ takes a numerical value of about 1.0 to 1.5
- ⁇ takes a numerical value of about 2.0 to 2.6
- ⁇ is set to a numerical value of about 2.3 to 2.7
- ⁇ is set to a numerical value of about 2.3 to 2.7
- the narrowband light near the wavelength of 540 nm may be allocated to the B channel
- the narrowband light near the wavelength 630 nm may be allocated to the G channel
- the narrowband light near the wavelength 600 nm i.e., the enhanced corrected image signal BEP 1 ( ⁇ 1 )
- the narrowband light near the wavelength of 540 nm may be allocated to the B channel and the G channel and the narrowband light near the wavelength of 600 nm or the narrowband light near the wavelength of 630 nm may be allocated to the R channel.
- color balance adjustment is explained.
- the narrowband light near the wavelength of 540 nm is allocated to the B channel
- the narrowband light near the wavelength of 600 nm is allocated to the G channel
- the narrowband light near the wavelength of 630 nm is allocated to the R channel as in the Equation (7)
- Signal intensity of the narrowband light near the wavelength of 600 nm is not corrected.
- the two signals are adjusted such that signal intensity of the narrowband light near the wavelength of 540 nm allocated to the B channel is 0.7 to 2.5 times as high as signal intensity of the narrowband light near the wavelength of 630 nm allocated to the R channel.
- the color conversion processing may be performed after the color balance adjustment is performed or the color balance processing may be performed after the color conversion processing.
- a color balance adjusting circuit for such color balance adjustment may be provided at a pre-stage of the W. B 25 shown in FIG. 1 .
- the color balance adjusting circuit multiplies a signal of the narrowband light near the wavelength of 540 nm allocated to the B channel with about 0.7 to 1.5 and multiplies a signal of the narrowband light near the wavelength of 630 nm allocated to the R channel with about 0.6 to 1.0.
- the color balance adjustment may be performed in the color conversion processing section 101 b , may be performed by adjusting intensity of illumination light in the light source device 4 , or may be performed by adjusting transmittances of respective colors of a color filter of the image pickup device.
- FIG. 11 is a diagram for explaining a flow of the processing for an image obtained from the image pickup device 2 in the image processing section 101 .
- three images from the image pickup device 2 are inputted to the image processing section 101 as the first to third image signals P 1 , P 2 , and P 3 .
- the enhancement processing by the inter-band operation is applied to the two image signals P 1 and P 2 among the inputted three images.
- the color conversion processing section 101 b applies the color conversion processing by the channel allocation to the second image signal P 2 and the third image signal P 3 and the enhanced corrected image signal BEP 1 ( ⁇ 1 ) obtained by the enhancement processing and outputs the signals to the observation monitor 5 .
- the two narrowband lights having the absorption characteristic explained above between the maximum value and the minimum value of the absorption characteristic of the living tissue shown in FIG. 4 are irradiated on a living body mucosa and the enhancement processing is applied to an image of obtained two return lights of the narrowband lights. Consequently, a relatively thick blood vessel present in a relatively deep part of the living body mucosa is highlighted and displayed on the screen of the observation monitor 5 . Therefore, the surgeon can perform desired treatment such as ESD while looking at and checking the relatively thick blood vessel as well.
- a blood vessel present in a portion close to a surface layer portion of the living body mucosa can also be displayed using the third narrowband light NL 3 .
- a state of capillaries of the surface layer portion is also displayed on the screen of the observation monitor 5 simultaneously with the thick blood vessel. Therefore, the surgeon can use an endoscopic image on the screen of the observation monitor 5 not only for treatment but also for performing, from a state of capillaries, for example, a degree of a concentration degree or a dispersion degree of the capillaries, a diagnosis of a living body tissue, for example, a presence diagnosis of cancer or a range diagnosis for specifying a range of cancer and a discrimination diagnosis for determining whether a diseased part is benign or malignant. Further, the surgeon can also perform, for example, a penetration depth diagnosis with consciousness directed to a blood vessel of a deeper part.
- the light source device 4 may be configured to include a light emitting section 11 A including a light emitting diode group 11 a formed by a plurality of light emitting diodes (LEDs) that emit desired wavelengths, for example, respective wavelengths of RGB corresponding to the first filter group and respective wavelengths near 600 nm and near 630 nm corresponding to the second filter group.
- the light emitting section 11 A and the light guide 15 configure an irradiating section configured to irradiate illumination light on an object.
- the light emitting section 11 A indicated by the dotted line is provided in the light source device 4 instead of the Xenon lamp 11 , the heat radiation cut filter 12 , the diaphragm device 13 , the rotating filter 14 , and the like.
- a driving circuit 11 b for driving the light-emitting diodes of the light emitting section 11 A at predetermined timing according to the respective modes is provided in the light source device 4 .
- the light emitting section 11 A including a plurality of LEDs 11 a receives power supply from a power supply 10 .
- the light emitting section 11 A is controlled and driven by the driving circuit 11 b under a control signal from the control circuit 17 .
- a laser diode (LD) configured to emit a predetermined plurality of narrowband lights may be used.
- the second narrowband light NL 2 shown in FIG. 4 may be light in a longer wavelength band than the minimum value ACmin (here, the absorption coefficient at the wavelength of 730 nm) of the absorption characteristic of hemoglobin. That is, the wavelength of the second narrowband light NL 2 is in a wavelength band in which an absorption coefficient is lower than the absorption coefficient of the wavelength of the first narrowband light NL 1 and a scattering characteristic of a living body tissue is suppressed more than the scattering characteristic of the wavelength of the first narrowband light NL 1 .
- ACmin the absorption coefficient at the wavelength of 730 nm
- the narrowband light NL 2 is set to any one of the wavelengths of 740 nm to 1300 nm, the narrowband light NL 1 is set to any wavelength equal to or higher than 576 nm and at least equal to or lower than 630 nm).
- the second narrowband light NL 2 can be generated irrespective of which of the Xenon light source, the LED, and the LD is mounted as the light source device.
- an endoscope apparatus that can clearly display a blood vessel in a mucosa deep part without performing complicated work of drug administration.
- At least one narrowband light is actually irradiated on a living body tissue as illumination light and the enhancement processing explained above is applied to an image of return light of the illumination light.
- at least one narrowband light is not actually irradiated on a living body tissue, image information of return lights of respective narrowband lights is obtained by so-called spectral estimation, and the enhancement processing explained above is applied to spectral image signals having respective wavelengths obtained by the spectral estimation.
- the first and second narrowband lights NL 1 and NL 2 are generated by the lighting device including the rotating filter or the light emitting device such as the light emitting diode and the enhancement processing is applied to images of return lights of the first and second narrowband lights NL 1 and NL 2 .
- image signals corresponding to the first and second narrowband lights NL 1 and NL 2 are obtained by the spectral estimation processing and the enhancement processing is applied to spectrally estimated image signals obtained by the spectral estimation.
- FIG. 12 is a configuration diagram showing a configuration of an endoscope apparatus 1 A according to the second embodiment.
- components same as the components shown in FIG. 1 are denoted by the same reference numerals and signs and explanation of the components is omitted.
- a light source device 4 A includes a lamp 11 B configured to emit white light, the heat radiation cut filter 12 , and the diaphragm device 13 . Illumination light from the light source device 4 A is irradiated on an object via the light guide 15 .
- the lamp 11 B may be a lamp that emits light other than the white light.
- An image pickup device 2 A provided at a distal end of an insertion portion of the endoscope 3 is a color image pickup device.
- the image pickup device 2 A is, for example, a color CCD.
- the image pickup device 2 A includes an RGB color filter on an image pickup plane. Return light from the object is received by respective pixel sections of the image pickup plane via the RGB color filter, which is wavelength band limiting means or a wavelength band limiting section. Image signals of three colors of RGB are outputted from the image pickup device 2 A.
- a selector 100 A outputs the three image signals of RGB to an image processing section 101 A.
- the image processing section 101 A includes a spectral estimation section. In the narrowband light observation mode, the image processing section 101 A outputs a spectrally estimated image signal near a wavelength of 600 nm, a spectrally estimated image signal near a wavelength of 630 nm, and a spectrally estimated image signal near a wavelength of 540 nm.
- FIG. 13 is a diagram for explaining a flow of overall processing in narrowband light observation according to the present embodiment.
- the image processing section 101 A includes a spectral estimation section 101 c in addition to the enhancement processing section 101 a and the color conversion processing section 101 b .
- the spectral estimation section 101 c extracts, from the three images of RGB, a first spectrally estimated image signal e 1 near the wavelength of 600 nm, a second spectrally estimated image signal e 2 near the wavelength of 630 nm, and a third spectrally estimated image signal e 3 near the wavelength of 540 nm according to spectral estimation processing and outputs the spectrally estimated image signals to the enhancement processing section 101 a.
- the spectral estimation section 101 c calculates, according to a matrix operation, an n-dimensional spectral image from the three inputs on the basis of a priori information given in advance and selectively outputs e 1 , e 2 , and e 3 out of a calculated n-dimensional spectrally estimated image signal.
- the spectral estimation section 101 c is configured to calculate, using the matrix operation or the like, the spectrally estimated image signal e 1 near the wavelength of 600 nm, the spectrally estimated image signal e 2 near the wavelength of 630 nm, and the third estimated image signal e 3 near the wavelength of 540 nm and output the spectrally estimated image signals.
- Subsequent processing in the enhancement processing section 101 a and the color conversion processing section 101 b concerning the first, second, and third spectrally estimated image signals outputted from the spectral estimation section 101 c is the same as the processing explained in the first embodiment.
- FIG. 14 is a diagram showing a spectral characteristic for explaining a case in which spectral image signals e 1 , e 2 , and e 3 of three narrowband lights are estimated from image signals B, G, R of three wideband lights.
- the three wideband lights B, G, R in FIG. 14 are obtained by a color filter of the image pickup device 2 A. Image signals of the three wideband light B, G, and R are inputted to the spectral estimation section 101 c.
- the spectral estimation section 101 c estimates, according to the spectral estimation processing, the spectrally estimated image signals e 1 , e 2 , and e 3 of the three narrowband lights from the image signals B, G, R of the three wideband lights.
- the spectrally estimated image signal e 1 of the narrowband light near the wavelength of 600 nm, the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm, and the spectrally estimated image signal e 3 of the narrowband light near the wavelength of 540 nm are obtained from the image signals B, G, and R of the wideband lights having wavelength bands shown in FIG. 14 according to the spectral estimation processing.
- the spectrally estimated image signals e 1 and e 2 of two narrowband lights within the wavelength band R from the maximum value ACmax to the minimum value ACmin in FIG. 4 and the spectrally estimated image signal e 3 of the narrowband light outside the wavelength band R are obtained by spectral estimation.
- the spectrally estimated image signals e 1 , e 2 , and e 3 are supplied to the enhancement processing section 101 a.
- At least the two spectrally estimated image signals e 1 and e 2 may be obtained from image signals of the two wideband lights among the three wideband lights, for example, image signals of the wideband lights G and R according to the spectral estimation processing.
- image signals of the three (or two) wideband lights may be obtained by irradiating, in the light source device, return lights of three (or two) illumination lights, which are generated by arranging first group filers of a rotating filter having a sensitivity characteristic with which the image signals having the spectral characteristic shown in FIG. 14 are obtained, on a monochrome image pickup device rather than obtaining the image signals using a color filter of a color image pickup device.
- the spectral estimation section 101 c generates at least two spectrally estimated image signals e 1 and e 2 on the basis of the at least two image pickup signals of return light of the subject according to the spectral estimation processing and outputs the spectrally estimated image signals e 1 and e 2 . Further, the spectral estimation section 101 c also generates, on the basis of the at least two image pickup signals, the spectrally estimated image signal e 3 corresponding to return light based on irradiation of illumination light, which can be transmitted for a predetermined distance from a surface layer portion of the subject, according to the spectral estimation processing and outputs the spectrally estimated image signal e 3 . As explained above, the processing in the enhancement processing section 101 a and the color conversion processing section 101 b is the same as the processing in the first embodiment.
- spectral image signals of a plurality of narrowband lights are estimated from image signals of a plurality of wideband lights.
- the processing is not limited to such a method and may be methods explained below.
- a first method is a method of estimating three spectral image signals from image signals of two wideband lights and an image signal of one narrowband light. Since the image signal of the narrowband light is used, it is possible to improve accuracy of the spectral estimation.
- FIG. 15 is a diagram showing a spectral characteristic for explaining a case in which spectral image signals of three narrowband lights are estimated from image signals of two wideband lights and an image signal of one narrowband light.
- wideband lights are used for B and G and narrowband light is used for R.
- the spectral estimation section 101 c estimates the three spectrally estimated image signals e 1 , e 2 , and e 3 from image signals B and G of two wideband lights and an image signal Rn of one narrowband light.
- the three image signals of the two wideband lights B and G and the one narrowband light Rn may be obtained by the color filter of the image pickup device 2 A having the spectral characteristic shown in FIG. 15 .
- three illumination lights i.e., illumination lights of the two wideband lights B and G and the one narrowband light Rn
- return lights of the three illumination lights are irradiated on a monochrome image pickup device to obtain the image signals.
- three image signals of two wideband lights and one narrowband light may be obtained by the color filter of the image pickup device 2 A.
- the light source device may irradiate two or more illumination lights to thereby make a wavelength band of at least one illumination light (Rn) among the two or more illumination lights narrower than a wavelength band of the other illumination lights (B and G).
- the spectral estimation section 101 c estimates, according to the spectral estimation processing, the spectrally estimated image signals e 1 , e 2 , and e 3 of the three narrowband lights from the image signals of the two wideband lights B and G and the image signal Rn of the one narrowband light.
- the spectrally estimated image signal e 1 of the narrowband light near the wavelength of 600 nm, the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm, and the third estimated image signal e 3 of the narrowband light near the wavelength of 540 nm are estimated from the image signals of the two wideband lights B and G and the image signal Rn of the one narrowband light having the wavelength bands shown in FIG. 15 .
- At least the two spectrally estimated image signals e 1 and e 2 may be obtained from an image signal of one wideband light (e.g., an image signal of the wideband light G) and an image signal of one narrowband light Rn according to the spectral estimation processing.
- the one narrowband light Rn includes narrowband light near the wavelength of 600 nm. However, the one narrowband light Rn may include narrowband light near the wavelength of 630 nm. Further, the one narrowband light Rn may be narrowband light including neither narrowband light near the wavelength of 600 nm nor narrowband light near the wavelength of 630 nm indicated by an alternate long and short dash line in FIG. 15 .
- FIG. 16 is a diagram showing a spectral characteristic for explaining a case in which the one narrowband light Rn does not include narrowband light of an estimated spectrally estimated image signal.
- the spectrally estimated image signal e 1 of the narrowband light near the wavelength of 600 nm, a spectrally estimated image signal e 21 of the narrowband light near the wavelength of 650 nm, and the spectrally estimated image signal e 3 of the narrowband light near the wavelength of 540 nm are obtained from the image signals B and G of the two wideband lights and the image signal Rn of the one narrowband light according to the spectral estimation processing.
- a second method is a method of estimating three spectrally estimated image signals from an image signal of one wideband light and image signals of two narrowband lights.
- FIG. 17 is a diagram showing a spectral characteristic for explaining a case in which spectrally estimated image signals of three narrowband lights are estimated from an image signal of one wideband light and image signals of two narrowband lights.
- narrowband lights are used for B and G and wideband light is used for R.
- the spectral estimation section 101 c estimates three spectrally estimated image signals e 1 , e 2 , and e 31 from image signals Bn and Gn of two narrowband lights and an image signal of one wideband light R.
- the spectrally estimated image signal e 31 is an image signal of narrowband light near a wavelength of 460 nm.
- the three image signals of the two narrowband lights Bn and Gn and the one wideband light R may be obtained by the color filter of the image pickup device 2 A having the spectral characteristic shown in FIG. 17 .
- three illumination lights i.e., illumination lights of the two narrowband lights Bn and Gn and the one narrowband light R
- return lights of the three illumination lights are irradiated on a monochrome image pickup device to obtain the image signals.
- the spectral estimation section 101 c estimates, according to the spectral estimation processing, the spectrally estimated image signals e 1 , e 2 , and e 31 of the three narrowband lights from the image signals Bn and Gn of the two narrowband lights and the image signal R of the one wideband light.
- the spectrally estimated image signal e 1 of the narrowband light near the wavelength of 600 nm, the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm, and the third estimated image signal e 31 of the narrowband light near the wavelength of 460 nm are estimated from the image signals Bn and Gn of the two narrowband lights and the image signal R of the one wideband light having the wavelength bands shown in FIG. 17 .
- At least the two spectrally estimated image signals el and e 2 may be obtained from an image signal of one narrowband light (e.g., an image signal of the narrowband light Gn) and the image signal R of one wideband light according to the spectral estimation processing.
- the one wideband light R includes the narrowband light near the wavelength of 600 nm and the narrowband light near the wavelength of 630 nm
- the one wideband light R may include only one of the narrowband lights, for example, the narrowband light near the wavelength of 630 nm.
- the one wideband light R may include neither the narrowband light near the wavelength of 600 nm nor the narrowband light near the wavelength of 630 nm.
- a third method is a method of estimating three spectral image signals from image signals of three narrowband lights.
- FIG. 18 is a diagram showing a spectral characteristic for explaining a case in which spectrally estimated image signals of three narrowband lights are estimated from image signals of three narrowband lights. As shown in FIG. 18 , narrowband lights are used for B, G, and R.
- the spectral estimation section 101 c estimates the three spectrally estimated image signals e 1 , e 21 , and e 31 from the image signals B, G, and R of the three narrowband lights.
- the three narrowband lights Bn, Gn, and Rn may be obtained by the color filter of the image pickup device 2 A having the spectral characteristic shown in FIG. 18 .
- three illumination lights i.e., illumination lights of the three narrowband lights B, G, and R
- return lights of the three illumination lights are irradiated on a monochrome image pickup device to obtain the narrowband lights Bn, Gn, and Rn.
- the spectral estimation section 101 c estimates, according to the spectral estimation processing, the three spectrally estimated image signals e 1 , e 21 , and e 31 of the three narrowband lights from the image signals Bn, Gn, and Rn of the three narrowband lights.
- the spectrally estimated image signal e 1 of the narrowband light near the wavelength of 600 nm, the spectrally estimated image signal e 21 of the narrowband light near the wavelength of 650 nm, and the spectrally estimated image signal e 31 of the narrowband light near the wavelength of 460 nm are estimated from the image signals Bn, Gn, and Rn of the three narrowband lights having the wavelength bands shown in FIG. 18 .
- At least the two spectrally estimated image signals e 1 and e 21 may be obtained from image signals of two narrowband lights, for example, the image signals Bn and Gn of the narrowband lights according to the spectral estimation processing.
- At least one narrowband light may include wavelength of narrowband light of an estimated spectrally estimated image.
- the narrowband light Rn does not include the narrowband light near the wavelength of 600 nm and the narrowband light near the wavelength of 630 nm.
- the narrowband light Rn may include only one of the narrowband lights, for example, the narrowband light near the wavelength of 600 nm.
- the narrowband light Bn does not include the narrowband light near the wavelength of 460 nm.
- the narrowband light Bn may include the narrowband light near the wavelength of 460 nm.
- a fourth method is a method of estimating three spectrally estimated image signals from image signals of four narrowband lights.
- FIG. 19 is a diagram showing a spectral characteristic for explaining a case in which spectral image signals of three narrowband lights are estimated from image signals of four narrowband lights. As shown in FIG. 19 , narrowband lights are used for Bn, Gn, and Rn. However, two narrowband lights are used for Rn.
- the spectral estimation section 101 c estimates the three spectrally estimated image signals e 1 , e 21 , and e 31 from image signals of four narrowband lights Bn, Gn, and Rn.
- Four narrowband lights Bn, Gn, Rn 1 , and Rn 2 may be obtained by the color filter of the image pickup device 2 A having the spectral characteristic shown in FIG. 19 .
- four illumination lights i.e., illumination lights of the four narrowband lights Bn, Gn, Rn 1 , and Rn 2
- the rotating filter shown in FIG. 2 in the light source device and return lights of the illumination lights are irradiated on a monochrome image pickup device to obtain the four narrowband lights Bn, Gn, Rn 1 , and Rn 2 .
- the spectral estimation section 101 c estimates, according to the spectral estimation processing, the spectrally estimated image signals e 1 , e 21 , and e 31 of the three narrowband lights from image signals of the four narrowband lights Bn, Gn, Rn 1 , and Rn 2 .
- the spectrally estimated image signal e 1 of the narrowband light near the wavelength of 600 nm, the spectrally estimated image signal e 21 of the narrowband light near the wavelength of 650 nm, and the spectrally estimated image signal e 31 of the narrowband light near the wavelength of 460 nm are estimated from the image signals Bn, Gn, Rn 1 , and Rn 2 of the four narrowband lights having the wavelength bands shown in FIG. 19 .
- the at least two spectrally estimated image signals el and e 21 may be obtained from image signals of four or more narrowband lights, for example, image signals of the narrowband lights Bn, Gn, Rnl, and Rn 2 according to the spectral estimation processing.
- Two or more of a plurality of narrowband lights may include wavelength of narrowband light of an estimated spectrally estimated image.
- the narrowband light Rn does not include the narrowband light near the wavelength of 650 nm.
- the narrowband light Rn may include the narrowband light near the wavelength of 650 nm.
- the narrowband light Bn does not include the narrowband light near the wavelength of 460 nm.
- the narrowband light Bn may include the narrowband light near the wavelength of 460 nm.
- FIG. 20 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in the image processing section 101 A in the present embodiment.
- three images i.e., first to third image signals P 1 , P 2 , and P 3 are inputted to the spectral estimation section 101 c from the image pickup device 2 .
- the spectral estimation section 101 c estimates and generates the three spectrally estimated image signals e 1 , e 2 , and e 3 from inputted two or three image signals.
- the enhancement processing section 101 a applies the enhancement processing by the inter-band operation to the two spectral image signals e 1 and e 2 among the three spectral image signals e 1 , e 2 , and e 3 obtained by the spectral estimation section 101 c .
- the color conversion processing section 101 b applies the color conversion processing by the channel allocation to the second spectrally estimated image signal e 2 , the third spectrally estimated image signal e 3 , and the enhanced corrected image signal BEP 1 ( ⁇ 1 ) obtained by the enhancement processing and outputs the image signals to the observation monitor 5 .
- the color filter of the RGB system is explained as an example of the color filter provided on the surface of the image pickup device.
- the color filter may be a color filter of a complementary color system.
- Wavelength of the second spectrally estimated signal e 2 or e 21 shown in FIGS. 14 to 19 may be light in a wavelength band longer than the minimum value ACmin (here, an absorption coefficient at wavelength of 730 nm) of the absorption characteristic of hemoglobin shown in FIG. 4 . That is, the wavelength of the second spectrally estimated signal e 2 or e 21 is a wavelength band in which an absorption coefficient is lower than the absorption coefficient of the wavelength of the first spectrally estimated signal e 1 and a scattering characteristic of a living body tissue is suppressed more than the scattering characteristic of the wavelength of the first spectrally estimated signal e 1 .
- ACmin absorption coefficient at wavelength of 730 nm
- a relatively thick blood vessel present in a relatively deep part of the living body mucosa is highlighted and displayed on the screen of the observation monitor 5 . Therefore, the surgeon can perform desired treatment such as ESD while looking at and checking the relatively thick blood vessel as well.
- the endoscope apparatus 1 A explained above can also display a blood vessel present in a portion close to the surface layer of the living body mucosa using the third spectrally estimated image signal e 3 . Therefore, the endoscope apparatus 1 A can also be used for performing, from a state of capillaries, for example, a degree of a concentration degree or a dispersion degree of the capillaries, a diagnosis of a living body tissue, for example, a presence diagnosis of cancer or a range diagnosis for specifying a range of cancer and a discrimination diagnosis for determining whether a diseased part is benign or malignant. Further, for example, a penetration depth diagnosis with consciousness directed to a blood vessel of a deeper part can also be performed.
- the blood vessel may be subjected to the color conversion processing and displayed on the observation monitor 5 further using fourth and fifth images obtained by spectrally estimating in addition to the third spectrally estimated image signal e 3 .
- an endoscope apparatus that can clearly display a blood vessel in a mucosa deep part without performing complicated work of drug administration.
- the enhancement processing explained above is applied to an image of return light of the illumination light.
- three narrowband lights are not actually irradiated on a living body tissue, image information of return lights of respective narrowband lights is obtained by so-called spectral estimation, and the enhancement processing explained above is applied to spectrally estimated image signals having respective wavelengths obtained by the spectral estimation.
- the enhancement processing explained above is applied to an image signal of return light of actual illumination light of narrowband light and a spectrally estimated image signal obtained by the spectral estimation.
- FIG. 21 is a diagram showing the configuration of the rotating filter 14 A in the present embodiment.
- the rotating filter 14 A includes only filter sections of RGB configuring a filter set for outputting frame-sequential light having a spectral characteristic for normal light observation. Return lights of frame-sequential BGR lights are received by the monochrome image pickup device 2 .
- FIG. 22 is a diagram for explaining a flow of overall processing in a special light observation mode according to the present embodiment.
- An image processing section 101 B includes the enhancement processing section 101 a , the color conversion processing section 101 b , and the spectral estimation section 101 c .
- the spectral estimation section 101 c generates at least one spectrally estimated image signal e from two or three image signals among RGB.
- the enhancement processing by the inter-band operation is performed between one image signal among RGB and the spectrally estimated image signal.
- the first spectrally estimated image signal e 1 near a wavelength of 600 nm and the third spectrally estimated image signal e 3 near a wavelength of 540 nm are estimated from three (or two) image signals among RGB according to the spectral estimation processing and outputted to the enhancement processing section 101 a.
- FIG. 23 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in the image processing section 101 B according to the present embodiment.
- three images i.e., first to third image signals B, G, and R are inputted to the spectral estimation section 101 c from the image pickup device 2 .
- the spectral estimation section 101 c estimates and generates the two spectrally estimated image signals e 1 and e 3 from the inputted two or three images.
- the enhancement processing section 101 a applies the enhancement processing by the inter-band operation to the image signal R and the spectral image signal e 1 of the two spectrally estimated image signals e 1 and e 3 obtained by the spectral estimation section 101 c .
- the color conversion processing section 101 b applies the color conversion processing by the channel allocation to the spectrally estimated image signal e 3 , the enhanced corrected image signal BEP 1 ( ⁇ 1 ) obtained by the enhancement processing, and the image signal R and outputs the image signals to the observation monitor 5 .
- processing in the enhancement processing section 101 a and the color conversion processing section 101 b is the same as the processing in the first embodiment.
- FIG. 24 is a diagram showing a spectral characteristic for explaining a case in which the spectrally estimated image signals e 1 and e 3 of two narrowband lights are estimated from the image signals B, G, and R of three (or two) wideband lights.
- the image signal R based on real light of the wideband light R from the reflected light receiving section 52 and the spectrally estimated image signal e 1 near the wavelength of 600 nm outputted from the spectral estimation section 101 c are inputted to the enhancement processing section 101 a .
- the spectral image signal e 1 is a spectrally estimated image signal of one narrowband light within the wavelength band R from the maximum value ACmax to the minimum value ACmin in FIG. 4 .
- the enhancement processing section 101 a performs the enhancement processing by the inter-band operation explained above between the inputted image signal R and spectrally estimated image signal e 1 and outputs the enhanced corrected image signal BEP 1 ( ⁇ 1 ) subjected to the enhancement processing to the color conversion processing section 101 b.
- the spectral estimation section 101 c spectrally estimates and generates at least one spectral image signal e 1 according to signal processing on the basis of at least two image pickup signals of return light from a subject.
- the enhancement processing section 101 a applies processing for enhancing the spectral image signal e 1 to the spectral image signal e 1 and an image signal of return light picked up by the image pickup device 2 , which is image pickup means or an image pickup section, and generates and outputs the enhanced image signal.
- the spectrally estimated image signal e 3 outputted from the spectral estimation section 101 c , the enhanced corrected image signal BEP 1 ( ⁇ 1 ) subjected to the enhancement processing by the enhancement processing section 101 a , and the real image signal R are inputted to the color conversion processing section 101 b .
- processing in the color conversion processing section 101 b is the same as the processing explained in the first embodiment.
- the three wideband lights B, G, and R in FIG. 23 may be obtained by the color filter of the image pickup device 2 A. That is, the three wideband lights B, G, and R may be obtained using the light source device 4 A and the color filter of the image pickup device 2 A explained in the second embodiment.
- wavelength of a signal having wavelength information on a longer wavelength side may be light in a wavelength band longer than the minimum value ACmin (here, an absorption coefficient at wavelength of 730 nm) of the absorption characteristic of hemoglobin in FIG. 4 . That is, the wavelength of the signal having the wavelength information on the longer wavelength side is a wavelength band in which an absorption coefficient is lower than the absorption coefficient of the wavelength of the other signal and a scattering characteristic of a living body tissue is suppressed more than the scattering characteristic of the wavelength of the other signal.
- ACmin absorption coefficient at wavelength of 730 nm
- the inter-band operation is performed between the image signal of the wideband light R and the spectrally estimated image signal e 1 .
- the inter-band operation is not limited to such a method. Methods of modifications explained below may be used.
- a first method is a method of performing the inter-band operation between the image signal Rn of one narrowband light and the spectrally estimated image signal e 2 .
- FIG. 25 is a diagram showing a spectral characteristic for explaining a case in which the inter-band operation is performed between the image signal Rn of the narrowband light near the wavelength of 600 nm ( ⁇ 1 ) and the one spectrally estimated image signal e 2 .
- one narrowband light is the narrowband light Rn near the wavelength of 600 nm ( ⁇ 1 ) and is a real image signal.
- One spectrally estimated image signal is the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm estimated by the spectral estimation from three (or two) out of the image signals B and G of two wideband lights and the image signal Rn of one narrowband light.
- the inter-band operation is performed between the image signal Rn of the narrowband light and the spectral image signal e 2 .
- the real image signal of the narrowband light is used, a thick blood vessel in a deep part is enhanced and displayed more than when the real image signal in the wideband is used as shown in FIG. 24 .
- FIG. 26 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in the image processing section 101 B in the modification 1 of the present embodiment.
- three images i.e., the first to third image signals B, G, and Rn are inputted to the spectral estimation section 101 c from the image pickup device 2 .
- the spectral estimation section 101 c estimates and generates the two spectrally estimated image signals e 2 and e 3 from the inputted three (or two) image signals.
- the enhancement processing section 101 a applies the enhancement processing by the inter-band operation to the image signal Rn and the spectral image signal e 2 of the two spectrally estimated image signals e 2 and e 3 obtained by the spectral estimation section 101 c .
- the color conversion processing section 101 b applies the color conversion processing by the channel allocation to the spectrally estimated image signal e 3 , the enhanced corrected image signal BEP 1 ( ⁇ 1 ) obtained by the enhancement processing, and the image signal Rn and outputs the image signals to the observation monitor 5 .
- FIG. 27 is a diagram showing a spectral characteristic for explaining a case in which the inter-band operation is performed between the image signal Rn of the narrowband light near the wavelength of 630 nm ( ⁇ 2 ) and the one spectrally estimated image signal e 1 .
- An image signal in processing for an image obtained from the image pickup device 2 in the image processing section 101 B in this case is an image signal indicated by parentheses in FIG. 26 . That is, the enhancement processing section 101 a outputs the enhanced corrected image signal BEP 1 ( ⁇ 1 ).
- the color conversion processing section 101 b applies the color conversion processing by the channel allocation to the enhanced corrected image signal BEP 1 ( ⁇ 1 ) and the image signal Rn.
- the three image signals of the two wideband lights B and G and the one narrowband light Rn can be obtained by generating three illumination lights (i.e., illumination lights of the two wideband lights B and G and the one narrowband light R) using the rotating filter shown in FIG. 2 , which has the spectral characteristic shown in FIG. 25 or 27 , in the light source device and irradiating return lights of three illumination lights on a monochrome image pickup device.
- three illumination lights i.e., illumination lights of the two wideband lights B and G and the one narrowband light R
- FIG. 2 which has the spectral characteristic shown in FIG. 25 or 27
- the three image signals of the two wideband lights B and G and the one narrowband light R may be obtained by the color filter of the image pickup device 2 A having the spectral characteristic shown in FIG. 25 or 27 .
- the spectral estimation section 101 c estimates the two spectrally estimated image signals e 1 (or e 2 ) and e 3 from the image signals B and G of two wideband lights and the image signal Rn of one narrowband light according to the spectral estimation processing.
- the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm (or the spectrally estimated image signal e 1 of the narrowband light near the wavelength of 600 nm) and the spectrally estimated image signal e 3 of the narrowband light near the wavelength of 540 nm are estimated from the image signals of the two wideband lights B and G and the image signal of the one narrowband light Rn.
- the color conversion processing section 101 b applies the color conversion processing by the channel allocation to the spectrally estimated image signal e 3 , an enhanced corrected image signal BEP 2 ( ⁇ 2 ) (or the enhanced corrected image signal BEP 1 ( ⁇ 1 )) obtained by the enhancement processing, and the image signal Rn and outputs the image signals to the observation monitor 5 .
- At least the two spectrally estimated image signals e 2 (or e 1 ) and e 3 may be obtained from the image signals B and G of two wideband lights according to the spectral estimation processing.
- at least the two spectrally estimated image signals e 2 (or e 1 ) and e 3 may be obtained from the one wideband light B (or G) and the image signal Rn of one narrowband light according to the spectral estimation processing.
- the one spectral image signal e 2 may be estimated from the image signals Bn, Gn, and Rn of three narrowband lights and the inter-band operation may be performed between the image signal Rn of one narrowband light and the one spectrally estimated image signal e 2 .
- FIG. 28 is a diagram showing a spectral characteristic for explaining a case in which the one spectrally estimated image signal e 2 is estimated from the image signals Bn, Gn, and Rn of three narrowband lights.
- the three narrowband lights are narrowband light Rn near a wavelength of 600 nm, narrowband light Gn near a wavelength of 540 nm, and narrowband light Bn near a wavelength of 415 nm and are real image signals.
- One spectral image signal is the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm.
- the inter-band operation is performed between image signals of the narrowband light Rn near the wavelength of 600 nm and the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm.
- the spectrally estimated image signal e 2 of the narrowband light near the wavelength of 630 nm is spectrally estimated from obtained image signals of the two image signals Gn and Rn, and the inter-band operation is performed between a real image signal of the narrowband light Rn near the wavelength of 600 nm and the spectrally estimated image signal e 2 .
- FIG. 29 is a diagram for explaining a flow of processing for an image obtained from the image pickup device 2 in the image processing section 101 B in the modification 2 of the present embodiment.
- three image signals i.e., the first to third image signals Bn, Gn, and Rn are inputted to the spectral estimation section 101 c from the image pickup device 2 .
- the spectral estimation section 101 c estimates and generates the two spectrally estimated image signals e 2 from the inputted three (or two) image signals.
- the enhancement processing section 101 a applies the enhancement processing by the inter-band operation to the spectral estimation image signal e 2 obtained by the spectral estimation section 101 c and the narrowband light Rn.
- the color conversion processing section 101 b applies the color conversion processing by the channel allocation to the two narrowband lights Rn and Gn and the enhanced corrected image signal BEP 2 ( ⁇ 2 ) obtained by the enhancement processing and outputs the narrowband lights Rn and Gn and the enhanced corrected image signal BEP 2 ( ⁇ 2 ) to the observation monitor 5 .
- the spectrally estimated image signal e 1 near the wavelength of 600 nm may be obtained according to the spectral estimation using the narrowband light Rn near the wavelength 630 nm instead of the narrowband light Rn near the wavelength 600 nm.
- the inter-band operation may be performed between image signals of the narrowband light R near the wavelength of 630 nm and the spectrally estimated image signal e 1 near the wavelength of 600 nm.
- FIG. 30 is a diagram showing a spectral characteristic for explaining a case in which the inter-band operation is performed between the image signal Rn of the narrowband light near the wavelength of 630 nm ( ⁇ 2 ) and the one spectrally estimated image signal e 1 .
- An image signal in processing for an image obtained from the image pickup device 2 in the image processing section 101 B in this case is an image signal indicated by parentheses in FIG. 29 . That is, the enhancement processing section 101 a outputs the enhanced corrected image signal BEP 1 ( ⁇ 1 ). The color conversion processing section 101 b applies the color conversion processing by the channel allocation to the enhanced corrected image signal BEP 1 ( ⁇ 1 ) and the image signal Rn.
- the image signals Bn, Gn, and Rn of three narrowband lights may be obtained by the color filter of the image pickup device 2 A having the spectral characteristic shown in FIG. 28 or 30 .
- the color conversion processing may be performed from four image signals including the image signal Bn of narrowband light in addition to the image signals of the two narrowband lights Gn and Rn and the spectrally estimated image signals e 1 (or e 2 ).
- fourth and fifth spectrally estimated image signals obtained by performing the spectral estimation may be subjected to the color conversion processing in addition to the image signal Bn of narrowband light or separately from the image signal Bn of narrowband light and displayed on the observation monitor 5 .
- the color filter when the color filter provided on the surface of the image pickup device are used, the color filers of the RGB system are explained as an example.
- the color filter may be a color filter of the complementary color system.
- a relatively thick blood vessel present in a relatively deep part of the living body mucosa is highlighted and displayed on the screen of the observation monitor 5 . Therefore, the surgeon can perform desired treatment such as ESD while looking at and checking the relatively thick blood vessel as well.
- the endoscope apparatus 1 A explained above can also display a blood vessel present in a portion close to the surface layer of the living body mucosa using the spectrally estimated image signal e 3 or the narrowband light Gn corresponding to the third narrowband light NL 3 . Therefore, the endoscope apparatus 1 A can also be used for performing, from a state of capillaries, for example, a degree of a concentration degree or a dispersion degree of the capillaries, a diagnosis of a living body tissue, for example, a presence diagnosis of cancer or a range diagnosis for specifying a range of cancer and a discrimination diagnosis for determining whether a diseased part is benign or malignant. Further, for example, a penetration depth diagnosis with consciousness directed to a blood vessel of a deeper part can also be performed.
- an endoscope apparatus that can clearly display a blood vessel in a mucosa deep part without performing complicated work of drug administration.
- the light absorption characteristic of the venous blood is explained as an example and the two narrowband lights are selected on the basis of the characteristic.
- the at least two narrowband lights explained above may be selected on the basis of a light absorption characteristic of arterial blood or a light absorption characteristic of blood obtained by combining both of the venous blood and the arterial blood.
- light near the wavelength of 600 nm and light near the wavelength of 630 nm are used as the wavelengths of the first narrowband light NL 1 and the second narrowband NL 2 .
- the wavelengths of the first narrowband light NL 1 and the second narrowband light NL 2 are preferably respectively wavelength in a range of wavelength of 580 to 620 nm and narrowband light having a distribution in a range of predetermined width and wavelength in a range of wavelength of 610 to 730 nm and narrowband light having a distribution in a range of predetermined width and more preferably respectively wavelength in a range of wavelength of 585 to 615 nm and narrowband light having a distribution in a range of predetermined width and wavelength in a range of wavelength of 620 to 640 nm and narrowband light having a distribution in a range of predetermined width.
- the wavelengths of the first narrowband light NL 1 and the second narrowband light NL 2 are not respectively limited to the light near the wavelength of 600 nm and the light near the wavelength of 630 nm and may be light having any wavelength as long as the light has the absorption characteristic explained above between the minimum value and the minimum value of the absorption characteristic.
- the wavelengths of the first narrowband light NL 1 and the second narrowband light NL 2 light near the wavelength of 610 nm and light near the wavelength of 645 nm or light near the wavelength of 630 nm or light near the wavelength of 660 nm may be respectively used.
- wavelength of the third narrowband light NL 3 is not limited to the light.
- the wavelength of the third narrowband light NL 3 light near a wavelength of 415 nm or light near a wavelength of 460 nm shorter than the wavelength of 540 nm may be used.
- the light near the wavelength of 415 nm or the light near the wavelength of 460 nm shorter than the light near the wavelength of 540 nm is desirable.
- the lamp of the heat light source the LED, the LD, or the like is used.
- other means may be used.
- a variable wavelength laser may be used or a phosphor may be excited by the LED or the LD to generate broadband light and use the light.
- the narrowband light near the wavelength of 600 nm may be generated by a laser and the narrowband light near the wavelength of 630 nm may be generated by the LED.
- the narrowband light near the wavelength 600 nm may be generated by the LED and the narrowband light near the wavelength of 630 nm may be generated by the laser.
- the laser it is possible to reduce noise in a depth direction.
- the enhancement processing is performed for the two narrowband lights.
- one of the two narrowband lights to be subjected to the enhancement processing may be generated in a pseudo manner.
- FIG. 31 is a diagram for explaining a configuration of a processing section configured to generate, from one of two narrowband lights, the other of the two narrowband lights.
- FIG. 32 is a diagram showing a spectral characteristic for explaining narrowband light generated in a pseudo manner.
- the first image signal P 1 of the return light of the narrowband light near the wavelength of 600 nm is inputted to a filter operation section 103 .
- the filter operation section 103 applies, to the inputted first image signal P 1 , for example, filtering for reducing a difference in light and shade as a whole and making an edge portion less conspicuous and outputs the second image signal P 2 as a pseudo image.
- the enhancement processing section 101 a applies the enhancement processing to the first image signal P 1 and the second image signal P 2 , which is the pseudo image.
- a pseudo image of the other may be generated to perform the enhancement processing.
- a pseudo image corresponding to the narrowband light near the wavelength of 630 nm is generated from the first image signal P 1 of the return light of the narrowband light near the wavelength of 600 nm.
- a pseudo image corresponding to the narrowband light near the wavelength of 600 nm may be generated from the first image signal P 1 of the return light of the narrowband light near the wavelength of 630 nm and the third image signal P 3 of the return light of the narrowband light near the wavelength of 540 nm.
- the pseudo image is generated with respect to an image of return light of real illumination light.
- a pseudo image obtained by generating one spectrally estimated image in the second or third embodiment from the other spectrally estimated image with the filter operation section 103 may be used.
- the enhancement processing is performed between the spectrally estimated image, which is one pseudo image and the other spectrally estimated image or the real image.
- the enhancement processing may be performed using the pseudo image.
- one enhancement processing result is obtained with respect to images of two narrowband lights.
- two or more enhancement processing results may be further obtained.
- FIG. 33 is a diagram showing a light observation characteristic of venous blood for explaining the modification 7 .
- the enhancement processing is applied to a first combination of the narrowband light NL 1 near the wavelength of 600 nm and the narrowband light NL 2 near the wavelength of 630 nm and, for the other enhancement processing result, the enhancement processing is applied to a second combination of narrowband light NL 12 near the wavelength of 650 nm and narrowband light NL 22 near the wavelength of 680 nm.
- a user is allowed to select any one of the combinations. For example, the user can select, according to mode selection, in which of the combinations display is performed.
- another combination may be a combination such as a combination of the narrowband light near the wavelength of 615 nm and the narrowband light near the wavelength of 645 nm or a combination of the narrowband light near the wavelength of 630 nm and the narrowband light near the wavelength of 660 nm.
- the enhancement processing for two or more combinations can be performed by increasing combinations of rotating filters in the light source device or increasing the number of spectrally estimated image signals to be estimated by the spectral estimation processing.
- combinations of wavelengths of narrowband lights preferably include two combinations, i.e., a combination of wavelength near the wavelength of 580 nm and wavelength near the wavelength of 630 nm and a combination of wavelength near the wavelength of 590 nm and wavelength near the wavelength of 630 nm.
- combinations of wavelengths of narrowband lights preferably include two combinations, i.e., a combination of wavelength near the wavelength of 600 nm and wavelength near the wavelength of 630 nm and a combination of wavelength near the wavelength of 650 nm and wavelength near the wavelength of 680 nm.
- the combinations are the two combinations. However, the combinations may be three combinations. In the case of the three combinations, the combinations include, for example, a first combination of the narrowband light near the wavelength of 600 nm and the narrowband light near the wavelength of 630 nm, a second combination of the narrowband light near the wavelength of 650 nm and the narrowband light near the wavelength of 680 nm, and a third combination of the narrowband light near the wavelength of 700 nm and the narrowband light near the wavelength of 730 nm.
- a plurality of enhancement processing results are obtained. Therefore, if concentration of blood or the like adhering to a mucosal surface of a living body is high, the surgeon selects a combination on a longer wavelength side (e.g., the combination of the wavelength near the wavelength of 650 nm and the wavelength near the wavelength of 680 nm). When a blood vessel is present in a relatively shallow part, if concentration of blood or the like adhering to the mucosal surface of the living body is low, the surgeon selects a combination on a shorter wavelength side (e.g., the combination of the wavelength near the wavelength of 580 nm and the wavelength near the wavelength of 630 nm). Consequently, the user can highlight a desired blood vessel.
- a shorter wavelength side e.g., the combination of the wavelength near the wavelength of 580 nm and the wavelength near the wavelength of 630 nm.
- a wavelength difference between two narrowband lights for the enhancement processing is fixed.
- one narrowband light may be fixed and the other may be variable.
- the narrowband light near the wavelength of 600 nm may be fixed and the other narrowband light may be able to be arbitrarily set to be variable from the narrowband light near the wavelength of 630 nm to the narrowband light near the wavelength of 730 nm.
- the other narrowband light near the wavelength of 730 nm may be fixed and the other narrowband light may be able to be arbitrarily set to be variable from the narrowband light near the wavelength of 590 nm to the narrowband light near the wavelength of 620 nm.
- the narrowband light near 600 nm may be fixed and the other narrowband light may be able to be arbitrarily set to wavelength band equal to or higher than 730 nm.
- one of the two narrowband lights is fixed and the other is set variable. Consequently, it is possible to further highlight a blood vessel in a desired region.
- the endoscope apparatus has the narrowband light observation mode in addition to the normal light observation mode.
- the surgeon switches the normal light observation mode to the narrowband light observation mode when necessary and performs various kinds of treatment.
- By adding the fourth image it is possible to easily obtain display images in the respective observation modes.
- the fourth image is obtained by using a light source device that can further irradiate illumination light of blue narrowband light (or may be wideband light) having a wavelength shorter than the wavelength of 540 nm.
- the light source device alternately irradiates, on an object, illumination light of a first combination of the light having a fourth wavelength and the narrowband light near the wavelength of 600 nm and illumination light of a second combination of the narrowband light near the wavelength of 540 nm and the narrowband light near the wavelength of 630 nm
- the light source device may alternately irradiate, on the object, illumination light of a combination of the light having the fourth wavelength, the narrowband light near the wavelength of 540 nm, and the narrowband light near the wavelength of 600 nm and illumination light of the narrowband light near the wavelength of 630 nm.
- Return lights of the respective illumination lights are received by an image pickup device including an RGB color filter.
- an image of the return light having the fourth wavelength is picked up in a B band of the color filter and an image of the return light of the narrowband light near the wavelength of 600 nm is picked up in an R band.
- the color filter of the image pickup device may be a color filter of the complementary color system.
- the image pickup device may be a monochrome image pickup device.
- a normal image for the normal light observation mode is generated using images of four return lights of the light having the fourth wavelength, the narrowband light near the wavelength of 540 nm, the narrowband light near the wavelength of 600 nm, and the narrowband light near the wavelength of 630 nm.
- a first narrowband light image is generated by allocating an image signal of the light having the fourth wavelength to the B and G channels and allocating an image signal of the narrowband light near the wavelength of 540 nm to the R channel and using two images of the light having the fourth wavelength and the narrowband light near the wavelength of 540 nm.
- a second narrowband light image is generated using three images of the narrowband light near the wavelength of 540 nm, the narrowband light near the wavelength of 600 nm, and the narrowband light near the wavelength of 630 nm.
- the images generated as explained above are selected and displayed on the observation monitor 5 .
- a superimposed image obtained by adding blood vessel information of a deep part to the normal image and display the superimposed image on the observation monitor by allocating an image signal of the light having the fourth wavelength to the B channel, allocating an image signal of the narrowband light near the wavelength of 540 nm to the G channel, and allocating an image signal of the narrowband light near the wavelength of 600 nm to the R channel or allocating the image signal of the light having the fourth wavelength to the B channel, allocating the image signal of the narrowband light near the wavelength of 540 nm and the image signal of the narrowband light near the wavelength of 600 nm to the G channel, and allocating the image signal of the narrowband light near the wavelength of 600 nm (or the image signal of the narrowband light near the wavelength of 600 nm and the image signal of the narrowband light near the wavelength of 630 nm) to the R channel.
- the image signal of the fourth wavelength may be generated according to the spectral estimation.
- the present invention is not limited to the embodiments explained above. Various changes, alterations, and the like are possible in a range in which the gist of the present invention is not changed.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Biophysics (AREA)
- Veterinary Medicine (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Endoscopes (AREA)
Abstract
Description
U=(Im(λ1)/Im(λ2))×K−1 Equation (1)
where, U represents a luminance ratio, Im represents luminance of each pixel, Im(λ1) represents a luminance value of the return light of the narrowband light near the wavelength of 600 nm (λ1), Im(λ2) represents a luminance value of the return light of the narrowband light near the wavelength of 630 nm (λ2), and K represents a correction coefficient. For example, a value of the following Equation (2) may be used as K:
K=(AVE(λ2)/AVE(λ1)) Equation (2)
where, AVE represents average luminance of the respective lines, AVE(λ1) represents an average value of luminance values of the return light of the narrowband light near the wavelength of 600 nm (λ1), and AVE(λ2) represents an average value of luminance values of the return light of the narrowband light near the wavelength of 630 nm (λ2). In
V=U×R Equation (3)
where, V represents a corrected luminance ratio and R represents an enhancement coefficient, which is a parameter for designating a blood vessel enhancement level.
ImA(λ1)=Im(λ1)×(V+1) Equation (4)
where, ImA(λ1) represents a luminance value after correction of a luminance value of return light of the narrowband light near the
ImA1(λ1)=Im(λ1)×(Im(λ1)/Im(λ2)) Equation (5)
where, ImA1(λ1) represents a luminance value after correction of a luminance value of the return light of the narrowband light near the wavelength of 600 nm (λ1).
ImA2(λ1)=Im(λ1)×|Im(λ2)−Im(λ1)| Equation (6)
where, ImA2(λ1) represents a corrected luminance value of the return light of the narrowband light near the wavelength of 600 nm (λ1).
Claims (13)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012082286 | 2012-03-30 | ||
JP2012-082286 | 2012-03-30 | ||
PCT/JP2012/078743 WO2013145409A1 (en) | 2012-03-30 | 2012-11-06 | Endoscopic device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/078743 Continuation WO2013145409A1 (en) | 2012-03-30 | 2012-11-06 | Endoscopic device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130293693A1 US20130293693A1 (en) | 2013-11-07 |
US9277190B2 true US9277190B2 (en) | 2016-03-01 |
Family
ID=49258747
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/896,881 Active US9277190B2 (en) | 2012-03-30 | 2013-05-17 | Endoscope apparatus |
Country Status (5)
Country | Link |
---|---|
US (1) | US9277190B2 (en) |
EP (1) | EP2700349A4 (en) |
JP (1) | JP5362149B1 (en) |
CN (1) | CN103582445B (en) |
WO (1) | WO2013145409A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9826893B2 (en) | 2012-08-17 | 2017-11-28 | Hoya Corporation | Electronic endoscope system and light source for endoscope |
US10031070B2 (en) | 2014-11-21 | 2018-07-24 | Hoya Corporation | Analyzing device and analyzing method based on images of biological tissue captured under illumination of light with different illumination wavelength ranges |
US10426325B2 (en) | 2014-09-03 | 2019-10-01 | Hoya Corporation | Image capturing system and electronic endoscope system |
US10722155B2 (en) | 2013-05-30 | 2020-07-28 | Hoya Corporation | Method and device for generating image showing concentration distribution of biological substances in biological tissue |
US10891743B2 (en) | 2016-06-22 | 2021-01-12 | Olympus Corporation | Image processing device, operation method performed by image processing device and computer readable recording medium for performing different enhancement processings based on context of update determined from latest image acquired |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015211727A (en) * | 2014-05-01 | 2015-11-26 | オリンパス株式会社 | Endoscope device |
JP6336098B2 (en) * | 2015-03-17 | 2018-06-06 | オリンパス株式会社 | Living body observation system |
WO2017051455A1 (en) * | 2015-09-24 | 2017-03-30 | オリンパス株式会社 | Endoscope device |
CN108778088B (en) * | 2016-05-19 | 2021-03-19 | 奥林巴斯株式会社 | Living body observation system |
JP6626783B2 (en) * | 2016-06-02 | 2019-12-25 | Hoya株式会社 | Image processing apparatus and electronic endoscope system |
JP6751763B2 (en) * | 2016-07-25 | 2020-09-09 | オリンパス株式会社 | Image processing equipment, image processing methods and programs |
WO2018142658A1 (en) | 2017-02-01 | 2018-08-09 | オリンパス株式会社 | Image processing device, operating method for image processing device, and operating program for image processing device |
WO2019171703A1 (en) * | 2018-03-05 | 2019-09-12 | オリンパス株式会社 | Endoscope system |
JP7090699B2 (en) * | 2018-05-17 | 2022-06-24 | オリンパス株式会社 | How to operate the endoscope device and the endoscope device |
JP7019039B2 (en) | 2018-06-05 | 2022-02-14 | オリンパス株式会社 | Endoscope device, operation method and program of the endoscope device |
WO2020188727A1 (en) * | 2019-03-19 | 2020-09-24 | オリンパス株式会社 | Endoscope device, operating method of endoscope device, and program |
US11232570B2 (en) | 2020-02-13 | 2022-01-25 | Olympus Corporation | System and method for diagnosing severity of gastritis |
US11024031B1 (en) * | 2020-02-13 | 2021-06-01 | Olympus Corporation | System and method for diagnosing severity of gastric cancer |
JP2022180108A (en) | 2021-05-24 | 2022-12-06 | 富士フイルム株式会社 | Medical imaging device, endoscopy system, and method of operating medical imaging device |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH01308531A (en) | 1988-02-08 | 1989-12-13 | Olympus Optical Co Ltd | Endoscopic apparatus |
US4959710A (en) | 1988-03-01 | 1990-09-25 | Olympus Optical Co., Ltd. | Electronic endoscope whereby the position of the insertable part can be known by a transmitted light outside a body |
JP2000041942A (en) | 1998-07-31 | 2000-02-15 | Olympus Optical Co Ltd | Endoscope apparatus |
WO2002007588A1 (en) | 2000-07-21 | 2002-01-31 | Olympus Optical Co., Ltd. | Endoscope apparatus |
JP2002034893A (en) | 2000-07-27 | 2002-02-05 | Olympus Optical Co Ltd | Endoscope instrument |
US20070153542A1 (en) * | 2004-08-30 | 2007-07-05 | Olympus Corporation | Endoscope apparatus |
US20090075391A1 (en) * | 2003-01-17 | 2009-03-19 | Newton Laboratories, Inc. | Spectroscopic diagnostic method and system based on scattering of polarized light |
US20090091614A1 (en) * | 2005-05-13 | 2009-04-09 | Olympus Medical Systems Corp. | Biological observation apparatus |
US20090289200A1 (en) * | 2008-05-22 | 2009-11-26 | Fujifilm Corporation | Fluorescent image obtainment method and apparatus, fluorescence endoscope, and excitation-light unit |
US20100004513A1 (en) * | 2003-09-26 | 2010-01-07 | Tidal Photonics, Inc. | Apparatus and methods relating to expanded dynamic range imaging endoscope systems |
US20100054576A1 (en) | 2008-08-26 | 2010-03-04 | Kazuhiro Tsujita | Image processing apparatus, image processing method, and image processing program |
JP2010142547A (en) | 2008-12-22 | 2010-07-01 | Fujifilm Corp | Apparatus, method and program for processing endoscope image |
US20110237884A1 (en) | 2010-03-23 | 2011-09-29 | Takaaki Saito | Electronic endoscope system |
US20120053434A1 (en) * | 2010-08-24 | 2012-03-01 | Takaaki Saito | Electronic endoscope system and method for obtaining vascular information |
US20120154567A1 (en) * | 2010-12-17 | 2012-06-21 | Hiroshi Yamaguchi | Endoscope apparatus |
US20120184812A1 (en) * | 2011-01-19 | 2012-07-19 | Fujifilm Corporation | Endoscope system |
US20130113904A1 (en) * | 2011-11-08 | 2013-05-09 | Capso Vision, Inc. | System and Method for Multiple Viewing-Window Display of Computed Spectral Images |
EP2604170A1 (en) | 2010-12-17 | 2013-06-19 | Olympus Medical Systems Corp. | Endoscopic apparatus, and method for displaying image of subject using endoscopy |
EP2687145A1 (en) | 2011-09-20 | 2014-01-22 | Olympus Medical Systems Corp. | Image processing equipment and endoscopic system |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8998802B2 (en) * | 2006-05-24 | 2015-04-07 | Olympus Medical Systems Corp. | Endoscope, endoscopic apparatus, and examination method using endoscope |
-
2012
- 2012-11-06 EP EP12872387.1A patent/EP2700349A4/en not_active Withdrawn
- 2012-11-06 WO PCT/JP2012/078743 patent/WO2013145409A1/en unknown
- 2012-11-06 JP JP2013522028A patent/JP5362149B1/en active Active
- 2012-11-06 CN CN201280026794.8A patent/CN103582445B/en active Active
-
2013
- 2013-05-17 US US13/896,881 patent/US9277190B2/en active Active
Patent Citations (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH01308531A (en) | 1988-02-08 | 1989-12-13 | Olympus Optical Co Ltd | Endoscopic apparatus |
US4959710A (en) | 1988-03-01 | 1990-09-25 | Olympus Optical Co., Ltd. | Electronic endoscope whereby the position of the insertable part can be known by a transmitted light outside a body |
JP2000041942A (en) | 1998-07-31 | 2000-02-15 | Olympus Optical Co Ltd | Endoscope apparatus |
WO2002007588A1 (en) | 2000-07-21 | 2002-01-31 | Olympus Optical Co., Ltd. | Endoscope apparatus |
EP1302152A1 (en) | 2000-07-21 | 2003-04-16 | Olympus Optical Co., Ltd. | Endoscope apparatus |
US20030176768A1 (en) | 2000-07-21 | 2003-09-18 | Kazuhiro Gono | Endoscope apparatus |
JP2002034893A (en) | 2000-07-27 | 2002-02-05 | Olympus Optical Co Ltd | Endoscope instrument |
US20090075391A1 (en) * | 2003-01-17 | 2009-03-19 | Newton Laboratories, Inc. | Spectroscopic diagnostic method and system based on scattering of polarized light |
US20100004513A1 (en) * | 2003-09-26 | 2010-01-07 | Tidal Photonics, Inc. | Apparatus and methods relating to expanded dynamic range imaging endoscope systems |
US20070153542A1 (en) * | 2004-08-30 | 2007-07-05 | Olympus Corporation | Endoscope apparatus |
US20090091614A1 (en) * | 2005-05-13 | 2009-04-09 | Olympus Medical Systems Corp. | Biological observation apparatus |
US20090289200A1 (en) * | 2008-05-22 | 2009-11-26 | Fujifilm Corporation | Fluorescent image obtainment method and apparatus, fluorescence endoscope, and excitation-light unit |
US20100054576A1 (en) | 2008-08-26 | 2010-03-04 | Kazuhiro Tsujita | Image processing apparatus, image processing method, and image processing program |
JP2010142547A (en) | 2008-12-22 | 2010-07-01 | Fujifilm Corp | Apparatus, method and program for processing endoscope image |
US20110237884A1 (en) | 2010-03-23 | 2011-09-29 | Takaaki Saito | Electronic endoscope system |
US20120053434A1 (en) * | 2010-08-24 | 2012-03-01 | Takaaki Saito | Electronic endoscope system and method for obtaining vascular information |
US20120154567A1 (en) * | 2010-12-17 | 2012-06-21 | Hiroshi Yamaguchi | Endoscope apparatus |
EP2604170A1 (en) | 2010-12-17 | 2013-06-19 | Olympus Medical Systems Corp. | Endoscopic apparatus, and method for displaying image of subject using endoscopy |
US20120184812A1 (en) * | 2011-01-19 | 2012-07-19 | Fujifilm Corporation | Endoscope system |
EP2687145A1 (en) | 2011-09-20 | 2014-01-22 | Olympus Medical Systems Corp. | Image processing equipment and endoscopic system |
US20130113904A1 (en) * | 2011-11-08 | 2013-05-09 | Capso Vision, Inc. | System and Method for Multiple Viewing-Window Display of Computed Spectral Images |
Non-Patent Citations (1)
Title |
---|
Extended Supplementary European Search Report dated Jul. 28, 2015 from related European Application No. 12 87 2387.1. |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9826893B2 (en) | 2012-08-17 | 2017-11-28 | Hoya Corporation | Electronic endoscope system and light source for endoscope |
US10722155B2 (en) | 2013-05-30 | 2020-07-28 | Hoya Corporation | Method and device for generating image showing concentration distribution of biological substances in biological tissue |
US10426325B2 (en) | 2014-09-03 | 2019-10-01 | Hoya Corporation | Image capturing system and electronic endoscope system |
US11224335B2 (en) | 2014-09-03 | 2022-01-18 | Hoya Corporation | Image capturing system and electronic endoscope system |
US10031070B2 (en) | 2014-11-21 | 2018-07-24 | Hoya Corporation | Analyzing device and analyzing method based on images of biological tissue captured under illumination of light with different illumination wavelength ranges |
US10891743B2 (en) | 2016-06-22 | 2021-01-12 | Olympus Corporation | Image processing device, operation method performed by image processing device and computer readable recording medium for performing different enhancement processings based on context of update determined from latest image acquired |
Also Published As
Publication number | Publication date |
---|---|
EP2700349A4 (en) | 2015-08-26 |
US20130293693A1 (en) | 2013-11-07 |
JP5362149B1 (en) | 2013-12-11 |
CN103582445A (en) | 2014-02-12 |
JPWO2013145409A1 (en) | 2015-12-10 |
EP2700349A1 (en) | 2014-02-26 |
WO2013145409A1 (en) | 2013-10-03 |
CN103582445B (en) | 2017-02-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9277190B2 (en) | Endoscope apparatus | |
US8723940B2 (en) | Endoscope apparatus | |
JP5404968B1 (en) | Endoscope device | |
US8939901B2 (en) | Endoscope apparatus for outputting signals corresponding to first and second narrowband wavelength bands | |
JP5167440B2 (en) | Endoscope device | |
EP2604170B1 (en) | Endoscopic apparatus | |
US11497390B2 (en) | Endoscope system, method of generating endoscope image, and processor | |
US10165934B2 (en) | Endoscope apparatus with addition of image signals | |
US20190159687A1 (en) | Image processing apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: OLYMPUS MEDICAL SYSTEMS CORP., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:IGARASHI, MAKOTO;NONAMI, TETSUO;REEL/FRAME:030865/0978 Effective date: 20130702 Owner name: OLYMPUS CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:IGARASHI, MAKOTO;NONAMI, TETSUO;REEL/FRAME:030865/0978 Effective date: 20130702 |
|
AS | Assignment |
Owner name: OLYMPUS CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OLYMPUS MEDICAL SYSTEMS CORP.;REEL/FRAME:035944/0022 Effective date: 20150611 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: OLYMPUS CORPORATION, JAPAN Free format text: CHANGE OF ADDRESS;ASSIGNOR:OLYMPUS CORPORATION;REEL/FRAME:039344/0502 Effective date: 20160401 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |