US20070121198A1 - Microscope imaging apparatus and biological-specimen examination system - Google Patents
Microscope imaging apparatus and biological-specimen examination system Download PDFInfo
- Publication number
- US20070121198A1 US20070121198A1 US11/655,507 US65550707A US2007121198A1 US 20070121198 A1 US20070121198 A1 US 20070121198A1 US 65550707 A US65550707 A US 65550707A US 2007121198 A1 US2007121198 A1 US 2007121198A1
- Authority
- US
- United States
- Prior art keywords
- measurement
- image
- specimen
- stage
- culture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 166
- 238000000034 method Methods 0.000 claims abstract description 138
- 230000033001 locomotion Effects 0.000 claims abstract description 97
- 238000005286 illumination Methods 0.000 claims abstract description 51
- 230000010354 integration Effects 0.000 claims abstract description 7
- 238000005259 measurement Methods 0.000 abstract description 232
- 210000004027 cell Anatomy 0.000 description 116
- 239000012531 culture fluid Substances 0.000 description 83
- 238000001514 detection method Methods 0.000 description 66
- 238000012546 transfer Methods 0.000 description 33
- 239000011521 glass Substances 0.000 description 28
- 238000012545 processing Methods 0.000 description 28
- 230000007246 mechanism Effects 0.000 description 27
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 description 25
- 238000012258 culturing Methods 0.000 description 18
- 230000005284 excitation Effects 0.000 description 17
- 229910002092 carbon dioxide Inorganic materials 0.000 description 14
- 238000004364 calculation method Methods 0.000 description 12
- 239000001569 carbon dioxide Substances 0.000 description 11
- 239000000463 material Substances 0.000 description 11
- 238000002360 preparation method Methods 0.000 description 11
- 238000002156 mixing Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 239000000758 substrate Substances 0.000 description 10
- 239000002699 waste material Substances 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 9
- 229920006395 saturated elastomer Polymers 0.000 description 9
- 238000010521 absorption reaction Methods 0.000 description 8
- 230000001276 controlling effect Effects 0.000 description 8
- 238000010276 construction Methods 0.000 description 7
- 238000005192 partition Methods 0.000 description 7
- 239000003570 air Substances 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 239000011347 resin Substances 0.000 description 6
- 229920005989 resin Polymers 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 5
- 238000009826 distribution Methods 0.000 description 5
- 229910052751 metal Inorganic materials 0.000 description 5
- 239000002184 metal Substances 0.000 description 5
- 230000005693 optoelectronics Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 230000001186 cumulative effect Effects 0.000 description 4
- 102000034287 fluorescent proteins Human genes 0.000 description 4
- 108091006047 fluorescent proteins Proteins 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000009281 ultraviolet germicidal irradiation Methods 0.000 description 4
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 4
- 238000009825 accumulation Methods 0.000 description 3
- 229910052782 aluminium Inorganic materials 0.000 description 3
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 3
- 239000012080 ambient air Substances 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 3
- 238000011109 contamination Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 230000001105 regulatory effect Effects 0.000 description 3
- 230000001954 sterilising effect Effects 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 238000002834 transmittance Methods 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 238000001816 cooling Methods 0.000 description 2
- 230000006866 deterioration Effects 0.000 description 2
- 230000002542 deteriorative effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000007599 discharging Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 239000007788 liquid Substances 0.000 description 2
- 238000000691 measurement method Methods 0.000 description 2
- QSHDDOUJBYECFT-UHFFFAOYSA-N mercury Chemical compound [Hg] QSHDDOUJBYECFT-UHFFFAOYSA-N 0.000 description 2
- 229910052753 mercury Inorganic materials 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 229910001220 stainless steel Inorganic materials 0.000 description 2
- 239000010935 stainless steel Substances 0.000 description 2
- FLDSMVTWEZKONL-AWEZNQCLSA-N 5,5-dimethyl-N-[(3S)-5-methyl-4-oxo-2,3-dihydro-1,5-benzoxazepin-3-yl]-1,4,7,8-tetrahydrooxepino[4,5-c]pyrazole-3-carboxamide Chemical compound CC1(CC2=C(NN=C2C(=O)N[C@@H]2C(N(C3=C(OC2)C=CC=C3)C)=O)CCO1)C FLDSMVTWEZKONL-AWEZNQCLSA-N 0.000 description 1
- 241000894006 Bacteria Species 0.000 description 1
- 241000276498 Pollachius virens Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000007743 anodising Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000007664 blowing Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000005260 corrosion Methods 0.000 description 1
- 230000007797 corrosion Effects 0.000 description 1
- 210000004748 cultured cell Anatomy 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 239000000975 dye Substances 0.000 description 1
- 229920001971 elastomer Polymers 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 229910052736 halogen Inorganic materials 0.000 description 1
- 150000002367 halogens Chemical class 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000009413 insulation Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 244000005700 microbiome Species 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 235000015097 nutrients Nutrition 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 239000005304 optical glass Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000009416 shuttering Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000004659 sterilization and disinfection Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6452—Individual samples arranged in a regular 2D-array, e.g. multiwell plates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6486—Measuring fluorescence of biological material, e.g. DNA, RNA, cells
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
Definitions
- the present invention relates to a microscope imaging apparatus and to a biological-specimen examination system using the same.
- a known apparatus for measuring fluorescence and so on of a biological specimen uses a microplate. Since the fluorescence intensity of a biological specimen is extremely dark, it is necessary to capture the fluorescence using a long exposure time. Also, since the microplate has a shape that is larger than the field of view of a microscope, it takes some time to examine the entire microplate.
- One method of imaging such fluorescence is a method in which measurement is carried out with a CCD (charge coupled device) while the microplate is repeatedly moved and stopped. A plurality of wells are provided in the microplate, and the specimens are held in these wells. Therefore, by repeatedly moving and stopping the microplate, the fluorescence from the specimen in each well can be measured. The microplate is moved by means of a moving stage.
- CCD charge coupled device
- the imaging devices using the TDI method are constituted by a plurality of optoelectronic devices. Fluorescence from the specimen is incident on the optoelectronic devices, and a charge corresponding to the incident fluorescence is produced in the optoelectronic devices by optical-to-electrical conversion. This charge is then transferred between optoelectronic devices as the microplate moves. Since the motion of the microplate is associated with the motion of the charge, fluorescence from the same position on the specimen is incident again on the optoelectronic devices after they have been moved. As a result, the charge builds up. Thus, the charge is progressively accumulated when using the TDI method.
- TDI time delay integration
- the feature of the TDI method is that charge corresponding to the fluorescence is accumulated while being transferred. Therefore, compared to the case where a one-dimensional line sensor is used for image acquisition, the speed at which the stage is moved can be increased according to the number of charge transfer lines. As a result, the measurement time can be shortened.
- a microscope imaging apparatus comprises:
- an illumination unit that illuminates the object under examination
- an image-acquisition unit that acquires images of the object under examination
- control unit that controls the image-acquisition unit and the motion unit, wherein the image-acquisition unit includes an imaging device that is capable of acquiring images with the time delay integration method, and
- control unit makes the exposure times of the imaging device different for each image acquisition.
- Another microscope imaging apparatus comprises:
- an illumination unit that illuminates the object under examination
- an image-acquisition unit that acquires images of the object under examination
- control unit that controls the image-acquisition unit and the motion unit
- the image-acquisition unit includes an imaging device that is capable of acquiring images with a time delay integration method
- control unit determines an exposure time for image acquisition after the prescan on the basis of the detected intensity.
- Another microscope imaging apparatus comprises:
- an illumination unit that illuminates the object under examination
- an image-acquisition unit that acquires images of the object under examination
- control unit that controls the image-acquisition unit and the motion unit
- the image-acquisition unit includes an imaging device that is capable of image acquisition using two methods
- control unit includes:
- the two image-acquisition methods are a time delay integration method and a two-dimensional imaging method in which accumulated charge is produced by a single exposure.
- a biological-specimen examination system comprises:
- the detection unit includes:
- FIGS. 1A to 1 C depict an image acquisition operation using the TDI method.
- FIGS. 2A to 2 C depict the transfer of signal charge in the TDI method.
- FIGS. 3A to 3 C show the intensity of signal charge accumulated in horizontal lines.
- FIG. 4 shows the overall configuration of a microscope imaging apparatus.
- FIGS. 5A and 5B show the structure of a specimen.
- FIG. 6 depicts scanning in the TDI method.
- FIG. 7 is a flowchart showing a measurement procedure according to a first embodiment.
- FIGS. 8A to 8 C are graphs showing the relationship between specimen brightness and output level.
- FIG. 9 is a timing chart for an electronic shutter used in the TDI method.
- FIG. 10 shows another example of the structure of a specimen.
- FIG. 11 shows the overall configuration of a microscope imaging apparatus according to a second embodiment.
- FIG. 12 is a flowchart showing a measurement procedure in the second embodiment.
- FIG. 13 is a graph showing the relationship between the number of saturated pixels and the exposure time used in the next image acquisition.
- FIG. 14 shows the overall configuration of a microscope imaging apparatus according to a third embodiment.
- FIG. 15 depicts an image acquired in the third embodiment.
- FIG. 16 is a flowchart showing a measurement procedure in a fourth embodiment.
- FIG. 17 is a graph showing the relationship between prescan brightness and exposure time of the main measurement.
- FIG. 18 shows another example of the microscope imaging apparatus in the fourth embodiment.
- FIG. 19 shows the overall configuration of a microscope imaging apparatus in a fifth embodiment.
- FIG. 20 shows the overall configuration of a microscope imaging apparatus in a sixth embodiment.
- FIG. 21 shows the overall configuration of a microscope imaging apparatus in a seventh embodiment.
- FIG. 22 is a flowchart showing a measurement procedure in the seventh embodiment.
- FIGS. 23A and 23B depict the structure of a specimen in an eighth embodiment.
- FIG. 24 shows the overall configuration of a microscope imaging apparatus in a ninth embodiment.
- FIGS. 25A and 25B show parameters used in estimating the scanning time.
- FIG. 26 depicts scanning in a two-dimensional imaging method.
- FIG. 28 shows a specimen in which the density of sample located portions is asymmetric.
- FIG. 29 depicts an example in which scanning is switched between the TDI method and the two-dimensional imaging method.
- FIG. 30 is a perspective view showing a biological-specimen examination system according to a tenth embodiment of the present invention, which is provided with a microscope imaging apparatus.
- FIG. 31 is a schematic diagram showing the system configuration of the biological-specimen examination system shown in FIG. 30 .
- FIG. 32 is a perspective view of an incubator box used in the biological-specimen examination system shown in FIG. 30 .
- FIG. 33 is a cross-sectional view of a chamber in the incubator box shown in FIG. 32 .
- FIGS. 34A and 34B are perspective views showing other examples of the incubator box shown in FIG. 33 .
- FIGS. 35A to 35 D show examples of selecting the scanning method and the detection regions in the biological-specimen examination system.
- FIG. 36 is a flowchart showing a procedure for setting measurement parameters used in the biological-specimen examination system.
- FIGS. 37 and 38 are flowcharts showing a measurement procedure in the biological-specimen examination system.
- FIG. 39 is a flowchart showing an image processing method in the biological-specimen examination system.
- FIG. 40 is a flowchart showing a data processing procedure in the biological-specimen examination system.
- FIG. 41 is a flowchart showing a procedure for adjusting intensity in the biological-specimen examination system.
- FIG. 43 shows a cell-tracking image representing the motion of cells over time.
- FIGS. 44 and 45 are flowcharts showing culturing and measurement using a microplate.
- FIGS. 46A and 46B are, respectively, an elevational view and a side view of a biological-specimen examination system according to an eleventh embodiment, in which a microscope imaging apparatus is provided.
- FIG. 47 is a plane view of a culture stage in the biological-specimen examination system shown in FIGS. 46A and 46B .
- FIG. 48 is a perspective view of the culture stage in the biological-specimen examination system shown in FIGS. 46A and 46B .
- a microscope imaging apparatus will be described below with reference to FIGS. 1A to 6 .
- FIGS. 1A, 1B , and 1 C depict the TDI image-capturing operation.
- FIGS. 2A, 2B , and 2 C depict the transfer of signal charge in the TDI method.
- FIG. 3A shows the level of signal charge accumulated in a horizontal line LA
- FIG. 3B shows the level of signal charge accumulated in a horizontal line LB
- FIG. 3C shows the level of signal charge accumulated in a horizontal line LC.
- the shape of the specimen is not particularly limited to this shape.
- FIG. 1A The positional relationship between a specimen (subject under examination) 20 and an imaging area S of an imaging device 63 is shown in FIG. 1A .
- Image-acquisition begins when the top of the specimen 20 and the bottom of the imaging area S overlap each other.
- the image of the tip of the upward-facing point of the star projects onto the imaging device 63 .
- the image of the tip of the upward-facing point is acquired by the horizontal line LA of the imaging device 63 .
- signal charge with a level corresponding to the light intensity (brightness) from the specimen 20 is accumulated in the horizontal line LA.
- a stage 30 is moved with a predetermined timing. As shown in FIG. 1B , the stage 30 is moved in the positive Y direction by a distance corresponding to one horizontal line of the imaging device 63 . By doing so, the entire upward-facing point of the specimen 20 is imaged.
- the signal charge accumulated in the horizontal line LA is transferred to the horizontal line LB in synchronization with the motion of the stage 30 .
- the image of the specimen 20 is acquired by the horizontal lines LA and LB of the imaging device 63 .
- the signal charge accumulated during this image acquisition is added to the signal charge accumulated in the previous acquisition.
- the signal charges obtained due to the previous and current image acquisition are accumulated in the horizontal line LB.
- the signal charge level is twice as high as that measured in one line.
- the stage 30 is then moved further at the predetermined timing. That is, as shown in FIG. 1C , the stage 30 is again moved in the positive Y direction by an amount corresponding to one horizontal line of the imaging device 63 . By doing so, image-acquisition of the specimen 20 proceeds.
- the signal charge accumulated in the horizontal line LB is transferred to the horizontal line LC in synchronization with the motion of the stage 30 .
- the signal charge accumulated in the horizontal line LA is transferred to the horizontal line LB.
- the image of the specimen 20 is acquired by the horizontal lines LA, LB, and LC.
- the signal charge obtained during this image-acquisition is added to the horizontal line LC.
- the signal charges obtained by the previous-but-one image-acquisition, the previous image-acquisition, and the current image-acquisition are accumulated in the horizontal line LC.
- the level of signal charge is three times higher than that measured with a single line.
- the signal charge obtained in the previous image-acquisition and the current image-acquisition are accumulated in the horizontal line LB.
- the same number of image-acquisition operations as the number of horizontal scanning lines is performed. Accordingly, a signal charge for the same part of the specimen 20 is accumulated corresponding to the number of image-acquisition operations.
- the image of the specimen 20 projected onto the imaging surface is shifted along with the motion of the stage 30 , and the signal charge accumulated in the imaging device 63 is shifted in synchronization therewith.
- the exposure time in the TDI method is the time it takes for the signal light returning from the specimen 20 to be accumulated as the signal charge.
- the exposure time in the TDI method can be expressed as the product of the TDI line transfer rate and the cumulative number of pixels. Therefore, to change the exposure time, the TDI line transfer rate can be made faster to lengthen the exposure time or the TDI line transfer rate can be slowed down to shorten the exposure time.
- the stage 30 is moved in synchronization with the transfer of the signal charge. Therefore, the speed at which the stage 30 is moved can be expressed as the pixel size on the stage 30 divided by the TDI line transfer rate.
- the pixel size on the stage 30 can be obtained from the pixel size of the imaging device 63 (for example, a CCD) and the projection magnification.
- FIG. 4 shows the overall configuration of a microscope imaging apparatus 10 .
- the microscope imaging apparatus 10 shown in FIG. 4 is used in the first to third embodiments of the present invention described below.
- the microscope imaging apparatus 10 includes the stage 30 , an illumination unit 40 , and an image-acquisition unit 60 .
- the stage 30 holds the specimen (object under examination) 20 thereon and is moveable.
- the illumination unit 40 radiates illumination light onto the specimen 20 .
- the image-acquisition unit 60 acquires signal light emitted from the region irradiated with the illumination light and measures it.
- the illumination unit 40 includes components capable of Kohler illumination. Specifically, these are a lamp 41 , a collector lens 42 , a reflecting mirror 43 , a field stop 44 , and a lens 45 .
- a gas discharge lamp or the like such as a halogen lamp, xenon lamp, or mercury lamp, is used at the light source lamp 41 .
- the collector lens 42 collects light emitted from the lamp 41 .
- the reflecting mirror 43 reflects light traveling backwards from the lamp 41 back towards the lamp 41 again.
- the field stop 44 is disposed after the collector lens 42 . This field stop 44 is disposed at a conjugate position with respect to the focal point of an objective lens 49 described below. The diameter of the opening of this field stop 44 is adjustable.
- a lens 45 is disposed after the field stop 44 .
- the lens 45 images the field stop 44 at infinity.
- An aperture stop 46 is disposed after the lens 45 , at the focal plane thereof.
- the diameter of the opening of this aperture stop 45 can be varied. By doing so, the size of the beam diameter at the exit-pupil position of the objective lens 49 can be adjusted.
- a mirror 47 is disposed after the aperture stop 46 .
- a dichroic mirror that reflects light from the lamp 41 and that transmits return light (fluorescence) from the specimen 20 is used as the mirror 47 .
- a half-mirror may be used instead of a dichroic mirror.
- the objective lens 49 is disposed after the mirror 47 .
- the stage 30 is disposed at a position facing the objective lens 49 .
- a stage driving mechanism (motion unit) 31 for driving the stage 30 is provided.
- the stage driving mechanism (motion unit) 31 drives the stage 30 in the X and Y directions on the basis of a signal output from a computer described below.
- Known technology for example, a sliding motion mechanism, may be used as the stage driving mechanism 31 . It is not particularly limited to a sliding motion mechanism, however.
- An imaging lens 61 and a detector 62 are provided in the image-acquisition unit 60 .
- Return light (fluorescence) from the specimen 20 is incident on the imaging lens 61 , and the imaging lens 61 focuses (images) the incident light at a predetermined position.
- the detector 62 is disposed at a predetermined position and detects the return light from the specimen 20 .
- the imaging device 63 which can acquire images by the TDI method, is provided in the detector 62 . As described above, the imaging device 63 accumulates signal charge in each horizontal line in response to the movement of the stage 30 .
- the output of the detector 62 is connected to an image processing unit 64 , which processes the output signal from the detector 62 .
- a monitor 65 for displaying the processed signal is connected to the image processing unit 64 .
- the image processing unit 64 is connected to the computer 66 .
- the stage driving mechanism 31 is also connected to the computer 66 .
- the computer (calculating unit) 66 calculates the exposure time in the main measurement. This calculation is carried out on the basis of information obtained during a prescan, as described above. This information is the brightness in each sample located portion (described below).
- FIG. 5A depicts the shape of the specimen 20 .
- FIG. 5B is a magnified view showing a sample located portion 22 of the specimen 20 .
- the specimen 20 includes a transparent substrate 21 .
- This transparent substrate 21 is formed of, for example, a glass plate or a plastic plate.
- the sample located portions 22 are formed in a matrix on the transparent substrate 21 . That is, a two-dimensional patterned portion 23 is formed by the plurality of sample located portions 22 .
- the sample located portions 22 have a substantially circular shape with a diameter of a few millimeters in plane view and have a concave profile in cross-section. As shown in FIG. 5B , cells, serving as the objects to be measured, are disposed in the sample located portions 22 . The cells are cultured inside the sample located portions 22 .
- stage scanning in the TDI method will be described.
- FIG. 6 depicts the scanning in the TDI method.
- the stage 30 is moved to perform scanning.
- the imaging device 63 is depicted as moving.
- the two-dimensional patterned portion 23 is completely scanned. This scanning is performed regardless of whether or not the sample located portions 22 are present.
- the stage 30 When the stage 30 is scanned in the Y-axis direction, the stage 30 moves at constant velocity in the ⁇ Y direction.
- the imaging device 63 is capable of transferring charge only in one direction. Therefore, as shown in FIG. 6 , measurement is carried out only while the stage 30 is advancing in the ⁇ Y direction. Measurement is not carried out while the stage 30 is advancing in the +Y direction.
- the motion in the +Y direction is for returning the stage to its initial position.
- the time required to return to the initial position may correspond to, for example, the time required for storing the acquired data in a hard disk of the computer 66 .
- FIG. 7 is a flowchart showing the measurement procedure in this embodiment.
- FIGS. 8A to 8 C show the relationship between the brightness of the specimen 20 and the output level from the imaging device 63 .
- FIG. 8A shows the relationship between the brightness obtained in a first scan and the output level
- FIG. 8B shows the relationship between the brightness obtained in a second scan and the output level
- FIG. 8C shows the dependency of the brightness obtained in the first and second scans no the output level.
- the first scan (image acquisition) is performed to acquire an image of the specimen 20 (step S 1 ). This corresponds to the prescan.
- the image acquired in the first scan will be described in terms of the relationship between the brightness of the image and the output level from the imaging device 63 .
- there is a region where the accumulated charge is saturated hereinafter referred to as saturation-level region
- a region where the accumulated charge is low hereinafter referred to as low-level region.
- step S 2 preparation for the second scan is carried out.
- the output levels of the saturation-level region and the low-level region are appropriately set. More specifically, exposure times of suitable length are set for each of these regions.
- the exposure time is set to be shorter than the exposure time in the first scan.
- the output level is set to utilize the entire dynamic range of the imaging device 63 .
- the exposure time is set to be longer than the exposure time in the first scan. In this case too, the output level is set to utilize the entire dynamic range of the imaging device 63 .
- the specimen 20 (stage 30 ) is moved from position b to position a.
- This embodiment is described in terms of an example in which the saturation-level region is eliminated.
- a second scan (image acquisition) is performed to acquire an image of the specimen 20 again (step S 3 ).
- the exposure time determined in step S 2 is used to acquire an image of the specimen 20 in the same way as in step S 1 .
- the image acquired in the second scan is a graph indicating the relationship between the brightness of the acquired image and the output level of the imaging device 63 .
- the image acquired in the second scan is shown in FIG. 8B . As shown in this figure, the saturation in the saturation-level region in the previous scan is eliminated, whereas the output level is increased in the low-level region.
- step S 4 the images acquired in the first and second scans are combined into a single image.
- a predetermined image processing operation is carried out during this image combining.
- the image acquired in step S 1 with the long exposure time and the image acquired in step S 3 with the short exposure time are combined to form a single image.
- the specimen 20 (stage 30 ) is moved from position b to position c, and the process proceeds to preparation for measuring the next line.
- This embodiment has been described in terms of an example in which scanning of the same position is repeated twice.
- the number of scans is not limited to two.
- scanning may be repeated at the same position three or more times. In such a case, between the image acquisitions performed in each scan, preparation for the next scan is carried out, and the acquired images are combined at the end.
- an imaging device 63 a having an electronic shutter may be used instead of the imaging device 63 described above.
- Use of such an imaging device 63 a is preferable since it can reduce the exposure time.
- the electronic shutter is the type of shutter normally used in CCD digital cameras and mobile telephones with built-in cameras. Such an electronic shutter uses a phenomenon whereby charge is not accumulated if the CCD is not operating, even if exposed to light. Accordingly, the CCD function itself is one form of shuttering.
- FIG. 9 is a timing chart for the electronic shutter in the TDI method.
- the electronic shutter is open for a period of t 2 seconds from each charge transfer, and charge accumulation is performed. In other words, the charge accumulation of the CCD is carried out for t 2 seconds after every charge transfer.
- the exposure time when not using the electronic shutter is t 1 . Therefore, the ratio of the exposure time when using the electronic shutter to the exposure time when not using the electronic shutter is t 2 /t 1 .
- the imaging device 63 a has 1000 pixels in the Y direction and a maximum transfer rate (t 1 ) of 10 kHZ (0.1 ms).
- the shortest exposure time is determined by the product of the maximum TDI transfer rate and the cumulative number of pixels. Accordingly, by using an electronic shutter of the type described above, it is possible to increase the range of exposure times for which measurement is possible. Therefore, even a high-brightness specimen 20 can be accurately measured.
- the specimen 20 may include only the sample located portions 22 on the transparent substrate 21 .
- a reference line BL may also be formed in a region close to the left-hand side of the transparent substrate 21 .
- the reference line BL can serve as a reference when combining the images acquired in each scan. Accordingly, it is possible to simplify the image combining operation.
- the reference line BL be formed of a material that fluoresces.
- the basic structure of the microscope imaging apparatus of this embodiment is the same as that of the first embodiment, but the method of measuring the specimen is different from that in the first embodiment. Therefore, in this embodiment, only the method of measuring the specimen shall be described, using FIGS. 11 to 13 , and a description of the TDI method and so on shall be omitted.
- FIG. 11 depicts the overall configuration of a microscope imaging apparatus 110 of this embodiment.
- the microscope imaging apparatus 110 includes a stage 30 , an illumination unit 40 , and an image-acquisition unit 160 .
- the stage 30 holds a specimen 20 and is moveable.
- the illumination unit 40 irradiates the specimen 20 with illumination light.
- the image-acquisition unit 160 acquires signal light emitted from the region irradiated with illumination and measures it.
- An imaging lens 61 and a detector 62 are provided in the image-acquisition unit 160 . Return light from the specimen 20 is incident on the imaging lens 61 , and the detector 62 detects the return light.
- the detector 62 is connected to an image processing unit 64 , which processes the output of the detector 62 .
- the image processing unit 64 , a monitor 65 for displaying the processed signal, and a stage driving mechanism 31 are connected to a computer 166 .
- An exposure-time input unit 167 and a setting unit 168 are provided in the computer 166 .
- a maximum exposure time Tmax is input using the exposure-time input unit 167 .
- This maximum exposure time Tmax is related to measurement of the specimen 20 and is set by the user.
- the setting unit 168 is used to set an exposure time Tmeasure used for image acquisition and measurement.
- FIG. 12 is a flowchart showing the measurement procedure in this embodiment.
- the user sets the maximum exposure time Tmax (step S 10 ) by inputting the maximum exposure time Tmax to the exposure-time input unit 167 .
- a first scan (image acquisition) is performed to acquire an image of the specimen 20 .
- the maximum exposure time Tmax input to the setting unit 168 is set as the exposure time Tmeasure used for image acquisition and measurement. Therefore, an image of the specimen 20 is acquired with the maximum exposure time Tmax.
- step S 12 preparation is arried out for a second scan.
- the setting unit 168 sets the exposure time Tmeasure for the second scan on the basis of the magnitude (number of saturated pixels) in the saturation-level region.
- the reltionship (table) between the number of saturated pixels and the exposure time in the next image acquisition is stored in the setting unit 168 .
- the computer 66 sets the exposure time Tmeasure for the second scan.
- the exposure time for the second scan decreases.
- a saturated pixel is a pixel for which the imaging device outputs a value of 4095, in other words, a pixel whose output value reaches the upper limit.
- a second scan (image acquisition) is performed to acquire an image of the specimen 20 (step S 13 ), and the images acquired in the first and second scans are combined to form a single image (step S 14 ).
- step S 13 The measurement procedure after step S 13 is the same as in the first embodiment, and therefore it is merely shown in FIG. 12 , but a description thereof is omitted.
- the user inputs the maximum exposure time Tmax in advance to the exposure-time input unit 167 .
- the exposure time can be reduced.
- image acquisition can be made more efficient, and it is possible to efficiently acquire images with a wider dynamic range.
- the time input to the exposure-time input unit 167 may be just the actual exposure time. In other words, it is not limited to the maximum exposure time.
- the basic configuration of the microscope imaging apparatus of this embodiment is the same as that in the first embodiment, but the configuration of the image-acquisition unit is different from the first embodiment. Therefore, in this embodiment only the image-acquisition unit will be described using FIGS. 14 and 15 , and a description of the illumination unit and so on shall be omitted.
- FIG. 14 shows the overall configuration of a microscope imaging apparatus 210 in this embodiment.
- the microscope imaging apparatus 210 includes a stage 30 , an illumination unit 40 , and an image-acquisition unit 260 .
- the stage 30 holds a specimen 20 and is moveable.
- the illumination unit 40 irradiates the specimen 20 with illumination light.
- the image-acquisition unit 260 acquires signal light emitted from the region irradiated with the illumination light and measures it.
- An imaging lens 61 and a detector 262 are provided in the image-acquisition unit 260 . Return light from the specimen 20 is incident on the imaging lens 61 , and the detector 262 detects the return light from the specimen 20 .
- An imaging device 263 is disposed in the detector 262 .
- the imaging device 263 has an anti-smear function and is capable of acquiring images on the basis of the TDI method. As described above, the TDI method is a technique in which, according to the motion of the stage 30 , the signal charge in each horizontal line is accumulated in the imaging device 63 .
- Smearing is a phenomenon occurring in photoelectric conversion devices like CCDs (charge coupled devices). When an excessive signal above a certain level is input to a photoelectric conversion device, this phenomenon produces a false signal as a result of completely changing the signal in the longitudinal or transverse direction during signal processing.
- CCDs charge coupled devices
- smearing is a phenomenon whereby, when a highly bright spot of light, for example, is incident on a photoelectric conversion device, a bright band of light extending in the longitudinal or transverse direction is produced.
- a cell BC of high brightness and a cell DC of low brightness are adjacent to each other.
- the exposure time is long enough for the low-brightness cell (biological specimen) DC
- smearing occurs in the image of the high-brightness cell BC.
- the configuration described above even if image acquisition is carried out with a long exposure time, which is suitable for the low-brightness cell DC, it is possible to prevent the occurrence of smearing. Therefore, it is possible to accurately measure both the high-brightness cell BC and the low-brightness cell DC.
- the microscope imaging apparatus of this embodiment when acquiring a plurality of images of the object under examination, it is possible to acquire images with different exposure times. Then, these images are combined into a single image. By doing so, it is possible to accurately perform measurement even for an examination object having significant brightness variation.
- FIG. 4 The microscope imaging apparatus shown in FIG. 4 is also used in this embodiment.
- the measurement procedure shall be described using FIG. 16 .
- FIG. 16 is a flowchart showing the measurement procedure in this embodiment.
- prescan preparation is carried out (step S 201 ).
- the stage 30 moves to a measurement starting point (the point where the imaging device 63 and the specimen 20 have the positional relationship shown in FIG. 6 ).
- the prescan is carried out (step S 202 ). Fluorescence, for example, is emitted from each of the sample located portions 22 , and the prescan is performed to acquire the brightness distribution of this fluorescence.
- the exposure time used in the prescan is set to be sufficiently short so that the signal charge accumulated in the imaging device 63 is not saturated.
- the movement speed of the stage 30 is set according to the TDI line transfer rate.
- FIG. 17 is graph showing the relationship between the prescan brightness and the exposure time in the main measurement.
- step S 203 preparation for the main measurement of the specimen 20 is carried out.
- the stage 30 is moved back to the measurement starting point.
- the brightness in each sample located portion 22 has already been acquired in the prescan (step S 202 ). Therefore, from among the acquired brightnesses, the maximum value, that is, the maximum intensity value (count), is found. This maximum intensity value is the digital value output from the imaging device 63 .
- the exposure time for each sample located portion 22 in the current measurement is determined.
- the exposure time is determined on the basis of the relationship between the prescan brightness and the exposure time for the main measurement, as shown in FIG. 17 .
- the relationship shown in FIG. 17 is obtained in advance before measurement. (For example, the relationship shown in FIG. 17 is obtained by measurement or simulation.)
- the main measurement (image acquisition) of the specimen 20 is carried out (step S 204 ).
- the image of each sample located portion 22 is acquired on the basis of the exposure time found in the main-measurement preparation step (step S 203 ).
- the exposure time is expressed by the TDI line transfer rate and the cumulative number of charged pixels.
- the stage 30 is moved at a speed in synchronization with the TDI line transfer rate.
- an imaging device 63 a having an electronic shutter may be used instead of the imaging device 63 described above.
- Use of such an imaging device 63 a is beneficial in that it is possible to reduce the exposure time.
- the electronic shutter and the mechanical shutter are as described previously.
- the TDI method is also used in this embodiment.
- the timing chart for the electronic shutter used in this TDI method is as shown in FIG. 9 .
- a suitable exposure time for measurement of the specimen 20 on the basis of the prescan performed before measurement of the specimen 20 . Accordingly, on the basis of the prescan before measurement, a suitable exposure time can be determined even when measuring a specimen 20 whose brightness changes with time. As a result, the specimen can be accurately measured.
- setting an exposure time longer than the appropriate time can prevent the problem of saturation of the accumulated charge. Also, setting an exposure time shorter than the appropriate time can prevent the problem of insufficient charge accumulation (only accumulating the noise level).
- FIG. 18 shows an example of the configuration of another microscope imaging apparatus 200 .
- a light control member 70 may be disposed between the imaging lens 61 and the detector 62 in the image-acquisition unit 60 .
- a neutral density (ND) filter or an electro-micro mirror device whose transmittance is varied by application of an electric potential may be used as the light control member 70 .
- the transmittance of the light control member 70 can be adjusted according to the exposure time obtained in the prescan.
- the range of possible exposure times for measurement can be increased.
- the basic configuration of the microscope imaging apparatus of this embodiment is the same as that of the fourth embodiment, but the prescan method is different from that in the fourth embodiment. Therefore, in this embodiment, only the prescan method is described using FIG. 19 , and a description of the main measurement method and so on is omitted.
- FIG. 19 shows the overall configuration of a microscope imaging apparatus 210 of this embodiment.
- the microscope imaging apparatus 210 includes a stage 30 , an illumination unit 140 , and an image-acquisition unit 60 .
- the stage 30 holds a specimen 20 and is moveable.
- the illumination unit 140 irradiates the specimen 20 with illumination light.
- the image-acquisition unit 60 acquires signal light emitted from the region irradiated with the illumination light and measures it.
- a light source lamp 41 , a collector lens 42 , a reflecting mirror 43 , a field stop 44 , a lens 45 , an aperture stop 46 , and a mirror 47 are provided in the illumination unit 140 .
- the collector lens 42 collects light emitted from the lamp 41 .
- the reflecting mirror 43 reflects backward-propagating light back to the lamp 41 .
- the diameter of the opening of the field stop 44 can be adjusted.
- the lens 45 images the field stop 44 at infinity.
- the diameter of the opening of the aperture stop 46 can be adjusted.
- the mirror 47 selectively transmits light.
- An objective lens 149 forms an image of the specimen 20 ; however, since the objective lens 149 focuses the light from the lamp 41 on the specimen 20 , it can also be considered part of the illumination unit 140 .
- a low-magnification objective lens 149 A used in the prescan and a high-magnification objective lens 149 B used in the main measurement are used as the objective lens 149 .
- These objective lenses 149 A and 149 B are retained by a known switching mechanism such as a revolver or the like. Thus, it is possible to change the objective lens as required.
- the prescan time can be shortened.
- the high-magnification objective lens 149 B used in the main measurement is a 20 ⁇ lens
- the low-magnification objective lens 149 A used in the prescan is a 4 ⁇ lens.
- the stage speed can be increased by a factor of five.
- the field is five times wider, the number of line scans can be reduced to one fifth. Therefore, compared to the case where the prescan and the main measurement are carried out with the same magnification, the prescan time required for the entire surface of the specimen 20 can be reduced to 1/25.
- the light (brightness) from the specimen may vary over time, depending on the specimen.
- the appropriate exposure time also changes over time. Therefore, if the time required for the prescan can be reduced, as in this embodiment, it is possible to reduce the time interval from the prescan to the main measurement. As a result, it is possible to carry out measurement with the appropriate exposure time.
- the basic configuration of the microscope imaging apparatus of this embodiment is the same as that of the fourth embodiment, but the image-acquisition unit is different from that in the fourth embodiment. Therefore, in this embodiment, only the image-acquisition unit is described using FIG. 20 , and a description of the illumination unit and so on is omitted.
- FIG. 20 shows the overall configuration of a microscope imaging apparatus 220 of this embodiment.
- the microscope imaging apparatus 220 includes a stage 30 , an illumination unit 40 , and an image-acquisition unit 260 .
- the stage 30 holds a specimen 20 and is moveable.
- the illumination unit 40 irradiates the specimen 20 with illumination light.
- the image-acquisition unit 260 acquires signal light emitted from the region irradiates with the illumination light and measures it.
- An imaging lens 61 , a detector 62 , and a scaling lens 261 are provided in the image-acquisition unit 260 .
- Return light from the specimen 20 is incident on the imaging lens 61 .
- the detector 62 detects the return light from the specimen 20 .
- the scaling lens 261 can acquire images over a wide field.
- the scaling lens 261 is inserted into the light path between the objective lens 49 and the detector 62 . It may be capable of being inserted in and removed from the light path. Also, the scaling lens 261 may be retained by a known switching mechanism such as a revolver. By doing so, it is possible to switch between scaling lenses with different magnifications, as required.
- the prescan time can be reduced.
- the basic configuration of the microscope imaging apparatus of this embodiment is the same as that of the fourth embodiment, but the method of controlling the exposure time is different from that in the fourth embodiment. Therefore, only the method of controlling the exposure time is described using FIGS. 21 and 22 , and a description of the structure and so on is omitted.
- FIG. 21 shows the overall configuration of a microscope imaging apparatus 230 in this embodiment.
- FIG. 22 is a flowchart showing the measurement procedure in this embodiment.
- the microscope imaging apparatus 230 includes a stage 30 , an illumination unit 40 , and an image-acquisition unit 360 .
- the stage 30 holds a specimen 20 and is moveable.
- the illumination unit 40 irradiates the specimen 20 with illumination light.
- the image-acquisition unit 360 acquires signal light emitted from the region irradiated with the illumination light and measures it.
- An imaging lens 61 and a detector 62 are provided in the image-acquisition unit 360 . Return light from the specimen 20 is incident on the imaging lens 61 .
- the detector 62 detects the return light from the specimen 20 .
- the detector 62 is connected to an image processing unit 64 , which processes the output from the detector 62 .
- a monitor 65 for displaying the processed signal is connected to the image processing unit 64 .
- a stage driving mechanism 31 is connected to a computer 366 .
- the computer 366 includes a maximum-exposure-time input unit 367 , a calculating unit 368 , and a selecting unit 369 .
- a maximum exposure time Tmax for measuring the specimen 20 is input to the maximum-exposure-time input unit 367 .
- the maximum exposure time Tmax is set by the user.
- the calculating unit 368 calculates an exposure time Tpre on the basis of information obtained in a prescan.
- the selecting unit 369 carries out comparison and selection of the exposure time Tpre and the maximum exposure time Tmax.
- the user inputs the maximum exposure time Tmax for the main measurment (step S 211 ). Then, measurement commences.
- prescan preparation is carried out (step S 212 ).
- the stage 30 moves to a measurement starting point (the point where the imaging device 63 and the specimen 20 have the positional relationship shown in FIG. 6 ).
- the prescan is performed (step S 213 ). Fluorescence, for example, is emitted from each sample located portion 22 , and the prescan is performed to acquire brightness distribution information of this fluorescence.
- the exposure time in the prescan is set to a sufficiently short duration so that, for example, the signal charge accumulated in the imaging device 63 is not saturated. Also, as described above, the movement speed of the stage 30 is set according to the TDI line transfer rate.
- step S 214 preparation for the main measurement of the specimen 20 is carried out.
- the stage 30 is moved back to the measurement starting point.
- a maximum value that is, a maximum intensity value (count) is found from among the acquired brightnesses.
- This maximum intensity value is a digital value output from the imaging device 63 .
- the exposure time Tpre for each sample located portion 22 is determined on the basis of the maximum intensity value found.
- the exposure time Tpre is determined on the basis of the relationship between the prescan brightness and the exposure time in the main measurement, as shown in FIG. 17 .
- the relationship shown in FIG. 17 is determined in advance before the measurement. (For example, the relationship shown in FIG. 17 is determined by measurement or simulation.)
- the maximum exposure time Tmax and the exposure time Tpre are compared. On the basis of the comparison result, if the exposure time Tpre is shorter than the maximum exposure time Tmax, the exposure time Tpre is used as the exposure time for the main measurement. On the other hand, if the exposure time Tpre is longer than the maximum exposure time Tmax, the maximum exposure time Tmax is used as the exposure time in the main measurement.
- the main measurement (image acquisition) of the specimen 20 is carried out (S 215 ).
- an image of each sample located portion 22 is acquired on the basis of the exposure time determined in the main measurement preparation (step S 214 ).
- the exposure time is given by the TDI line transfer rate and the cumulative number of charged pixels.
- the stage 30 is moved at a speed in synchronization with the TDI line transfer rate.
- FIGS. 23A and 23B Next, an eighth embodiment will be described with reference to FIGS. 23A and 23B .
- the basic configuration of the microscope imaging apparatus of this embodiment is the same as that in the fourth embodiment, but the specimen is different from that in the fourth embodiment. Therefore, only the specimen is described using FIGS. 23A and 23B , and a description of the illumination unit and so on is omitted.
- FIGS. 23A and 23B show the configuration of a specimen 20 in this embodiment.
- the specimen 20 is disposed so that the brightness in the sample located portions 22 arrayed in the X direction (the sample located portions 22 enclosed by the ellipses in FIG. 23A ) is substantially uniform.
- sample located portions 22 having substantially uniform brightness may be arranged so as to be grouped in regions formed of two or three rows in the X direction and two rows in the Y direction (the region enclosed by the ellipses in FIG. 23B ).
- the arrangement of the sample located portions 22 having substantially uniform brightness is not particularly limited; any arrangement is possible so long as the number of prescans can be reduced.
- the microscope imaging apparatus of this embodiment it is possible to achieve an appropriate exposure time for measuring the object under examination on the basis of the prescan performed before the main measurement. Therefore, a specimen whose brightness varies over time can be accurately measured.
- FIG. 24 shows the overall configuration of a microscope imaging apparatus 310 of this embodiment. Components that are the same as those in FIG. 4 are assigned the same reference numeral, and a description thereof shall be omitted.
- microscope imaging apparatus 310 of this embodiment it is possible to acquire images by the TDI method and by a two-dimensional imaging method.
- An imaging lens 61 and a detector 62 are provided in an image-acquisition unit 60 .
- Return light (fluorescence) from the specimen 20 is incident on the imaging lens 61 .
- the imaging lens 61 focuses (images) the incident light at a predetermined position.
- the detector 62 is disposed at the predetermined position and detects the return light from the specimen 20 .
- An imaging device 63 that is capable of the TDI method and the two-dimensional imaging method is provided in the detector 62 .
- the output from the detector 62 is connected to an image processing unit 64 that processes the signal output from the detector 62 .
- a monitor 65 for displaying the processed signal is connected to the image processing unit 64 .
- the image processing unit 64 is connected to a computer 66 .
- a mirror driving mechanism 48 and a stage driving mechanism 31 are also connected to the computer 66 .
- the computer 66 is provided with a specimen-parameter input unit (examination-object-parameter input unit) 67 , a calculating unit 68 , and a switching unit 69 .
- the specimen-parameter input unit 67 obtains and inputs information on the specimen 20 in advance.
- the calculation unit 68 calculates the scanning time for the stage 30 on the basis of the specimen parameters output from the specimen-parameter input unit 67 .
- the switching unit 69 switches between the TDI method and the two-dimensional imaging method on the basis of the calculation results from the calculation unit 68 , and output a switching signal to the detector 62 .
- the calculation unit 68 calculates the scanning time for the stage 30 in the TDI method and the two-dimensional imaging method. Then, by comparing the durations of the scanning times used in each method, it selects the method having the shorter scanning time.
- the measurement carried out by the microscope imaging apparatus 310 is performed while scanning the plurality of sample located portions 22 , that is, while scanning the cells in the two-dimensional patterned portion 23 . Accordingly, when measuring the two-dimensional patterned portion 23 with the TDI method or the two-dimensional imaging method, the shorter time required for scanning, that is, the shorter measurement time, is employed.
- the specimen 20 used here has the configuration shown in FIGS. 5A and 5B .
- FIG. 25A shows the parameters for the specimen.
- FIG. 25B shows the parameters for the imaging device 63 .
- a measurement substrate 21 has a rectangular outer shape.
- the length in the X direction is A (mm)
- the length in the Y direction is B (mm).
- the sample located portions 22 are arranged in a C ⁇ D array, where C is the number in the X direction and D is the number in the Y direction. Therefore, the total number of sample located portions 22 is C ⁇ D.
- the exposure time for each sample located portion is E (s), and the number of measurement wavelengths is F.
- E s
- F the number of measurement wavelengths
- the pixel pitch of the imaging device 63 is G (mm).
- the number of pixels disposed in the X direction is H (pixels), and the number of pixels disposed in the Y direction is I (pixels).
- the magnification of the objective lens is J 1
- the projection magnification is J 2 .
- the entire surface of the two-dimensional patterned portion 23 is scanned regardless of whether or not the sample located portions 22 exist.
- the stage When measuring fluorescence with a plurality of wavelengths, the number of wavelengths that can be observed in one scan is only one. Therefore, the stage must be moved back and forth corresponding to the number of wavelengths. For example, when measuring fluorescence with two wavelengths, to acquire an image of one line, the stage 30 must be moved back and forth twice.
- T shift E/I (seconds).
- T single B/V stage (seconds).
- T line F ⁇ T double (seconds).
- Ttdi C ⁇ T line (seconds).
- an imaging device 63 a having an electronic shutter may be used in this embodiment too.
- Using such an imaging device 63 a is advantageous in that the exposure time can be reduced.
- the electronic shutter and the mechanical shutter are as described previously.
- the timing chart of the electronic shutter in the TDI method is as shown in FIG. 9 .
- the maximum TDI transfer rate (t 1 ) is Tshift.
- FIG. 26 depicts scanning in the two-dimensional imaging method.
- the imaging device 63 is depicted as moving.
- the stage 30 when carrying out measurement of the specimen 20 with the two-dimensional imaging method, the stage 30 is moved while performing measurement. By moving the stage 30 , the measurement point sequentially moves to the next sample located portion 22 in the examination region.
- FIG. 27 is a graph depicting the operation of the stage 30 in the two-dimensional imaging method.
- the stage 30 is driven while alternating between acceleration and deceleration.
- the motion of the sample located portions 22 advances in this way.
- the stage 30 accelerates during the period T 1 to T 2 , moves at constant speed during period T 2 to T 3 , decelerates during period T 3 to T 4 , and stops during period T 4 to T 5 .
- measurement of the sample located portion 22 is carried out during period T 4 to T 5 where the stage 30 stops.
- the time to move between the sample located portion 22 is K (seconds).
- the dichroic mirror in the microscope is changed. Therefore, the time required to change the dichroic mirror is L (seconds).
- the dichroic mirrors are normally held in a turret, which is rotated by a driving mechanism such as a motor or the like. Thus, changing of the dichroic mirror is carried out electrically.
- T well T measure+ K (seconds).
- T 2 D C ⁇ D ⁇ T well (seconds).
- Table 1 shows values of parameters used in the estimation.
- the values of parameters C, D, E, and F in Table 1 are shown in Table 2.
- Table 2 shows the estimated results of the measurement time corresponding to the parameters C, D, E, and F.
- Tables 3 and 4 show intermediate results of the estimation for each parameter. TABLE 1 Measure- ment Switching time for substrate No. Magnification two-dimensional size No. wells Exposure measurement Pixels No.
- FIG. 28 shows an arrangement in which the density of sample located portions 22 on the measurement substrate 21 changes depending on position (that is, the density is non-uniform).
- FIG. 29 depicts an example where the scanning method switches between the TDI method and the two-dimensional imaging method.
- the region where the density of specimen location portions 22 is high is measured with the TDI method
- the region where the density is low is measured with the two-dimensional imaging method.
- a prescan may be carried out to measure the density of sample located portions 22 in the specimen 20 before measuring the specimen 20 . Doing so allows the main measurement to be carried out after selecting the TDI method or the two-dimensional imaging method for measuring the specimen 20 on the basis of information about the density obtained in the prescan.
- the objective lens 49 When performing the prescan, it is preferable that the objective lens 49 have low magnification. By doing so, the field of view of the microscope is widened, and therefore, it is possible to complete the prescan in a shorter period of time. Also, user input is not required beforehand.
- the method having the shorter scanning time among the TDI method and the two-dimensional imaging method is selected as the method used in the measurement. Therefore, compared to the case where the method is not selected, the scanning in the measurement can be carried out more quickly. Also, being able to select the method having the higher scanning speed allows the time required for measuring the specimen 20 to be reduced.
- the method for measuring the object under examination can be selected from either the TDI method or the two-dimensional imaging method on the basis of the scanning time described above, and it is therefore possible to select the method having the shorter scanning time.
- the scanning during measurement of the object under examination can be made faster, and the time required for measurement can thus be reduced.
- the tenth embodiment is a biological-specimen examination system using one of the microscope imaging apparatuses according to the first to ninth embodiments described above.
- FIG. 30 is a perspective view showing an overview of a biological-specimen examination system 410 according to this embodiment.
- FIG. 31 is a schematic diagram showing the system configuration of the biological-specimen examination system.
- the biological-specimen examination system 410 includes a detection unit 420 and a culture unit 470 .
- the detection unit 420 and the culture unit 470 are preferably disposed adjacent to each other, and more preferably, the units 420 and 470 are disposed in contact with each other.
- the detection unit 420 includes an insulated compartment 421 that contains biological specimens and a detection section (microscope imaging apparatus) 440 that measures cells CE serving as the biological specimens.
- the insulated compartment 421 includes a heater 421 H for keeping the interior of the insulated compartment 421 at a predetermined temperature; a stage 422 that holds an incubator box 500 (described later); a transmission light source (illuminating unit) 423 that irradiates the cells CE with light; a fan 424 to make the temperature inside the insulated compartment 421 uniform; a UV lamp 425 for sterilizing the interior of the insulated compartment 421 ; a carrier 426 that covers a culture-fluid circulating tube 477 (described later), a culture-gas supply tube 497 , and so on; a door 427 used when putting the incubator box 500 or the like in the insulated compartment 421 or when removing it therefrom; and a main power-supply switch 428 for turning on and off the main power supply of the detection unit 420 .
- a heater 421 H for keeping the interior of the insulated compartment 421 at a predetermined temperature
- a stage 422 that holds an incubator box 500 (described later);
- the stage 422 includes an X-axis motion stage 422 X and a Y-axis motion stage 422 Y that move relative to each other in mutually orthogonal directions, and scanning of the stage 422 is controlled by a stage scanning unit (motion unit) 429 .
- stage scanning unit motion unit
- the stage scanning unit 429 is formed of an X-axis coordinate detection unit 430 that detects the X-axis coordinate value of the X-axis motion stage 422 X, an X-axis scanning controller 431 that controls the motion (scanning) of the X-axis motion stage 422 X, a Y-axis coordinate detection unit 432 that detects the Y-axis coordinate value of the Y-axis motion stage 422 Y, and a Y-axis scanning controller 433 that controls the motion (scanning) of the Y-axis motion stage 422 Y.
- the X-axis coordinate detection unit 430 and the Y-axis coordinate detection unit 432 are configured so as to output the detected X-coordinate of the X-axis motion stage 422 X and the Y-coordinate of the Y-axis motion stage 422 Y, respectively, to a computer PC.
- the X-axis scanning controller 431 and the Y-axis scanning controller 433 are configured so as to control the scanning of the X-axis motion stage 422 X and the scanning of the Y-axis motion stage 422 Y on the basis of respective instructions from the computer PC.
- the mechanism for driving the X-axis motion stage 422 X and the Y-axis motion stage 422 Y may be, for example, a combination of a motor and a ball screw.
- the computer PC controls the scanning of the X-axis motion stage 422 X and the Y-axis motion stage 422 Y, and in addition, as described later, it also controls the detection system of the cells CE, performs analysis of the images of the cells CE, and so on and controls the X-axis motion stage 422 X, the Y-axis motion stage 422 Y, the detection system, and the analysis system in a coordinated fashion.
- a condenser lens 434 that focuses the light emitted from the transmission light source 423 onto the cells CE is disposed between the transmission light source 423 and the incubator box 500 .
- a shutter 435 may be disposed between the condenser lens 434 and the incubator box 500 , or the shutter 435 may be omitted.
- the fan 424 is disposed on the wall of the insulated compartment 421 . Operating this fan 424 causes air convection inside the insulated compartment 421 , which enables the temperature inside the insulated compartment 421 to be easily kept uniform and constant.
- the UV lamp 425 is connected to a UV-lamp switch 436 disposed on the wall of the detection unit 420 , and a control timer 437 that periodically operates the UV lamp 425 is disposed between the UV lamp 425 and the UV-lamp switch 436 . Furthermore, a sterilization-in-progress indicator lamp (not shown) for indicating that the UV lamp 425 is turned on is provided.
- the timer 437 commences counting and power is supplied to the UV lamp 425 to irradiate the interior of the insulated compartment 421 with UV light (ultraviolet light). At the same time, the sterilization-in-progress indicator lamp is illuminated. Then, after a predetermined amount of time (for example, 30 minutes), the timer 437 finishes counting, the timer 437 stops supplying power to the UV lamp 425 , and the UV irradiation is stopped. Also, the sterilization-in-progress lamp is turned off.
- a predetermined amount of time for example, 30 minutes
- the UV lamp 425 can be controlled independently of the main power-supply switch 428 so that it can be operated even if the main power-supply is off.
- the illumination time of the UV lamp 425 may be 30 minutes, as described above. Alternatively, an illumination time less than 30 minutes or more than 30 minutes may also be used so long as contamination and so forth inside the insulated compartment 421 can be completely killed.
- the door 427 is formed of a metal such as aluminum or the like that has been subjected to anodizing, or it may be formed of a translucent resin with high opacity.
- the door 427 may have a double-layer construction with an air gap, or the inside may be formed of metal and the outside formed of resin. Using resin on the outside of the door 427 can prevent heat from inside the insulated compartment 421 from escaping through the door 427 . Also, forming the inside of the door 427 of anodized metal can prevent deterioration of the lifetime of the door 427 due to the UV lamp 425 .
- the inspection window is preferably formed of transparent resin or glass, and an openable/closable cover is preferably disposed at the outer side thereof.
- a detection section 440 includes a heater 440 H for keeping the interior of the detection section 440 at a predetermined temperature; incident light sources 441 A and 441 B that irradiate the cells CE from the detection section 440 side; a light-path switching unit 442 that switches the light path from the incident light sources 441 A and 441 B; a light-intensity adjusting mechanism 443 that adjusts the intensity of the irradiated light; a lens system 444 that focuses the irradiated light towards the cells CE; a filter unit 445 that controls the wavelength of the irradiated light and the wavelength of the detection light; an autofocus (AF) unit 446 that performs a focusing operation with respect to the cells CE; a revolver 447 provided with a plurality of objective lenses 448 having different magnifications and properties; a detector (imaging unit) 449 that detects detection light from the cells CE; a light-intensity monitor 450 that measures the intensity of
- the incident light sources (illumination unit) 441 A and 441 B which are formed of mercury lamps, for example, are disposed outside the detection section 440 and are connected to a power supply 453 that supplies power thereto.
- a single incident light source for example, the incident light source 441 A
- the incident light source 441 A is used; however, if the intensity of the incident light source 441 A falls below a certain prescribed value, light is irradiated from the other incident light source 441 B and the power supply to the first incident light source 441 A is turned off.
- the light-path switching unit 442 is configured to guide illumination light from either the incident light source 441 A or the incident light source 441 B to the light-intensity adjusting mechanism 443 . Also, the light-path switching unit 442 is provided with a light-path control unit 454 , which is connected to the computer PC (described later) for controlling the light-path switching unit 442 on the basis of an instruction from the computer PC.
- a shutter 442 S that controls the transmission and blocking of the illumination light is provided.
- the light-intensity adjusting mechanism 443 which is disposed at the emission side of the shutter 442 S where the illumination light is emitted, adjusts the intensity of the illumination light passing through the shutter 442 S.
- a known aperture mechanism for example, may be used, or any other known mechanism or technique that can adjust the light intensity may be used.
- the light-intensity adjusting mechanism 443 is provided with a light-intensity control unit 455 , which is connected to the computer PC (described later) for controlling the light-intensity adjusting mechanism 443 on the basis of an instruction from the computer PC.
- the lens system 444 is disposed at the emission side of the light-intensity adjusting mechanism 443 where the illumination light is emitted.
- the lens system 444 includes a pair of lenses 444 A and 444 B and a stop 444 C disposed between the lens 444 A and the lens 444 B.
- the filter unit 445 includes an excitation filter 456 , a dichroic mirror 457 , and an absorption filter 458 .
- the excitation filter 456 is a filter that transmits wavelengths which contribute to the generation of fluorescence in the cells CE (excitation light) from among the illumination light and is disposed so that the illumination light emitted from the lens system 444 is incident on the excitation filter 456 .
- the dichroic mirror 457 is an optical element that splits excitation light and fluorescence. More specifically, the dichroic mirror 457 is disposed so as to reflect excitation light transmitted through the excitation filter 456 towards the cells CE and to transmit fluorescence from the cells CE.
- the absorption filter 458 is an optical element that separates fluorescence from the cells CE from other unwanted scattered light. The absorption filter 458 is disposed so that light transmitted through the dichroic mirror 457 is incident thereon.
- the filter unit 445 is provided with a filter control unit 446 C that controls the wavelengths of the excitation light emitted from the filter unit 445 and the detection light (fluorescence) on the basis of instructions from the computer PC (described later).
- One excitation filter 456 , one dichroic mirror 457 , and one absorption filter 458 may be used, or alternatively, a plurality of each may be used.
- the AF unit 446 is disposed at the emission side of the filter unit 445 where the excitation light is emitted and is disposed so that the excitation light is focused onto the cells CE via one of the objective lenses 448 , on the basis of an instruction from the computer PC (described later).
- the revolver 447 is disposed at the emission side of the AF unit 446 where the excitation light is emitted and is provided with the plurality of objective lenses 448 having different magnifications.
- the revolver 447 is provided with an objective-lens control unit 459 which selects and controls the objective lens 448 on which the excitation light is incident, on the basis of an instruction from the computer PC (described later).
- the objective lenses 448 are configured to allow examination, from the detection section 440 , of the interior of the incubator box inside the insulated compartment 421 via holes provided in the X-axis motion stage 422 X and the Y-axis motion stage 422 Y.
- the holes in the X-axis motion stage 422 X and the Y-axis motion stage 422 Y are large enough to allow viewing over the operating region of the stage, with some additional margin.
- the ambient air inside the insulated compartment 421 should be kept at a humidity suitable for culturing cells, the ambient air may escape to the detection section 440 through the holes, which makes it impossible to maintain the temperature suitable for culturing cells, and therefore, there is a risk of bringing about a reduction in cell activity.
- the containment mechanism 449 should be capable of suppressing the flow of air while not interfering with the operation of the revolver 447 and the objective lenses 448 .
- it may be a sheet-like mechanism in which, for example, a sheet formed of a flexible material, such as a film or transparent sheet, is attached to the perimeter of a hole provided at the boundary between the insulated compartment 421 and the detection section 440 and in such a manner that it is draped around the perimeter of the revolver.
- a focusing lens 460 that focuses the detection light onto the detector 449 and the light-intensity monitor 450 is provided at the emission side of the filter unit 445 where the detection light is emitted.
- a half-mirror 461 that reflects some of the detection light towards the detector 449 and that transmits the remaining detection light towards the light-intensity monitor 450 is provided at the emission side of the focusing lens 460 where the detection light is emitted.
- the detector 449 is disposed at a position where the detection light reflected from the half mirror 461 is incident thereon. Also, a detector calculation unit 462 that calculates a detection signal from the detector 449 and outputs it to the computer PC (described later) is connected to the detector 449 .
- the detector 449 is not particularly limited and may use a line sensor, an area sensor, or both a line sensor and an area sensor.
- the light-intensity monitor 450 measures the detection light transmitted through the half-mirror 461 and is configured so as to output the measured value to the computer PC.
- the intensity of the detection light may be measured using the light-intensity monitor 450 , as described above, or alternatively, the intensity of the detection light may be measured using an illuminance meter or a power meter.
- the heater 440 H controls the temperature inside the detection section 440 to be from 30° C. to 37° C.
- the fan 451 is disposed to cause air convection inside the detection section 440 to make the temperature inside the detection section 440 uniform. Therefore, the temperature inside the detection section 440 can be maintained close to the temperature in the insulated compartment 421 , and the temperature in the insulated compartment 421 can thus be more easily stabilized.
- the cooling fan 452 is operated to reduce the temperature inside the detection section 440 on the basis of the output from a temperature sensor (not shown) provided inside the detection section 440 . Therefore, it is possible to prevent an abnormal rise in temperature inside the detection section 440 due to heating by, for example, the motors and so forth.
- FIG. 32 is a perspective view of the incubator box according to this embodiment
- FIG. 33 is a cross-sectional view of a chamber according to this embodiment.
- the incubator box 500 includes a frame 501 , containing a chamber (object under examination) 510 , and a cover 502 that forms a sealed space together with the frame 501 .
- the frame 501 and the cover 502 are subjected to magnetic-shielding treatment for blocking external magnetic fields and anti-static treatment for eliminating the build-up of static electricity in the incubator box 500 .
- the frame 501 is formed of a base plate 503 and side walls 504 , and a region corresponding to the measurement area of the base plate 503 is formed of a transparent material, such as glass.
- the other regions of the base plate 503 and the side walls 504 are preferably formed of an anti-corrosive material having high opacity, such as anodized aluminum or stainless steel, like SUS316. More preferably, from the viewpoint of maintaining the temperature, a material having a low thermal conductivity may be selected.
- An adaptor 505 for holding the chamber 510 and a temperature sensor 506 for measuring the temperature of the chamber 510 are provided on the base plate 503 .
- the chamber 510 may be held using the adaptor 505 , as described above, or the chamber 510 may be held without using the adaptor 505 .
- the output from the temperature sensor 506 is input to the computer PC via an incubator-temperature detection unit 506 S and is also input to a temperature-display unit 507 disposed on the wall of the detection unit 420 .
- the computer PC controls the heater 421 H and so on via an incubator-temperature control unit 506 C shown in FIG. 17 to control the temperature inside the incubator box 500 in order to keep it constant.
- the cover 502 includes a glass plate 517 that transmits the illumination light and a support portion 517 A that supports the glass plate 517 .
- An anti-reflection film may be formed on both sides of the glass plate 517 in a region corresponding to the measurement area. Forming such an anti-reflection film on both sides allows prevention of reflection by the glass plate 517 during transmission examination and incidence examination.
- the area of the glass plate 517 may be substantially the same as that of the base plate 503 of the incubator box 500 , or it may be the minimum necessary area that does not cause any problem during measurement.
- the chamber 510 is formed of a lower glass member 511 for observation with the objective lens 448 , an upper glass member 512 for transmitting light from the transmission light source 423 , and a frame member 513 that supports the lower glass member 511 and the upper glass member 512 .
- Joints 514 having channels formed therein for circulating culture fluid are formed at opposing sides of the frame member 513 .
- a culture-fluid circulating tube 477 (described later) is connected to the joints 514 , for allowing culture fluid to circulate between the culture unit 470 and the detection unit 420 .
- a pair of flow smoothers 515 for making the flow of culture fluid uniform are disposed in the frame member 513 so as to be substantially orthogonal to the flow of culture fluid.
- the flow smoothers 515 are formed of sheet members in which, for example, small holes are formed in a matrix, and by splitting the culture fluid and flowing it through the plurality of small holes, the flow becomes uniform.
- a slide glass 516 on which the cells CE are disposed is provided between the two flow smoothers 515 .
- the incubator box 500 may be provided with the chamber 510 inside, or, as shown in FIG. 34A , a microplate (object under examination) 520 (or a well plate) may be disposed inside.
- the frame 501 of an incubator box 500 a is provided with a square-shaped reservoir 521 surrounding the microplate 520 , an internal fan 522 disposed at the inner side of the reservoir 521 , a connector 523 for supplying culture gas, and a culture-gas concentration sensor 524 for detecting the concentration of carbon dioxide in the culture gas.
- the temperature sensor 506 is disposed so as to measure the temperature of the microplate 520 .
- the microplate temperature input to the computer PC from the temperature sensor 506 is collected in the form of text data in a memory and can be subjected to data processing in the computer PC.
- the culture-gas concentration sensor 524 outputs the carbon-dioxide concentration to the computer PC and to a culture-gas concentration display unit 524 D.
- the height of side walls 521 W of the reservoir 521 is formed to be lower than the height of the side walls of the frame 501 . Also, the positional relationship with respect to the connector 523 is adjusted so that the supplied culture gas blows against the side walls 521 W. Sterilized water is stored in the reservoir 521 , and the humidity inside the incubator box 500 a is regulated at about 100%.
- the internal fan 522 is disposed so that the microplate 520 is not positioned in the blowing direction thereof and so that it blows along the side walls 521 W of the reservoir 521 .
- the culture-gas concentration sensor 524 may be disposed on the inner surface of one of the side walls 521 W of the reservoir 521 .
- the tubes from the incubator box 500 a may be disposed outside and the culture gas inside the incubator box 500 a may be evacuated with a suction pump to detect the concentration thereof with the culture-gas concentration sensor 524 .
- the destination of the culture gas supplied from a culture-gas mixing tank 491 (described later) is changed from a culture fluid vessel 472 to the incubator box 500 a, and because it is not necessary to supply culture fluid from the culture unit 470 , the operation of a culture-fluid pump 480 or the like can be stopped.
- the humidity and culture-gas concentration in the incubator box 500 a which is not directly in contact with the detection section 440 , are maintained, it is possible to prevent contamination during examination.
- the performance of the objective lenses 448 and so on disposed in the insulated compartment 421 can be prevented from deteriorating.
- a reduction in lifetime of the objective lenses 448 and so on can be prevented.
- the chamber 510 may be a sealed enclosure, as described above, or it may be an open chamber that is not sealed. Such an open chamber is formed with the same construction as the chamber 510 except for the provision of the upper glass member 512 .
- the incubator box 500 a When using such an open chamber, using the incubator box 500 described above, the incubator box 500 a is filled with the culture gas and the open chamber is supplied with culture liquid.
- the chamber 510 described above may also be used in the incubator box 500 a.
- the connector 523 for supplying culture gas is blocked off, and the culture-gas concentration sensor 524 is not used.
- the chamber 510 may be placed in the incubator box 500 a using an adaptor 505 . Sterilized water need not be placed in the reservoir 521 ; in fact, the reservoir 521 itself may be eliminated from the incubator box 500 a.
- the temperature sensor 506 measures the temperature in the chamber 510 .
- the connector 523 may be blocked off, as described above, or it may be left connected to the culture-gas supply tube 497 and the supply of culture gas to the incubator box 500 a simply stopped.
- the culture unit 470 includes a sterilized compartment 471 containing the culture fluid and a mixing section 490 for producing the culture gas.
- the sterile compartment 471 includes a heater 471 H for keeping the interior of the sterile compartment 471 at a predetermined temperature; a culture-fluid vessel 472 for storing the culture fluid; an auxiliary tank 473 for storing spare culture fluid; a waste tank 474 into which used culture fluid is discharged; a UV lamp 425 for sterilizing the interior of the sterile compartment 471 ; a door 475 used when putting the culture-liquid vessel 472 into the sterile compartment 471 and when removing it therefrom; and a main power-supply switch 476 for turning on and off the main power supply for the culture unit 470 .
- the culture-fluid vessel 472 is provided with a culture-fluid circulating tube 477 for circulating culture fluid between the culture-fluid vessel 472 and the incubator box 500 ; a supply tube 478 for supplying spare culture fluid from the auxiliary tank 473 ; and a waste tube 479 for discharging used culture fluid from the culture-fluid vessel 472 to the waste tank 474 .
- a culture-fluid pump 480 for delivering culture fluid from the culture-fluid vessel 472 to the incubator box 500 and circulating the culture fluid is provided for the culture-fluid circulating tube 477 .
- the culture-fluid pump 480 it is possible to replace the culture fluid in the chamber 510 with fresh culture fluid, and therefore, the cells CE can be cultured for a longer period of time compared to a case where the culture fluid is not replaced.
- a supply pump 481 for transferring culture fluid from the auxiliary tank 473 to the culture-fluid vessel 472 is provided for the supply tube 478 .
- a waste pump 482 for transferring the used culture fluid from the culture-fluid vessel 472 to the waste tank 474 is provided for the waste tube 479 .
- the waste tank 474 for storing the used culture fluid may be used.
- a discharge port for directly discharging the used culture fluid may be provided.
- a culture-fluid temperature sensor (not shown) for detecting the culture-fluid temperature is provided in the culture-fluid vessel 472 , and the output from the culture-fluid temperature sensor is input to the computer PC via a culture-fluid temperature detector 483 .
- Data concerning the culture-fluid temperature input to the computer PC is collected in a memory in the form of text data and is used when comparing and verifying the detection results of the cells CE.
- the heater 471 H is provided with a culture-fluid temperature controller 484 that controls the temperature of the culture fluid via the temperature inside the sterilized compartment 471 , on the basis of an instruction from the computer PC.
- the temperature of the culture fluid supplied from the culture-fluid vessel 472 is held at about 37° C. by the culture-fluid temperature controller 484 , which prevents the activity of the cells CE from dropping due to temperature changes of the culture fluid.
- a temperature display unit 485 for displaying the culture-fluid temperature detected by the culture-fluid temperature sensor is provided on the wall of the culture unit 470 .
- the culture-fluid pump 480 is provided with a culture-fluid-pump controller 486 for controlling the circulation of the culture fluid on the basis of an instruction from the computer PC.
- the operation of the supply pump 481 and the waste pump 482 is also controlled on the basis of instructions from the computer PC.
- the UV lamp 425 is connected to a UV-lamp switch 436 disposed on the wall of the culture unit 470 , and a timer 437 for periodically controlling the operation of the UV lamp 425 is provided between the UV lamp 425 and the UV-lamp switch 436 . Furthermore, a sterilization-in-progress indicator lamp (not shown) for indicating that the UV lamp 425 is illuminated is also provided.
- the UV lamp 425 is controlled independently of the main power-supply switch 476 and can be operated even when the main power-supply switch 476 is off.
- the mixing section 490 includes a heater (not shown) for keeping the interior of the mixing section 490 at a predetermined temperature; a culture-gas mixing tank 491 for adjusting the carbon-dioxide concentration in the culture gas supplied to the incubator box 500 ; and a CO 2 -pump 493 for supplying carbon dioxide from a CO 2 tank 492 provided outside the culture unit 470 to the culture-gas mixing tank 491 .
- a CO 2 -concentration detector 494 is provided in the culture-gas mixing tank 491 for detecting the concentration of carbon dioxide therein, and the output from the CO 2 -concentration detector 494 is input to the computer PC.
- the CO 2 pump 493 is provided with a CO 2 -concentration controller 495 for controlling the amount of carbon dioxide supplied to the culture-gas mixing tank 491 on the basis of an instruction from the computer PC.
- a CO 2 -concentration display unit 496 for displaying the carbon-dioxide concentration inside the culture-gas mixing tank 491 , which is detected by the CO 2 -concentration detector 494 is provided on the wall of the culture unit 470 .
- a culture-gas supply tube 497 is provided between the culture-gas mixing tank 491 and the culture-fluid vessel 472 . Accordingly, culture gas is supplied to the culture fluid via the culture-gas supply tube 497 , which allows a sufficient level of culture gas to be dissolved in the culture fluid. In this way, by producing culture fluid in which culture gas having a 5% concentration of carbon dioxide is dissolved inside the culture-fluid vessel 472 , culture fluid including culture gas and nutrients necessary for nourishing the cells CE is supplied to the chamber 510 . Also, by dissolving the culture gas in the culture fluid, the pH and so forth of the culture fluid can be regulated.
- the carbon-dioxide concentration input to the computer PC from the CO 2 -concentration detector 494 is collected in the memory in the form of text data, and data processing can be carried out in the computer PC.
- FIGS. 35A to 35 D depict examples of the scanning method and selection of the detection areas in this embodiment.
- a measurement region M (the region surrounded by the dashed line in the figure) is set by specifying an upper-left point a and a lower-right point b defining the measurement region M in the displayed image. More concretely, the measurement region M may be set by dragging a device like a mouse from point a to point b, or it may be specified by inputting the coordinates of the points a and b.
- the specified measurement region M is scanned from left to right. That is, when scanning from the left to the right in the figure, scanning is performed parallel to the X direction, and when scanning from the right to the left, scanning is performed downward and to the left at an angle. While scanning from left to right, image acquisition of the cells CE is carried out.
- FIG. 35B is an example in which two measurement regions M are specified by the method described above.
- the two measurement regions MA and MB are specified using the method described above.
- the measurement region MA and the measurement region MB are arranged with a certain gap therebetween in the X direction in the figure, and they are disposed so as to completely overlap in the Y direction.
- the part to be measured by the detector 449 in this example is scanned so as to measure the measurement regions MA and MB in parallel. That is, when scanning from the left to the right in the figure, scanning is performed from the measurement region MA to the measurement region MB, and when scanning from the right to the left, scanning is performed from the measurement region MB to the measurement region MA.
- FIG. 35C is an example in which two measurement regions are set using the method described above.
- the two measurement regions MA and MB are disposed at different positions.
- the measurement region MA and the measurement region MB are arranged with a gap therebetween in the X direction in the figure, and they are disposed so that they partially overlap in the Y direction in the figure.
- the portions of the measurement regions MA and MB that overlap in the Y direction are sequentially scanned. That is, first the non-overlapping portion of the measurement region MA is scanned. Next, the overlapping portions of the measurement regions MA and MB are sequentially scanned. Then, the non-overlapping portion of the measurement region MB is scanned.
- FIG. 35D is an example in which two measurement regions M are set by the method described above.
- the two measurement regions MA and MB are the same as those in FIG. 35B , but the scanning method is different.
- the measurement regions MA and MB are scanned independently. That is, after first scanning the entire measurement region MA, the entire measurement region MB is scanned.
- the method with the shortest total distance moved or shortest scanning time is automatically selected by the computer PC on the basis of specified parameters and a measurement mode, which are described later.
- the settings of the computer PC are changed to alternately scan the entire region and predetermined parts of the object to be scanned, it is possible to observe phenomena unique to biological specimens which occur only for a short time.
- scanning of the entire region of an object is normally performed every 30 minutes, so long as scanning is performed in a predetermined measurement region M where cells of interest exist, it is possible to determine the occurrence of a specific phenomenon that is exhibited only every 15 minutes in those cells of interest.
- the scanning time can be reduced, and the time required to irradiate other cells with light can be reduced.
- FIG. 36 is a flowchart showing the procedure for setting the measurement parameters.
- the measurement parameters are set (step S 21 ).
- the conditions set are the culturing conditions and the measurement conditions, for example, a CO 2 concentration of 5%, a temperature of 37° C., and so forth. These conditions can be changed to predetermined conditions by the user.
- Measurement object means the container of the cells CE, for example, the microplate 520 or the slide glass 516 .
- the measurement mode is selected (step S 24 ).
- Possible measurement modes include an area acquisition mode, a line acquisition mode, an automatic mode, and so on.
- the automatic mode the measurement mode having the shortest measurement time is automatically selected from among the other modes.
- the measurement magnification is selected (step S 25 ), and after that, the detection wavelength is selected (step S 26 ).
- the measurement magnification and the detection wavelength can each be automatically selected from among two or more options.
- a list of fluorescent proteins used for example, GFP, HC-Red, and so on, is stored in advance in the computer PC, and one of them is selected from the stored list.
- the computer PC automatically selects the most appropriate excitation filter 456 , absorption filter 458 , and so on for examination, on the basis of the selected fluorescent protein. In this way, specific fluorescence from the cells CE can be detected.
- the excitation filter 456 , the absorption filter 458 , the objective lens 448 and so on used for measurement are automatically changed in synchronization with the driving of the X-axis motion stage 422 X and the Y-axis motion stage 422 Y.
- the measurement interval is set (step S 27 ).
- a preview image is acquired (step S 28 ), and the preview image is displayed on the monitor (step S 29 ).
- the preview image is displayed on the monitor when the user issues an instruction using a preview button or the like for instructing display of the preview image on the monitor.
- the user can confirm the preview image displayed on the monitor.
- the measurement region is selected (step S 30 ).
- the preview image may be displayed on the monitor again to confirm whether the measurement region has been correctly selected.
- a predetermined measurement interval is selected from a plurality of specified measurement intervals (step S 31 ).
- step S 32 upon pressing a start-measurement switch (not shown; step S 32 ), measurement of the cells CE commences (step S 33 ). If the start-measurement switch is not pressed, the process stands by until the start-measurement switch is pressed (step S 32 ).
- step S 32 the process may jump back to any predetermined step to allow the measurement parameters to be set again.
- FIGS. 37 and 38 are flowcharts showing the measurement procedure.
- the measurement region is retrieved (step S 41 ). Then, the magnification is retrieved (step S 42 ), and the detection wavelength is retrieved (step S 43 ).
- the measurement mode is retrieved (step S 44 ).
- the appropriate stage scanning method is determined on the basis of the retrieved measurement region, magnification, detection wavelength (fluorescence wavelength), and so on. If the measurement mode is set to the automatic mode, the image acquisition mode is also determined at this point.
- step S 45 the method of operating the X-axis motion stage 422 X and the Y-axis motion stage 422 Y in accordance with the determined stage scanning mode is analyzed (step S 45 ), and data for the analyzed operating method (operating data) is saved in a table in the computer PC (step S 46 ).
- step S 47 measurement is carried out using a different measurement method depending on whether or not the area sensor mode is selected.
- the X-axis motion stage 422 X and the Y-axis motion stage 422 Y are moved to a measurement starting position (S 50 ).
- the computer PC retrieves the measurement starting position which has been input and moves the X-axis motion stage 422 X and the Y-axis motion stage 422 Y to the measurement starting position, and the cells CE are thus moved to a position within the imaging field of the objective lens 448 .
- the shutter 435 is opened (step S 51 ) and the objective lens 448 is selected (step S 52 ).
- the computer PC drives the revolver 447 to select an objective lens 448 having a predetermined magnification on the basis of the specified measurement magnification.
- the filter unit 445 is selected (step S 53 ).
- the filter control unit 446 C selects the excitation filter 456 , the absorption filter 458 , and so on that are most appropriate for the measurement on the basis of the fluorescent protein specified in the computer PC.
- step S 50 to S 53 The operations carried out from when the start-measurement switch described above is pressed up to this point (steps S 50 to S 53 ) are automatically selected and executed according to the measurement mode.
- step S 54 After that, the focus position is detected (step S 54 ), and then image acquisition is performed and the image data is output to an image memory in the computer PC (step S 55 ).
- step S 52 the operations from selection of the objective lens 448 (step S 52 ) to image acquisition and output of the image data to the image memory in the computer PC (step S 55 ) are repeated until the required image acquisition is completed (step S 56 ).
- the X-axis motion stage 422 X or the Y-axis motion stage 422 Y is driven by one step (step S 57 ). Then, if the position to which the X-axis motion stage 422 X or the Y-axis motion stage 422 Y has been moved is within the measurement region, the operations from selection of the objective lens 448 (step S 52 ) to driving the motion stage by one step (step S 57 ) are repeated. These operations are repeated until the position to which the X-axis motion stage 422 X or the Y-axis motion stage 422 Y has been moved is outside the measurement region (step S 58 ).
- the shutter 435 is closed (step S 59 ).
- step S 51 the operations from opening of the shutter 435 (step S 51 ) to closing of the shutter 435 (step S 59 ) are repeated until the end of the measurement time (step S 60 ).
- the x-axis motion stage 422 X and the Y-axis motion stage 422 Y are moved to the measurement starting position (step S 70 ).
- the computer retrieves the measurement start position that was input and moves the X-axis motion stage 422 X and the Y-axis motion stage 422 Y to the measurement starting position to move the cells CE to a position within the imaging field of the objective lens 448 .
- step S 71 the shutter 435 is opened (step S 71 ), and the focus position is detected (step S 72 ).
- the objective lens 448 is selected (step S 73 ).
- the computer PC drives the revolver 447 to select an objective lens 448 having a predetermined magnification, on the basis of the specified measurement magnification.
- the filter unit 445 is selected (step S 74 ).
- the filter control unit 446 C selects the excitation filter 456 , the absorption filter 458 , and so on that are most appropriate for the measurement on the basis of the fluorescent protein specified in the computer PC.
- the operations carried out from when the start-measurement switch is pressed up to this point (steps S 70 to S 74 ) are automatically selected and executed according to the measurement mode.
- step S 75 driving of the X-axis motion stage 422 X and the Y-axis stage 422 Y commences (step S 75 ), and then image acquisition is performed and the image data is output to an image memory in the computer PC (step S 76 ).
- step S 73 the operations from selection of the objective lens 448 (step S 73 ) to image acquisition and output of the image data to the memory in the computer PC (step S 76 ) are repeated until the required image acquisition is completed (step S 77 ).
- the shutter 435 is closed (step S 78 ).
- step S 71 the operations from opening of the shutter 435 (step S 71 ) to closing of the shutter 435 (step S 78 ) are repeated until the end of the measurement time (step S 79 ).
- FIG. 39 is a flowchart showing the image processing method.
- the image processing unit of the computer PC extracts the background image from the acquired images collected in the memory (step S 91 ), and removes the background image from the acquired images (step S 92 ).
- step S 93 the maximum brightness region of the image, which can be enhanced, is read out (step S 93 ) and multiplied by, for example, a predetermined coefficient to enhance the image (step S 94 ).
- the image is enhanced so that the individual cells CE can easily be recognized as spots in the image from which the background is removed.
- the bright cells CE can be clearly recognized as individual spots (step S 95 ).
- step S 96 geometrical features, such as the center of gravity and the area, chemical features, and optical features, such as the fluorescence intensity, of the cells CE are more accurately determined, and positional information of the cells CE is determined and extracted (step S 96 ). Extracting these features allows the individual cells CE to be distinguished.
- step S 97 After extracting the features of the cells CE, correction (step S 97 ) of the enhancement (S 94 ) carried out for recognizing the cells CE is carried out. With this correction, the effect of the predetermined coefficient used for enhancing the image is removed.
- the features are output to a file, for example, and are stored in that file (step S 98 ).
- the image processing unit of the computer PC can convert the fluorescence distribution of the cells CE at each position on the entire surface of the slide glass, microplate, or the like into an image. Also, since the image processing unit can accurately track the individual cells CE, it can target a predetermined number of cells CE, which allows localized, long-term measurement of the fluorescence distribution of the cells CE while performing culturing. Furthermore, while culturing the cells CE, the entire surface of the slide glass, microplate, or the like is measured at fixed time intervals, for example, and the fluorescence intensity of the cells CE over time can be automatically measured.
- FIG. 40 is a flowchart depicting the data processing procedure.
- processing of the cell data (features) stored in the file is carried performed by a data processing unit of the computer PC.
- the data processing unit reads out (step S 101 ) raw data (features) of the cells CE, which is stored in the file, and sorts the data to arrange it time-sequentially for each cell CE (step S 102 ).
- the data processing unit graphs the variation in brightness of each cell CE, that is, the level of expression, with time (step S 103 ).
- the data processing unit displays a preview of the graph (step S 104 ), and outputs the graph data to a file (step S 105 ).
- FIG. 41 is a flowchart showing the procedure for adjusting the intensity.
- the intensity of light irradiated onto the cells CE is measured (step S 111 ).
- the irradiation intensity may be calculated from the output of the light-intensity monitor 450 , by providing an irradiance meter for measuring the intensity, or by providing a power meter and calculating the intensity from the output of the power meter.
- the process returns to measurement of the irradiation intensity (step S 111 ) and repeats this until the irradiation intensity is outside the permissible range (step S 112 ).
- the ND filter (not shown) included in the light-intensity adjusting mechanism 443 is changed (step S 113 ) to adjust the irradiation intensity so that it falls within the permissible range. Thereafter, the process returns to measurement of the irradiation intensity (step S 111 ), and repeats the adjustment of the irradiation intensity.
- FIG. 42 is a flowchart showing the method for supplying and replacing the culture fluid.
- the background level of the acquired image is analyzed (step S 121 ).
- the autofluorescence of the culture fluid in the background of the acquired image is acquired, and the brightness of this autofluorescence is analyzed.
- step S 121 the process returns to analysis of the background level and repeats this until the temporal variation of the background level exceeds the predetermined level (step S 122 ).
- the waste pump 482 for the culture fluid is operated (step S 123 ), and then, the supply pump 481 for the culture fluid is operated (step S 124 ).
- the intervals at which the culture fluid should be supplied and replaced may be determined on the basis of the autofluorescence of the culture fluid, as described above.
- the culture fluid may be supplied/replaced continuously, or automatically at intervals specified in advance by the user.
- the point at which the culture fluid should be replaced can be specified at will by selecting the type of cells CE from a table that is registered in advance.
- the amount of culture fluid to be replaced may be specified by the user or may be determined on the basis of the autofluorescence of the culture fluid.
- the amount of culture fluid to be replaced can be specified at will by selecting the type of cells CE from a table that is registered in advance.
- the amount of culture fluid to be replaced may be calculated and determined automatically using the weight and so on.
- the level of autofluorescence in the background is detected using the acquired image; however, it may be detected from an acquired image of a location where cells CE do not exist. Alternatively, it may be detected by providing an optical detector in the vicinity of the culture-fluid vessel 472 .
- FIGS. 44 and 45 are flowcharts showing the culturing and measurement when using the microplate 520 .
- sterilized water is supplied to the reservoir 521 in the incubator box 500 a (step S 131 ).
- step S 132 the PC is started up (step S 132 ), and the main power supplies for the detection unit 420 and the culture unit 470 are turned on (step S 133 ).
- the internal fan 522 inside the incubator box 500 a is operated (step S 134 ) to circulate the air inside the incubator box 500 a.
- the CO 2 -concentration controller 495 is operated (step S 135 ) to regulate the carbon dioxide concentration in the culture gas supplied to the incubator box 500 a at 5%.
- the temperature controllers are operated (step S 136 ) to regulate the culture-fluid temperature, the culture-gas temperature, and the temperature inside the insulated compartment 421 at about 37° C.
- step S 137 the door 427 of the detection unit 420 is opened (step S 137 ), the incubator box 500 a is placed on the stage 422 (step S 138 ), and the door 427 is closed (step S 139 ).
- the transmission light source 423 is turned on (step S 140 ) to irradiate the cells CE with transmission light, and the measurement conditions are set (step S 141 ).
- step S 142 measurement of the cells CE commences.
- step S 143 scanning is carried out beforehand on predetermined cells CE to perform autofocusing (step S 143 ), and once the focus position of each part has been determined, the shutter 435 is opened (step S 144 ).
- an image of the cells CE is acquired and output (step S 145 ).
- the acquired image data is output to the memory of the computer PC.
- the operations from the autofocusing (step S 143 ) to the image acquisition and outputting (step S 145 ) are repeated until the required image acquisition has been completed (step S 146 ).
- the required images are, for example, the images acquired using the selected wavelength, the images acquired using the selected magnification, and so forth.
- the X-axis motion stage 422 X or the Y-axis motion stage 422 Y is driven by one step (step S 147 ). Then, if the position to which the X-axis motion stage 422 X or the Y-axis motion stage 422 Y has moved is within the measurement region, the operations from the autofocusing (step S 143 ) to driving of the motion stage by a single step (step S 147 ) are repeated. These operations are repeated until the position to which the X-axis motion stage 422 X or the Y-axis motion stage 422 Y has moved is outside of the measurement region.
- step S 149 When the position to which the X-axis motion stage 422 X or the Y-axis motion stage 422 Y has moved is outside the measurement region, the shutter 435 is closed (step S 149 ), and the X-axis motion stage 422 X and the Y-axis motion stage 422 Y are moved to their home positions (step S 150 ).
- step S 143 the operations from the autofocusing (step S 143 ) to moving the stages to their home positions (step S 150 ) are repeated until the end of the measurement time (step S 151 ).
- step S 152 the door 427 is opened (step S 153 ), and the microplate 520 is removed from the incubator box 500 a (step S 154 ). Then, the sterilized water is removed from the reservoir 521 (step S 155 ), and the door 427 is closed (S 156 ).
- the UV lamp 425 inside the insulated compartment 421 is illuminated (step S 157 ) to sterilize the interior of the insulated compartment 421 , and the measurement is thus completed.
- the sterilization may be carried out at the end of the measurement procedure, or alternatively, it may be carried out at the beginning of the measurement procedure to sterilize the insulated compartment 421 before measurement actually takes place.
- the autofocusing may be carried out for each measurement of the cells CE, as described above, but it need not be carried out for each measurement.
- the thermal environment is maintained by the insulated compartment 421 and the humidity environment and the culture-fluid environment are maintained by the chamber 510 disposed inside the insulated compartment 421 , the humidity environment and the culture-fluid environment are influenced by the thermal environment, and therefore the thermal environment inside the chamber 510 is also maintained.
- the dimensions of the chamber 510 are small compared to the insulated compartment 421 , it is easier to maintain and control the humidity environment and the culture-fluid environment, thus making it relatively difficult to cause damage to the cells CE.
- the cells CE can be examined through the insulated compartment 421 , the incubator box 500 , and the chamber 510 , it is possible to carry out examination while culturing the cells CE, without causing any damage to the cells CE. Accordingly, behavior that the cells exhibit during culturing can be accurately measured over time.
- the detection section 440 examines the cells CE in the chamber 510 via the insulated compartment 421 and the incubator 500 , it is not necessary to insert and remove the cells CE from the chamber 510 during examination, and therefore, the cells CE can remain inside the chamber 510 during examination. Accordingly, it is possible to accurately examine the same position in each examination. Also, contamination can be prevented during examination, which can prevent the cells from being stressed.
- the environmental conditions inside the chamber 510 for example, the combination of carbon dioxide concentration and humidity
- the cells CE are contained inside the chamber 510 , which is disposed inside the insulated compartment 421 and the incubator box 500 , a certain distance can be maintained between the cells CE and the environment outside the incubator box 500 compared to a case where chamber 510 is not provided. Therefore, it is possible to reduce the effects of electric and magnetic fields from outside the incubator box 500 , such as those from the driving motors of the X-axis motion stage 422 X and the Y-axis motions stage 422 Y and magnets provided in the door 427 .
- the basic construction of the biological-specimen examination system of this embodiment is the same as the tenth embodiment, but the constructions of the detection unit and the culture unit are different from those in the tenth embodiment. Therefore, in this embodiment, only the detection unit and the culture unit will be described using FIGS. 46A to 48 , and a description of the chamber and so on will be omitted.
- FIG. 46A is an elevational view of a biological-specimen examination system 600 of this embodiment, and FIG. 46B is a side view thereof.
- the biological-specimen examination system 600 includes an inverted microscope (microscope imaging apparatus) 610 and a culture stage 620 .
- the inverted microscope 610 and the culture stage 620 may be integrated or they may be constructed so as to be detachable from each other.
- the culture system 620 can be attached to and detached from the inverted microscope 610 , an existing inverted microscope can also be used. In such a case, even though a stage driving motor is disposed in the vicinity of the cells CE due to constraints on the shape and the construction involved with attaching the culture stage 620 , for example, the effect of electric and magnetic fields on the cells CE can be suppressed.
- the culture stage 620 can be attached to the inverted microscope 610 ; at other times (for example, when culturing the cells CE), the inverted microscope 610 can be removed from the microscope.
- FIG. 47 is a plane view of the culture stage 620
- FIG. 48 is a perspective view of the culture stage 620 .
- the culture stage 620 includes a frame 621 , openable/closable lid 622 provided on the upper surface of the frame 621 , an X-axis motion stage 422 X, a Y-axis motion stage 422 Y, a small or strip-shaped heater 620 H, a heatsink 623 , a fan 624 , and culture-gas supply connector 625 .
- the frame 621 is preferably formed of a highly opaque, corrosion-resistant material, such as anodized aluminum or stainless steel, like SUS 316. More preferably, from the viewpoint of thermal insulation, a material having a low thermal conductivity is selected.
- the interior of the frame 621 is divided into a measurement area 626 for performing examination of cultured cells and a non-measurement area 627 only for culturing cells.
- cell culturing is performed in the culture stage 620 .
- a microplate 520 that holds the cells is accommodated inside the culture stage 620 , and the culture stage 620 is configured so as to allow examination of the cells in the microplate 520 from outside the culture stage 620 .
- the microplate 520 is used as a culture vessel, as shown in FIGS. 47 and 48 , but a dish or flask may also be used.
- the fan 624 and the culture-gas supply connector 625 are disposed in a side wall in the non-measurement area 627 in the frame 621 . Also, the heater 620 H and the heatsink 623 for dissipating heat from the heater 620 H are disposed in an area where the fan 624 and the culture-gas supply connector 625 are not disposed (including the measurement area 626 ).
- the fan 624 causes convection of the air inside the culture stage 620 and is arranged so as not to blow directly onto the incubator box 500 a.
- the temperature inside the culture stage 620 is raised by means of the heater 620 H and is regulated at 36.5° C. ⁇ 0.5° C.
- the X-axis motion stage 422 X and the Y-axis motion stage 422 Y are provided on the bottom surface of the frame 621 .
- the X-axis motion stage 422 X and the Y-axis motion stage 422 Y are driven by, for example, motors and ball screws.
- a small or strip-shaped heater (not shown) is attached to the Y-axis motion stage 422 Y.
- the heater is disposed at a position such that the microplate 520 is uniformly heated.
- the measurement area 626 and the non-measurement area 627 are formed by dividing the interior of the culture stage 620 in the X-direction by means of a top plate 628 and a pair of partition seats 629 , which are fixed to the frame 621 .
- the region to the left of the partition seats 629 in FIG. 47 constitutes the measurement area 626
- the region to the right constitutes the non-measurement area 627 .
- a partition plate 629 a that is formed in substantially the same shape as the cross-sectional shape of the frame 621 is attached to the X-axis motion stage 422 X.
- the measurement area 626 and the non-measurement area 627 can define two spaces that are separated from each other.
- a glass lid 630 is removably attached to the frame 621 and is disposed so as to cover the upper opening of the measurement area 626 .
- the glass lid 630 can be attached by, for example, screwing the glass lid 630 to the frame 621 , or by means of a lock mechanism, a hook, a magnet, and so forth.
- the glass lid 630 may be constructed such that the entire surface or substantially the entire surface except for the peripheral frame portion is formed of the glass plate 631 , or it may be formed with a minimum possible area so long as it does not obstruct measurement. In order to suppress the reflection of light during transmission examination and incidence examination, it is preferable to use an optical glass material having an anti-reflection film (AR coat) coated on both sides thereof as the glass plate 631 .
- AR coat anti-reflection film
- the anti-reflection film may be coated on both sides of the glass plate 631 , as described above, or it may be coated on only one side of the glass plate 631 .
- the glass lid 630 may be removed as required when carrying out various tasks, for example, when changing the objective lens of the inverted microscope 610 , when cleaning the inside of the measurement area 626 , and so forth.
- the glass lid 630 may be provided with an observation hole into which the objective lens of the inverted microscope 610 is inserted. Also, a rubber sheet may be disposed in the observation hole to occupy a gap between the objective lens and the observation hole. The sheet is preferably disposed so as to prevent relative motion between the objective lens and the culture stage 620 .
- the openable/closable lid 622 is attached so that it can be opened and closed by means of a hinge or the like. When closed, one edge of the openable/closable lid 622 is in contact with the top plate 628 so as to be supported.
- the openable/closable lid 622 is entirely formed of an opaque material (for example, the same material as the frame 621 ) and is provided with an observation-hole cover 632 that blocks the observation hole or a UV-irradiation-hole cover 633 that blocks a UV irradiation hole, as required.
- the observation hole is an opening (window) formed in the openable/closable lid 622 .
- the observation-hole cover 632 is formed, for example, of a glass plate, a resin plate, or the like having low transmittance and is inserted in the observation hole. Also, the observation-hole cover 632 is formed of the same opaque material as the openable/closable lid 622 and may be attached in such a manner that it can be either detached or opened and closed.
- the UV-irradiation-hole is an opening (window) formed in the openable/closable lid 622 .
- the UV-irradiation-hole cover 633 is formed, for example, of the same opaque material as the openable/closable lid 622 and is attached in such a manner that it can be opened and closed, or detached from the UV irradiation hole.
- the UV-irradiation-hole cover 633 is removed when irradiating the interior of the non-measurement area 627 with ultraviolet (UV) light to sterilize it.
- UV ultraviolet
- a handheld UV lamp can be used for the UV irradiation.
- the incubator box 500 a which contains the microplate 520 , is held on the Y-axis motion stage 422 Y. Since the incubator box 500 a is the same as that described in the tenth embodiment, the same components are assigned the same reference numerals, and a description thereof shall be omitted.
- Culture gas is supplied to the connector 523 of the incubator box 500 a via a culture-gas supply tube 634 from a culture-gas supply connector 625 of the culture stage 620 .
- the biological-specimen examination system 600 includes the integrated inverted microscope 610 , a biological specimen can be examined using the inverted microscope 610 . Therefore, more detailed examination can be carried out compared to a case where the inverted microscope 610 is not provided.
- the entire biological-specimen examination system 600 may be surrounded with a blackout curtain.
- the biological specimen to be measured may be various other types of biological specimen, such as bacteria, microorganisms, ova, and so forth.
- an advantage is afforded in that, even when the brightness of the biological specimen changes over time, it is possible to effectively observe such changes in the biological specimen over time. Also, it is possible to accurately examine a wide range of biological specimens, from specimens having low brightness to specimens having high brightness.
- the biological-specimen examination system of this embodiment since the time required for measuring the measurement region once can be shortened, the motion of the biological specimen in part of the measurement region does not vary substantially over time. Thus, the accuracy of the examination results when examining the biological specimen over time can be improved.
Landscapes
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Immunology (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biochemistry (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Optics & Photonics (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Microscoopes, Condenser (AREA)
Abstract
A microscope imaging apparatus and a biological-specimen examination system that can accurately carry out measurement even for an object under examination having substantial brightness non-uniformity are provided. The microscope imaging apparatus includes a stage that holds the object under examination, an illumination unit that illuminates the object under examination, an image-acquisition unit that acquires images of the object under examination, and a motion unit that moves the stage and the image-acquisition unit relative to each other. The image-acquisition unit includes an imaging device capable of image acquisition using a time delay integration method. When acquiring a plurality of images of the object under examination, the exposure time during which accumulated charge is produced in the imaging device is made different for each of the acquired images, and the plurality of images are combined into a single image.
Description
- 1. Field of the Invention
- The present invention relates to a microscope imaging apparatus and to a biological-specimen examination system using the same.
- 2. Description of Related Art
- A known apparatus for measuring fluorescence and so on of a biological specimen uses a microplate. Since the fluorescence intensity of a biological specimen is extremely dark, it is necessary to capture the fluorescence using a long exposure time. Also, since the microplate has a shape that is larger than the field of view of a microscope, it takes some time to examine the entire microplate.
- One method of imaging such fluorescence is a method in which measurement is carried out with a CCD (charge coupled device) while the microplate is repeatedly moved and stopped. A plurality of wells are provided in the microplate, and the specimens are held in these wells. Therefore, by repeatedly moving and stopping the microplate, the fluorescence from the specimen in each well can be measured. The microplate is moved by means of a moving stage.
- Another known method of imaging the fluorescence is a method using TDI (time delay integration) imaging devices (for example, see patent document 1). The imaging devices using the TDI method are constituted by a plurality of optoelectronic devices. Fluorescence from the specimen is incident on the optoelectronic devices, and a charge corresponding to the incident fluorescence is produced in the optoelectronic devices by optical-to-electrical conversion. This charge is then transferred between optoelectronic devices as the microplate moves. Since the motion of the microplate is associated with the motion of the charge, fluorescence from the same position on the specimen is incident again on the optoelectronic devices after they have been moved. As a result, the charge builds up. Thus, the charge is progressively accumulated when using the TDI method.
- The feature of the TDI method is that charge corresponding to the fluorescence is accumulated while being transferred. Therefore, compared to the case where a one-dimensional line sensor is used for image acquisition, the speed at which the stage is moved can be increased according to the number of charge transfer lines. As a result, the measurement time can be shortened.
- A microscope imaging apparatus according to the present invention comprises:
- a stage that holds an object under examination;
- an illumination unit that illuminates the object under examination;
- an image-acquisition unit that acquires images of the object under examination;
- a motion unit that moves the stage and the image-acquisition unit relative to each other; and
- a control unit that controls the image-acquisition unit and the motion unit, wherein the image-acquisition unit includes an imaging device that is capable of acquiring images with the time delay integration method, and
- when image acquisition of the object under examination is carried out a plurality of times, the control unit makes the exposure times of the imaging device different for each image acquisition.
- Another microscope imaging apparatus according to the present invention comprises:
- a stage that holds an object under examination;
- an illumination unit that illuminates the object under examination;
- an image-acquisition unit that acquires images of the object under examination;
- a motion unit that moves the stage and the image-acquisition unit relative to each other; and
- a control unit that controls the image-acquisition unit and the motion unit,
- wherein the image-acquisition unit includes an imaging device that is capable of acquiring images with a time delay integration method, and
- by performing a prescan of the object under examination to obtain a detected intensity of the object under examination, the control unit determines an exposure time for image acquisition after the prescan on the basis of the detected intensity.
- Another microscope imaging apparatus according to the present invention comprises:
- a stage that holds an object under examination;
- an illumination unit that illuminates the object under examination;
- an image-acquisition unit that acquires images of the object under examination;
- a motion unit that moves the stage and the image-acquisition unit relative to each other; and
- a control unit that controls the image-acquisition unit and the motion unit,
- wherein the image-acquisition unit includes an imaging device that is capable of image acquisition using two methods;
- the control unit includes:
-
- an examination-object-parameter input unit for inputting information about the object under examination as an examination-object parameter;
- a calculation unit that calculates a time for the relative motion on the basis of the examination-object parameter which has been input; and
- a switching unit that switches the image-acquisition method of the imaging device on the basis of the calculation result; and
- the two image-acquisition methods are a time delay integration method and a two-dimensional imaging method in which accumulated charge is produced by a single exposure.
- A biological-specimen examination system according to the present invention comprises:
- a culture unit for culturing a biological specimen; and
- a detection unit disposed adjacent to the culture unit,
- wherein the detection unit includes:
-
- an above-described microscope imaging apparatus; and
- a preserving unit for preserving the biological specimen in a predetermined state.
-
FIGS. 1A to 1C depict an image acquisition operation using the TDI method. -
FIGS. 2A to 2C depict the transfer of signal charge in the TDI method. -
FIGS. 3A to 3C show the intensity of signal charge accumulated in horizontal lines. -
FIG. 4 shows the overall configuration of a microscope imaging apparatus. -
FIGS. 5A and 5B show the structure of a specimen. -
FIG. 6 depicts scanning in the TDI method. -
FIG. 7 is a flowchart showing a measurement procedure according to a first embodiment. -
FIGS. 8A to 8C are graphs showing the relationship between specimen brightness and output level. -
FIG. 9 is a timing chart for an electronic shutter used in the TDI method. -
FIG. 10 shows another example of the structure of a specimen. -
FIG. 11 shows the overall configuration of a microscope imaging apparatus according to a second embodiment. -
FIG. 12 is a flowchart showing a measurement procedure in the second embodiment. -
FIG. 13 is a graph showing the relationship between the number of saturated pixels and the exposure time used in the next image acquisition. -
FIG. 14 shows the overall configuration of a microscope imaging apparatus according to a third embodiment. -
FIG. 15 depicts an image acquired in the third embodiment. -
FIG. 16 is a flowchart showing a measurement procedure in a fourth embodiment. -
FIG. 17 is a graph showing the relationship between prescan brightness and exposure time of the main measurement. -
FIG. 18 shows another example of the microscope imaging apparatus in the fourth embodiment. -
FIG. 19 shows the overall configuration of a microscope imaging apparatus in a fifth embodiment. -
FIG. 20 shows the overall configuration of a microscope imaging apparatus in a sixth embodiment. -
FIG. 21 shows the overall configuration of a microscope imaging apparatus in a seventh embodiment. -
FIG. 22 is a flowchart showing a measurement procedure in the seventh embodiment. -
FIGS. 23A and 23B depict the structure of a specimen in an eighth embodiment. -
FIG. 24 shows the overall configuration of a microscope imaging apparatus in a ninth embodiment. -
FIGS. 25A and 25B show parameters used in estimating the scanning time. -
FIG. 26 depicts scanning in a two-dimensional imaging method. -
FIG. 27 depicts the operation of a stage in the two-dimensional imaging method. -
FIG. 28 shows a specimen in which the density of sample located portions is asymmetric. -
FIG. 29 depicts an example in which scanning is switched between the TDI method and the two-dimensional imaging method. -
FIG. 30 is a perspective view showing a biological-specimen examination system according to a tenth embodiment of the present invention, which is provided with a microscope imaging apparatus. -
FIG. 31 is a schematic diagram showing the system configuration of the biological-specimen examination system shown inFIG. 30 . -
FIG. 32 is a perspective view of an incubator box used in the biological-specimen examination system shown inFIG. 30 . -
FIG. 33 is a cross-sectional view of a chamber in the incubator box shown inFIG. 32 . -
FIGS. 34A and 34B are perspective views showing other examples of the incubator box shown inFIG. 33 . -
FIGS. 35A to 35D show examples of selecting the scanning method and the detection regions in the biological-specimen examination system. -
FIG. 36 is a flowchart showing a procedure for setting measurement parameters used in the biological-specimen examination system. -
FIGS. 37 and 38 are flowcharts showing a measurement procedure in the biological-specimen examination system. -
FIG. 39 is a flowchart showing an image processing method in the biological-specimen examination system. -
FIG. 40 is a flowchart showing a data processing procedure in the biological-specimen examination system. -
FIG. 41 is a flowchart showing a procedure for adjusting intensity in the biological-specimen examination system. -
FIG. 42 is a flowchart showing the method of supplying and replacing culture fluid in the biological-specimen examination system. -
FIG. 43 shows a cell-tracking image representing the motion of cells over time. -
FIGS. 44 and 45 are flowcharts showing culturing and measurement using a microplate. -
FIGS. 46A and 46B are, respectively, an elevational view and a side view of a biological-specimen examination system according to an eleventh embodiment, in which a microscope imaging apparatus is provided. -
FIG. 47 is a plane view of a culture stage in the biological-specimen examination system shown inFIGS. 46A and 46B . -
FIG. 48 is a perspective view of the culture stage in the biological-specimen examination system shown inFIGS. 46A and 46B . - A microscope imaging apparatus will be described below with reference to
FIGS. 1A to 6. - First, an image-acquisition operation according to a time delay integration (TDI) method will be described using
FIGS. 1A to 1C. -
FIGS. 1A, 1B , and 1C depict the TDI image-capturing operation.FIGS. 2A, 2B , and 2C depict the transfer of signal charge in the TDI method.FIG. 3A shows the level of signal charge accumulated in a horizontal line LA,FIG. 3B shows the level of signal charge accumulated in a horizontal line LB, andFIG. 3C shows the level of signal charge accumulated in a horizontal line LC. - For the sake of simplifying the explanation, a star-shaped specimen is assumed here. However, the shape of the specimen is not particularly limited to this shape.
- The positional relationship between a specimen (subject under examination) 20 and an imaging area S of an
imaging device 63 is shown inFIG. 1A . Image-acquisition begins when the top of thespecimen 20 and the bottom of the imaging area S overlap each other. Thus, initially, only the tip of the upward-facing point of the star projects onto theimaging device 63. At this time, as shown inFIG. 2A , the image of the tip of the upward-facing point is acquired by the horizontal line LA of theimaging device 63. As shown inFIG. 3A , signal charge with a level corresponding to the light intensity (brightness) from thespecimen 20 is accumulated in the horizontal line LA. - Subsequently, a
stage 30 is moved with a predetermined timing. As shown inFIG. 1B , thestage 30 is moved in the positive Y direction by a distance corresponding to one horizontal line of theimaging device 63. By doing so, the entire upward-facing point of thespecimen 20 is imaged. - At this point, as shown in
FIG. 2B , the signal charge accumulated in the horizontal line LA is transferred to the horizontal line LB in synchronization with the motion of thestage 30. Thus, the image of thespecimen 20 is acquired by the horizontal lines LA and LB of theimaging device 63. - Therefore, as shown in
FIG. 3B , the signal charge accumulated during this image acquisition is added to the signal charge accumulated in the previous acquisition. In other words, the signal charges obtained due to the previous and current image acquisition are accumulated in the horizontal line LB. As a result, the signal charge level is twice as high as that measured in one line. - In this way, charge transfer is carried out from the state shown in
FIG. 2A to the state shown inFIG. 2B . The time interval at which this charge transfer is carried out is called the TDI line transfer rate. - The
stage 30 is then moved further at the predetermined timing. That is, as shown inFIG. 1C , thestage 30 is again moved in the positive Y direction by an amount corresponding to one horizontal line of theimaging device 63. By doing so, image-acquisition of thespecimen 20 proceeds. - At this point, as shown in
FIG. 2C , the signal charge accumulated in the horizontal line LB is transferred to the horizontal line LC in synchronization with the motion of thestage 30. In addition, the signal charge accumulated in the horizontal line LA is transferred to the horizontal line LB. Thus, the image of thespecimen 20 is acquired by the horizontal lines LA, LB, and LC. - Therefore, as shown in
FIG. 3C , the signal charge obtained during this image-acquisition is added to the horizontal line LC. Thus, the signal charges obtained by the previous-but-one image-acquisition, the previous image-acquisition, and the current image-acquisition are accumulated in the horizontal line LC. In other words, the level of signal charge is three times higher than that measured with a single line. The signal charge obtained in the previous image-acquisition and the current image-acquisition are accumulated in the horizontal line LB. - By continuing with the above-described operation, the same number of image-acquisition operations as the number of horizontal scanning lines is performed. Accordingly, a signal charge for the same part of the
specimen 20 is accumulated corresponding to the number of image-acquisition operations. Thus, with the TDI method, the image of thespecimen 20 projected onto the imaging surface is shifted along with the motion of thestage 30, and the signal charge accumulated in theimaging device 63 is shifted in synchronization therewith. - Next, the exposure time used when carrying out image-acquisition in the TDI method will be discussed.
- The exposure time in the TDI method is the time it takes for the signal light returning from the
specimen 20 to be accumulated as the signal charge. In other words, the exposure time in the TDI method can be expressed as the product of the TDI line transfer rate and the cumulative number of pixels. Therefore, to change the exposure time, the TDI line transfer rate can be made faster to lengthen the exposure time or the TDI line transfer rate can be slowed down to shorten the exposure time. - For example, when using a CCD camera having 1,000 pixels in the Y direction as the
imaging device 63, to acquire images with an exposure time of 0.2 s, the line transfer rate is set to 5 kHz (0.2 ms transfer time) according to the calculation shown below:
0.2 s/1000=0/2 ms. - Next, the stage scanning speed used in the TDI method will be discussed.
- The
stage 30 is moved in synchronization with the transfer of the signal charge. Therefore, the speed at which thestage 30 is moved can be expressed as the pixel size on thestage 30 divided by the TDI line transfer rate. The pixel size on thestage 30 can be obtained from the pixel size of the imaging device 63 (for example, a CCD) and the projection magnification. - For example, with a projection magnification of 10, a pixel size in the
imaging device 63 of 6.45 μm, and a TDI line transfer rate of 5 kHz, the speed of the stage is 3.23 mm/s, according to the calculation shown below:
6.45×10−3 mm/10×5×103 Hz=3.23 mm/s. - Next, the structure of a microscope imaging apparatus will be described.
-
FIG. 4 shows the overall configuration of amicroscope imaging apparatus 10. Themicroscope imaging apparatus 10 shown inFIG. 4 is used in the first to third embodiments of the present invention described below. - As shown in
FIG. 4 , themicroscope imaging apparatus 10 includes thestage 30, anillumination unit 40, and an image-acquisition unit 60. Thestage 30 holds the specimen (object under examination) 20 thereon and is moveable. Theillumination unit 40 radiates illumination light onto thespecimen 20. The image-acquisition unit 60 acquires signal light emitted from the region irradiated with the illumination light and measures it. - The
illumination unit 40 includes components capable of Kohler illumination. Specifically, these are alamp 41, acollector lens 42, a reflectingmirror 43, afield stop 44, and alens 45. A gas discharge lamp or the like, such as a halogen lamp, xenon lamp, or mercury lamp, is used at thelight source lamp 41. Thecollector lens 42 collects light emitted from thelamp 41. The reflectingmirror 43 reflects light traveling backwards from thelamp 41 back towards thelamp 41 again. Thefield stop 44 is disposed after thecollector lens 42. Thisfield stop 44 is disposed at a conjugate position with respect to the focal point of anobjective lens 49 described below. The diameter of the opening of thisfield stop 44 is adjustable. Alens 45 is disposed after thefield stop 44. Thelens 45 images thefield stop 44 at infinity. - An
aperture stop 46 is disposed after thelens 45, at the focal plane thereof. The diameter of the opening of this aperture stop 45 can be varied. By doing so, the size of the beam diameter at the exit-pupil position of theobjective lens 49 can be adjusted. Amirror 47 is disposed after theaperture stop 46. A dichroic mirror that reflects light from thelamp 41 and that transmits return light (fluorescence) from thespecimen 20 is used as themirror 47. A half-mirror may be used instead of a dichroic mirror. - The
objective lens 49 is disposed after themirror 47. Thestage 30 is disposed at a position facing theobjective lens 49. - A stage driving mechanism (motion unit) 31 for driving the
stage 30 is provided. The stage driving mechanism (motion unit) 31 drives thestage 30 in the X and Y directions on the basis of a signal output from a computer described below. Known technology, for example, a sliding motion mechanism, may be used as thestage driving mechanism 31. It is not particularly limited to a sliding motion mechanism, however. - An
imaging lens 61 and adetector 62 are provided in the image-acquisition unit 60. Return light (fluorescence) from thespecimen 20 is incident on theimaging lens 61, and theimaging lens 61 focuses (images) the incident light at a predetermined position. Thedetector 62 is disposed at a predetermined position and detects the return light from thespecimen 20. Theimaging device 63, which can acquire images by the TDI method, is provided in thedetector 62. As described above, theimaging device 63 accumulates signal charge in each horizontal line in response to the movement of thestage 30. - The output of the
detector 62 is connected to animage processing unit 64, which processes the output signal from thedetector 62. Amonitor 65 for displaying the processed signal is connected to theimage processing unit 64. Also, theimage processing unit 64 is connected to thecomputer 66. Thestage driving mechanism 31 is also connected to thecomputer 66. - The computer (calculating unit) 66 calculates the exposure time in the main measurement. This calculation is carried out on the basis of information obtained during a prescan, as described above. This information is the brightness in each sample located portion (described below).
-
FIG. 5A depicts the shape of thespecimen 20.FIG. 5B is a magnified view showing a sample locatedportion 22 of thespecimen 20. - As shown in
FIG. 5A , thespecimen 20 includes atransparent substrate 21. Thistransparent substrate 21 is formed of, for example, a glass plate or a plastic plate. The sample locatedportions 22 are formed in a matrix on thetransparent substrate 21. That is, a two-dimensionalpatterned portion 23 is formed by the plurality of sample locatedportions 22. - The sample located
portions 22 have a substantially circular shape with a diameter of a few millimeters in plane view and have a concave profile in cross-section. As shown inFIG. 5B , cells, serving as the objects to be measured, are disposed in the sample locatedportions 22. The cells are cultured inside the sample locatedportions 22. - Next, stage scanning in the TDI method will be described.
-
FIG. 6 depicts the scanning in the TDI method. In this embodiment, thestage 30 is moved to perform scanning. However, inFIG. 6 , for the sake of simplifying the drawing, theimaging device 63 is depicted as moving. - As shown in
FIG. 6 , when measuring thespecimen 20 with the TDI method, the two-dimensionalpatterned portion 23 is completely scanned. This scanning is performed regardless of whether or not the sample locatedportions 22 are present. - When the
stage 30 is scanned in the Y-axis direction, thestage 30 moves at constant velocity in the −Y direction. On the other hand, theimaging device 63 is capable of transferring charge only in one direction. Therefore, as shown inFIG. 6 , measurement is carried out only while thestage 30 is advancing in the −Y direction. Measurement is not carried out while thestage 30 is advancing in the +Y direction. The motion in the +Y direction is for returning the stage to its initial position. The time required to return to the initial position may correspond to, for example, the time required for storing the acquired data in a hard disk of thecomputer 66. - Next, a first embodiment of the present invention will be described. Here, a measurement procedure will be described using
FIG. 7 . -
FIG. 7 is a flowchart showing the measurement procedure in this embodiment.FIGS. 8A to 8C show the relationship between the brightness of thespecimen 20 and the output level from theimaging device 63.FIG. 8A shows the relationship between the brightness obtained in a first scan and the output level,FIG. 8B shows the relationship between the brightness obtained in a second scan and the output level, andFIG. 8C shows the dependency of the brightness obtained in the first and second scans no the output level. - First, the first scan (image acquisition) is performed to acquire an image of the specimen 20 (step S1). This corresponds to the prescan.
- In this step, while the specimen 20 (stage 30) is moved from position a to position b shown in
FIG. 6 , thespecimen 20 is imaged with a predetermined exposure time. - The image acquired in the first scan will be described in terms of the relationship between the brightness of the image and the output level from the
imaging device 63. In this case, as shown inFIG. 8A , there is a region where the accumulated charge is saturated (hereinafter referred to as saturation-level region) and a region where the accumulated charge is low (hereinafter referred to as low-level region). - Next, preparation for the second scan is carried out (step S2).
- The output levels of the saturation-level region and the low-level region are appropriately set. More specifically, exposure times of suitable length are set for each of these regions.
- That is, when the saturation-level region is to be eliminated, the exposure time is set to be shorter than the exposure time in the first scan. At this time, the output level is set to utilize the entire dynamic range of the
imaging device 63. When the low-level region is to be eliminated, the exposure time is set to be longer than the exposure time in the first scan. In this case too, the output level is set to utilize the entire dynamic range of theimaging device 63. - Simultaneously, the specimen 20 (stage 30) is moved from position b to position a.
- This embodiment is described in terms of an example in which the saturation-level region is eliminated.
- Next, a second scan (image acquisition) is performed to acquire an image of the
specimen 20 again (step S3). - In this image acquisition, the exposure time determined in step S2 is used to acquire an image of the
specimen 20 in the same way as in step S1. - The image acquired in the second scan is a graph indicating the relationship between the brightness of the acquired image and the output level of the
imaging device 63. The image acquired in the second scan is shown inFIG. 8B . As shown in this figure, the saturation in the saturation-level region in the previous scan is eliminated, whereas the output level is increased in the low-level region. - Next, the images acquired in the first and second scans are combined into a single image (step S4). A predetermined image processing operation is carried out during this image combining.
- In this step, the images acquired in steps S1 and S3 are combined. By doing so, a single image with wider dynamic range can be obtained.
- Thus, in this embodiment, as shown in
FIG. 8C , the image acquired in step S1 with the long exposure time and the image acquired in step S3 with the short exposure time are combined to form a single image. - Thereafter, the specimen 20 (stage 30) is moved from position b to position c, and the process proceeds to preparation for measuring the next line.
- This embodiment has been described in terms of an example in which scanning of the same position is repeated twice. However, the number of scans is not limited to two. For example, scanning may be repeated at the same position three or more times. In such a case, between the image acquisitions performed in each scan, preparation for the next scan is carried out, and the acquired images are combined at the end.
- Instead of the
imaging device 63 described above, animaging device 63 a having an electronic shutter may be used. Use of such animaging device 63 a is preferable since it can reduce the exposure time. - The electronic shutter is the type of shutter normally used in CCD digital cameras and mobile telephones with built-in cameras. Such an electronic shutter uses a phenomenon whereby charge is not accumulated if the CCD is not operating, even if exposed to light. Accordingly, the CCD function itself is one form of shuttering.
- On the other hand, in a mechanical shutter used in a silver-halide camera, an opaque plate is placed between the lens and the film, and exposure is performed by opening and closing (moving) this plate. Thus, the electronic shutter is different from the mechanical shutter. The electronic shutter controls the exposure time without using a mechanical shutter.
-
FIG. 9 is a timing chart for the electronic shutter in the TDI method. - As shown in
FIG. 9 , for example, when the maximum transfer rate in the TDI method is t1 (seconds), the charge is transferred to a neighboring horizontal line every t1 seconds. The timing of the transfers is indicated by the arrows in the figure. - The electronic shutter is open for a period of t2 seconds from each charge transfer, and charge accumulation is performed. In other words, the charge accumulation of the CCD is carried out for t2 seconds after every charge transfer. On the other hand, the exposure time when not using the electronic shutter is t1. Therefore, the ratio of the exposure time when using the electronic shutter to the exposure time when not using the electronic shutter is t2/t1.
- For example, assume that the
imaging device 63 a has 1000 pixels in the Y direction and a maximum transfer rate (t1) of 10 kHZ (0.1 ms). When using thisimaging device 63 a to acquire images with an exposure time of 1 ms, the open time of the electronic shutter (t2) should be set to 0.001 ms, according to the calculation shown below:
1000×0.1 (ms)×(t2/0.1)=1 (ms)
t2=0.001 ms - When the electronic shutter is not used, the shortest exposure time is determined by the product of the maximum TDI transfer rate and the cumulative number of pixels. Accordingly, by using an electronic shutter of the type described above, it is possible to increase the range of exposure times for which measurement is possible. Therefore, even a high-
brightness specimen 20 can be accurately measured. - With the configuration described above, two images obtained by two scans with different exposure times in steps S1 and S3 are combined into a single image (S4). By doing so, it is possible to acquire an image with a wider dynamic range compared to an image acquired with a single exposure time. Therefore, it is possible to accurately carry out measurement even for a
specimen 20 whose brightness variation is large. - As shown in
FIGS. 5A and 5B , thespecimen 20 may include only the sample locatedportions 22 on thetransparent substrate 21. Alternatively, as shown inFIG. 10 , a reference line BL may also be formed in a region close to the left-hand side of thetransparent substrate 21. - If the reference line BL is formed, it can serve as a reference when combining the images acquired in each scan. Accordingly, it is possible to simplify the image combining operation.
- In this embodiment, since fluorescence examination is carried out, it is preferable that the reference line BL be formed of a material that fluoresces.
- Next, a second embodiment of the present invention will be described with reference to FIGS. 11 to 13.
- The basic structure of the microscope imaging apparatus of this embodiment is the same as that of the first embodiment, but the method of measuring the specimen is different from that in the first embodiment. Therefore, in this embodiment, only the method of measuring the specimen shall be described, using FIGS. 11 to 13, and a description of the TDI method and so on shall be omitted.
-
FIG. 11 depicts the overall configuration of amicroscope imaging apparatus 110 of this embodiment. - As shown in
FIG. 11 , themicroscope imaging apparatus 110 includes astage 30, anillumination unit 40, and an image-acquisition unit 160. Thestage 30 holds aspecimen 20 and is moveable. Theillumination unit 40 irradiates thespecimen 20 with illumination light. The image-acquisition unit 160 acquires signal light emitted from the region irradiated with illumination and measures it. - An
imaging lens 61 and adetector 62 are provided in the image-acquisition unit 160. Return light from thespecimen 20 is incident on theimaging lens 61, and thedetector 62 detects the return light. - The
detector 62 is connected to animage processing unit 64, which processes the output of thedetector 62. Theimage processing unit 64, amonitor 65 for displaying the processed signal, and astage driving mechanism 31 are connected to acomputer 166. - An exposure-
time input unit 167 and asetting unit 168 are provided in thecomputer 166. A maximum exposure time Tmax is input using the exposure-time input unit 167. This maximum exposure time Tmax is related to measurement of thespecimen 20 and is set by the user. Thesetting unit 168 is used to set an exposure time Tmeasure used for image acquisition and measurement. - Next, the measurement procedure will be described.
-
FIG. 12 is a flowchart showing the measurement procedure in this embodiment. - First, the user sets the maximum exposure time Tmax (step S10) by inputting the maximum exposure time Tmax to the exposure-
time input unit 167. - Next, a first scan (image acquisition) is performed to acquire an image of the
specimen 20. - In this step, the maximum exposure time Tmax input to the
setting unit 168 is set as the exposure time Tmeasure used for image acquisition and measurement. Therefore, an image of thespecimen 20 is acquired with the maximum exposure time Tmax. - Next, preparation is arried out for a second scan (step S12).
- In this step, the
setting unit 168 sets the exposure time Tmeasure for the second scan on the basis of the magnitude (number of saturated pixels) in the saturation-level region. - More specifically, as shown in
FIG. 13 , the reltionship (table) between the number of saturated pixels and the exposure time in the next image acquisition is stored in thesetting unit 168. On the basis of this table, thecomputer 66 sets the exposure time Tmeasure for the second scan. Thus, as the number of saturated pixels, for example, in each sample locatedportion 22 increases, the exposure time for the second scan decreases. - Saturated pixels shall now be explained. For example, if a 12-bit CCD is used as the
imaging device 63, the maximum number of gradation levels is 4095 (=212, the maximum value that can be represented by 12 bits). Therefore, a saturated pixel is a pixel for which the imaging device outputs a value of 4095, in other words, a pixel whose output value reaches the upper limit. - Next, a second scan (image acquisition) is performed to acquire an image of the specimen 20 (step S13), and the images acquired in the first and second scans are combined to form a single image (step S14).
- The measurement procedure after step S13 is the same as in the first embodiment, and therefore it is merely shown in
FIG. 12 , but a description thereof is omitted. - With the configuration described above, the user inputs the maximum exposure time Tmax in advance to the exposure-
time input unit 167. By doing so, the exposure time can be reduced. Thus, image acquisition can be made more efficient, and it is possible to efficiently acquire images with a wider dynamic range. - This embodiment has been described in terms of an example in which the user sets the maximum exposure time. However, the time input to the exposure-
time input unit 167 may be just the actual exposure time. In other words, it is not limited to the maximum exposure time. - Next, a third embodiment will be described with reference to
FIGS. 14 and 15 . - The basic configuration of the microscope imaging apparatus of this embodiment is the same as that in the first embodiment, but the configuration of the image-acquisition unit is different from the first embodiment. Therefore, in this embodiment only the image-acquisition unit will be described using
FIGS. 14 and 15 , and a description of the illumination unit and so on shall be omitted. -
FIG. 14 shows the overall configuration of amicroscope imaging apparatus 210 in this embodiment. - As shown in
FIG. 12 , themicroscope imaging apparatus 210 includes astage 30, anillumination unit 40, and an image-acquisition unit 260. Thestage 30 holds aspecimen 20 and is moveable. Theillumination unit 40 irradiates thespecimen 20 with illumination light. The image-acquisition unit 260 acquires signal light emitted from the region irradiated with the illumination light and measures it. - An
imaging lens 61 and adetector 262 are provided in the image-acquisition unit 260. Return light from thespecimen 20 is incident on theimaging lens 61, and thedetector 262 detects the return light from thespecimen 20. Animaging device 263 is disposed in thedetector 262. Theimaging device 263 has an anti-smear function and is capable of acquiring images on the basis of the TDI method. As described above, the TDI method is a technique in which, according to the motion of thestage 30, the signal charge in each horizontal line is accumulated in theimaging device 63. - Smearing is a phenomenon occurring in photoelectric conversion devices like CCDs (charge coupled devices). When an excessive signal above a certain level is input to a photoelectric conversion device, this phenomenon produces a false signal as a result of completely changing the signal in the longitudinal or transverse direction during signal processing.
- That is, smearing is a phenomenon whereby, when a highly bright spot of light, for example, is incident on a photoelectric conversion device, a bright band of light extending in the longitudinal or transverse direction is produced.
- It is possible to prevent the occurrence of smearing with the configuration described above. For example, as shown in
FIG. 15 , a cell BC of high brightness and a cell DC of low brightness are adjacent to each other. In this case, if the exposure time is long enough for the low-brightness cell (biological specimen) DC, smearing occurs in the image of the high-brightness cell BC. However, with the configuration described above, even if image acquisition is carried out with a long exposure time, which is suitable for the low-brightness cell DC, it is possible to prevent the occurrence of smearing. Therefore, it is possible to accurately measure both the high-brightness cell BC and the low-brightness cell DC. - When using an imaging device not having the anti-smear function, as described above, there is a risk of causing smearing at the low-brightness cell DC due to the high-brightness cell BC. As a result, it may not be possible to accurately measure the low-brightness cell DC.
- With the microscope imaging apparatus of this embodiment, when acquiring a plurality of images of the object under examination, it is possible to acquire images with different exposure times. Then, these images are combined into a single image. By doing so, it is possible to accurately perform measurement even for an examination object having significant brightness variation.
- Next, a fourth embodiment will be described. The microscope imaging apparatus shown in
FIG. 4 is also used in this embodiment. The measurement procedure shall be described usingFIG. 16 . -
FIG. 16 is a flowchart showing the measurement procedure in this embodiment. - First, when measurement commences, prescan preparation is carried out (step S201). In this step, the
stage 30 moves to a measurement starting point (the point where theimaging device 63 and thespecimen 20 have the positional relationship shown inFIG. 6 ). - Next, the prescan is carried out (step S202). Fluorescence, for example, is emitted from each of the sample located
portions 22, and the prescan is performed to acquire the brightness distribution of this fluorescence. The exposure time used in the prescan is set to be sufficiently short so that the signal charge accumulated in theimaging device 63 is not saturated. As described above, the movement speed of thestage 30 is set according to the TDI line transfer rate. -
FIG. 17 is graph showing the relationship between the prescan brightness and the exposure time in the main measurement. - When the prescan is completed, preparation for the main measurement of the
specimen 20 is carried out (step S203). In this step, thestage 30 is moved back to the measurement starting point. - The brightness in each sample located
portion 22 has already been acquired in the prescan (step S202). Therefore, from among the acquired brightnesses, the maximum value, that is, the maximum intensity value (count), is found. This maximum intensity value is the digital value output from theimaging device 63. - Then, on the basis of the maximum intensity value, the exposure time for each sample located
portion 22 in the current measurement is determined. The exposure time is determined on the basis of the relationship between the prescan brightness and the exposure time for the main measurement, as shown inFIG. 17 . The relationship shown inFIG. 17 is obtained in advance before measurement. (For example, the relationship shown inFIG. 17 is obtained by measurement or simulation.) - Once the exposure time has been determined, the main measurement (image acquisition) of the
specimen 20 is carried out (step S204). In this step, the image of each sample locatedportion 22 is acquired on the basis of the exposure time found in the main-measurement preparation step (step S203). As described above, the exposure time is expressed by the TDI line transfer rate and the cumulative number of charged pixels. Also, thestage 30 is moved at a speed in synchronization with the TDI line transfer rate. - In this embodiment too, instead of the
imaging device 63 described above, animaging device 63 a having an electronic shutter may be used. Use of such animaging device 63 a is beneficial in that it is possible to reduce the exposure time. The electronic shutter and the mechanical shutter are as described previously. - The TDI method is also used in this embodiment. The timing chart for the electronic shutter used in this TDI method is as shown in
FIG. 9 . - With the configuration described above, it is possible to obtain a suitable exposure time for measurement of the
specimen 20 on the basis of the prescan performed before measurement of thespecimen 20. Accordingly, on the basis of the prescan before measurement, a suitable exposure time can be determined even when measuring aspecimen 20 whose brightness changes with time. As a result, the specimen can be accurately measured. - More concretely, setting an exposure time longer than the appropriate time can prevent the problem of saturation of the accumulated charge. Also, setting an exposure time shorter than the appropriate time can prevent the problem of insufficient charge accumulation (only accumulating the noise level).
-
FIG. 18 shows an example of the configuration of anothermicroscope imaging apparatus 200. As shown inFIG. 18 , for example, alight control member 70 may be disposed between theimaging lens 61 and thedetector 62 in the image-acquisition unit 60. For example, a neutral density (ND) filter or an electro-micro mirror device whose transmittance is varied by application of an electric potential may be used as thelight control member 70. - With the configuration described above, the transmittance of the
light control member 70 can be adjusted according to the exposure time obtained in the prescan. Thus, the range of possible exposure times for measurement can be increased. As a result, it is possible to accurately carry out measurement even for aspecimen 20 having high brightness or low brightness. - Next, a fifth embodiment will be described with reference to
FIG. 19 . - The basic configuration of the microscope imaging apparatus of this embodiment is the same as that of the fourth embodiment, but the prescan method is different from that in the fourth embodiment. Therefore, in this embodiment, only the prescan method is described using
FIG. 19 , and a description of the main measurement method and so on is omitted. -
FIG. 19 shows the overall configuration of amicroscope imaging apparatus 210 of this embodiment. - As shown in
FIG. 19 , themicroscope imaging apparatus 210 includes astage 30, anillumination unit 140, and an image-acquisition unit 60. Thestage 30 holds aspecimen 20 and is moveable. Theillumination unit 140 irradiates thespecimen 20 with illumination light. The image-acquisition unit 60 acquires signal light emitted from the region irradiated with the illumination light and measures it. - A
light source lamp 41, acollector lens 42, a reflectingmirror 43, afield stop 44, alens 45, anaperture stop 46, and amirror 47 are provided in theillumination unit 140. Thecollector lens 42 collects light emitted from thelamp 41. The reflectingmirror 43 reflects backward-propagating light back to thelamp 41. The diameter of the opening of thefield stop 44 can be adjusted. Thelens 45 images thefield stop 44 at infinity. The diameter of the opening of theaperture stop 46 can be adjusted. Themirror 47 selectively transmits light. Anobjective lens 149 forms an image of thespecimen 20; however, since theobjective lens 149 focuses the light from thelamp 41 on thespecimen 20, it can also be considered part of theillumination unit 140. - A low-
magnification objective lens 149A used in the prescan and a high-magnification objective lens 149B used in the main measurement are used as theobjective lens 149. Theseobjective lenses - With the configuration described above, since it is possible to acquire a wide-field image during the prescan, the prescan time can be shortened.
- For example, the high-
magnification objective lens 149B used in the main measurement is a 20× lens, and the low-magnification objective lens 149A used in the prescan is a 4× lens. Thus, because the pixel pitch on thestage 30 is five times larger, the stage speed can be increased by a factor of five. Furthermore, because the field is five times wider, the number of line scans can be reduced to one fifth. Therefore, compared to the case where the prescan and the main measurement are carried out with the same magnification, the prescan time required for the entire surface of thespecimen 20 can be reduced to 1/25. - Also, the light (brightness) from the specimen may vary over time, depending on the specimen. In such a case, the appropriate exposure time also changes over time. Therefore, if the time required for the prescan can be reduced, as in this embodiment, it is possible to reduce the time interval from the prescan to the main measurement. As a result, it is possible to carry out measurement with the appropriate exposure time.
- Next, a sixth embodiment will be described with reference to
FIG. 20 . - The basic configuration of the microscope imaging apparatus of this embodiment is the same as that of the fourth embodiment, but the image-acquisition unit is different from that in the fourth embodiment. Therefore, in this embodiment, only the image-acquisition unit is described using
FIG. 20 , and a description of the illumination unit and so on is omitted. -
FIG. 20 shows the overall configuration of amicroscope imaging apparatus 220 of this embodiment. - As shown in
FIG. 20 , themicroscope imaging apparatus 220 includes astage 30, anillumination unit 40, and an image-acquisition unit 260. Thestage 30 holds aspecimen 20 and is moveable. Theillumination unit 40 irradiates thespecimen 20 with illumination light. The image-acquisition unit 260 acquires signal light emitted from the region irradiates with the illumination light and measures it. - An
imaging lens 61, adetector 62, and a scalinglens 261 are provided in the image-acquisition unit 260. Return light from thespecimen 20 is incident on theimaging lens 61. Thedetector 62 detects the return light from thespecimen 20. The scalinglens 261 can acquire images over a wide field. - The scaling
lens 261 is inserted into the light path between theobjective lens 49 and thedetector 62. It may be capable of being inserted in and removed from the light path. Also, the scalinglens 261 may be retained by a known switching mechanism such as a revolver. By doing so, it is possible to switch between scaling lenses with different magnifications, as required. - With the configuration described above, by inserting the scaling
lens 261 into the light path between theobjective lens 49 and thedetector 62 during the prescan, it is possible to acquire images over a wide field of view. Accordingly, the prescan time can be reduced. - Furthermore, since it is possible to reduce the time interval from the prescan to the main measurement, even for a
specimen 20 whose brightness varies with time, it is possible to carry out measurement with the appropriate exposure time. - Next, a seventh embodiment will be described with reference to
FIGS. 21 and 22 . - The basic configuration of the microscope imaging apparatus of this embodiment is the same as that of the fourth embodiment, but the method of controlling the exposure time is different from that in the fourth embodiment. Therefore, only the method of controlling the exposure time is described using
FIGS. 21 and 22 , and a description of the structure and so on is omitted. -
FIG. 21 shows the overall configuration of amicroscope imaging apparatus 230 in this embodiment.FIG. 22 is a flowchart showing the measurement procedure in this embodiment. - As shown in
FIG. 21 , themicroscope imaging apparatus 230 includes astage 30, anillumination unit 40, and an image-acquisition unit 360. Thestage 30 holds aspecimen 20 and is moveable. Theillumination unit 40 irradiates thespecimen 20 with illumination light. The image-acquisition unit 360 acquires signal light emitted from the region irradiated with the illumination light and measures it. - An
imaging lens 61 and adetector 62 are provided in the image-acquisition unit 360. Return light from thespecimen 20 is incident on theimaging lens 61. Thedetector 62 detects the return light from thespecimen 20. - The
detector 62 is connected to animage processing unit 64, which processes the output from thedetector 62. Amonitor 65 for displaying the processed signal is connected to theimage processing unit 64. Astage driving mechanism 31 is connected to acomputer 366. - The
computer 366 includes a maximum-exposure-time input unit 367, a calculatingunit 368, and a selectingunit 369. A maximum exposure time Tmax for measuring thespecimen 20 is input to the maximum-exposure-time input unit 367. The maximum exposure time Tmax is set by the user. The calculatingunit 368 calculates an exposure time Tpre on the basis of information obtained in a prescan. The selectingunit 369 carries out comparison and selection of the exposure time Tpre and the maximum exposure time Tmax. - Next, the measurement procedure will be described.
- As shown in
FIG. 22 , first, the user inputs the maximum exposure time Tmax for the main measurment (step S211). Then, measurement commences. - Next, prescan preparation is carried out (step S212). In this step, the
stage 30 moves to a measurement starting point (the point where theimaging device 63 and thespecimen 20 have the positional relationship shown inFIG. 6 ). - Next, the prescan is performed (step S213). Fluorescence, for example, is emitted from each sample located
portion 22, and the prescan is performed to acquire brightness distribution information of this fluorescence. The exposure time in the prescan is set to a sufficiently short duration so that, for example, the signal charge accumulated in theimaging device 63 is not saturated. Also, as described above, the movement speed of thestage 30 is set according to the TDI line transfer rate. - Once the prescan has been completed, preparation for the main measurement of the
specimen 20 is carried out (step S214). In this step, thestage 30 is moved back to the measurement starting point. - The brightness in each sample located
portion 22 has already been acquired in the prescan (S213). Thus, a maximum value, that is, a maximum intensity value (count), is found from among the acquired brightnesses. This maximum intensity value is a digital value output from theimaging device 63. - Then, the exposure time Tpre for each sample located
portion 22 is determined on the basis of the maximum intensity value found. The exposure time Tpre is determined on the basis of the relationship between the prescan brightness and the exposure time in the main measurement, as shown inFIG. 17 . The relationship shown inFIG. 17 is determined in advance before the measurement. (For example, the relationship shown inFIG. 17 is determined by measurement or simulation.) Here, the maximum exposure time Tmax and the exposure time Tpre are compared. On the basis of the comparison result, if the exposure time Tpre is shorter than the maximum exposure time Tmax, the exposure time Tpre is used as the exposure time for the main measurement. On the other hand, if the exposure time Tpre is longer than the maximum exposure time Tmax, the maximum exposure time Tmax is used as the exposure time in the main measurement. - When the exposure time has been determined, the main measurement (image acquisition) of the
specimen 20 is carried out (S215). In this step, an image of each sample locatedportion 22 is acquired on the basis of the exposure time determined in the main measurement preparation (step S214). As described above, the exposure time is given by the TDI line transfer rate and the cumulative number of charged pixels. Also, thestage 30 is moved at a speed in synchronization with the TDI line transfer rate. - By setting the exposure time as described above, it is possible to prevent the exposure time from becoming too long when carrying out the main measurement of a
specimen 20 having low brightness. Moreover, it is possible to measure aspecimen 20 whose brightness varies over time using the appropriate exposure time. - Next, an eighth embodiment will be described with reference to
FIGS. 23A and 23B . - The basic configuration of the microscope imaging apparatus of this embodiment is the same as that in the fourth embodiment, but the specimen is different from that in the fourth embodiment. Therefore, only the specimen is described using
FIGS. 23A and 23B , and a description of the illumination unit and so on is omitted. -
FIGS. 23A and 23B show the configuration of aspecimen 20 in this embodiment. - As shown in
FIG. 23A , thespecimen 20 is disposed so that the brightness in the sample locatedportions 22 arrayed in the X direction (the sample locatedportions 22 enclosed by the ellipses inFIG. 23A ) is substantially uniform. - With the configuration described above, by performing the prescan in one row in the Y direction in
FIG. 23A , it is possible to obtain an appropriate exposure time. Accordingly, the time required for the prescan can be reduced. - The
specimen 20 may be arranged as shown inFIG. 23A . Also, as shown inFIG. 23B , sample locatedportions 22 having substantially uniform brightness may be arranged so as to be grouped in regions formed of two or three rows in the X direction and two rows in the Y direction (the region enclosed by the ellipses inFIG. 23B ). - By adopting such an arrangement, as shown in
FIG. 23B , it is possible to achieve the appropriate exposure time by performing the prescan in two rows. Therefore, the time required for the prescan can be reduced. - The arrangement of the sample located
portions 22 having substantially uniform brightness is not particularly limited; any arrangement is possible so long as the number of prescans can be reduced. - With the microscope imaging apparatus of this embodiment, it is possible to achieve an appropriate exposure time for measuring the object under examination on the basis of the prescan performed before the main measurement. Therefore, a specimen whose brightness varies over time can be accurately measured.
- A ninth embodiment will now be described.
FIG. 24 shows the overall configuration of amicroscope imaging apparatus 310 of this embodiment. Components that are the same as those inFIG. 4 are assigned the same reference numeral, and a description thereof shall be omitted. - With the
microscope imaging apparatus 310 of this embodiment, it is possible to acquire images by the TDI method and by a two-dimensional imaging method. - An
imaging lens 61 and adetector 62 are provided in an image-acquisition unit 60. Return light (fluorescence) from thespecimen 20 is incident on theimaging lens 61. Theimaging lens 61 focuses (images) the incident light at a predetermined position. Thedetector 62 is disposed at the predetermined position and detects the return light from thespecimen 20. Animaging device 63 that is capable of the TDI method and the two-dimensional imaging method is provided in thedetector 62. - The output from the
detector 62 is connected to animage processing unit 64 that processes the signal output from thedetector 62. Amonitor 65 for displaying the processed signal is connected to theimage processing unit 64. Theimage processing unit 64 is connected to acomputer 66. Amirror driving mechanism 48 and astage driving mechanism 31 are also connected to thecomputer 66. - The
computer 66 is provided with a specimen-parameter input unit (examination-object-parameter input unit) 67, a calculatingunit 68, and aswitching unit 69. The specimen-parameter input unit 67 obtains and inputs information on thespecimen 20 in advance. Thecalculation unit 68 calculates the scanning time for thestage 30 on the basis of the specimen parameters output from the specimen-parameter input unit 67. The switchingunit 69 switches between the TDI method and the two-dimensional imaging method on the basis of the calculation results from thecalculation unit 68, and output a switching signal to thedetector 62. - The
calculation unit 68 calculates the scanning time for thestage 30 in the TDI method and the two-dimensional imaging method. Then, by comparing the durations of the scanning times used in each method, it selects the method having the shorter scanning time. - In this way, the measurement carried out by the
microscope imaging apparatus 310 is performed while scanning the plurality of sample locatedportions 22, that is, while scanning the cells in the two-dimensionalpatterned portion 23. Accordingly, when measuring the two-dimensionalpatterned portion 23 with the TDI method or the two-dimensional imaging method, the shorter time required for scanning, that is, the shorter measurement time, is employed. Thespecimen 20 used here has the configuration shown inFIGS. 5A and 5B . - The method of estimating the respective scanning times of the
specimen 20 when thespecimen 20 is imaged with the TDI method and the two-dimensional imaging method shall be described next. - First, the parameters used in estimating the scanning time of the
specimen 20 will be described. -
FIG. 25A shows the parameters for the specimen.FIG. 25B shows the parameters for theimaging device 63. - As shown in
FIG. 25A , ameasurement substrate 21 has a rectangular outer shape. The length in the X direction is A (mm), and the length in the Y direction is B (mm). Also, the sample locatedportions 22 are arranged in a C×D array, where C is the number in the X direction and D is the number in the Y direction. Therefore, the total number of sample locatedportions 22 is C×D. - The exposure time for each sample located portion is E (s), and the number of measurement wavelengths is F. For example, when observing two different fluorescence dyes (fluorescence wavelengths), the number of measurement wavelengths F is two.
- As shown in
FIG. 25B , the pixel pitch of theimaging device 63 is G (mm). The number of pixels disposed in the X direction is H (pixels), and the number of pixels disposed in the Y direction is I (pixels). Furthermore, the magnification of the objective lens is J1, and the projection magnification is J2. - When measuring the
specimen 20 with the TDI method, as shown inFIG. 6 , the entire surface of the two-dimensionalpatterned portion 23 is scanned regardless of whether or not the sample locatedportions 22 exist. - When measuring fluorescence with a plurality of wavelengths, the number of wavelengths that can be observed in one scan is only one. Therefore, the stage must be moved back and forth corresponding to the number of wavelengths. For example, when measuring fluorescence with two wavelengths, to acquire an image of one line, the
stage 30 must be moved back and forth twice. - The calculation for estimating the measurement time in the TDI method is described below.
- The product of the TDI line transfer rate and the number of pixels in the
imaging device 63 in the transfer direction gives the exposure time. Therefore, the transfer rate (Tshift) is given by:
Tshift=E/I (seconds). - The stage speed (Vstage) can be expressed by the ratio of the pixel size on the examination surface to the transfer rate. Therefore, the stage speed is expressed by:
Vstage=(G/(J1×J2))/Tshift (mm/sec). - The time required for a one-way scan of the measurement substrate 21 (Tsingle) is given by:
Tsingle=B/Vstage (seconds). - Detection is not performed when returning the
stage 30, but it is assumed that the same time is required as for the one-way scan of thestage 30. In such a case, the time required for one reciprocation of the stage 30 (Tdouble) is expressed as:
Tdouble=2×Tsingle (seconds). - When measuring fluorescence with a plurality of wavelengths, the stage is reciprocated according to the number of wavelengths measured. Therefore, the time required to complete acquisition of one line (Tline) is expressed as:
Tline=F×Tdouble (seconds). - The number of scans (N) can be expressed as the ratio of the size of the
measurement substrate 21 in the X direction to the size of theimaging device 63 in the X direction, on the surface of the object under examination. Therefore, the number of scans is given by:
N=[A/(H×G/J)]+1 (repetitions) - where the square brackets indicate Gauss' symbol, that is, the greatest integer that is not over that value, for example, [2.34]=2.
- Therefore, the scanning time in the TDI method (Ttdi) is:
Ttdi=C×Tline (seconds). - Instead of the
imaging device 63 described above, animaging device 63 a having an electronic shutter may be used in this embodiment too. Using such animaging device 63 a is advantageous in that the exposure time can be reduced. The electronic shutter and the mechanical shutter are as described previously. - The timing chart of the electronic shutter in the TDI method is as shown in
FIG. 9 . - When determining the scanning time of the
specimen 20, the maximum TDI transfer rate (t1) is Tshift. - Next, the method of estimating the measurement time in the two-dimensional imaging method will be described.
-
FIG. 26 depicts scanning in the two-dimensional imaging method. InFIG. 26 , for the sake of simplifying the illustration, theimaging device 63 is depicted as moving. - As shown in
FIG. 26 , when carrying out measurement of thespecimen 20 with the two-dimensional imaging method, thestage 30 is moved while performing measurement. By moving thestage 30, the measurement point sequentially moves to the next sample locatedportion 22 in the examination region. -
FIG. 27 is a graph depicting the operation of thestage 30 in the two-dimensional imaging method. - As shown in
FIG. 27 , thestage 30 is driven while alternating between acceleration and deceleration. The motion of the sample locatedportions 22 advances in this way. Thestage 30 accelerates during the period T1 to T2, moves at constant speed during period T2 to T3, decelerates during period T3 to T4, and stops during period T4 to T5. - Thus, measurement of the sample located
portion 22 is carried out during period T4 to T5 where thestage 30 stops. - In the two-dimensional imaging method, charge transfer in the
imaging device 63 does not occur, unlike the TDI method. Therefore, in the two-dimensional imaging method, image acquisition can be carried out regardless of the direction of motion of thestage 30. - Next, the method of estimating the measurement time in the two-dimensional imaging method will be described.
- Here, the time to move between the sample located
portion 22 is K (seconds). In addition, when measuring a plurality of wavelengths, the dichroic mirror in the microscope is changed. Therefore, the time required to change the dichroic mirror is L (seconds). In the microscope, the dichroic mirrors are normally held in a turret, which is rotated by a driving mechanism such as a motor or the like. Thus, changing of the dichroic mirror is carried out electrically. - The measurement time Tmeasure for one sample located
portion 22 depends on the exposure time E (seconds), the time for changing the dichroic mirror L (seconds), and the number of measurement wavelengths F, and is given by:
Tmeasure=F×E+(F−1)×L (seconds). - Considering the period for moving between the sample located
portions 22, the measurement interval Twell between one sample locatedportion 22 and another sample locatedportion 22 is given by:
Twell=Tmeasure+K (seconds). - Also, because the sample located
portions 22 are arranged in a C×D matrix, the scanning time for the two-dimensional imaging method (T2D) is:
T2D=C×D×Twell (seconds). - Next, an example of an actual estimation is shown in Tables 1 to 3.
- Table 1 shows values of parameters used in the estimation. The values of parameters C, D, E, and F in Table 1 are shown in Table 2. Table 2 shows the estimated results of the measurement time corresponding to the parameters C, D, E, and F. Tables 3 and 4 show intermediate results of the estimation for each parameter.
TABLE 1 Measure- ment Switching time for substrate No. Magnification two-dimensional size No. wells Exposure measurement Pixels No. pixels Objective Projection imaging method X Y X Y time wavelengths size X Y lens lens Moving Switching (mm) (mm) (no.) (no.) (s) Wavelength (mm) pixels pixels (magnification) (magnification) time (s) time (s) A B C D E F G H I J1 J2 K L 26 76 parameters 0.0065 1300 1000 20 0.5 4 1 -
TABLE 2 Measurement time Measurement conditions (excluding image No. sample transfer time) located Exposure No. TDI Two-dimensional portions time wavelengths method imaging method C * D (no.) E (s) F Ttdi (s) T2D (s) Method used 1000 0.1 1 725 4100 TDI method 100 0.1 1 725 410 Two-dimensional imaging method 1000 0.1 2 1450 5200 TDI method 100 0.1 2 1450 520 Two-dimensional imaging method -
TABLE 3 1 2 3 4 Tshift (s) 1.00E−04 1.00E−04 1.00E−04 1.00E−04 Vstage (s) 6.5 6.5 6.5 6.5 Tstage (s) 11.7 11.7 11.7 11.7 Tdouble (s) 23.4 23.4 23.4 23.4 Tline (s) 23.4 23.4 46.8 46.8 N (repetitions) 31 31 31 31 Ttdi (s) 725 725 1450 1450 -
TABLE 4 5 6 7 8 Tmeasure (s) 0.1 0.1 1.2 1.2 Twell (s) 4.1 4.1 5.2 5.2 T2D (s) 4100 410 5200 520 -
FIG. 28 shows an arrangement in which the density of sample locatedportions 22 on themeasurement substrate 21 changes depending on position (that is, the density is non-uniform).FIG. 29 depicts an example where the scanning method switches between the TDI method and the two-dimensional imaging method. - As shown in
FIG. 28 , when the density of the sample locatedportions 22 is non-uniform, two imaging methods are used. Specifically, as shown inFIG. 29 , the region where the density ofspecimen location portions 22 is high (the region at the left inFIGS. 28 and 29 ) is measured with the TDI method, and the region where the density is low (the region at the right inFIGS. 28 and 29 ) is measured with the two-dimensional imaging method. In this way, by switching between the TDI method and the two-dimensional imaging method depending on the distribution of sample locatedportions 22, it is possible to select the method having the higher scanning speed for carrying out measurement. As a result, the measurement time can be shortened. - In the measurement described above, measurement of the
specimen 20 is carried out right after the measurement preparation has been completed. However, a prescan may be carried out to measure the density of sample locatedportions 22 in thespecimen 20 before measuring thespecimen 20. Doing so allows the main measurement to be carried out after selecting the TDI method or the two-dimensional imaging method for measuring thespecimen 20 on the basis of information about the density obtained in the prescan. - When performing the prescan, it is preferable that the
objective lens 49 have low magnification. By doing so, the field of view of the microscope is widened, and therefore, it is possible to complete the prescan in a shorter period of time. Also, user input is not required beforehand. - Furthermore, when the density of sample located
portions 22 is non-uniform, as shown inFIG. 28 , it requires a substantial effort for the user to input information for changing the imaging method. Conversely, since the imaging method can be changed automatically on the basis of the prescan, no such effort is required. - With the configuration described above, the method having the shorter scanning time among the TDI method and the two-dimensional imaging method is selected as the method used in the measurement. Therefore, compared to the case where the method is not selected, the scanning in the measurement can be carried out more quickly. Also, being able to select the method having the higher scanning speed allows the time required for measuring the
specimen 20 to be reduced. - Moreover, it is possible to automatically select either the TDI method or the two-dimensional imaging method, whichever is most appropriate, on the basis of the number of measurement wavelengths, the exposure time, and the density of the
specimen 20. Therefore, it is easy to speed up the scanning procedure, which allows the measurement time to be easily reduced. - With the microscope imaging apparatus of this embodiment, the method for measuring the object under examination can be selected from either the TDI method or the two-dimensional imaging method on the basis of the scanning time described above, and it is therefore possible to select the method having the shorter scanning time.
- Accordingly, compared to a case where the imaging method is not selected, the scanning during measurement of the object under examination can be made faster, and the time required for measurement can thus be reduced.
- Next, a tenth embodiment will be described with reference to FIGS. 30 to 45. The tenth embodiment is a biological-specimen examination system using one of the microscope imaging apparatuses according to the first to ninth embodiments described above.
-
FIG. 30 is a perspective view showing an overview of a biological-specimen examination system 410 according to this embodiment.FIG. 31 is a schematic diagram showing the system configuration of the biological-specimen examination system. - As shown in
FIGS. 30 and 31 , the biological-specimen examination system 410 includes adetection unit 420 and aculture unit 470. Thedetection unit 420 and theculture unit 470 are preferably disposed adjacent to each other, and more preferably, theunits - As shown in
FIGS. 30 and 31 , thedetection unit 420 includes aninsulated compartment 421 that contains biological specimens and a detection section (microscope imaging apparatus) 440 that measures cells CE serving as the biological specimens. - The
insulated compartment 421 includes aheater 421H for keeping the interior of theinsulated compartment 421 at a predetermined temperature; a stage 422 that holds an incubator box 500 (described later); a transmission light source (illuminating unit) 423 that irradiates the cells CE with light; afan 424 to make the temperature inside theinsulated compartment 421 uniform; aUV lamp 425 for sterilizing the interior of theinsulated compartment 421; acarrier 426 that covers a culture-fluid circulating tube 477 (described later), a culture-gas supply tube 497, and so on; adoor 427 used when putting theincubator box 500 or the like in theinsulated compartment 421 or when removing it therefrom; and a main power-supply switch 428 for turning on and off the main power supply of thedetection unit 420. - The stage 422 includes an
X-axis motion stage 422X and a Y-axis motion stage 422Y that move relative to each other in mutually orthogonal directions, and scanning of the stage 422 is controlled by a stage scanning unit (motion unit) 429. - The
stage scanning unit 429 is formed of an X-axis coordinatedetection unit 430 that detects the X-axis coordinate value of theX-axis motion stage 422X, anX-axis scanning controller 431 that controls the motion (scanning) of theX-axis motion stage 422X, a Y-axis coordinatedetection unit 432 that detects the Y-axis coordinate value of the Y-axis motion stage 422Y, and a Y-axis scanning controller 433 that controls the motion (scanning) of the Y-axis motion stage 422Y. - The X-axis coordinate
detection unit 430 and the Y-axis coordinatedetection unit 432 are configured so as to output the detected X-coordinate of theX-axis motion stage 422X and the Y-coordinate of the Y-axis motion stage 422Y, respectively, to a computer PC. TheX-axis scanning controller 431 and the Y-axis scanning controller 433 are configured so as to control the scanning of theX-axis motion stage 422X and the scanning of the Y-axis motion stage 422Y on the basis of respective instructions from the computer PC. - The mechanism for driving the
X-axis motion stage 422X and the Y-axis motion stage 422Y may be, for example, a combination of a motor and a ball screw. - As described above, the computer PC controls the scanning of the
X-axis motion stage 422X and the Y-axis motion stage 422Y, and in addition, as described later, it also controls the detection system of the cells CE, performs analysis of the images of the cells CE, and so on and controls theX-axis motion stage 422X, the Y-axis motion stage 422Y, the detection system, and the analysis system in a coordinated fashion. - A
condenser lens 434 that focuses the light emitted from thetransmission light source 423 onto the cells CE is disposed between thetransmission light source 423 and theincubator box 500. - A
shutter 435 may be disposed between thecondenser lens 434 and theincubator box 500, or theshutter 435 may be omitted. - The
fan 424 is disposed on the wall of theinsulated compartment 421. Operating thisfan 424 causes air convection inside theinsulated compartment 421, which enables the temperature inside theinsulated compartment 421 to be easily kept uniform and constant. - The
UV lamp 425 is connected to a UV-lamp switch 436 disposed on the wall of thedetection unit 420, and acontrol timer 437 that periodically operates theUV lamp 425 is disposed between theUV lamp 425 and the UV-lamp switch 436. Furthermore, a sterilization-in-progress indicator lamp (not shown) for indicating that theUV lamp 425 is turned on is provided. - For example, if the UV-
lamp switch 436 is pressed when not measuring the cells CE, thetimer 437 commences counting and power is supplied to theUV lamp 425 to irradiate the interior of theinsulated compartment 421 with UV light (ultraviolet light). At the same time, the sterilization-in-progress indicator lamp is illuminated. Then, after a predetermined amount of time (for example, 30 minutes), thetimer 437 finishes counting, thetimer 437 stops supplying power to theUV lamp 425, and the UV irradiation is stopped. Also, the sterilization-in-progress lamp is turned off. - The
UV lamp 425 can be controlled independently of the main power-supply switch 428 so that it can be operated even if the main power-supply is off. - The illumination time of the
UV lamp 425 may be 30 minutes, as described above. Alternatively, an illumination time less than 30 minutes or more than 30 minutes may also be used so long as contamination and so forth inside theinsulated compartment 421 can be completely killed. - The
door 427 is formed of a metal such as aluminum or the like that has been subjected to anodizing, or it may be formed of a translucent resin with high opacity. - The
door 427 may have a double-layer construction with an air gap, or the inside may be formed of metal and the outside formed of resin. Using resin on the outside of thedoor 427 can prevent heat from inside theinsulated compartment 421 from escaping through thedoor 427. Also, forming the inside of thedoor 427 of anodized metal can prevent deterioration of the lifetime of thedoor 427 due to theUV lamp 425. - If the
door 427 has a double-layer construction of metal or metal and resin, since light is completely blocked, it is preferable to provide an inspection window at a position where theincubator box 500 can be viewed. The inspection window is preferably formed of transparent resin or glass, and an openable/closable cover is preferably disposed at the outer side thereof. - As shown in
FIGS. 16 and 17 , adetection section 440 includes aheater 440H for keeping the interior of thedetection section 440 at a predetermined temperature; incidentlight sources detection section 440 side; a light-path switching unit 442 that switches the light path from theincident light sources intensity adjusting mechanism 443 that adjusts the intensity of the irradiated light; alens system 444 that focuses the irradiated light towards the cells CE; afilter unit 445 that controls the wavelength of the irradiated light and the wavelength of the detection light; an autofocus (AF)unit 446 that performs a focusing operation with respect to the cells CE; arevolver 447 provided with a plurality ofobjective lenses 448 having different magnifications and properties; a detector (imaging unit) 449 that detects detection light from the cells CE; a light-intensity monitor 450 that measures the intensity of the detection light; afan 451 that makes the temperature inside thedetection section 440 uniform; and a coolingfan 452 that cools the interior of thedetection section 440. - The incident light sources (illumination unit) 441A and 441B, which are formed of mercury lamps, for example, are disposed outside the
detection section 440 and are connected to apower supply 453 that supplies power thereto. - Normally, a single incident light source, for example, the incident
light source 441A, is used; however, if the intensity of the incidentlight source 441A falls below a certain prescribed value, light is irradiated from the other incidentlight source 441B and the power supply to the first incidentlight source 441A is turned off. - The light-
path switching unit 442 is configured to guide illumination light from either the incidentlight source 441A or the incidentlight source 441B to the light-intensity adjusting mechanism 443. Also, the light-path switching unit 442 is provided with a light-path control unit 454, which is connected to the computer PC (described later) for controlling the light-path switching unit 442 on the basis of an instruction from the computer PC. - At the emitting side of the light-
path switching unit 442 where the illumination light is emitted, ashutter 442S that controls the transmission and blocking of the illumination light is provided. - The light-
intensity adjusting mechanism 443, which is disposed at the emission side of theshutter 442S where the illumination light is emitted, adjusts the intensity of the illumination light passing through theshutter 442S. A known aperture mechanism, for example, may be used, or any other known mechanism or technique that can adjust the light intensity may be used. - The light-
intensity adjusting mechanism 443 is provided with a light-intensity control unit 455, which is connected to the computer PC (described later) for controlling the light-intensity adjusting mechanism 443 on the basis of an instruction from the computer PC. - The
lens system 444 is disposed at the emission side of the light-intensity adjusting mechanism 443 where the illumination light is emitted. Thelens system 444 includes a pair oflenses stop 444C disposed between thelens 444A and thelens 444B. - The
filter unit 445 includes anexcitation filter 456, adichroic mirror 457, and anabsorption filter 458. Theexcitation filter 456 is a filter that transmits wavelengths which contribute to the generation of fluorescence in the cells CE (excitation light) from among the illumination light and is disposed so that the illumination light emitted from thelens system 444 is incident on theexcitation filter 456. Thedichroic mirror 457 is an optical element that splits excitation light and fluorescence. More specifically, thedichroic mirror 457 is disposed so as to reflect excitation light transmitted through theexcitation filter 456 towards the cells CE and to transmit fluorescence from the cells CE. Theabsorption filter 458 is an optical element that separates fluorescence from the cells CE from other unwanted scattered light. Theabsorption filter 458 is disposed so that light transmitted through thedichroic mirror 457 is incident thereon. - The
filter unit 445 is provided with afilter control unit 446C that controls the wavelengths of the excitation light emitted from thefilter unit 445 and the detection light (fluorescence) on the basis of instructions from the computer PC (described later). - One
excitation filter 456, onedichroic mirror 457, and oneabsorption filter 458 may be used, or alternatively, a plurality of each may be used. - The
AF unit 446 is disposed at the emission side of thefilter unit 445 where the excitation light is emitted and is disposed so that the excitation light is focused onto the cells CE via one of theobjective lenses 448, on the basis of an instruction from the computer PC (described later). - The
revolver 447 is disposed at the emission side of theAF unit 446 where the excitation light is emitted and is provided with the plurality ofobjective lenses 448 having different magnifications. Therevolver 447 is provided with an objective-lens control unit 459 which selects and controls theobjective lens 448 on which the excitation light is incident, on the basis of an instruction from the computer PC (described later). - The
objective lenses 448 are configured to allow examination, from thedetection section 440, of the interior of the incubator box inside theinsulated compartment 421 via holes provided in theX-axis motion stage 422X and the Y-axis motion stage 422Y. - The holes in the
X-axis motion stage 422X and the Y-axis motion stage 422Y are large enough to allow viewing over the operating region of the stage, with some additional margin. - Therefore, although the ambient air inside the
insulated compartment 421 should be kept at a humidity suitable for culturing cells, the ambient air may escape to thedetection section 440 through the holes, which makes it impossible to maintain the temperature suitable for culturing cells, and therefore, there is a risk of bringing about a reduction in cell activity. - Thus, a
containment mechanism 449 for suppressing the passage of such ambient air, which is at a temperature suitable for cell culturing, between theinsulated compartment 421 and thedetection section 440. - The
containment mechanism 449 should be capable of suppressing the flow of air while not interfering with the operation of therevolver 447 and theobjective lenses 448. For example, it may be a sheet-like mechanism in which, for example, a sheet formed of a flexible material, such as a film or transparent sheet, is attached to the perimeter of a hole provided at the boundary between theinsulated compartment 421 and thedetection section 440 and in such a manner that it is draped around the perimeter of the revolver. - A focusing
lens 460 that focuses the detection light onto thedetector 449 and the light-intensity monitor 450 is provided at the emission side of thefilter unit 445 where the detection light is emitted. - A half-
mirror 461 that reflects some of the detection light towards thedetector 449 and that transmits the remaining detection light towards the light-intensity monitor 450 is provided at the emission side of the focusinglens 460 where the detection light is emitted. - The
detector 449 is disposed at a position where the detection light reflected from thehalf mirror 461 is incident thereon. Also, adetector calculation unit 462 that calculates a detection signal from thedetector 449 and outputs it to the computer PC (described later) is connected to thedetector 449. - The
detector 449 is not particularly limited and may use a line sensor, an area sensor, or both a line sensor and an area sensor. - The light-
intensity monitor 450 measures the detection light transmitted through the half-mirror 461 and is configured so as to output the measured value to the computer PC. - The intensity of the detection light may be measured using the light-
intensity monitor 450, as described above, or alternatively, the intensity of the detection light may be measured using an illuminance meter or a power meter. - The
heater 440H controls the temperature inside thedetection section 440 to be from 30° C. to 37° C. Thefan 451 is disposed to cause air convection inside thedetection section 440 to make the temperature inside thedetection section 440 uniform. Therefore, the temperature inside thedetection section 440 can be maintained close to the temperature in theinsulated compartment 421, and the temperature in theinsulated compartment 421 can thus be more easily stabilized. - The cooling
fan 452 is operated to reduce the temperature inside thedetection section 440 on the basis of the output from a temperature sensor (not shown) provided inside thedetection section 440. Therefore, it is possible to prevent an abnormal rise in temperature inside thedetection section 440 due to heating by, for example, the motors and so forth. -
FIG. 32 is a perspective view of the incubator box according to this embodiment, andFIG. 33 is a cross-sectional view of a chamber according to this embodiment. - As shown in
FIGS. 32 and 33 , theincubator box 500 includes aframe 501, containing a chamber (object under examination) 510, and acover 502 that forms a sealed space together with theframe 501. Theframe 501 and thecover 502 are subjected to magnetic-shielding treatment for blocking external magnetic fields and anti-static treatment for eliminating the build-up of static electricity in theincubator box 500. - The
frame 501 is formed of abase plate 503 andside walls 504, and a region corresponding to the measurement area of thebase plate 503 is formed of a transparent material, such as glass. The other regions of thebase plate 503 and theside walls 504 are preferably formed of an anti-corrosive material having high opacity, such as anodized aluminum or stainless steel, like SUS316. More preferably, from the viewpoint of maintaining the temperature, a material having a low thermal conductivity may be selected. - An
adaptor 505 for holding thechamber 510 and atemperature sensor 506 for measuring the temperature of thechamber 510 are provided on thebase plate 503. Thechamber 510 may be held using theadaptor 505, as described above, or thechamber 510 may be held without using theadaptor 505. - The output from the
temperature sensor 506 is input to the computer PC via an incubator-temperature detection unit 506S and is also input to a temperature-display unit 507 disposed on the wall of thedetection unit 420. The computer PC controls theheater 421H and so on via an incubator-temperature control unit 506C shown inFIG. 17 to control the temperature inside theincubator box 500 in order to keep it constant. - The
cover 502 includes aglass plate 517 that transmits the illumination light and asupport portion 517A that supports theglass plate 517. An anti-reflection film may be formed on both sides of theglass plate 517 in a region corresponding to the measurement area. Forming such an anti-reflection film on both sides allows prevention of reflection by theglass plate 517 during transmission examination and incidence examination. - The area of the
glass plate 517 may be substantially the same as that of thebase plate 503 of theincubator box 500, or it may be the minimum necessary area that does not cause any problem during measurement. - As shown in
FIG. 33 , thechamber 510 is formed of alower glass member 511 for observation with theobjective lens 448, anupper glass member 512 for transmitting light from thetransmission light source 423, and aframe member 513 that supports thelower glass member 511 and theupper glass member 512. -
Joints 514 having channels formed therein for circulating culture fluid are formed at opposing sides of theframe member 513. A culture-fluid circulating tube 477 (described later) is connected to thejoints 514, for allowing culture fluid to circulate between theculture unit 470 and thedetection unit 420. - A pair of
flow smoothers 515 for making the flow of culture fluid uniform are disposed in theframe member 513 so as to be substantially orthogonal to the flow of culture fluid. Theflow smoothers 515 are formed of sheet members in which, for example, small holes are formed in a matrix, and by splitting the culture fluid and flowing it through the plurality of small holes, the flow becomes uniform. Aslide glass 516 on which the cells CE are disposed is provided between the twoflow smoothers 515. - As described above, the
incubator box 500 may be provided with thechamber 510 inside, or, as shown inFIG. 34A , a microplate (object under examination) 520 (or a well plate) may be disposed inside. - In this configuration, as shown in
FIG. 34A , theframe 501 of anincubator box 500 a is provided with a square-shapedreservoir 521 surrounding themicroplate 520, aninternal fan 522 disposed at the inner side of thereservoir 521, aconnector 523 for supplying culture gas, and a culture-gas concentration sensor 524 for detecting the concentration of carbon dioxide in the culture gas. - The
temperature sensor 506 is disposed so as to measure the temperature of themicroplate 520. The microplate temperature input to the computer PC from thetemperature sensor 506 is collected in the form of text data in a memory and can be subjected to data processing in the computer PC. - The culture-
gas concentration sensor 524 outputs the carbon-dioxide concentration to the computer PC and to a culture-gasconcentration display unit 524D. - The height of side walls 521W of the
reservoir 521 is formed to be lower than the height of the side walls of theframe 501. Also, the positional relationship with respect to theconnector 523 is adjusted so that the supplied culture gas blows against the side walls 521W. Sterilized water is stored in thereservoir 521, and the humidity inside theincubator box 500 a is regulated at about 100%. - The
internal fan 522 is disposed so that themicroplate 520 is not positioned in the blowing direction thereof and so that it blows along the side walls 521W of thereservoir 521. - The culture-
gas concentration sensor 524 may be disposed on the inner surface of one of the side walls 521W of thereservoir 521. Alternatively, the tubes from theincubator box 500 a may be disposed outside and the culture gas inside theincubator box 500 a may be evacuated with a suction pump to detect the concentration thereof with the culture-gas concentration sensor 524. - When using this kind of
incubator box 500 a, the destination of the culture gas supplied from a culture-gas mixing tank 491 (described later) is changed from aculture fluid vessel 472 to theincubator box 500 a, and because it is not necessary to supply culture fluid from theculture unit 470, the operation of a culture-fluid pump 480 or the like can be stopped. - With such a construction, since the humidity environment and culture-gas concentration in the
incubator box 500 a are maintained so that little damage is caused to the cells CE by changes and non-uniformity in the humidity and culture-gas concentration, damage to the cells CE can be reduced compared to a thermal environment. - Also, because the humidity and culture-gas concentration in the
incubator box 500 a, which is not directly in contact with thedetection section 440, are maintained, it is possible to prevent contamination during examination. - Furthermore, since it is not necessary to maintain the proper humidity and culture-gas concentration when culturing the cells CE in the
insulated compartment 421, the performance of theobjective lenses 448 and so on disposed in theinsulated compartment 421 can be prevented from deteriorating. Thus, a reduction in lifetime of theobjective lenses 448 and so on can be prevented. - The
chamber 510 may be a sealed enclosure, as described above, or it may be an open chamber that is not sealed. Such an open chamber is formed with the same construction as thechamber 510 except for the provision of theupper glass member 512. - When using such an open chamber, using the
incubator box 500 described above, theincubator box 500 a is filled with the culture gas and the open chamber is supplied with culture liquid. - As shown in
FIG. 34B , thechamber 510 described above may also be used in theincubator box 500 a. In such a case, theconnector 523 for supplying culture gas is blocked off, and the culture-gas concentration sensor 524 is not used. If the size of thechamber 510 is different from that of themicroplate 520, thechamber 510 may be placed in theincubator box 500 a using anadaptor 505. Sterilized water need not be placed in thereservoir 521; in fact, thereservoir 521 itself may be eliminated from theincubator box 500 a. Also, thetemperature sensor 506 measures the temperature in thechamber 510. - The
connector 523 may be blocked off, as described above, or it may be left connected to the culture-gas supply tube 497 and the supply of culture gas to theincubator box 500 a simply stopped. - As shown in
FIGS. 16 and 17 , theculture unit 470 includes a sterilizedcompartment 471 containing the culture fluid and amixing section 490 for producing the culture gas. - The
sterile compartment 471 includes aheater 471H for keeping the interior of thesterile compartment 471 at a predetermined temperature; a culture-fluid vessel 472 for storing the culture fluid; anauxiliary tank 473 for storing spare culture fluid; awaste tank 474 into which used culture fluid is discharged; aUV lamp 425 for sterilizing the interior of thesterile compartment 471; adoor 475 used when putting the culture-liquid vessel 472 into thesterile compartment 471 and when removing it therefrom; and a main power-supply switch 476 for turning on and off the main power supply for theculture unit 470. - The culture-
fluid vessel 472 is provided with a culture-fluid circulating tube 477 for circulating culture fluid between the culture-fluid vessel 472 and theincubator box 500; asupply tube 478 for supplying spare culture fluid from theauxiliary tank 473; and awaste tube 479 for discharging used culture fluid from the culture-fluid vessel 472 to thewaste tank 474. - A culture-
fluid pump 480 for delivering culture fluid from the culture-fluid vessel 472 to theincubator box 500 and circulating the culture fluid is provided for the culture-fluid circulating tube 477. Using the culture-fluid pump 480, it is possible to replace the culture fluid in thechamber 510 with fresh culture fluid, and therefore, the cells CE can be cultured for a longer period of time compared to a case where the culture fluid is not replaced. - A
supply pump 481 for transferring culture fluid from theauxiliary tank 473 to the culture-fluid vessel 472 is provided for thesupply tube 478. In addition, awaste pump 482 for transferring the used culture fluid from the culture-fluid vessel 472 to thewaste tank 474 is provided for thewaste tube 479. - As described above, the
waste tank 474 for storing the used culture fluid may be used. Alternatively, instead of using thewaste tank 474, a discharge port for directly discharging the used culture fluid may be provided. - A culture-fluid temperature sensor (not shown) for detecting the culture-fluid temperature is provided in the culture-
fluid vessel 472, and the output from the culture-fluid temperature sensor is input to the computer PC via a culture-fluid temperature detector 483. Data concerning the culture-fluid temperature input to the computer PC is collected in a memory in the form of text data and is used when comparing and verifying the detection results of the cells CE. - The
heater 471H is provided with a culture-fluid temperature controller 484 that controls the temperature of the culture fluid via the temperature inside the sterilizedcompartment 471, on the basis of an instruction from the computer PC. The temperature of the culture fluid supplied from the culture-fluid vessel 472 is held at about 37° C. by the culture-fluid temperature controller 484, which prevents the activity of the cells CE from dropping due to temperature changes of the culture fluid. Also, atemperature display unit 485 for displaying the culture-fluid temperature detected by the culture-fluid temperature sensor is provided on the wall of theculture unit 470. - The culture-
fluid pump 480 is provided with a culture-fluid-pump controller 486 for controlling the circulation of the culture fluid on the basis of an instruction from the computer PC. The operation of thesupply pump 481 and thewaste pump 482 is also controlled on the basis of instructions from the computer PC. - The
UV lamp 425 is connected to a UV-lamp switch 436 disposed on the wall of theculture unit 470, and atimer 437 for periodically controlling the operation of theUV lamp 425 is provided between theUV lamp 425 and the UV-lamp switch 436. Furthermore, a sterilization-in-progress indicator lamp (not shown) for indicating that theUV lamp 425 is illuminated is also provided. - The
UV lamp 425 is controlled independently of the main power-supply switch 476 and can be operated even when the main power-supply switch 476 is off. - As shown in
FIGS. 16 and 17 , themixing section 490 includes a heater (not shown) for keeping the interior of themixing section 490 at a predetermined temperature; a culture-gas mixing tank 491 for adjusting the carbon-dioxide concentration in the culture gas supplied to theincubator box 500; and a CO2-pump 493 for supplying carbon dioxide from a CO2 tank 492 provided outside theculture unit 470 to the culture-gas mixing tank 491. - A CO2-concentration detector 494 is provided in the culture-
gas mixing tank 491 for detecting the concentration of carbon dioxide therein, and the output from the CO2-concentration detector 494 is input to the computer PC. The CO2 pump 493 is provided with a CO2-concentration controller 495 for controlling the amount of carbon dioxide supplied to the culture-gas mixing tank 491 on the basis of an instruction from the computer PC. Also, a CO2-concentration display unit 496 for displaying the carbon-dioxide concentration inside the culture-gas mixing tank 491, which is detected by the CO2-concentration detector 494, is provided on the wall of theculture unit 470. - Furthermore, a culture-
gas supply tube 497 is provided between the culture-gas mixing tank 491 and the culture-fluid vessel 472. Accordingly, culture gas is supplied to the culture fluid via the culture-gas supply tube 497, which allows a sufficient level of culture gas to be dissolved in the culture fluid. In this way, by producing culture fluid in which culture gas having a 5% concentration of carbon dioxide is dissolved inside the culture-fluid vessel 472, culture fluid including culture gas and nutrients necessary for nourishing the cells CE is supplied to thechamber 510. Also, by dissolving the culture gas in the culture fluid, the pH and so forth of the culture fluid can be regulated. - The carbon-dioxide concentration input to the computer PC from the CO2-concentration detector 494 is collected in the memory in the form of text data, and data processing can be carried out in the computer PC.
- Next, an examination method used in the biological-
specimen examination system 410 having the above-described configuration will be described. - First, the scanning method and selection of a detection region in this embodiment will be described with reference to
FIGS. 35A to 35D. -
FIGS. 35A to 35D depict examples of the scanning method and selection of the detection areas in this embodiment. - In the example shown in
FIG. 35A , a measurement region M (the region surrounded by the dashed line in the figure) is set by specifying an upper-left point a and a lower-right point b defining the measurement region M in the displayed image. More concretely, the measurement region M may be set by dragging a device like a mouse from point a to point b, or it may be specified by inputting the coordinates of the points a and b. - As indicated by the arrows in the figure, regarding the part to be measured by the
detector 449, the specified measurement region M is scanned from left to right. That is, when scanning from the left to the right in the figure, scanning is performed parallel to the X direction, and when scanning from the right to the left, scanning is performed downward and to the left at an angle. While scanning from left to right, image acquisition of the cells CE is carried out. -
FIG. 35B is an example in which two measurement regions M are specified by the method described above. First, the two measurement regions MA and MB are specified using the method described above. The measurement region MA and the measurement region MB are arranged with a certain gap therebetween in the X direction in the figure, and they are disposed so as to completely overlap in the Y direction. - As indicated by the arrows, the part to be measured by the
detector 449 in this example is scanned so as to measure the measurement regions MA and MB in parallel. That is, when scanning from the left to the right in the figure, scanning is performed from the measurement region MA to the measurement region MB, and when scanning from the right to the left, scanning is performed from the measurement region MB to the measurement region MA. -
FIG. 35C is an example in which two measurement regions are set using the method described above. The two measurement regions MA and MB are disposed at different positions. Here, the measurement region MA and the measurement region MB are arranged with a gap therebetween in the X direction in the figure, and they are disposed so that they partially overlap in the Y direction in the figure. - As indicated by the arrows in the figure, regarding the parts to be measured by the
detector 449 in this example, only the portions of the measurement regions MA and MB that overlap in the Y direction are sequentially scanned. That is, first the non-overlapping portion of the measurement region MA is scanned. Next, the overlapping portions of the measurement regions MA and MB are sequentially scanned. Then, the non-overlapping portion of the measurement region MB is scanned. -
FIG. 35D is an example in which two measurement regions M are set by the method described above. In this example, the two measurement regions MA and MB are the same as those inFIG. 35B , but the scanning method is different. - As indicated by the arrows in the figure, regarding the parts to be measured by the
detector 449 in this example, the measurement regions MA and MB are scanned independently. That is, after first scanning the entire measurement region MA, the entire measurement region MB is scanned. - Among the scanning methods shown in
FIGS. 35A to 35D described above, the method with the shortest total distance moved or shortest scanning time is automatically selected by the computer PC on the basis of specified parameters and a measurement mode, which are described later. - When acquiring images of the region where the cells are cultured, it is possible to carry out image acquisition only in the required parts, as necessary, if that region is formed of a plurality of divided regions (detection regions) by, for example, specifying measurement regions M that can be imaged.
- For example, if the settings of the computer PC are changed to alternately scan the entire region and predetermined parts of the object to be scanned, it is possible to observe phenomena unique to biological specimens which occur only for a short time. As one example, in a case where scanning of the entire region of an object is normally performed every 30 minutes, so long as scanning is performed in a predetermined measurement region M where cells of interest exist, it is possible to determine the occurrence of a specific phenomenon that is exhibited only every 15 minutes in those cells of interest.
- In order to scan the desired measurement region M in the required time, the scanning time can be reduced, and the time required to irradiate other cells with light can be reduced.
- Next, the procedure for measuring the cells CE will be described using a flowchart.
- First, before measuring the cells CE, measurement parameters are set. Therefore, the procedure for setting the measurement parameters will be described with reference to
FIG. 36 . -
FIG. 36 is a flowchart showing the procedure for setting the measurement parameters. - First, the measurement parameters are set (step S21).
- Then, default conditions are set (step S22). Here, the conditions set are the culturing conditions and the measurement conditions, for example, a CO2 concentration of 5%, a temperature of 37° C., and so forth. These conditions can be changed to predetermined conditions by the user.
- Next, the measurement object is selected (step S23). Measurement object means the container of the cells CE, for example, the
microplate 520 or theslide glass 516. - Next, the measurement mode is selected (step S24). Possible measurement modes include an area acquisition mode, a line acquisition mode, an automatic mode, and so on. In the automatic mode, the measurement mode having the shortest measurement time is automatically selected from among the other modes.
- Next, the measurement magnification is selected (step S25), and after that, the detection wavelength is selected (step S26). The measurement magnification and the detection wavelength can each be automatically selected from among two or more options.
- Here, as the method of selecting the detection wavelength, a list of fluorescent proteins used, for example, GFP, HC-Red, and so on, is stored in advance in the computer PC, and one of them is selected from the stored list. The computer PC automatically selects the most
appropriate excitation filter 456,absorption filter 458, and so on for examination, on the basis of the selected fluorescent protein. In this way, specific fluorescence from the cells CE can be detected. - The
excitation filter 456, theabsorption filter 458, theobjective lens 448 and so on used for measurement are automatically changed in synchronization with the driving of theX-axis motion stage 422X and the Y-axis motion stage 422Y. - Next, the measurement interval is set (step S27).
- Then, a preview image is acquired (step S28), and the preview image is displayed on the monitor (step S29). In the latter step, the preview image is displayed on the monitor when the user issues an instruction using a preview button or the like for instructing display of the preview image on the monitor. Thus, the user can confirm the preview image displayed on the monitor.
- Next, the measurement region is selected (step S30). After selecting the measurement region, the preview image may be displayed on the monitor again to confirm whether the measurement region has been correctly selected.
- Next, a predetermined measurement interval is selected from a plurality of specified measurement intervals (step S31).
- Then, upon pressing a start-measurement switch (not shown; step S32), measurement of the cells CE commences (step S33). If the start-measurement switch is not pressed, the process stands by until the start-measurement switch is pressed (step S32).
- If the start-measurement switch is not pressed in step S32, the process may jump back to any predetermined step to allow the measurement parameters to be set again.
- After the measurement parameters have been set, measurement of the cells CE is carried out. Therefore, the procedure for measuring the cells CE will be described with reference to
FIGS. 37 and 38 . -
FIGS. 37 and 38 are flowcharts showing the measurement procedure. - First, when measurement starts, the measurement region is retrieved (step S41). Then, the magnification is retrieved (step S42), and the detection wavelength is retrieved (step S43).
- Next, the measurement mode is retrieved (step S44). Here, the appropriate stage scanning method is determined on the basis of the retrieved measurement region, magnification, detection wavelength (fluorescence wavelength), and so on. If the measurement mode is set to the automatic mode, the image acquisition mode is also determined at this point.
- Next, the method of operating the
X-axis motion stage 422X and the Y-axis motion stage 422Y in accordance with the determined stage scanning mode is analyzed (step S45), and data for the analyzed operating method (operating data) is saved in a table in the computer PC (step S46). - Thereafter, measurement is carried out using a different measurement method depending on whether or not the area sensor mode is selected (step S47).
- First, a description will be given in the case where the area sensor mode is selected.
- When the start-measurement switch is pressed, the
X-axis motion stage 422X and the Y-axis motion stage 422Y are moved to a measurement starting position (S50). In this step, the computer PC retrieves the measurement starting position which has been input and moves theX-axis motion stage 422X and the Y-axis motion stage 422Y to the measurement starting position, and the cells CE are thus moved to a position within the imaging field of theobjective lens 448. - Then, the
shutter 435 is opened (step S51) and theobjective lens 448 is selected (step S52). Here, the computer PC drives therevolver 447 to select anobjective lens 448 having a predetermined magnification on the basis of the specified measurement magnification. - Next, the
filter unit 445 is selected (step S53). Here, thefilter control unit 446C selects theexcitation filter 456, theabsorption filter 458, and so on that are most appropriate for the measurement on the basis of the fluorescent protein specified in the computer PC. - The operations carried out from when the start-measurement switch described above is pressed up to this point (steps S50 to S53) are automatically selected and executed according to the measurement mode.
- After that, the focus position is detected (step S54), and then image acquisition is performed and the image data is output to an image memory in the computer PC (step S55).
- Then, if the required image acquisition has not yet been completed, the operations from selection of the objective lens 448 (step S52) to image acquisition and output of the image data to the image memory in the computer PC (step S55) are repeated until the required image acquisition is completed (step S56).
- When the required image acquisition has been completed, the
X-axis motion stage 422X or the Y-axis motion stage 422Y is driven by one step (step S57). Then, if the position to which theX-axis motion stage 422X or the Y-axis motion stage 422Y has been moved is within the measurement region, the operations from selection of the objective lens 448 (step S52) to driving the motion stage by one step (step S57) are repeated. These operations are repeated until the position to which theX-axis motion stage 422X or the Y-axis motion stage 422Y has been moved is outside the measurement region (step S58). - When the position of the
X-axis motion stage 422X or the Y-axis motion stage 422Y is outside the measurement region, theshutter 435 is closed (step S59). - Thereafter, once the predetermined measurement time interval is over, the operations from opening of the shutter 435 (step S51) to closing of the shutter 435 (step S59) are repeated until the end of the measurement time (step S60).
- Next, a case where the area sensor mode is not selected shall be described.
- When the start-measurement switch is pressed, the
x-axis motion stage 422X and the Y-axis motion stage 422Y are moved to the measurement starting position (step S70). Here, the computer retrieves the measurement start position that was input and moves theX-axis motion stage 422X and the Y-axis motion stage 422Y to the measurement starting position to move the cells CE to a position within the imaging field of theobjective lens 448. - Then, the
shutter 435 is opened (step S71), and the focus position is detected (step S72). - Next, the
objective lens 448 is selected (step S73). Here, the computer PC drives therevolver 447 to select anobjective lens 448 having a predetermined magnification, on the basis of the specified measurement magnification. - Next, the
filter unit 445 is selected (step S74). Here, thefilter control unit 446C selects theexcitation filter 456, theabsorption filter 458, and so on that are most appropriate for the measurement on the basis of the fluorescent protein specified in the computer PC. The operations carried out from when the start-measurement switch is pressed up to this point (steps S70 to S74) are automatically selected and executed according to the measurement mode. - After that, driving of the
X-axis motion stage 422X and the Y-axis stage 422Y commences (step S75), and then image acquisition is performed and the image data is output to an image memory in the computer PC (step S76). - Then, if the required image acquisition has not yet been completed, the operations from selection of the objective lens 448 (step S73) to image acquisition and output of the image data to the memory in the computer PC (step S76) are repeated until the required image acquisition is completed (step S77).
- When the required image acquisition has been completed, the
shutter 435 is closed (step S78). - Thereafter, once the predetermined measurement time interval is over, the operations from opening of the shutter 435 (step S71) to closing of the shutter 435 (step S78) are repeated until the end of the measurement time (step S79).
- When image acquisition of the cells CE has been completed, the acquired images are then processed. Therefore, the method of processing the acquired images will be explained with reference to
FIG. 39 . -
FIG. 39 is a flowchart showing the image processing method. - First, the image processing unit of the computer PC extracts the background image from the acquired images collected in the memory (step S91), and removes the background image from the acquired images (step S92).
- Next, the maximum brightness region of the image, which can be enhanced, is read out (step S93) and multiplied by, for example, a predetermined coefficient to enhance the image (step S94). With this processing, the image is enhanced so that the individual cells CE can easily be recognized as spots in the image from which the background is removed.
- Then, by extracting portions having a brightness higher than, for example, a predetermined threshold from the enhanced image, the bright cells CE can be clearly recognized as individual spots (step S95).
- Next, geometrical features, such as the center of gravity and the area, chemical features, and optical features, such as the fluorescence intensity, of the cells CE are more accurately determined, and positional information of the cells CE is determined and extracted (step S96). Extracting these features allows the individual cells CE to be distinguished.
- After extracting the features of the cells CE, correction (step S97) of the enhancement (S94) carried out for recognizing the cells CE is carried out. With this correction, the effect of the predetermined coefficient used for enhancing the image is removed.
- Next, after correction, the features are output to a file, for example, and are stored in that file (step S98).
- Accordingly, the image processing unit of the computer PC can convert the fluorescence distribution of the cells CE at each position on the entire surface of the slide glass, microplate, or the like into an image. Also, since the image processing unit can accurately track the individual cells CE, it can target a predetermined number of cells CE, which allows localized, long-term measurement of the fluorescence distribution of the cells CE while performing culturing. Furthermore, while culturing the cells CE, the entire surface of the slide glass, microplate, or the like is measured at fixed time intervals, for example, and the fluorescence intensity of the cells CE over time can be automatically measured.
- Next, data processing carried out after extracting data about the features of the cells CE from the acquired images will be described with reference to
FIG. 40 . -
FIG. 40 is a flowchart depicting the data processing procedure. - Here, processing of the cell data (features) stored in the file is carried performed by a data processing unit of the computer PC.
- First, the data processing unit reads out (step S101) raw data (features) of the cells CE, which is stored in the file, and sorts the data to arrange it time-sequentially for each cell CE (step S102). When the data has been sorted, the data processing unit graphs the variation in brightness of each cell CE, that is, the level of expression, with time (step S103).
- When the graphing has been completed, the data processing unit displays a preview of the graph (step S104), and outputs the graph data to a file (step S105).
- By performing this processing, when cells CE are cultured for an extended period of time, the variation of a single cell with time can be easily examined. Therefore, during culturing, the variation in the level of expression of the cells CE with time can be accurately and easily measured.
- Next, adjustment of the irradiation intensity carried out during measurement of the cells CE will be explained with reference to
FIG. 41 . -
FIG. 41 is a flowchart showing the procedure for adjusting the intensity. - First, the intensity of light irradiated onto the cells CE is measured (step S111). The irradiation intensity may be calculated from the output of the light-
intensity monitor 450, by providing an irradiance meter for measuring the intensity, or by providing a power meter and calculating the intensity from the output of the power meter. - If the measured irradiation intensity is within a permissible range, the process returns to measurement of the irradiation intensity (step S111) and repeats this until the irradiation intensity is outside the permissible range (step S112).
- Once the irradiation intensity is outside the permissible range, the ND filter (not shown) included in the light-
intensity adjusting mechanism 443 is changed (step S113) to adjust the irradiation intensity so that it falls within the permissible range. Thereafter, the process returns to measurement of the irradiation intensity (step S111), and repeats the adjustment of the irradiation intensity. - Next, a control method for supplying and replacing the culture fluid in the
chamber 510 is described with reference toFIG. 42 . -
FIG. 42 is a flowchart showing the method for supplying and replacing the culture fluid. - First, the background level of the acquired image is analyzed (step S121). The autofluorescence of the culture fluid in the background of the acquired image is acquired, and the brightness of this autofluorescence is analyzed.
- Here, since the brightness of this autofluorescence increases as the culture fluid ages, the point at which the culture fluid should be replaced can be detected by measuring the brightness of this autofluorescence.
- Then, if the temporal variation in the analyzed background level is within a predetermined level, the process returns to analysis of the background level (step S121) and repeats this until the temporal variation of the background level exceeds the predetermined level (step S122).
- Once the temporal variation of the background level exceeds the predetermined value, the
waste pump 482 for the culture fluid is operated (step S123), and then, thesupply pump 481 for the culture fluid is operated (step S124). - The intervals at which the culture fluid should be supplied and replaced may be determined on the basis of the autofluorescence of the culture fluid, as described above. Alternatively, the culture fluid may be supplied/replaced continuously, or automatically at intervals specified in advance by the user. Alternatively, the point at which the culture fluid should be replaced can be specified at will by selecting the type of cells CE from a table that is registered in advance. In addition, the amount of culture fluid to be replaced may be specified by the user or may be determined on the basis of the autofluorescence of the culture fluid. Alternatively, the amount of culture fluid to be replaced can be specified at will by selecting the type of cells CE from a table that is registered in advance.
- The amount of culture fluid to be replaced may be calculated and determined automatically using the weight and so on.
- In this embodiment, the level of autofluorescence in the background is detected using the acquired image; however, it may be detected from an acquired image of a location where cells CE do not exist. Alternatively, it may be detected by providing an optical detector in the vicinity of the culture-
fluid vessel 472. - According to the measurement procedure described above, as shown in
FIG. 43 , a cell-tracking image showing the change in position of individual cells over time can be obtained. - Next, the culturing and measurement procedures when using the
microplate 520 will be described with reference toFIGS. 44 and 45 . -
FIGS. 44 and 45 are flowcharts showing the culturing and measurement when using themicroplate 520. - First, sterilized water is supplied to the
reservoir 521 in theincubator box 500 a (step S131). - Next, the PC is started up (step S132), and the main power supplies for the
detection unit 420 and theculture unit 470 are turned on (step S133). - After that, the
internal fan 522 inside theincubator box 500 a is operated (step S134) to circulate the air inside theincubator box 500 a. Then, the CO2-concentration controller 495 is operated (step S135) to regulate the carbon dioxide concentration in the culture gas supplied to theincubator box 500 a at 5%. Thereafter, the temperature controllers are operated (step S136) to regulate the culture-fluid temperature, the culture-gas temperature, and the temperature inside theinsulated compartment 421 at about 37° C. - After that, the
door 427 of thedetection unit 420 is opened (step S137), theincubator box 500 a is placed on the stage 422 (step S138), and thedoor 427 is closed (step S139). - Next, the
transmission light source 423 is turned on (step S140) to irradiate the cells CE with transmission light, and the measurement conditions are set (step S141). - Then, by pressing the start-measurement button (step S142), measurement of the cells CE commences.
- First, scanning is carried out beforehand on predetermined cells CE to perform autofocusing (step S143), and once the focus position of each part has been determined, the
shutter 435 is opened (step S144). - Next, an image of the cells CE is acquired and output (step S145). Here, the acquired image data is output to the memory of the computer PC.
- Then, if the required image acquisition has not yet been completed, the operations from the autofocusing (step S143) to the image acquisition and outputting (step S145) are repeated until the required image acquisition has been completed (step S146). Here, the required images are, for example, the images acquired using the selected wavelength, the images acquired using the selected magnification, and so forth.
- Once the required image acquisition has been completed, the
X-axis motion stage 422X or the Y-axis motion stage 422Y is driven by one step (step S147). Then, if the position to which theX-axis motion stage 422X or the Y-axis motion stage 422Y has moved is within the measurement region, the operations from the autofocusing (step S143) to driving of the motion stage by a single step (step S147) are repeated. These operations are repeated until the position to which theX-axis motion stage 422X or the Y-axis motion stage 422Y has moved is outside of the measurement region. - When the position to which the
X-axis motion stage 422X or the Y-axis motion stage 422Y has moved is outside the measurement region, theshutter 435 is closed (step S149), and theX-axis motion stage 422X and the Y-axis motion stage 422Y are moved to their home positions (step S150). - Thereafter, after a predetermined measurement interval, the operations from the autofocusing (step S143) to moving the stages to their home positions (step S150) are repeated until the end of the measurement time (step S151).
- Once the measurement time ends (step S152), the
door 427 is opened (step S153), and themicroplate 520 is removed from theincubator box 500 a (step S154). Then, the sterilized water is removed from the reservoir 521 (step S155), and thedoor 427 is closed (S156). - After that, the
UV lamp 425 inside theinsulated compartment 421 is illuminated (step S157) to sterilize the interior of theinsulated compartment 421, and the measurement is thus completed. - As described above, the sterilization may be carried out at the end of the measurement procedure, or alternatively, it may be carried out at the beginning of the measurement procedure to sterilize the
insulated compartment 421 before measurement actually takes place. - The autofocusing may be carried out for each measurement of the cells CE, as described above, but it need not be carried out for each measurement.
- With the configuration described above, since the thermal environment is maintained by the
insulated compartment 421 and the humidity environment and the culture-fluid environment are maintained by thechamber 510 disposed inside theinsulated compartment 421, the humidity environment and the culture-fluid environment are influenced by the thermal environment, and therefore the thermal environment inside thechamber 510 is also maintained. - Accordingly, sudden changes and non-uniformities in the thermal environment, which might cause damage to the cells CE, are moderated via the humidity environment and the culture-fluid environment, and therefore, it is possible to reduce damage caused to the cells CE.
- Also, since the dimensions of the
chamber 510 are small compared to theinsulated compartment 421, it is easier to maintain and control the humidity environment and the culture-fluid environment, thus making it relatively difficult to cause damage to the cells CE. - Since the cells CE can be examined through the
insulated compartment 421, theincubator box 500, and thechamber 510, it is possible to carry out examination while culturing the cells CE, without causing any damage to the cells CE. Accordingly, behavior that the cells exhibit during culturing can be accurately measured over time. - It is possible to measure in real time the reaction of the cells CE in the object under examination while changing the culture conditions. For example, the existence and level of expression of proteins can be measured, and changes in the level of expression with time can be accurately measured.
- Furthermore, deterioration of the activity of the cells CE by handling them in a first examination can be prevented, which enables multiple examinations of the same cells CE. Also, since multiple examinations of the same cells CE can be carried out at intervals, it is not necessary to control the experimental protocol.
- Since the
detection section 440 examines the cells CE in thechamber 510 via theinsulated compartment 421 and theincubator 500, it is not necessary to insert and remove the cells CE from thechamber 510 during examination, and therefore, the cells CE can remain inside thechamber 510 during examination. Accordingly, it is possible to accurately examine the same position in each examination. Also, contamination can be prevented during examination, which can prevent the cells from being stressed. - Furthermore, by controlling the environmental conditions inside the chamber 510 (for example, the combination of carbon dioxide concentration and humidity), it is possible to prevent the performance of the
detection section 440 from deteriorating. - Moreover, since the cells CE are contained inside the
chamber 510, which is disposed inside theinsulated compartment 421 and theincubator box 500, a certain distance can be maintained between the cells CE and the environment outside theincubator box 500 compared to a case wherechamber 510 is not provided. Therefore, it is possible to reduce the effects of electric and magnetic fields from outside theincubator box 500, such as those from the driving motors of theX-axis motion stage 422X and the Y-axis motions stage 422Y and magnets provided in thedoor 427. - Next, an eleventh embodiment will be described with reference to
FIGS. 46A to 48. - The basic construction of the biological-specimen examination system of this embodiment is the same as the tenth embodiment, but the constructions of the detection unit and the culture unit are different from those in the tenth embodiment. Therefore, in this embodiment, only the detection unit and the culture unit will be described using
FIGS. 46A to 48, and a description of the chamber and so on will be omitted. -
FIG. 46A is an elevational view of a biological-specimen examination system 600 of this embodiment, andFIG. 46B is a side view thereof. - As shown in
FIGS. 46A and 46B , the biological-specimen examination system 600 includes an inverted microscope (microscope imaging apparatus) 610 and aculture stage 620. Theinverted microscope 610 and theculture stage 620 may be integrated or they may be constructed so as to be detachable from each other. - If the
culture system 620 can be attached to and detached from theinverted microscope 610, an existing inverted microscope can also be used. In such a case, even though a stage driving motor is disposed in the vicinity of the cells CE due to constraints on the shape and the construction involved with attaching theculture stage 620, for example, the effect of electric and magnetic fields on the cells CE can be suppressed. - Also, when examining the cells CE using the
inverted microscope 610, for example, theculture stage 620 can be attached to theinverted microscope 610; at other times (for example, when culturing the cells CE), theinverted microscope 610 can be removed from the microscope. -
FIG. 47 is a plane view of theculture stage 620, andFIG. 48 is a perspective view of theculture stage 620. - As shown in
FIGS. 46A, 46B , and 47, theculture stage 620 includes aframe 621, openable/closable lid 622 provided on the upper surface of theframe 621, anX-axis motion stage 422X, a Y-axis motion stage 422Y, a small or strip-shapedheater 620H, aheatsink 623, afan 624, and culture-gas supply connector 625. - The
frame 621 is preferably formed of a highly opaque, corrosion-resistant material, such as anodized aluminum or stainless steel, like SUS 316. More preferably, from the viewpoint of thermal insulation, a material having a low thermal conductivity is selected. - The interior of the
frame 621 is divided into ameasurement area 626 for performing examination of cultured cells and anon-measurement area 627 only for culturing cells. Thus, cell culturing is performed in theculture stage 620. Amicroplate 520 that holds the cells is accommodated inside theculture stage 620, and theculture stage 620 is configured so as to allow examination of the cells in the microplate 520 from outside theculture stage 620. In the description given here, themicroplate 520 is used as a culture vessel, as shown inFIGS. 47 and 48 , but a dish or flask may also be used. - The
fan 624 and the culture-gas supply connector 625 are disposed in a side wall in thenon-measurement area 627 in theframe 621. Also, theheater 620H and theheatsink 623 for dissipating heat from theheater 620H are disposed in an area where thefan 624 and the culture-gas supply connector 625 are not disposed (including the measurement area 626). - The
fan 624 causes convection of the air inside theculture stage 620 and is arranged so as not to blow directly onto theincubator box 500 a. - The temperature inside the
culture stage 620 is raised by means of theheater 620H and is regulated at 36.5° C.±0.5° C. - As shown in
FIGS. 47 and 48 , theX-axis motion stage 422X and the Y-axis motion stage 422Y are provided on the bottom surface of theframe 621. TheX-axis motion stage 422X and the Y-axis motion stage 422Y are driven by, for example, motors and ball screws. - A small or strip-shaped heater (not shown) is attached to the Y-
axis motion stage 422Y. The heater is disposed at a position such that themicroplate 520 is uniformly heated. - The
measurement area 626 and thenon-measurement area 627 are formed by dividing the interior of theculture stage 620 in the X-direction by means of atop plate 628 and a pair ofpartition seats 629, which are fixed to theframe 621. The region to the left of thepartition seats 629 inFIG. 47 constitutes themeasurement area 626, and the region to the right constitutes thenon-measurement area 627. - A
partition plate 629 a that is formed in substantially the same shape as the cross-sectional shape of theframe 621 is attached to theX-axis motion stage 422X. - By moving the
X-axis motion stage 422X towards thenon-measurement area 627, side faces at both ends (the ends in the Y-direction) of thepartition plate 629 a come into contact with the partition seats 629, and thepartition plate 629 a is thus positioned so as to divide the space inside theframe 621 into two portions in the left-to-right (X-axis) direction. - Furthermore, since the edge of the
partition plate 629 a at thetop plate 628 is positioned in contact with the lower surface of thetop plate 628, themeasurement area 626 and thenon-measurement area 627 can define two spaces that are separated from each other. - At the upper opening of the
measurement area 626, aglass lid 630 is removably attached to theframe 621 and is disposed so as to cover the upper opening of themeasurement area 626. Theglass lid 630 can be attached by, for example, screwing theglass lid 630 to theframe 621, or by means of a lock mechanism, a hook, a magnet, and so forth. - The
glass lid 630 may be constructed such that the entire surface or substantially the entire surface except for the peripheral frame portion is formed of theglass plate 631, or it may be formed with a minimum possible area so long as it does not obstruct measurement. In order to suppress the reflection of light during transmission examination and incidence examination, it is preferable to use an optical glass material having an anti-reflection film (AR coat) coated on both sides thereof as theglass plate 631. - The anti-reflection film may be coated on both sides of the
glass plate 631, as described above, or it may be coated on only one side of theglass plate 631. - The
glass lid 630 may be removed as required when carrying out various tasks, for example, when changing the objective lens of theinverted microscope 610, when cleaning the inside of themeasurement area 626, and so forth. - The
glass lid 630 may be provided with an observation hole into which the objective lens of theinverted microscope 610 is inserted. Also, a rubber sheet may be disposed in the observation hole to occupy a gap between the objective lens and the observation hole. The sheet is preferably disposed so as to prevent relative motion between the objective lens and theculture stage 620. - At the upper opening of the
non-measurement area 627, the openable/closable lid 622 is attached so that it can be opened and closed by means of a hinge or the like. When closed, one edge of the openable/closable lid 622 is in contact with thetop plate 628 so as to be supported. - The openable/
closable lid 622 is entirely formed of an opaque material (for example, the same material as the frame 621) and is provided with an observation-hole cover 632 that blocks the observation hole or a UV-irradiation-hole cover 633 that blocks a UV irradiation hole, as required. - The observation hole is an opening (window) formed in the openable/
closable lid 622. The observation-hole cover 632 is formed, for example, of a glass plate, a resin plate, or the like having low transmittance and is inserted in the observation hole. Also, the observation-hole cover 632 is formed of the same opaque material as the openable/closable lid 622 and may be attached in such a manner that it can be either detached or opened and closed. - The UV-irradiation-hole is an opening (window) formed in the openable/
closable lid 622. The UV-irradiation-hole cover 633 is formed, for example, of the same opaque material as the openable/closable lid 622 and is attached in such a manner that it can be opened and closed, or detached from the UV irradiation hole. - The UV-irradiation-
hole cover 633 is removed when irradiating the interior of thenon-measurement area 627 with ultraviolet (UV) light to sterilize it. A handheld UV lamp can be used for the UV irradiation. - The
incubator box 500 a, which contains themicroplate 520, is held on the Y-axis motion stage 422Y. Since theincubator box 500 a is the same as that described in the tenth embodiment, the same components are assigned the same reference numerals, and a description thereof shall be omitted. - Culture gas is supplied to the
connector 523 of theincubator box 500 a via a culture-gas supply tube 634 from a culture-gas supply connector 625 of theculture stage 620. - With the configuration described above, since the biological-
specimen examination system 600 according to the present invention includes the integratedinverted microscope 610, a biological specimen can be examined using theinverted microscope 610. Therefore, more detailed examination can be carried out compared to a case where theinverted microscope 610 is not provided. - When measuring and culturing the cells, in order that the cells are not affected by ambient light, the entire biological-
specimen examination system 600 may be surrounded with a blackout curtain. - Also, instead of cells, the biological specimen to be measured may be various other types of biological specimen, such as bacteria, microorganisms, ova, and so forth.
- With the biological-specimen examination system of this embodiment, since it is possible to reduce the image acquisition time, special phenomena that occur in the biological specimen only for a short time can be observed, and the accuracy of the examination results of the biological specimen can be improved.
- Furthermore, with the biological-specimen examination system of this embodiment, an advantage is afforded in that, even when the brightness of the biological specimen changes over time, it is possible to effectively observe such changes in the biological specimen over time. Also, it is possible to accurately examine a wide range of biological specimens, from specimens having low brightness to specimens having high brightness.
- Moreover, with the biological-specimen examination system of this embodiment, since the time required for measuring the measurement region once can be shortened, the motion of the biological specimen in part of the measurement region does not vary substantially over time. Thus, the accuracy of the examination results when examining the biological specimen over time can be improved.
Claims (1)
1. A microscope imaging apparatus comprising:
a stage that holds an object under examination;
an illumination unit that illuminates the object under examination, the illumination unit includes a first objective lens and a second objective lens that focus light onto the object under examination;
an image-acquisition unit that acquires images of the object under examination;
a motion unit that moves the stage and the image-acquisition unit relative to each other; and
a control unit that controls the image-acquisition unit and the motion unit,
wherein the image-acquisition unit includes an imaging device that is capable of acquiring images with a time delay integration method, and
by performing a prescan of the object under examination to obtain a detected intensity of the object under examination, the control unit determines an exposure time for image acquisition after the prescan on the basis of the detected intensity, and wherein
during the prescan, the first objective lens is disposed in a light path of the illumination unit;
during image acquisition after the prescan, the second objective lens is disposed in the light path of the illumination unit; and
the magnification of the first objective lens is lower than the magnification of the second objective lens.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/655,507 US20070121198A1 (en) | 2004-07-07 | 2007-01-18 | Microscope imaging apparatus and biological-specimen examination system |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004-200954 | 2004-07-07 | ||
JP2004200954A JP3837145B2 (en) | 2004-07-07 | 2004-07-07 | Microscope imaging device |
JP2004200914A JP4020893B2 (en) | 2004-07-07 | 2004-07-07 | Microscope imaging apparatus and biological sample observation system |
JP2004-200866 | 2004-07-07 | ||
JP2004200866A JP2006023491A (en) | 2004-07-07 | 2004-07-07 | Microscopic imaging apparatus and biological material observation system |
JP2004-200914 | 2004-07-07 | ||
US11/173,020 US20060018013A1 (en) | 2004-07-07 | 2005-07-05 | Microscope imaging apparatus and biological-specimen examination system |
US11/655,507 US20070121198A1 (en) | 2004-07-07 | 2007-01-18 | Microscope imaging apparatus and biological-specimen examination system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/173,020 Division US20060018013A1 (en) | 2004-07-07 | 2005-07-05 | Microscope imaging apparatus and biological-specimen examination system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070121198A1 true US20070121198A1 (en) | 2007-05-31 |
Family
ID=35656847
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/173,020 Abandoned US20060018013A1 (en) | 2004-07-07 | 2005-07-05 | Microscope imaging apparatus and biological-specimen examination system |
US11/655,793 Abandoned US20070121200A1 (en) | 2004-07-07 | 2007-01-18 | Microscope imaging apparatus and biological-specimen examination system |
US11/655,512 Expired - Fee Related US7271952B2 (en) | 2004-07-07 | 2007-01-18 | Microscope imaging apparatus and biological-specimen examination system |
US11/655,507 Abandoned US20070121198A1 (en) | 2004-07-07 | 2007-01-18 | Microscope imaging apparatus and biological-specimen examination system |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/173,020 Abandoned US20060018013A1 (en) | 2004-07-07 | 2005-07-05 | Microscope imaging apparatus and biological-specimen examination system |
US11/655,793 Abandoned US20070121200A1 (en) | 2004-07-07 | 2007-01-18 | Microscope imaging apparatus and biological-specimen examination system |
US11/655,512 Expired - Fee Related US7271952B2 (en) | 2004-07-07 | 2007-01-18 | Microscope imaging apparatus and biological-specimen examination system |
Country Status (1)
Country | Link |
---|---|
US (4) | US20060018013A1 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070285768A1 (en) * | 2006-05-24 | 2007-12-13 | Olympus Corporation | Microscope system and method for synthesizing microscopic images |
US20070285769A1 (en) * | 2006-05-24 | 2007-12-13 | Olympus Corporation | Microscope system and method for synthesizing microscopic images |
US20090161929A1 (en) * | 2007-12-21 | 2009-06-25 | Olympus Corporation | Biological specimen observation method |
US10852069B2 (en) | 2010-05-04 | 2020-12-01 | Fractal Heatsink Technologies, LLC | System and method for maintaining efficiency of a fractal heat sink |
US10884227B2 (en) | 2016-11-10 | 2021-01-05 | The Trustees Of Columbia University In The City Of New York | Rapid high-resolution imaging methods for large samples |
US11598593B2 (en) | 2010-05-04 | 2023-03-07 | Fractal Heatsink Technologies LLC | Fractal heat transfer device |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4885646B2 (en) * | 2006-08-14 | 2012-02-29 | オリンパス株式会社 | Cell automatic analysis apparatus and cell automatic analysis method |
US9557217B2 (en) | 2007-02-13 | 2017-01-31 | Bti Holdings, Inc. | Universal multidetection system for microplates |
CN101715564A (en) * | 2007-05-15 | 2010-05-26 | 索尼德国有限责任公司 | Microscope measurement system |
JP5188101B2 (en) | 2007-06-01 | 2013-04-24 | 株式会社キーエンス | Magnification observation apparatus, magnified image photographing method, magnified image photographing program, and computer-readable recording medium |
JP2009063679A (en) * | 2007-09-04 | 2009-03-26 | Olympus Corp | Microscope system |
JP2009253315A (en) * | 2008-04-01 | 2009-10-29 | Panasonic Corp | Solid-state image pickup apparatus, smear correction method and image pickup device |
CN101939636B (en) * | 2008-05-08 | 2013-05-08 | 株式会社日立高新技术 | Automatic analyzer |
GB0814297D0 (en) * | 2008-08-05 | 2008-09-10 | Ge Healthcare Uk Ltd | Microscopy |
EP2344864B1 (en) | 2008-10-24 | 2020-05-06 | Leica Biosystems Imaging, Inc. | Whole slide fluorescence scanner |
TWM354738U (en) * | 2008-11-07 | 2009-04-11 | Shanghai Microtek Technology Co Ltd | Electronic device for biological microscopy |
JP5212122B2 (en) * | 2009-01-09 | 2013-06-19 | ソニー株式会社 | Biological sample image acquisition apparatus, biological sample image acquisition method, and program |
JP5965644B2 (en) | 2009-03-10 | 2016-08-10 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Time-domain multiplexing for imaging using time-delay integrating sensors |
US20110122381A1 (en) * | 2009-11-25 | 2011-05-26 | Kevin Hickerson | Imaging Assembly |
HUP0900431A2 (en) * | 2009-07-10 | 2011-01-28 | Cryo Innovation Kft | Sample imaging system and pocedure for transmitting imager of cells or tissues located in breeder space towards a data processing device |
US20110017915A1 (en) * | 2009-07-23 | 2011-01-27 | Palo Alto Research Center Incorporated | Drift scanner for rare cell detection |
JP5365407B2 (en) * | 2009-08-17 | 2013-12-11 | ソニー株式会社 | Image acquisition apparatus and image acquisition method |
US9066657B2 (en) * | 2010-11-23 | 2015-06-30 | General Electric Company | Methods and systems of optical imaging for target detection in a scattering medium |
US8988740B2 (en) * | 2011-01-04 | 2015-03-24 | Piqx Imaging Pte Ltd | Scanning method and apparatus |
EP2725346B1 (en) * | 2011-06-21 | 2017-03-08 | Hamamatsu Photonics K.K. | Light measurement device, light measurement method, and light measurement program |
JP5869239B2 (en) * | 2011-06-21 | 2016-02-24 | 浜松ホトニクス株式会社 | Light measurement apparatus, light measurement method, and light measurement program |
EP3470906A3 (en) * | 2011-10-11 | 2019-07-10 | Carl Zeiss Microscopy GmbH | Microscope and method of spim microscopy |
DE102013007463A1 (en) | 2013-04-30 | 2014-10-30 | Carl Zeiss Microscopy Gmbh | Device for sterilizing a sample space in a living cell microscope |
JP2015031831A (en) * | 2013-08-02 | 2015-02-16 | オリンパス株式会社 | Cell tracking device and method, and cell tracking program |
US20180080877A1 (en) * | 2015-03-17 | 2018-03-22 | Hamamatsu Photonics K.K. | Device for generating fluorescence image and method for generating fluorescence image |
US10473908B2 (en) * | 2017-04-21 | 2019-11-12 | Shimadzu Corporation | Optical observation device |
CN107367829B (en) * | 2017-08-16 | 2023-10-31 | 桂林优利特医疗电子有限公司 | Single lens light-splitting zoom microscope system |
DE102018128281B3 (en) * | 2018-11-12 | 2019-11-14 | Leica Microsystems Cms Gmbh | Microscope system and method for examining a sample |
GB2597502A (en) | 2020-07-24 | 2022-02-02 | Ffei Ltd | A whole slide imaging method for a microscope |
WO2022032194A1 (en) | 2020-08-06 | 2022-02-10 | Singular Genomics Systems, Inc. | Methods for in situ transcriptomics and proteomics |
WO2022235764A1 (en) * | 2021-05-05 | 2022-11-10 | Singular Genomics Systems, Inc. | Multiomic analysis device and methods of use thereof |
KR20250044428A (en) * | 2022-08-04 | 2025-03-31 | 어플라이드 머티어리얼스, 인코포레이티드 | Multifocal planar scanning using time-delay integrated imaging |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4877326A (en) * | 1988-02-19 | 1989-10-31 | Kla Instruments Corporation | Method and apparatus for optical inspection of substrates |
US5848123A (en) * | 1995-11-21 | 1998-12-08 | Planmed Oy | Methods and apparatus for use in imaging an object |
US20010012069A1 (en) * | 1997-04-07 | 2001-08-09 | Eberhard Derndinger | Confocal microscope with a motorized scanning table |
US20020001759A1 (en) * | 1997-06-27 | 2002-01-03 | Katsuki Ohashi | Method for repairing a photomask, method for inspecting a photomask, method for manufacturing a photomask, and method for manufacturing a semiconductor device |
US20020118359A1 (en) * | 1995-06-06 | 2002-08-29 | Kla-Tencor Technologies Corporation | High throughput brightfield/darkfield wafer inspection system using advanced optical techniques |
US20020167604A1 (en) * | 2001-05-09 | 2002-11-14 | Fanuc Ltd. | Visual sensor |
US6496309B1 (en) * | 1999-06-18 | 2002-12-17 | Genomic Solutions, Inc. | Automated, CCD-based DNA micro-array imaging system |
US6640014B1 (en) * | 1999-01-22 | 2003-10-28 | Jeffrey H. Price | Automatic on-the-fly focusing for continuous image acquisition in high-resolution microscopy |
US20030222197A1 (en) * | 2002-03-13 | 2003-12-04 | Reese Steven A. | Multi-axis integration system and method |
US20040101210A1 (en) * | 2001-03-19 | 2004-05-27 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Miniaturized microscope array digital slide scanner |
US20040106862A1 (en) * | 1999-09-21 | 2004-06-03 | Nikon Corporation | Electron beam apparatus, and inspection instrument and inspection process thereof |
US20040170312A1 (en) * | 2000-05-03 | 2004-09-02 | Soenksen Dirk G. | Fully automatic rapid microscope slide scanner |
US6819416B2 (en) * | 2000-07-27 | 2004-11-16 | Hitachi, Ltd. | Defect inspection method and apparatus therefor |
US20040263829A1 (en) * | 2003-03-11 | 2004-12-30 | Hiroyuki Ikeda | Method and device for inspecting an object using a time delay integration sensor |
US20050168730A1 (en) * | 2001-04-03 | 2005-08-04 | Hitachi, Ltd. | Method and apparatus for inspecting defects |
US20050270639A1 (en) * | 2004-05-21 | 2005-12-08 | Keyence Corporation | Fluorescence microscope, display method using fluorescence microscope system, and computer-readable medium |
US20060082782A1 (en) * | 2004-10-14 | 2006-04-20 | Riki Ogawa | Defect inspecting apparatus |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3704387B2 (en) | 1995-02-23 | 2005-10-12 | オリンパス株式会社 | Confocal scanning optical microscope and measuring method using this microscope |
JP3534273B2 (en) | 1995-07-19 | 2004-06-07 | 富士写真フイルム株式会社 | Pre-scanning method for film scanner |
JPH09236750A (en) | 1996-03-01 | 1997-09-09 | Olympus Optical Co Ltd | Determining method measuring parameter of scanning microscope |
JP3808169B2 (en) | 1997-05-23 | 2006-08-09 | 株式会社ルネサステクノロジ | Inspection method and apparatus, and semiconductor substrate manufacturing method |
JPH11196225A (en) | 1997-12-26 | 1999-07-21 | Canon Inc | Film image reader |
JPH11345585A (en) * | 1998-06-03 | 1999-12-14 | Nikon Corp | Device and method using electron beam |
JP2002165138A (en) | 2000-11-24 | 2002-06-07 | Olympus Optical Co Ltd | Imaging apparatus |
WO2003014400A1 (en) | 2001-08-08 | 2003-02-20 | Applied Precision, Llc | Time-delay integration imaging of biological specimens |
JP2003158669A (en) | 2001-11-21 | 2003-05-30 | Olympus Optical Co Ltd | Image pickup device |
JP4014436B2 (en) | 2002-04-22 | 2007-11-28 | オリンパス株式会社 | Imaging device |
-
2005
- 2005-07-05 US US11/173,020 patent/US20060018013A1/en not_active Abandoned
-
2007
- 2007-01-18 US US11/655,793 patent/US20070121200A1/en not_active Abandoned
- 2007-01-18 US US11/655,512 patent/US7271952B2/en not_active Expired - Fee Related
- 2007-01-18 US US11/655,507 patent/US20070121198A1/en not_active Abandoned
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4877326A (en) * | 1988-02-19 | 1989-10-31 | Kla Instruments Corporation | Method and apparatus for optical inspection of substrates |
US20020118359A1 (en) * | 1995-06-06 | 2002-08-29 | Kla-Tencor Technologies Corporation | High throughput brightfield/darkfield wafer inspection system using advanced optical techniques |
US5848123A (en) * | 1995-11-21 | 1998-12-08 | Planmed Oy | Methods and apparatus for use in imaging an object |
US20010012069A1 (en) * | 1997-04-07 | 2001-08-09 | Eberhard Derndinger | Confocal microscope with a motorized scanning table |
US6429897B2 (en) * | 1997-04-07 | 2002-08-06 | Carl-Zeiss-Stiftung | Confocal microscope with a motorized scanning table |
US20020001759A1 (en) * | 1997-06-27 | 2002-01-03 | Katsuki Ohashi | Method for repairing a photomask, method for inspecting a photomask, method for manufacturing a photomask, and method for manufacturing a semiconductor device |
US6640014B1 (en) * | 1999-01-22 | 2003-10-28 | Jeffrey H. Price | Automatic on-the-fly focusing for continuous image acquisition in high-resolution microscopy |
US6496309B1 (en) * | 1999-06-18 | 2002-12-17 | Genomic Solutions, Inc. | Automated, CCD-based DNA micro-array imaging system |
US20040106862A1 (en) * | 1999-09-21 | 2004-06-03 | Nikon Corporation | Electron beam apparatus, and inspection instrument and inspection process thereof |
US20040170312A1 (en) * | 2000-05-03 | 2004-09-02 | Soenksen Dirk G. | Fully automatic rapid microscope slide scanner |
US6819416B2 (en) * | 2000-07-27 | 2004-11-16 | Hitachi, Ltd. | Defect inspection method and apparatus therefor |
US20040101210A1 (en) * | 2001-03-19 | 2004-05-27 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Miniaturized microscope array digital slide scanner |
US20050168730A1 (en) * | 2001-04-03 | 2005-08-04 | Hitachi, Ltd. | Method and apparatus for inspecting defects |
US20020167604A1 (en) * | 2001-05-09 | 2002-11-14 | Fanuc Ltd. | Visual sensor |
US20030222197A1 (en) * | 2002-03-13 | 2003-12-04 | Reese Steven A. | Multi-axis integration system and method |
US20040263829A1 (en) * | 2003-03-11 | 2004-12-30 | Hiroyuki Ikeda | Method and device for inspecting an object using a time delay integration sensor |
US20050270639A1 (en) * | 2004-05-21 | 2005-12-08 | Keyence Corporation | Fluorescence microscope, display method using fluorescence microscope system, and computer-readable medium |
US20060082782A1 (en) * | 2004-10-14 | 2006-04-20 | Riki Ogawa | Defect inspecting apparatus |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070285768A1 (en) * | 2006-05-24 | 2007-12-13 | Olympus Corporation | Microscope system and method for synthesizing microscopic images |
US20070285769A1 (en) * | 2006-05-24 | 2007-12-13 | Olympus Corporation | Microscope system and method for synthesizing microscopic images |
US7949161B2 (en) | 2006-05-24 | 2011-05-24 | Olympus Corporation | Microscope system and method for synthesizing microscopic images |
US8014579B2 (en) | 2006-05-24 | 2011-09-06 | Olympus Corporation | Microscope system and method for synthesizing microscopic images |
US20090161929A1 (en) * | 2007-12-21 | 2009-06-25 | Olympus Corporation | Biological specimen observation method |
US8786720B2 (en) * | 2007-12-21 | 2014-07-22 | Olympus Corporation | Biological specimen observation method |
US10852069B2 (en) | 2010-05-04 | 2020-12-01 | Fractal Heatsink Technologies, LLC | System and method for maintaining efficiency of a fractal heat sink |
US11598593B2 (en) | 2010-05-04 | 2023-03-07 | Fractal Heatsink Technologies LLC | Fractal heat transfer device |
US10884227B2 (en) | 2016-11-10 | 2021-01-05 | The Trustees Of Columbia University In The City Of New York | Rapid high-resolution imaging methods for large samples |
US11506877B2 (en) | 2016-11-10 | 2022-11-22 | The Trustees Of Columbia University In The City Of New York | Imaging instrument having objective axis and light sheet or light beam projector axis intersecting at less than 90 degrees |
Also Published As
Publication number | Publication date |
---|---|
US7271952B2 (en) | 2007-09-18 |
US20070121200A1 (en) | 2007-05-31 |
US20060018013A1 (en) | 2006-01-26 |
US20070121199A1 (en) | 2007-05-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7271952B2 (en) | Microscope imaging apparatus and biological-specimen examination system | |
US20060000962A1 (en) | Biological sample observation system and biological sample observation method | |
CN102216827B (en) | Microscope device and fluorescent observing method using same | |
US20080131922A1 (en) | Cell culture detection apparatus, cell culture observation apparatus, and cell culture observation method | |
EP3551054B1 (en) | Trans-illumination imaging with an array of light sources | |
JP2011141444A (en) | Microscope system | |
WO2019124448A1 (en) | Observation device and observation method using same | |
JP2006025789A (en) | Observing system for biological sample and method for observing the same | |
CN104797925A (en) | Receptacle and system for optically analyzing a sample without optical lenses | |
JP5734588B2 (en) | Cell observation apparatus and observation method | |
JP2006023491A (en) | Microscopic imaging apparatus and biological material observation system | |
JP3837145B2 (en) | Microscope imaging device | |
US10674044B2 (en) | Observation apparatus, method for controlling observation apparatus, and non-transitory computer-readable medium storing control program for observation apparatus | |
US11977214B2 (en) | Phase difference observation apparatus and cell treatment apparatus | |
JP4020893B2 (en) | Microscope imaging apparatus and biological sample observation system | |
JP4468661B2 (en) | Cell culture observation apparatus and cell culture observation method | |
JP2006141326A (en) | Culturing device | |
JP2006000057A (en) | Culture vessel and biological sample observation system | |
EP1857538B1 (en) | Microscope apparatus and cell observation method | |
JP2006000054A (en) | Culture vessel and biological sample observation system | |
JP2004113175A (en) | Apparatus for cell culture and detection | |
JP2006000052A (en) | Biological sample observation system | |
JP2004070039A (en) | Observation device and observation method of biological material | |
JP6239881B2 (en) | Image acquisition apparatus and image acquisition method | |
JP2010008492A (en) | Living sample observation apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |