CN108648262B - Three-dimensional enhancement method and apparatus for backscatter human inspection images - Google Patents
Three-dimensional enhancement method and apparatus for backscatter human inspection images Download PDFInfo
- Publication number
- CN108648262B CN108648262B CN201810364368.4A CN201810364368A CN108648262B CN 108648262 B CN108648262 B CN 108648262B CN 201810364368 A CN201810364368 A CN 201810364368A CN 108648262 B CN108648262 B CN 108648262B
- Authority
- CN
- China
- Prior art keywords
- image
- dimensional
- entrainment
- human body
- backscatter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000007689 inspection Methods 0.000 title abstract description 7
- 230000002708 enhancing effect Effects 0.000 claims description 11
- 230000003287 optical effect Effects 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 7
- 238000012937 correction Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 12
- 230000000007 visual effect Effects 0.000 abstract description 11
- 238000004422 calculation algorithm Methods 0.000 abstract description 6
- 230000009466 transformation Effects 0.000 abstract description 4
- 238000003709 image segmentation Methods 0.000 abstract description 2
- 230000005855 radiation Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 239000000463 material Substances 0.000 description 5
- 230000004927 fusion Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000002184 metal Substances 0.000 description 2
- 229910052751 metal Inorganic materials 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 150000002739 metals Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
- Analysing Materials By The Use Of Radiation (AREA)
Abstract
A method and apparatus for three-dimensional enhancement of backscatter images in a backscatter body scanning system is disclosed. And establishing a human body three-dimensional model according to the outline of the scanned image of the human body inspection equipment, and back projecting the scanned image onto the three-dimensional model. Then separating the entrained articles by using an image segmentation algorithm, endowing the entrained articles with a thickness according to the contrast of gray level and background gray level, correcting according to the scattering cross section, converting into a three-dimensional image, and finally fusing the three-dimensional image to a three-dimensional human body model. By utilizing the scheme, the object carried by the human body is subjected to three-dimensional transformation after being segmented, the object carried by the human body is protruded on the surface of the human body, the visual contrast effect is very strong, the gray scale of the original image is reserved, the noise is not enhanced, and the overall effect is better.
Description
The invention is a divisional application of an invention patent application with application number 201210581560.1, filed 12/27/2012, of 'method and apparatus for three-dimensional enhancement of backscatter human inspection images'.
Technical Field
The present technology relates to radiation imaging technology, and in particular, to a method and apparatus for three-dimensionally enhancing backscatter images in a backscatter body scanning system.
Background
At present, image enhancement methods for human body examination mainly include means such as gray scale transformation, contrast enhancement, edge enhancement and the like, images transformed by the means can meet a specific purpose, but the overall visual effect of the images can be influenced, for example, the images subjected to denoising and filtering still keep weak noise signals, and the noise after enhancement can be enhanced, so that the overall effect is influenced.
Disclosure of Invention
In order to solve the problem of poor overall effect of image enhancement in the prior art, a three-dimensional enhancement method and equipment of a backscatter human body inspection image are provided.
In one aspect of the present invention, a method for three-dimensionally enhancing a backscatter image in a backscatter body scanning system is provided, comprising the steps of: obtaining back scattering images of a plurality of sides of an object to be detected in a scanning area; obtaining a human body three-dimensional model of the detected object based on at least one back scattering image; back projecting the back scattering image to the obtained human body three-dimensional model to obtain a three-dimensional image of the detected object; determining an image of entrainment carried by the inspected object based on one or more of the backscatter images; generating a three-dimensional image of the entrainment from the image of the entrainment; fusing the three-dimensional image of the detected object and the three-dimensional image of the entrainment object to generate a fused three-dimensional image; and presenting the fused three-dimensional image on a display.
According to an embodiment of the present invention, the backscatter images of the plurality of side surfaces include a front backscatter image and at least one other backscatter image, and the step of obtaining the three-dimensional model of the human body of the detected object based on the at least one backscatter image includes: extracting contour information of the detected object from the front backscatter image; and obtaining a human body three-dimensional model of the detected object based on the contour information.
According to an embodiment of the present invention, the step of obtaining a three-dimensional model of the human body of the detected object based on at least one backscatter image further includes: extracting key data from the contour information; and extracting the corresponding human body three-dimensional model from the database by referring to the key data.
According to an embodiment of the invention, the step of generating a three-dimensional image of the entrainment from the image of the entrainment comprises: imparting a thickness to the entrainment based on a contrast of the entrainment image, forming a three-dimensional image of the entrainment; and correcting the three-dimensional image of the entrainment object by using the three-dimensional scattering cross section of the entrainment object.
According to an embodiment of the present invention, the step of fusing the three-dimensional image of the object to be inspected and the three-dimensional image of the entrainment includes: and fusing a three-dimensional image generated by the image of the carried object into the three-dimensional image of the detected object according to the corresponding position.
According to an embodiment of the invention, the method further comprises: and generating a two-dimensional projection map from the fused three-dimensional image according to the projection angle selected by the user, and displaying the projection image of the detected object under the projection angle.
According to an embodiment of the present invention, the method further comprises the step of obtaining object information of the object to be examined and obtaining a three-dimensional model of a human body of the object to be examined based on both the object information and the at least one backscatter image.
According to an embodiment of the present invention, the object information is profile information measured with an optical measuring device.
According to an embodiment of the present invention, the object information is ID information of the object to be inspected, and the contour information of the object to be inspected is obtained from a database based on the ID information.
In another aspect of the present invention, an apparatus for three-dimensionally enhancing a backscatter image in a backscatter human body scanning system is presented, comprising: a memory for storing backscatter images of a plurality of sides of an object under examination; a processor for processing the backscatter image stored in the memory as follows: obtaining a human body three-dimensional model of the detected object based on at least one scattered image; back projecting the back scattering image to a human body three-dimensional model to obtain a three-dimensional image of the detected object; determining an image of entrainment carried by the inspected object based on one or more of the backscatter images; generating a three-dimensional image of the entrainment from the image of the entrainment; fusing the three-dimensional image of the detected object and the three-dimensional image of the entrainment object to generate a fused three-dimensional image; and a display for presenting the fused three-dimensional image.
According to an embodiment of the invention, the back scatter images of the plurality of side faces comprise a front back scatter image and at least one other back scatter image, the processor is further configured to: extracting contour information of the detected object from the front backscatter image; and obtaining a human body three-dimensional model of the detected object based on the contour information.
According to an embodiment of the invention, the processor is further configured to: extracting key data from the contour information; and extracting the corresponding human body three-dimensional model from the database by referring to the key data.
According to an embodiment of the invention, the processor is further configured to: imparting a thickness to the entrainment based on a contrast of the entrainment image, forming a three-dimensional image of the entrainment; and correcting the three-dimensional image of the entrainment object by using the three-dimensional scattering cross section of the entrainment object.
According to an embodiment of the invention, the processor is further configured to: and fusing a three-dimensional image generated by the image of the carried object into the three-dimensional image of the detected object according to the corresponding position.
According to an embodiment of the present invention, the processor is configured to generate a two-dimensional projection map from the fused three-dimensional image according to a projection angle selected by a user, and the display displays a projection image of the detected object at the projection angle.
According to an embodiment of the present invention, the processor is further configured to obtain object information of the object to be examined and obtain a three-dimensional model of a human body of the object to be examined based on both the object information and the at least one backscatter image.
According to an embodiment of the present invention, the object information is profile information measured with an optical measuring device.
According to an embodiment of the present invention, the object information is ID information of the object to be inspected, and the processor obtains the contour information of the object to be inspected from a database based on the ID information.
In another aspect of the invention, a computer-readable medium is provided, storing a computer program which, when executed by a processor, performs the steps of: obtaining a human body three-dimensional model of the detected object based on the at least one back scattering image; back projecting the back scattering image to the obtained human body three-dimensional model to obtain a three-dimensional image of the detected object; determining an image of entrainment carried by the inspected object based on one or more of the backscatter images; generating a three-dimensional image of the entrainment from the image of the entrainment; and fusing the three-dimensional image of the detected object and the three-dimensional image of the entrainment object to generate a fused three-dimensional image.
According to the scheme, the articles carried by the human body are subjected to three-dimensional transformation after being divided, the carried articles are protruded on the surface of the human body, and the visual contrast effect is very strong. In addition, the gray scale of the original image is reserved, the noise is not enhanced, and the overall effect is better.
Drawings
The following figures illustrate embodiments of the present technology. These drawings and embodiments provide some examples of the present technology in a non-limiting, non-exhaustive manner, wherein:
FIG. 1 shows a schematic diagram of a human backscatter scanning system according to an embodiment of the invention;
FIG. 2 shows a flow diagram of a method of three-dimensionally enhancing a backscatter image according to an embodiment of the invention;
FIG. 3 shows an example of the operation of a human backscatter scanning system according to another embodiment of the invention; and
fig. 4 shows a flowchart of a method of three-dimensionally enhancing a backscatter image of a human body according to still another embodiment of the present invention.
Detailed Description
Specific embodiments of the present invention will be described in detail below, and it should be noted that the embodiments described herein are only for illustration and are not intended to limit the present invention. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one of ordinary skill in the art that: it is not necessary to employ these specific details to practice the present invention. In other instances, well-known structures, materials, or methods have not been described in detail in order to avoid obscuring the present invention.
Throughout the specification, reference to "one embodiment," "an embodiment," "one example," or "an example" means: the particular features, structures, or characteristics described in connection with the embodiment or example are included in at least one embodiment of the invention. Thus, the appearances of the phrases "in one embodiment," "in an embodiment," "one example" or "an example" in various places throughout this specification are not necessarily all referring to the same embodiment or example. Furthermore, the particular features, structures, or characteristics may be combined in any suitable combination and/or sub-combination in one or more embodiments or examples. Further, as used herein, the term "and/or" will be understood by those of ordinary skill in the art to include any and all combinations of one or more of the associated listed items.
In view of the problem of the prior art that image enhancement adversely affects the overall effect, some embodiments of the present invention provide a method for three-dimensionally enhancing a backscatter image in a backscatter body scanning system. Backscatter images of a plurality of sides of an object to be inspected within a scanning region are first acquired, which can be obtained by scanning the plurality of sides of a human body using a human body backscatter system. Then, a three-dimensional model of the human body of the inspected object is obtained based on the at least one scattered image. For example, contour information of the human body of the object to be examined is obtained from the backscatter image, and a corresponding three-dimensional model of the human body is obtained based on the contour information. For example, retrieving an appropriate three-dimensional model of the human body from a database. Then, the back scattering image is back projected to the obtained human body three-dimensional model, and a three-dimensional image of the detected object is obtained.
In another aspect, an image of entrainment carried by the inspected object is determined based on one or more of the backscatter images. And generating a three-dimensional image of the entrainment based on the two-dimensional image of the entrainment. For example, a three-dimensional image of the material to be entrained is generated by giving the material to be entrained a thickness based on information such as the gradation or contrast of the image of the material to be entrained.
Next, the three-dimensional image of the object to be inspected and the three-dimensional image of the entrainment are fused to generate a fused three-dimensional image, and the fused three-dimensional image is presented on a display. Therefore, the carried three-dimensional image can be highlighted on the surface of the human body three-dimensional model, and the visual contrast effect is very strong. In addition, the gray scale of the original image is reserved, the noise is not enhanced, and the overall effect is better.
According to the embodiment of the invention, after the three-dimensional image of the carried object is fused on the three-dimensional human body model, an operator can select a two-dimensional projection image along a certain visual angle, for example, the observation visual angle is changed by using a mouse, a keyboard or a shortcut key, so that the three-dimensional display effect is achieved. For example, only a two-dimensional projection view along a certain viewing angle is displayed, the projection direction is changed by sliding a mouse, the projection direction is changed by up, down, left, right, and left keys of a keyboard, and front, left, right, and back images are displayed by shortcut keys.
In addition, in other embodiments of the present invention, a three-dimensional model of the human body can be established by using a priori information of the detected object, for example, known contour information such as height, and information such as fat and thin of the object. In this case, a three-dimensional model of the human body can be established based on key information of the human body to be examined. For example, a three-dimensional model of a human body can be acquired relatively quickly by acquiring key information such as the height and weight of the subject from a database based on the ID of the subject, or by acquiring a contour image of the human body of the subject using an optical camera, extracting key data, and comparing the extracted key data with a model in the database.
According to some embodiments of the invention, after the image subjected to feature matching is back-projected onto the three-dimensional model, image fusion is completed through image deformation, hole filling and other technologies. And giving thickness to the entrainment according to information such as the gray scale or contrast of the entrainment, generating a three-dimensional image from the two-dimensional image, and correcting the three-dimensional image by using a thickness correction table (calibrating and generating the correction table by using some typical materials), thereby obtaining a more proper three-dimensional image of the entrainment.
According to the embodiment of the invention, the three-dimensional graph generated by the carried article is fused on the human body three-dimensional model according to the corresponding position, and because the carried article is outside the surface of the human body, the carried article is convex, so that the image is convex.
FIG. 1 shows a schematic diagram of a human backscatter scanning system according to an embodiment of the invention. As shown in FIG. 1, the human backscatter scanning system includes an X-ray source 10, a detector 30, a control apparatus 20, and an image processing and display device 60. The control device 20 controls the X-ray source 10 to emit X-rays, forms flying spots under the modulation of a flying spot forming device (not shown), scans the surface of the human body of the object 50, and controls the detector 30 to detect scattered X-rays of the human body, thereby forming a backscatter image. Thus, after the scanning is performed on a plurality of sides of the human body, back scattering images of the plurality of sides are obtained. The resulting back-scattered images of the sides are then processed in an image processing and display device 60, for example with software.
Fig. 2 shows a flow chart of a method of three-dimensionally enhancing a backscatter image according to an embodiment of the invention. As shown in fig. 2, in step S21, a backscatter image of the object to be examined is obtained, for example, a backscatter image of a human body is obtained by fusing a plurality of side scattered images or a backscatter image of interest is used.
For example, in some embodiments, when backscatter images of different sides are obtained, the images may also be matched and fused first. Taking two images which are scanned on the back and rotate by 45 degrees left and right as an example, the feature matching algorithm is adopted for fusion, and because the scanned image obtained by each examination and the image obtained by the previous examination have strong correlation, the correlation optimization algorithm is utilized to realize rapid fusion.
For example, in the example of fig. 1, the person may stand in three images, namely, a left turn 45 ° on the back side, a right turn 45 ° on the right side, and a right turn on the front side, where the two left and right rotation scanning images on the back side include two sides of the human body. For another example, a circular scanning method may be used to collect the backscatter image around one revolution of the person (person revolution or equipment revolution), and restore the two-dimensional image according to the auxiliary information. Alternatively, a circular arc scan or the like may be used to obtain back-scattered images of multiple sides of the human body of the object to be examined.
Fig. 3 shows an example of the operation of a human backscatter scanning system according to another embodiment of the invention. As shown in fig. 3, apparatus 100 and apparatus 300 are two backscatter apparatuses, each using a flying spot forming device as described in chinese patent application 201010624252.3(CN102565110A), the detectors comprising two backscatter detectors. The probe does not translate left and right, and the object 500 to be inspected moves while standing on the conveyor 200. When the object 500 to be inspected is within the scanning range of the apparatus 100, the radiation source 101 of the apparatus 100 emits a radiation beam 102 to irradiate the object 500 to be inspected, and the backscattered radiation is received by the detectors 103 and 104.
When the object 500 to be inspected is conveyed within the scanning range of the apparatus 300, the radiation source 301 of the apparatus 300 emits radiation to irradiate the object 500 to be inspected, and the backscattered radiation is received by the detectors 303 and 304. After the object 500 to be examined passes out of the scanning range of the apparatus 300 on the conveyor belt, the human body scanning is completed. This allows fast acquisition of back-scattered images of multiple sides of the human body.
According to other embodiments of the present invention, the human backscatter scanning system may also use the camera 400 to quickly obtain an optical image of the object 500 to be examined, which is used to determine contour information of the object 500 to be examined.
In step S22, a three-dimensional phantom of the object to be examined is obtained based on the backscattered image, and in step S24, the backscattered image is back-projected onto the three-dimensional phantom to obtain a three-dimensional phantom.
A library of three-dimensional models of the human body is stored in the image processing and display device 60. These three-dimensional models are, for example, a library of reference three-dimensional model supplementary models that are derived from statistics of people of different groups and are formed in an actual backscatter scan using body size information obtained from the scan. For example, a human body three-dimensional model is built according to geometric data (height, full head height, shoulder width, leg length, arm length and the like) of the surface of the human body obtained by scanning an image, and body surface data can be obtained by analyzing the outline of the image, so that the model is modeled as a basic model. This modeling process is completed before the device is shipped from the factory, and the reference model information is stored in the image processing and display device 60.
According to other embodiments of the present invention, a method of local editing of the human body with spline curves proposed by Seo et al (Seo H, Cordier F, Philippon L, et al. Interactive modeling of MPEG-4deformable human body models [ OL ] http:// www.miralab.unige.ch/papers/115.pdf, 2004) may also be employed. And the basic models are deformed and edited according to newly obtained human body surface geometric data to generate a new three-dimensional model, so that the modeling speed is greatly improved.
In some embodiments of the invention, in order to make the modeling speed faster, a typical human body three-dimensional model library is established, the three-dimensional model established each time is numbered, a record document is established, the model number and the surface geometric data are in one-to-one correspondence, a threshold method is adopted to judge whether a new model is needed, the sum of squares of the difference values of new parameters and the existing library model parameters is calculated, and if the sum exceeds a specified threshold value, the new model is stored in the library. Regarding the threshold determination, according to the characteristics of the human body examination equipment, the three-dimensional model is not required to be very accurate to correspond to the real human body, and only the physical and physical characteristics of the human body are required to be approximately reflected, so that the threshold is set to be higher, and the database is not too large.
In addition, a data sharing mode can be adopted, a database established by each device can be copied to other devices for use, a model does not need to be newly built after the devices are used for a period of time, the human body three-dimensional model can be called out from the database only by matching the geometric parameters of the body surface in the normal scanning process, the speed is very high, and the requirement on the human body inspection speed can be met.
In some embodiments of the invention, the three-dimensional model is established based on parameters obtained by scanning image contour analysis, the scanning two-dimensional image is back-projected onto the three-dimensional model according to a contour corresponding method, the projected image is deformed to form some holes, and some positions are blocked and can not be projected, and linear interpolation algorithm is adopted for filling.
In step S23, an image of an entrainment carried by the object to be examined is determined from the backscatter image, and in step S25, a three-dimensional image of the entrainment is generated.
For example, in some embodiments, the entire image contour is extracted, and the human body contour is analyzed and removed according to human body features, so as to realize the segmentation of the entrainment. The method is simple and rapid, the thickness of the divided entrained articles is given according to the contrast, a three-dimensional image is generated from the two-dimensional image, and the thickness is corrected by using a correction table. For example, for low-energy X-ray, the scattering cross section of a high atomic number substance is small, the photoelectric cross section is large, the gray value is low, and the contrast between a thin metal and a human body is large, so that the thickness generated according to the contrast needs to be corrected. For example, the low gray scale is corrected for metals, and the highlight portion is generally corrected for organic substances having a low atomic number. Since the thickness calculation does not need to be accurate, the correction coefficient can be an empirical value.
In step S26, the three-dimensional image of the entrainment and the three-dimensional image of the human body are fused. For example, the divided entrained articles are placed in corresponding positions according to the three-dimensional coordinate system of the human body model. In step S27, the fused three-dimensional image, or the two-dimensional image at a certain viewing angle, is displayed on the display. For example, according to the observation visual angle selected by the user, the three-dimensional image is quickly projected, shortcut keys are arranged to display a plurality of main visual angle images, and corresponding functions can be added according to the actual requirements of the user.
In other embodiments, the corresponding three-dimensional model may also be obtained from object information of the detected object. Fig. 4 shows a flowchart of a method of three-dimensionally enhancing a backscatter image of a human body according to still another embodiment of the present invention.
In step S41, a backscatter image of the object to be inspected and object information are acquired. In step S42, a three-dimensional model of the human body of the test object is obtained based on the object information of the test object. For example, a priori information of the object to be examined, such as known height and other contour information, is obtained. For example, the fat and thin of the object, and the like, to build a three-dimensional model of the human body. In this case, a three-dimensional model of the human body can be established based on key information of the human body to be examined. For example, key information such as the height and the weight of the subject is obtained from the database based on the ID of the subject. For example, at an airport or a port, the name or identification number of the subject may be used to obtain a priori information about the subject. Or an optical camera is used for obtaining a human body outline image of the detected object, key data are extracted, and the key data are compared with the models in the database, so that the human body three-dimensional model is obtained more quickly. Therefore, it is not necessary to create a three-dimensional model of the human body of the object to be examined from the backscatter images.
The remaining steps S43, S44, S45, S46 and S47 in the method shown in fig. 4 correspond to the steps S23, S24, S25, S26 and S27 in fig. 2 described above, respectively, and thus the description of these steps is omitted here.
According to the human body inspection image three-dimensional enhancement method of the embodiment, the image segmentation, matching, three-dimensional modeling, fusion and other methods are used, a plurality of images are fused into a three-dimensional image, the image can be observed from any visual angle, the detected object and the human body have light and shade difference and space position difference, the entrained objects can be seen more easily, and a better visual effect is achieved. In addition, the side entrainment of the human body can also be clearly shown.
According to some embodiments, the articles carried by the human body are subjected to three-dimensional transformation after being divided, the carried articles are protruded on the surface of the human body, the visual contrast effect is very strong, the gray scale of an original image is reserved, noise is not enhanced, the overall effect is better, and meanwhile, the articles carried by the side surface of the human body can be clearly displayed.
The three-dimensional enhancement method for the human body examination image according to the embodiment can meet the requirement of human body examination practicability, namely, the image processing speed is high; the image quality level after being processed by various methods is kept consistent with the original image; the algorithm is required to be concise, and the output result is stable, namely the robustness of the algorithm is required.
The foregoing detailed description has set forth numerous embodiments of a method and apparatus for three-dimensionally enhancing image quality of a backscatter image using schematics, flowcharts, and/or examples. Where such diagrams, flowcharts, and/or examples contain one or more functions and/or operations, it will be understood by those within the art that each function and/or operation within such diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of structures, hardware, software, firmware, or virtually any combination thereof. In one embodiment, portions of the subject matter described by embodiments of the invention may be implemented by Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), Digital Signal Processors (DSPs), or other integrated formats. However, those skilled in the art will recognize that some aspects of the embodiments disclosed herein, in whole or in part, can be equivalently implemented in integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computer systems), as one or more programs running on one or more processors (e.g., as one or more programs running on one or more microprocessors), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure. In addition, those skilled in the art will appreciate that the mechanisms of the subject matter described herein are capable of being distributed as a program product in a variety of forms, and that an illustrative embodiment of the subject matter described herein applies regardless of the particular type of signal bearing media used to actually carry out the distribution. Examples of signal bearing media include, but are not limited to: recordable type media such as floppy disks, hard disk drives, Compact Disks (CDs), Digital Versatile Disks (DVDs), digital tape, computer memory, etc.; and a transmission type medium such as a digital and/or an analog communication medium (e.g., a fiber optic cable, a waveguide, a wired communications link, a wireless communication link, etc.).
While the present invention has been described with reference to several exemplary embodiments, it is understood that the terminology used is intended to be in the nature of words of description and illustration, rather than of limitation. As the present invention may be embodied in several forms without departing from the spirit or essential characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, but rather should be construed broadly within its spirit and scope as defined in the appended claims, and therefore all changes and modifications that fall within the meets and bounds of the claims, or equivalences of such meets and bounds are therefore intended to be embraced by the appended claims.
Claims (21)
1. A method for three-dimensionally enhancing a backscatter image in a backscatter body scanning system, comprising the steps of:
obtaining back scattering images of a plurality of sides of an object to be detected in a scanning area;
fusing the back scattering images of the plurality of side surfaces to be used as human body back scattering images of the detected object;
obtaining a human body three-dimensional model of the detected object based on at least one back scattering image;
back projecting the human body back scattering image to the obtained human body three-dimensional model to obtain a three-dimensional image of the detected object;
determining an image of an entrainment carried by the detected object based on one or more of the human body backscatter images;
generating a three-dimensional image of the entrainment from the image of the entrainment;
fusing the three-dimensional image of the detected object and the three-dimensional image of the entrainment object to generate a fused three-dimensional image; and
presenting the fused three-dimensional image on a display;
wherein generating a three-dimensional image of the entrainment from the image of the entrainment comprises:
imparting a thickness to the entrainment based on a contrast of the entrainment image, forming a three-dimensional image of the entrainment; and
and correcting the three-dimensional image of the entrainment object by using the three-dimensional scattering cross section of the entrainment object.
2. The method of claim 1, wherein the plurality of side backscatter images include a front backscatter image and at least one other backscatter image, and the step of obtaining a three-dimensional model of the inspected object based on the at least one backscatter image comprises:
extracting contour information of the detected object from the front backscatter image;
and obtaining a human body three-dimensional model of the detected object based on the contour information.
3. The method of claim 2, wherein the step of obtaining a three-dimensional model of the human body of the inspected object based on at least one backscatter image further comprises:
extracting key data from the contour information;
and extracting the corresponding human body three-dimensional model from the database by referring to the key data.
4. The method of claim 1, wherein the step of modifying the three-dimensional image of the entrainment using the three-dimensional scattering cross-section of the entrainment comprises:
subsequent correction of the entrainment is based on the grey value or contrast value.
5. The method of claim 1, wherein fusing the three-dimensional image of the inspected object and the three-dimensional image of the entrainment comprises:
and fusing a three-dimensional image generated by the image of the carried object into the three-dimensional image of the detected object according to the corresponding position.
6. The method of claim 1, further comprising:
and generating a two-dimensional projection map from the fused three-dimensional image according to the projection angle selected by the user, and displaying the projection image of the detected object under the projection angle.
7. The method of claim 1, further comprising the steps of obtaining object information of the object under examination and obtaining a three-dimensional model of a human body of the object under examination based on both the object information and the at least one backscatter image.
8. The method of claim 7, wherein the object information is profile information measured with an optical measuring device.
9. The method of claim 7, wherein the object information is ID information of the object to be inspected, and the contour information of the object to be inspected is obtained from a database based on the ID information.
10. The method of claim 1, further comprising the steps of:
and calculating the sum of squares of the difference values of the parameters of the new three-dimensional human body model and the parameters of the existing three-dimensional human body models in the library, and recording the new three-dimensional human body model in the library if the sum exceeds a specified threshold value.
11. An apparatus for three-dimensionally enhancing backscatter images in a backscatter body scanning system, comprising:
a memory for storing backscatter images of a plurality of sides of an object under examination;
a processor for processing the backscatter image stored in the memory as follows:
fusing the back scattering images of the plurality of side surfaces to be used as human body back scattering images of the detected object;
obtaining a human body three-dimensional model of the detected object based on at least one back scattering image;
back projecting the human body back scattering image to the obtained human body three-dimensional model to obtain a three-dimensional image of the detected object;
determining an image of an entrainment carried by the detected object based on one or more of the human body backscatter images;
generating a three-dimensional image of the entrainment from the image of the entrainment; and
fusing the three-dimensional image of the detected object and the three-dimensional image of the entrainment object to generate a fused three-dimensional image; and
a display for presenting the fused three-dimensional image;
wherein the processor is further configured to:
imparting a thickness to the entrainment based on a contrast of the entrainment image, forming a three-dimensional image of the entrainment; and
and correcting the three-dimensional image of the entrainment object by using the three-dimensional scattering cross section of the entrainment object.
12. The apparatus of claim 11, wherein the plurality of side backscatter images comprises a front side backscatter image and at least one other backscatter image, the processor further to:
extracting contour information of the detected object from the front backscatter image;
and obtaining a human body three-dimensional model of the detected object based on the contour information.
13. The apparatus of claim 12, wherein the processor is further configured to:
extracting key data from the contour information;
and extracting the corresponding human body three-dimensional model from the database by referring to the key data.
14. The apparatus of claim 11, wherein the processor corrects for subsequent entrainment based on the gray value or contrast value.
15. The apparatus of claim 11, wherein the processor is further configured to:
and fusing a three-dimensional image generated by the image of the carried object into the three-dimensional image of the detected object according to the corresponding position.
16. The apparatus of claim 11, the processor to generate a two-dimensional projection map from the fused three-dimensional image according to a user selected projection angle, the display to display a projection image of the object under examination at the projection angle.
17. The apparatus of claim 11, the processor further to obtain object information of the inspected object and to obtain a three-dimensional model of a human body of the inspected object based on both the object information and the at least one backscatter image.
18. The apparatus of claim 17, wherein the object information is profile information measured with an optical measuring device.
19. The apparatus of claim 17, wherein the object information is ID information of the object to be inspected, and the processor obtains contour information of the object to be inspected from a database based on the ID information.
20. The apparatus of claim 11 wherein the processor further calculates a sum of squares of differences between parameters of the new three-dimensional model of the human body and parameters of existing three-dimensional models of the human body in a library, and records the new three-dimensional model of the human body in the library if a prescribed threshold is exceeded.
21. A computer-readable medium storing a computer program which, when executed by a processor, performs the steps of:
obtaining a human body three-dimensional model of the detected object based on the at least one back scattering image;
back projecting the back scattering image to the obtained human body three-dimensional model to obtain a three-dimensional image of the detected object;
determining an image of entrainment carried by the inspected object based on one or more of the backscatter images;
generating a three-dimensional image of the entrainment from the image of the entrainment; and
fusing the three-dimensional image of the detected object and the three-dimensional image of the entrainment object to generate a fused three-dimensional image;
wherein generating a three-dimensional image of the entrainment from the image of the entrainment comprises:
imparting a thickness to the entrainment based on a contrast of the entrainment image, forming a three-dimensional image of the entrainment; and
and correcting the three-dimensional image of the entrainment object by using the three-dimensional scattering cross section of the entrainment object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810364368.4A CN108648262B (en) | 2012-12-27 | 2012-12-27 | Three-dimensional enhancement method and apparatus for backscatter human inspection images |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210581560.1A CN103903299B (en) | 2012-12-27 | 2012-12-27 | The three-dimensional Enhancement Method and equipment of back scattering human body check image |
| CN201810364368.4A CN108648262B (en) | 2012-12-27 | 2012-12-27 | Three-dimensional enhancement method and apparatus for backscatter human inspection images |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210581560.1A Division CN103903299B (en) | 2012-12-27 | 2012-12-27 | The three-dimensional Enhancement Method and equipment of back scattering human body check image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108648262A CN108648262A (en) | 2018-10-12 |
| CN108648262B true CN108648262B (en) | 2021-04-13 |
Family
ID=50994604
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210581560.1A Active CN103903299B (en) | 2012-12-27 | 2012-12-27 | The three-dimensional Enhancement Method and equipment of back scattering human body check image |
| CN201810364368.4A Active CN108648262B (en) | 2012-12-27 | 2012-12-27 | Three-dimensional enhancement method and apparatus for backscatter human inspection images |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210581560.1A Active CN103903299B (en) | 2012-12-27 | 2012-12-27 | The three-dimensional Enhancement Method and equipment of back scattering human body check image |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN103903299B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107918990A (en) * | 2017-11-29 | 2018-04-17 | 西安超嗨网络科技有限公司 | A kind of antitheft system for supermarket and method |
| CN108182663B (en) * | 2017-12-26 | 2021-11-30 | 北京无线电计量测试研究所 | Millimeter wave image effect enhancement method and device and readable storage medium |
| CN111243106B (en) * | 2020-01-21 | 2021-05-25 | 杭州微洱网络科技有限公司 | Method for correcting three-dimensional human body model based on 2D human body image |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201199235Y (en) * | 2008-05-12 | 2009-02-25 | 丁青 | Novel X-ray channel type safety-check system structure |
| CN101779119A (en) * | 2007-06-21 | 2010-07-14 | 瑞皮斯坎安全产品公司 | Systems and methods for improving directed people screening |
| CN102028482A (en) * | 2009-09-30 | 2011-04-27 | 同方威视技术股份有限公司 | Human body detection image processing method and human body detection apparatus |
| CN202523130U (en) * | 2012-05-08 | 2012-11-07 | 厦门兆翔智能科技有限公司 | Airport security-check information management system |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1779443B (en) * | 2004-11-26 | 2010-09-15 | 清华大学 | Method and device for safety detection of liquid by radioactive source |
| US20100201786A1 (en) * | 2006-05-11 | 2010-08-12 | Koninklijke Philips Electronics N.V. | Method and apparatus for reconstructing an image |
| CN100517060C (en) * | 2006-06-01 | 2009-07-22 | 高宏 | Three-dimensional portrait photographing method |
| CN101113961A (en) * | 2006-07-27 | 2008-01-30 | 上海英迈吉东影图像设备有限公司 | Image-forming system with X-ray backscattering and tomography scanning |
| CN101470079A (en) * | 2007-12-28 | 2009-07-01 | 沈阳利泰自控技术有限责任公司 | Laser dynamic security examination method |
| WO2011014192A1 (en) * | 2009-07-31 | 2011-02-03 | Analogic Corporation | Two-dimensional colored projection image from three-dimensional image data |
| CN101887518B (en) * | 2010-06-17 | 2012-10-31 | 北京交通大学 | Human body detection device and method |
| CN101943761B (en) * | 2010-09-12 | 2012-09-05 | 上海英迈吉东影图像设备有限公司 | Detection method of X-ray |
| JP5822554B2 (en) * | 2011-06-17 | 2015-11-24 | キヤノン株式会社 | Image processing apparatus, image processing method, photographing system, and program |
| CN102565794B (en) * | 2011-12-30 | 2013-09-18 | 北京华航无线电测量研究所 | Microwave security inspection system for automatically detecting dangerous object hidden in human body |
| CN102708372B (en) * | 2012-02-29 | 2016-02-24 | 北京无线电计量测试研究所 | A kind of automatic detection and Identification method of hiding article |
| CN102707322B (en) * | 2012-02-29 | 2014-11-12 | 北京无线电计量测试研究所 | Human body detection device based on millimeter wave imaging |
-
2012
- 2012-12-27 CN CN201210581560.1A patent/CN103903299B/en active Active
- 2012-12-27 CN CN201810364368.4A patent/CN108648262B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101779119A (en) * | 2007-06-21 | 2010-07-14 | 瑞皮斯坎安全产品公司 | Systems and methods for improving directed people screening |
| CN201199235Y (en) * | 2008-05-12 | 2009-02-25 | 丁青 | Novel X-ray channel type safety-check system structure |
| CN102028482A (en) * | 2009-09-30 | 2011-04-27 | 同方威视技术股份有限公司 | Human body detection image processing method and human body detection apparatus |
| CN202523130U (en) * | 2012-05-08 | 2012-11-07 | 厦门兆翔智能科技有限公司 | Airport security-check information management system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103903299A (en) | 2014-07-02 |
| CN103903299B (en) | 2018-05-22 |
| CN108648262A (en) | 2018-10-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3488233B1 (en) | Inspection method for a manufactured article and system for performing same | |
| US11953451B2 (en) | Item inspection by dynamic selection of projection angle | |
| CN105784731B (en) | Mesh calibration method and safe examination system in a kind of positioning three-dimensional CT image | |
| Warnett et al. | Towards in-process x-ray CT for dimensional metrology | |
| Yagüe-Fabra et al. | A 3D edge detection technique for surface extraction in computed tomography for dimensional metrology applications | |
| US20220244194A1 (en) | Automated inspection method for a manufactured article and system for performing same | |
| US9763630B2 (en) | Stereoscopic imaging systems and methods | |
| US10068322B2 (en) | Inspection system | |
| US10586324B2 (en) | Inspection devices and methods for inspecting a container | |
| KR102021945B1 (en) | Determination of localised quality measurements from a volumetric image record | |
| EP1788525A2 (en) | Method of radiographic imaging for three-dimensional reconstruction, device and computer program for carrying out said method | |
| EP3112852B1 (en) | Method for positioning target in three-dimensional ct image and security check system | |
| EP3203914A1 (en) | Radiation dose applied to different anatomical stages | |
| CN108648262B (en) | Three-dimensional enhancement method and apparatus for backscatter human inspection images | |
| Butzhammer et al. | Comparison of geometrically derived quality criteria regarding optimal workpiece orientation for computed tomography measurements | |
| HK1195655A (en) | Method and apparatus for three-dimensional enhancing the backscattering human inspection image | |
| CN112950664B (en) | Target object positioning and labeling method and device based on sliding profile | |
| Baier et al. | Contrast based method for the automated analysis of transfer functions and spatial resolution limits of micro-and nano-focus computed tomography systems: Evaluation with simulated data | |
| Lou et al. | Simulation for XCT and CMM measurements of additively manufactured surfaces | |
| HK1195655B (en) | Method and apparatus for three-dimensional enhancing the backscattering human inspection image | |
| JPWO2020129384A1 (en) | Radiation image processing equipment, radiation image processing method and radiation image processing program | |
| Kolokytha | On-belt Tomosynthesis: 3D Imaging of Baggage for Security Inspection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |