HK40002674A - Handheld three-dimensional ultrasound imaging system and method - Google Patents

Description

Handheld three-dimensional ultrasonic imaging system and method

Technical Field

The invention relates to the field of medical instruments, in particular to a handheld three-dimensional ultrasonic imaging system and a handheld three-dimensional ultrasonic imaging method.

Background

Three-dimensional ultrasound imaging has been widely used in the medical field, and there are generally three modes, electronic scanning, mechanical scanning, and manual scanning. Mechanical scanning is to use a motor to drive an ultrasonic probe to scan, and has the advantage of good repeatability, but is only suitable for scanning in a small range, such as fetal observation. Electronic scanning can give real-time three-dimensional images, such as the heart, but is only suitable for scanning a smaller range and requires the use of a two-dimensional transducer array, making it quite expensive. The manual scanning means that an operator holds an ultrasonic probe to scan a region of interest of a human body or an animal, a space positioning system records the three-dimensional space position and angle of each ultrasonic image, and then three-dimensional image reconstruction is performed.

In recent years, miniaturization of ultrasound imaging systems has progressed rapidly, and there are many different types of hand-held ultrasound systems. The palm-type ultrasonic system can greatly improve the portability, so that the ultrasonic imaging can be applied to more fields. However, at present, there is still no handheld three-dimensional ultrasound imaging system on the market because of the difficulty in implementing the handheld three-dimensional ultrasound imaging system, especially for manually scanning a large area of a human body. Because the spatial location system required by conventional ultrasound imaging systems is bulky and not suitable for handheld applications, for example, the most common electromagnetic locating devices require an external transmitter and a spatial location sensor mounted on the ultrasound probe, making such systems completely handheld, portable, is difficult.

Therefore, how to improve a huge space positioning system so that a portable handheld three-dimensional ultrasonic imaging system can be widely applied is a technical problem which needs to be solved urgently in the industry.

Disclosure of Invention

The invention aims to solve the problems in the prior art and provides a handheld three-dimensional ultrasonic imaging system and a handheld three-dimensional ultrasonic imaging method, so that the handheld three-dimensional ultrasonic imaging can be widely applied.

The technical scheme for solving the technical problems is that the invention provides a handheld ultrasonic imaging system, which comprises a handheld ultrasonic instrument probe, a data acquisition module and a data processing module, wherein the handheld ultrasonic instrument probe is used for scanning and acquiring an ultrasonic image; the display, control and processing terminal is connected with the handheld ultrasonic instrument probe in a wired or wireless connection mode; the palm-type ultrasonic imaging system of the invention further comprises: the handheld three-dimensional space positioning system is connected with the handheld ultrasonic instrument probe, moves along with the movement of the handheld ultrasonic instrument probe, is connected with the display, control and processing terminal in a wired or wireless connection mode, and is used for independently positioning the three-dimensional position of the handheld ultrasonic instrument probe.

Preferably, the handheld ultrasonic imaging system further comprises a positioning reference device, which is located outside the probe of the handheld ultrasonic instrument and used for providing positioning reference for the handheld three-dimensional space positioning system.

Preferably, the handheld three-dimensional space positioning system is built in the handheld ultrasonic instrument probe.

Preferably, the handheld three-dimensional space positioning system is an accelerometer or an angular velocity meter mounted on the handheld ultrasonic instrument probe, and is used for obtaining an acceleration value or an angular acceleration value of the handheld ultrasonic instrument probe, so as to obtain a moving distance and a rotating angle of the handheld ultrasonic instrument probe.

Preferably, the positioning reference device is a positioning image arranged on the part to be detected, and the handheld three-dimensional space positioning system comprises a camera for detecting the position of the positioning image and providing a positioning reference; and the accelerometer or the angular velocity meter is used for obtaining the acceleration or the angular acceleration value of the palm ultrasonic instrument probe so as to further obtain the moving distance and the rotating angle of the palm ultrasonic instrument probe.

Preferably, the system further comprises a cloud database which is in communication connection with the display, control and processing terminal, acquires the ultrasonic image and the three-dimensional position and angle information from the display, control and processing terminal through a wireless or wired data transmission device to perform data processing, and returns a data processing result to the display, control and processing terminal.

The invention further provides a handheld three-dimensional ultrasonic imaging method, which comprises the following steps:

s1, scanning the part to be detected by using the handheld ultrasonic probe to acquire a series of ultrasonic images;

s2, acquiring a three-dimensional space position and an angle corresponding to each ultrasonic image by the palm type three-dimensional space positioning system;

and S3, reconstructing and displaying the ultrasonic image, the three-dimensional space information and the angle.

Preferably, step S3 is:

and S3, transmitting the ultrasonic images and the three-dimensional spatial position and angle information to a cloud database through a wireless or wired data transmission device for image reconstruction, analysis, calculation and comparison, and transmitting the results of image reconstruction, analysis, calculation and comparison back to a display, control and processing terminal for display by the cloud database.

Preferably, step S3 is:

and S3, carrying out three-dimensional image reconstruction and display on the ultrasonic image, the three-dimensional space information and the angle through a display, control and processing terminal.

Preferably, the handheld three-dimensional space positioning system is an accelerometer or an angular velocity meter mounted on the handheld ultrasonic instrument probe, and is used for obtaining an acceleration value or an angular acceleration value of the handheld ultrasonic instrument probe, so as to obtain a moving distance and a rotating angle of the handheld ultrasonic instrument probe.

Preferably, step S2 of the imaging method includes the steps of:

and S2.1, scanning and positioning reference devices are used for providing space positioning reference for the handheld three-dimensional space positioning system by using the three-dimensional space positioning system.

Preferably, the positioning reference device is disposed at the site to be detected, and step S3 of the imaging method further includes the steps of:

s3.1, the display, control and processing terminal extracts the information of the positioning reference device from the ultrasonic image as positioning information;

and S3.2, restoring the ultrasonic image to a state without the interference of a positioning reference device by the display, control and processing terminal, and then reconstructing and displaying a three-dimensional image of the ultrasonic image.

Preferably, the positioning reference device is disposed at the site to be detected, and step S1 of the imaging method further includes the steps of:

s1.1, when the positioning reference device is arranged on a part to be detected, scanning the part to be detected by using a palm-type ultrasonic instrument probe to obtain a first ultrasonic image;

s1.2, taking the positioning reference device away, and scanning the part to be detected by using the palm type ultrasonic instrument probe again to obtain a second ultrasonic image;

step S3 of the image forming method further includes the steps of:

and S3.6, the display, control and processing terminal determines the position of the positioning reference device relative to the second ultrasonic image according to the first ultrasonic image as a reference, so that the ultrasonic image, the three-dimensional space information and the angle are subjected to three-dimensional image reconstruction and displayed.

By applying the palm three-dimensional ultrasonic imaging system and the method provided by the invention, a huge space positioning system in the existing three-dimensional ultrasonic imaging system is changed into a portable space positioning system which can be used at any time, so that the palm three-dimensional ultrasonic imaging can be widely introduced.

Drawings

The invention will be further described with reference to the accompanying drawings and examples, in which:

FIG. 1 is a schematic diagram of a palm-type three-dimensional ultrasonic imaging system of the present invention;

FIG. 2 is a schematic diagram of a palm-type three-dimensional ultrasonic imaging system in a preferred embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a palm-type three-dimensional ultrasonic imaging system in another preferred embodiment of the present invention;

fig. 4 is a schematic structural diagram of a palm-type three-dimensional ultrasonic imaging system in a third embodiment of the present invention;

fig. 5a is a scanning schematic diagram of a palm-type three-dimensional ultrasonic imaging system in a fourth embodiment of the present invention;

FIG. 5b is a schematic diagram of two consecutive ultrasound images in accordance with a fourth embodiment of the present invention

Fig. 6 is a schematic structural diagram of a positioning reference system and a handheld ultrasonic instrument probe in a sixth embodiment of the invention;

FIG. 7 is a schematic structural diagram of a positioning reference system according to a seventh embodiment of the present invention;

FIG. 8a is a diagram of positioning information obtained by scanning a positioning reference system according to a seventh embodiment of the present invention;

FIG. 8b is a diagram of another positioning information obtained by scanning the positioning reference system according to the seventh embodiment of the present invention;

FIG. 9 is a schematic diagram of a palm-type ultrasound probe in a preferred embodiment of the present invention;

fig. 10 is a schematic diagram of a palm-type three-dimensional ultrasonic imaging method provided by the invention.

Detailed Description

In order that those skilled in the art will more clearly understand the present invention, the present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.

As shown in fig. 1, the present invention discloses a palm-type three-dimensional ultrasonic imaging system, which comprises a palm-type ultrasonic instrument probe 100; the display, control and processing terminal 300 is connected with the handheld ultrasonic instrument probe 100 in a wired or wireless connection mode; the palm type three-dimensional space positioning system 200 is connected with the palm type ultrasonic instrument probe 100, moves along with the movement of the palm type ultrasonic instrument probe 100 and is connected with the display, control and processing terminal 300 in a wired or wireless connection mode. In fig. 1, the handheld three-dimensional spatial positioning system 200 is mounted on the handheld ultrasonic probe 100, but in other embodiments, it only needs to be connected to the handheld ultrasonic probe 100 and can move along with the movement of the handheld ultrasonic probe 100, and it does not necessarily need to be mounted on the handheld ultrasonic probe 100, and the specific arrangement manner is not limited herein. The display, control and processing terminal 300 of the present invention may be a palm-type terminal or a desktop terminal, such as a laptop computer, which may be connected to the palm-type ultrasound probe 100 in a wireless or wired manner. The display, control and processing terminal 300 stores therein three-dimensional imaging, image processing and three-dimensional display algorithms, directly analyzes and processes the image and data information transmitted back by the palm-type ultrasonic probe 100, and displays a three-dimensional image.

As shown in fig. 2, since the handheld three-dimensional ultrasound imaging system is required to be small, light and portable, in order to reduce the volume of the handheld three-dimensional ultrasound imaging system, the handheld three-dimensional ultrasound imaging system of the present invention further includes a cloud database 400 and a similar processing system. Thus, the display, control and processing terminal 300 transmits the three-dimensional position information, the angle and the reconstruction result to the cloud database 400 for storage. In the cloud database 400, the reconstructed results may be stored in a classified manner, for example, the names of the clients are used for time classified storage, so that the users can compare the change conditions of the to-be-detected part 600 in different time periods, or the names of different diseases are used for classified storage, so that the users can refer to the change conditions of the to-be-detected part 600 of other users.

Further, in order to make the handheld three-dimensional ultrasonic imaging system more compact and improve its portability, only simple three-dimensional imaging, image processing and three-dimensional display algorithms are stored in the display, control and processing terminal 300, and simple analysis and processing are performed on the image and data information. The display, control and processing terminal 300 is connected to the cloud database 400 and similar processing systems through a network, bluetooth and the like, higher-level and more complex three-dimensional imaging, image processing and three-dimensional display algorithms can be stored in the cloud database 400, the display, control and processing terminal 300 uploads the simply processed information to the cloud database 400 for analysis and processing, and the cloud database 400 transmits the analyzed and processed result back to the display, control and processing terminal 300 of the handheld ultrasonic instrument for display or further processing. Even, the display, control and processing terminal 300 may not store the three-dimensional imaging, image processing and three-dimensional display algorithm, and only needs to directly upload the image and data information transmitted back by the palm-type ultrasonic probe 100 to the cloud database 400, and after performing operation, analysis and processing through the three-dimensional imaging, image processing and three-dimensional display algorithm in the cloud database 400, transmit the processed information back to the display, control and processing terminal 300 for display. Similarly, in the cloud database 400, the reconstructed results can still be stored in a classified manner, so that a client can conveniently retrieve the data of the reconstructed results from the cloud database 400 for query. The cloud database 400 may be a remote storage and computing device.

The palm-type three-dimensional space positioning system 200 is a device which is convenient to move and install, is connected with the palm-type ultrasonic instrument probe 100 and can move along with the movement of the palm-type ultrasonic instrument probe 100, and the palm-type three-dimensional ultrasonic imaging system directly acquires the three-dimensional space position of the palm-type ultrasonic instrument probe 100 through the palm-type three-dimensional space positioning system 200 without other positioning systems. Preferably, the palm-type three-dimensional spatial location system 200 is built into the palm-type ultrasonic instrument probe 100, so that when the palm-type three-dimensional ultrasonic imaging system of the invention is used, a non-portable location system does not exist, which affects the portability of the palm-type three-dimensional ultrasonic imaging system. There are six embodiments as to how the three-dimensional spatial localization system 200 obtains the three-dimensional position information and angle information of the palm-type ultrasound probe 100.

As shown in fig. 3, in order to improve the accuracy of positioning, the three-dimensional palm-type ultrasonic imaging system may further include a positioning reference device 500, which is located outside the palm-type ultrasonic probe 100 and is used for providing a positioning reference for the three-dimensional palm-type spatial positioning system 200.

Example one

The palm-type three-dimensional space positioning system 200 includes micro inertial sensors such as an accelerometer and an angular velocity meter mounted on the palm-type ultrasonic probe 100, and is used for obtaining acceleration and angular acceleration values of the palm-type ultrasonic probe 100, so as to calculate a moving distance and a rotating angle of the palm-type ultrasonic probe 100, and further independently obtain a three-dimensional space position of the palm-type ultrasonic probe 100.

Example two

The handheld three-dimensional space positioning system 200 comprises one or more cameras mounted on the handheld ultrasonic instrument probe 100 and micro inertial sensors such as an accelerometer, an angular velocity meter and the like mounted in the handheld ultrasonic instrument probe 100. The positioning reference device 500 is an external environment. The camera is used for acquiring images of the surrounding environment, such as grids on a ceiling, and calculating the position and the angle of the handheld ultrasonic instrument probe 100 according to the acquired image change, and special patterns can be simply added in the environment to facilitate detection. The accelerometer and the angular velocity meter are used for obtaining the acceleration and the angular acceleration values of the palm-type ultrasonic instrument probe 100, so that the moving distance and the moving angle of the palm-type ultrasonic instrument probe 100 are calculated. The combination of the accelerometer, the angular velocity meter and the camera makes the positioning more accurate. Before the handheld three-dimensional space positioning system 200 is used, the handheld ultrasonic probe 100 needs to move a known distance or rotate a known angle for determining various parameters required in a positioning algorithm.

EXAMPLE III

As shown in fig. 4, the handheld three-dimensional space positioning system 200 is a miniature inertial sensor such as an accelerometer, an angular velocity meter, etc. mounted on the handheld ultrasonic probe 100. The hand-held three-dimensional ultrasound system further comprises a positioning reference device 500, wherein the positioning reference device 500 is a small reference system installed on or near the scanned object, namely, installed outside the hand-held ultrasound probe 100, and is used for providing a positioning reference for the hand-held three-dimensional space positioning system 200. The miniature reference system is a miniature electromagnetic emitter mounted on the scanned object. Besides electromagnetic emitters, sound or light emitting and receiving systems can be used, i.e. the traditional light, sound and electromagnetic handheld three-dimensional space positioning system can be miniaturized. The accelerometer and the angular velocity meter are used for obtaining the acceleration and the angular acceleration values of the palm-type ultrasonic instrument probe 100, so that the moving distance and the moving angle of the palm-type ultrasonic instrument probe 100 can be calculated. The combination of accelerometers, angular velocity gauges and small reference systems allows for more accurate positioning.

In addition, the miniature reference system can also be one or more miniature cameras placed on the scanning body, and the rotation angles of the miniature cameras are recorded to track the movement and the angles of the probe.

Example four

The palm-type three-dimensional space positioning system 200 in the fourth embodiment is a miniature inertial sensor such as an accelerometer and an angular velocity meter. The hand-held three-dimensional ultrasound system further comprises a positioning reference device 500, the positioning reference device 500 being the ultrasound image itself.

As shown in fig. 5a, when the hand-held ultrasound probe 100 moves, the left and right ultrasound images in fig. 5b are obtained sequentially. The two ultrasound images have continuity and a certain image overlap, i.e., there is a great similarity between the contents of the ultrasound images obtained in sequence. When the image sampling speed is high and the moving speed is not fast, the images in the two images have a difference of a distance d, so that the moving distance can be obtained from the difference between the sequentially obtained ultrasonic images in an image matching mode. The angle of rotation of the hand-held ultrasound probe 100 in this plane can also be obtained in the same way. However, when the ultrasound image itself is used alone, the limitation is that the hand-held ultrasound probe 100 can only move or rotate in one direction, and when the hand-held ultrasound probe 100 moves or rotates in the opposite direction, it is easy to cause an error in calculating the acquired three-dimensional position information or angle information.

Therefore, in this embodiment, the micro inertial sensors such as the accelerometer and the angular velocity meter are used in cooperation with the ultrasound image, and the micro inertial sensors such as the accelerometer and the angular velocity meter are used to obtain the acceleration and the angular acceleration of the palm-type ultrasound probe 100, so as to calculate the moving distance and the angle of the palm-type ultrasound probe 100, and supplement data obtained from the image, so that the positioning method is more accurate.

EXAMPLE five

The difference between the fifth embodiment and the fourth embodiment is that the palm-type ultrasonic probe in the fifth embodiment adopts a composite probe, that is, sub-probes in different directions are installed in one palm-type ultrasonic probe 100, and are used for simultaneously measuring the moving distance and the rotating angle of the palm-type ultrasonic probe 100 in two directions. The palm-type three-dimensional space positioning system 200 is still a micro inertial sensor such as an accelerometer, an angular velocity meter, and the like, and is used for obtaining acceleration and angular acceleration values of the palm-type ultrasonic probe 100 and calculating the moving distance and angle of the palm-type ultrasonic probe 100. Thus, the palm-type three-dimensional space positioning system 200 can detect the moving amount and the rotating amount in the third direction except the direction provided by the composite probe, and further more accurately calculate the three-dimensional position information and the angle of the palm-type ultrasonic probe 100.

EXAMPLE six

As shown in fig. 6, the handheld three-dimensional ultrasound imaging system further includes a positioning reference device 500, and in this embodiment, the positioning reference device 500 is a positioning image 501 disposed on the surface of the scanned object. The handheld three dimensional spatial locator system 200 includes a camera 201 mounted on the handheld ultrasound probe 100. When the hand-held ultrasound probe 100 moves, the camera 201 tracks the moving distance and the rotating angle of the hand-held ultrasound probe 100 according to the change of the positioning image 501. Preferably, the handheld three-dimensional space positioning system 200 further includes a miniature inertial sensor such as an accelerometer, an angular velocity meter, etc. mounted on the handheld ultrasonic probe 100 for further providing information of the moving distance and the rotating angle of the handheld ultrasonic probe 100. The positioning image 501 may be a diagram of a specific design temporarily attached to the surface of the scanning object, and they are attached beside the to-be-detected part 600 of the object to be scanned, so as to avoid the interference of the positioning image 501 on the ultrasonic signal. In the present embodiment, the positioning image 501 is a dot matrix attached to the to-be-detected part 600, and the distance between a dot in the dot matrix and a dot is a pre-designed value and is known. Preferably, the lattice can also be designed as dots of a size interval for providing a positioning reference more clearly.

In the present embodiment, the camera 201 is used to record the positioning image 501 for positioning, and in other embodiments of the present invention, other similar methods may also be applied, for example, the positioning image 501 with characteristics of sound, light, point, magnetism, etc. is designed to be attached to a scanned object, and a detector is installed on the palm-type ultrasonic probe 100 to record the positioning image 501 outside the portion 600 to be detected for positioning.

EXAMPLE seven

The seventh embodiment is different from the sixth embodiment in that the positioning image 501 of the sixth embodiment is temporarily attached beside the to-be-detected part 600 of the object to be scanned, i.e. the ultrasound does not scan the positioning image 501 to avoid the positioning image 501 from interfering with the ultrasound signal. However, in the sixth embodiment, the interference of the positioning images 501 with the signals of the ultrasound is used for positioning.

As shown in fig. 7, the positioning image 501 is a dot matrix, however, in other embodiments of the present invention, the positioning image 501 may have other shapes, such as a grid, a wave shape, etc., as long as it can provide a positioning reference. The positioning image 501 in this embodiment is attached to the part 600 to be detected, and the distance between a point in the dot matrix and a point is a pre-designed value and is known. Preferably, it may be set in a mode in which there is one large dot every five small dots for providing more clear positioning information. Further, according to the material of the positioning image 501, each point on the lattice has different influence on the ultrasonic signal, as shown in fig. 8a, the reflection signal may be a point, as shown in fig. 8b, or a point with a shaded area, for distinguishing the position of each row or column of points, so that the positioning is more accurate. Preferably, the positioning image 501 and the ultrasonic coupling patch are integrally combined together, so that the use and the adhesion are more convenient, and the operation process is simpler.

Therefore, in this embodiment, there are two positioning methods, the first positioning method is to extract the information of these positioning images 501 from the obtained ultrasound image as positioning information, and then restore the ultrasound image to a state without interference of the positioning images 501 through image processing, and then reconstruct a three-dimensional image of the ultrasound image.

Another positioning method is that, under the condition that the positioning image 501 is attached to the part 600 to be detected, the part 600 to be detected is scanned once to obtain a first ultrasonic image, and the range of the first ultrasonic image may include the positioning image 501 and the range outside the positioning image 501; then, the positioning image 501 is taken away, and the scanning is repeated once again to obtain a second ultrasonic image; the display, control and processing terminal determines the position of the positioning image 501 relative to the second ultrasound image with reference to the obtained first ultrasound image, thereby obtaining a three-dimensional image that is completely unaffected by the positioning image 501 and that has the positioning information of the positioning image 501.

As shown in fig. 9, the present embodiment uses the above positioning image 501 to interfere with the ultrasonic wave to perform the positioning function, and in other embodiments of the present invention, other similar methods may also be applied, for example, the positioning image 501 with optical, electrical, magnetic, etc. characteristics is designed to be attached to the scanned object, and the handheld three-dimensional space positioning system 200 with optical, electrical, magnetic, etc. detectors as a system is mounted on the handheld ultrasonic probe 100 to detect these positioning images 501 for positioning, and the mounting manner of the handheld three-dimensional space positioning system 200 is shown in the figure.

It is to be understood that, in the first to seventh embodiments, all of the palm-type three-dimensional space positioning systems 200, i.e., the camera, the acoustic, optical, electrical, and magnetic detectors, etc., mounted on the palm-type ultrasonic probe 100 may not be mounted on the palm-type ultrasonic probe 100, as long as they can move along with the movement of the palm-type ultrasonic probe 100, and are not limited herein.

The invention further discloses a handheld three-dimensional ultrasonic imaging method, which comprises the following steps as shown in figure 10:

s1, scanning the part to be detected 600 by using the handheld ultrasonic instrument probe 100 to obtain a series of ultrasonic images;

s2, acquiring a three-dimensional space position and an angle corresponding to each ultrasonic image by the handheld three-dimensional space positioning system 200;

and S3, the display, control and processing terminal 300 reconstructs and displays the ultrasonic image and the three-dimensional space information and angle into a three-dimensional image.

The handheld three-dimensional ultrasonic imaging method in step S2 includes the following steps:

s2.1, a positioning reference device 500 is arranged on a scanned object and used for giving a space positioning reference to the handheld three-dimensional space positioning system 200.

The positioning reference device 500 is an electric, magnetic, acoustic, optical or other transmitter installed on the scanned object, and the transmitted electric, magnetic, acoustic, optical or other signals can be received by a corresponding receiver installed on the palm-type ultrasonic probe 100 to be used as a positioning reference; or the positioning image 501 with electrical, magnetic, acoustic, and optical characteristics is placed on the surface of the scanned object, so that it can be detected by the ultrasound transducer on the palm-type ultrasound probe 100, or the electrical, magnetic, acoustic, and optical detectors, and then used for positioning.

The handheld three-dimensional ultrasonic imaging method in step S3 includes the following steps:

s3.1 the display, control and processing terminal 300 reconstructs and displays the ultrasonic image, the three-dimensional space information and the three-dimensional image.

In order to achieve miniaturization of the handheld three-dimensional ultrasound imaging system, when the handheld three-dimensional ultrasound imaging system further includes the cloud database 400 for storing data, the step S3 further includes:

s3.2, the display, control and processing terminal 300 transmits the reconstruction result to the cloud database 400 for storage.

In the cloud database 400, the reconstructed results may be stored in a classified manner, for example, the names of the clients are used for time classified storage, so that the users can compare the change conditions of the to-be-detected part 600 in different time periods, or the names of different diseases are used for classified storage, so that the users can refer to the change conditions of the to-be-detected part 600 of other users.

In order to further miniaturize the handheld three-dimensional ultrasound imaging system and improve the portability of the handheld three-dimensional ultrasound imaging system, the handheld three-dimensional ultrasound imaging system further includes a cloud database 400 for performing data processing, and the step S3 of the imaging method includes:

s3.3, the display, control and processing terminal 300 transmits the ultrasonic image and the three-dimensional space information and angle to the cloud database 400;

s3.4, the cloud database 400 carries out three-dimensional image reconstruction on the ultrasonic image, the three-dimensional spatial information and the angle and transmits a reconstruction result back to the display, control and processing terminal 300;

s3.5, the display, control and processing terminal 300 displays the reconstruction result.

Similarly, in the cloud database 400, the reconstructed results may be stored in a classified manner, so that the client can retrieve the data of the reconstructed results from the cloud database 400 for query.

The handheld three-dimensional space positioning system 300 in the method may be any one of the first to seventh embodiments, and the positioning reference device 500 in the present invention may be when the seventh embodiment is described, that is, the positioning reference device 500 is any one of the second to seventh embodiments. When the positioning reference device 500 is the material capable of interfering with ultrasonic imaging and is disposed on the site 600 to be detected, as shown in the seventh embodiment, step S3 of the imaging method further includes the following steps:

s3.1, the display, control and processing terminal 300 extracts the information of the positioning reference device 500 from the ultrasonic image as positioning information;

s3.2 the display, control and processing terminal 300 restores the ultrasonic image to a state without the interference of the positioning reference device 500, and then reconstructs and displays a three-dimensional image of the ultrasonic image.

In yet another embodiment, the step S1 of the imaging method further includes the steps of:

s1.1, when the positioning reference device 500 is arranged on the part 600 to be detected, the handheld ultrasonic instrument probe 100 is used for scanning the part 600 to be detected to obtain a first ultrasonic image;

s1.2, taking the positioning reference device 500 away, and scanning the part to be detected 600 by using the palm-type ultrasonic instrument probe 100 again to obtain a second ultrasonic image;

meanwhile, step S3 of the image forming method further includes the steps of:

s3.6 the display, control and processing terminal 300 determines the position of the positioning reference device 500 relative to the second ultrasound image according to the first ultrasound image as a reference, thereby reconstructing and displaying the ultrasound image and the three-dimensional spatial information and angle.

In summary, the handheld three-dimensional ultrasonic imaging system and method disclosed by the invention do not have a traditional space positioning system which is large in size and inconvenient to carry, and can complete the positioning of the probe of the handheld ultrasonic instrument through the portable handheld three-dimensional space positioning system and the positioning reference device, even by independently adopting the handheld three-dimensional space positioning system, so that a user can conveniently carry and use the handheld three-dimensional ultrasonic imaging system disclosed by the invention at any time, and a miniaturized and portable handheld three-dimensional ultrasonic imaging system is obtained.

It will be understood that modifications and variations can be made by persons skilled in the art in light of the above teachings and all such modifications and variations are intended to be included within the scope of the invention as defined in the appended claims.

Claims (13)

1. A palm-type three-dimensional ultrasonic imaging system comprises a palm-type ultrasonic instrument probe (100) for scanning and acquiring ultrasonic images;

the display, control and processing terminal (300) is connected with the handheld ultrasonic instrument probe (100) in a wired or wireless connection mode;

it is characterized by also comprising:

the handheld three-dimensional space positioning system (200) is connected with the handheld ultrasonic instrument probe (100), moves along with the movement of the handheld ultrasonic instrument probe (100), is connected with the display, control and processing terminal (300) in a wired or wireless connection mode, and is used for independently positioning the three-dimensional position and angle information of the handheld ultrasonic instrument probe (100).

2. The hand-held three-dimensional ultrasound imaging system according to claim 1, further comprising a positioning reference device (500) located outside said hand-held ultrasound probe (100) for providing a positioning reference for the hand-held three-dimensional spatial positioning system (200).

3. The hand-held three-dimensional ultrasound imaging system according to claim 1, wherein the hand-held three-dimensional spatial location system (200) is built into the hand-held ultrasound probe (100).

4. The palm-type three-dimensional ultrasonic imaging system according to claim 1, wherein the palm-type three-dimensional space positioning system (200) is an accelerometer or an angular velocity meter mounted on the palm-type ultrasonic probe (100) and used for obtaining the acceleration or the angular acceleration value of the palm-type ultrasonic probe (100) and further obtaining the moving distance and the rotating angle of the palm-type ultrasonic probe (100).

5. The palm-type three-dimensional ultrasonic imaging system according to claim 2, characterized in that the positioning reference device (500) is a positioning image (501) arranged on the part (600) to be detected, and the palm-type three-dimensional space positioning system (200) comprises a camera (201) for detecting the position of the positioning image (501) and giving a positioning reference; and the accelerometer or the angular velocity meter is used for obtaining the acceleration or the angular acceleration value of the palm-type ultrasonic instrument probe (100) so as to further obtain the moving distance and the rotating angle of the palm-type ultrasonic instrument probe (100).

6. The hand-held three-dimensional ultrasound imaging system according to claim 1, further comprising a cloud database (400) communicatively connected to the display, control and processing terminal (300), wherein the ultrasound image and the three-dimensional position and angle information are obtained from the display, control and processing terminal (300) through a wireless or wired data transmission device for data processing, and the data processing result is returned to the display, control and processing terminal (300).

7. A palm type three-dimensional ultrasonic imaging method is characterized by comprising the following steps:

s1, scanning the part to be detected (600) by using the handheld ultrasonic instrument probe (100) to acquire a series of ultrasonic images;

s2, acquiring three-dimensional space position and angle information corresponding to each frame of ultrasonic image through the handheld three-dimensional space positioning system (200);

and S3, reconstructing and displaying the ultrasonic image, the three-dimensional space information and the angle.

8. The palm-type three-dimensional ultrasonic imaging method according to claim 7, wherein the step S3 is:

s3, the ultrasonic images, the three-dimensional spatial position and the angle information are transmitted to a cloud database (400) through a wireless or wired data transmission device to be subjected to image reconstruction, analysis, calculation and comparison, and the cloud database (400) transmits the results of image reconstruction, analysis, calculation and comparison back to the display, control and processing terminal (300) to be displayed.

9. The palm-type three-dimensional ultrasonic imaging method according to claim 7, wherein the step S3 is:

and S3, reconstructing and displaying the ultrasonic image and the three-dimensional space information and angle through a display, control and processing terminal (300).

10. The palm-type three-dimensional ultrasonic imaging method according to claim 7, characterized in that the palm-type three-dimensional space positioning system (200) is an accelerometer or an angular velocity meter mounted on the palm-type ultrasonic probe (100) and is used for obtaining the acceleration or the angular acceleration value of the palm-type ultrasonic probe (100) and further obtaining the moving distance and the rotating angle of the palm-type ultrasonic probe (100).

11. The palm-type three-dimensional ultrasonic imaging method according to claims 7 to 10, wherein the step S2 of the imaging method comprises the steps of:

s2.1, the three-dimensional space positioning system (200) is used for scanning the positioning reference device (500) and providing space positioning reference for the handheld three-dimensional space positioning system (200).

12. The palm-type three-dimensional ultrasonic imaging method according to claim 11, wherein the positioning reference device (500) is arranged at the part (600) to be detected, and the step S3 of the imaging method further comprises the following steps:

s3.1, the display, control and processing terminal (300) extracts the information of the positioning reference device (500) from the ultrasonic image as positioning information;

s3.2, the display, control and processing terminal (300) restores the ultrasonic image to a state without the interference of the positioning reference device (500), and then reconstructs and displays a three-dimensional image of the ultrasonic image.

13. The palm-type three-dimensional ultrasonic imaging method according to claim 11, wherein the positioning reference device (500) is arranged at the part (600) to be detected, and the step S1 of the imaging method further comprises the following steps:

s1.1, when the positioning reference device (500) is arranged on a part (600) to be detected, scanning the part (600) to be detected by using the palm type ultrasonic instrument probe (100) to obtain a first ultrasonic image;

s1.2, taking the positioning reference device (500) away, and scanning the part (600) to be detected by using the palm type ultrasonic instrument probe (100) again to obtain a second ultrasonic image;

step S3 of the image forming method further includes the steps of:

s3.6 the display, control and processing terminal (300) determines the position of the positioning reference device (500) relative to the second ultrasonic image according to the first ultrasonic image as a reference, thereby reconstructing and displaying the ultrasonic image and the three-dimensional spatial information and angle.