EP3122268B1 - Quality assurance and data coordination for electromagnetic tracking systems - Google Patents
Quality assurance and data coordination for electromagnetic tracking systems Download PDFInfo
- Publication number
- EP3122268B1 EP3122268B1 EP15718266.8A EP15718266A EP3122268B1 EP 3122268 B1 EP3122268 B1 EP 3122268B1 EP 15718266 A EP15718266 A EP 15718266A EP 3122268 B1 EP3122268 B1 EP 3122268B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- electromagnetic
- grid
- tracking
- sensor
- calibration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
- 238000000275 quality assurance Methods 0.000 title claims description 29
- 210000003484 anatomy Anatomy 0.000 claims description 9
- 238000003780 insertion Methods 0.000 claims description 8
- 230000037431 insertion Effects 0.000 claims description 8
- 238000001125 extrusion Methods 0.000 claims description 7
- 238000012360 testing method Methods 0.000 claims description 4
- 230000005672 electromagnetic field Effects 0.000 claims 24
- 230000003993 interaction Effects 0.000 claims 1
- 210000002307 prostate Anatomy 0.000 description 24
- 238000000034 method Methods 0.000 description 19
- 239000000523 sample Substances 0.000 description 18
- 238000002725 brachytherapy Methods 0.000 description 16
- 238000002604 ultrasonography Methods 0.000 description 12
- 230000009466 transformation Effects 0.000 description 10
- 238000013152 interventional procedure Methods 0.000 description 7
- 230000003044 adaptive effect Effects 0.000 description 5
- 210000000664 rectum Anatomy 0.000 description 5
- 238000012937 correction Methods 0.000 description 4
- 238000005259 measurement Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 210000004197 pelvis Anatomy 0.000 description 2
- 238000000844 transformation Methods 0.000 description 2
- 238000010200 validation analysis Methods 0.000 description 2
- 210000001015 abdomen Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods
- A61B17/34—Trocars; Puncturing needles
- A61B17/3403—Needle locating or guiding means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/06—Devices, other than using radiation, for detecting or locating foreign bodies ; Determining position of diagnostic devices within or on the body of the patient
- A61B5/061—Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body
- A61B5/062—Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body using magnetic field
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N5/00—Radiation therapy
- A61N5/10—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
- A61N5/1001—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy using radiation sources introduced into or applied onto the body; brachytherapy
- A61N5/1027—Interstitial radiation therapy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N5/00—Radiation therapy
- A61N5/10—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
- A61N5/1048—Monitoring, verifying, controlling systems and methods
- A61N5/1075—Monitoring, verifying, controlling systems and methods for testing, calibrating, or quality assurance of the radiation treatment apparatus
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods
- A61B17/00234—Surgical instruments, devices or methods for minimally invasive surgery
- A61B2017/00238—Type of minimally invasive operation
- A61B2017/00274—Prostate operation, e.g. prostatectomy, turp, bhp treatment
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods
- A61B2017/00681—Aspects not otherwise provided for
- A61B2017/00725—Calibration or performance testing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods
- A61B17/34—Trocars; Puncturing needles
- A61B17/3403—Needle locating or guiding means
- A61B2017/3405—Needle locating or guiding means using mechanical guide means
- A61B2017/3411—Needle locating or guiding means using mechanical guide means with a plurality of holes, e.g. holes in matrix arrangement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2051—Electromagnetic tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/02—Operational features
- A61B2560/0223—Operational features of calibration, e.g. protocols for calibrating sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N5/00—Radiation therapy
- A61N5/10—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
- A61N5/1001—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy using radiation sources introduced into or applied onto the body; brachytherapy
- A61N5/1007—Arrangements or means for the introduction of sources into the body
- A61N2005/1012—Templates or grids for guiding the introduction of sources
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N5/00—Radiation therapy
- A61N5/10—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
- A61N5/1001—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy using radiation sources introduced into or applied onto the body; brachytherapy
Definitions
- the present invention generally relates to an electromagnetic ("EM") tracking system incorporated within an interventional procedure (e.g., a prostate brachytherapy procedure).
- the present invention specifically relates to a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.)
- Document WO2013/144832 discloses an electromagnetic quality assurance system according to the preamble of claim 1.
- an EM field 21 is generated by an EM field generator 20 that is located close to a pelvic region of a patient 11.
- a tracking field of view may be 50 ⁇ 50 ⁇ 50 cm.
- a typical position for EM field generator 20 during the prostate brachytherapy 10 would be above an abdomen of patient 11, because this position typically leads to minimal physical interference with the existing clinical setup.
- EM field generator 20 is usually held in place using a mounting arm (not shown) that is attached to a treatment table (not shown).
- EM field generator 20 may be parallel to the table or angled towards the prostate, depending on the patient-specific geometry and set-up.
- the position of EM field generator 20 with respect to the tracked pelvic region of patient 11 plays a vital role in an achievable tracking accuracy of an intervention of a catheter/needle 13 with a prostate 15 of patient 11 as guided by a grid template 12 and an achievable tracking accuracy of an imaging of prostate 15 by an ultrasound probe 14 as guided by grid template 12.
- the accuracy of the EM measurements from each EM sensor (not shown) coupled to catheter/needle 13 and to ultrasound probe 14 depends on a position of each EM sensor relative to EM field generator 20. This is due to the fact that EM field 21 produced by EM field generator 20 is not perfectly homogeneous.
- a treatment plan based on the transrectal ultrasound (“TRUS") images from ultrasound probe 14 may indicate a distance through holes of grid 12 of each catheter/needle 13 to achieve an intended dose delivery for prostate 15.
- grid 12 also serves to determine a common data coordinate system for EM data and TRUS data.
- an EM-tracked tool (not shown) is positioned at different holes of grid 12 and the recorded EM data is fit to the known grid hole pattern.
- the EM-tracked tool must be positioned perfectly perpendicular to each grid hole and at the same depth. Otherwise, if the EM-tracked tool is not perpendicular to the grid hole and/or is inserted to varying depths in different holes, the resulting estimated grid plane will not be accurately representative of the actual grid 12. This will result in errors in the estimated location of catheter/needle 13 with respect to grid 12 as compared to the actual location of catheter/needle 13 with respect to grid 12. It will also result in a distorted/inaccurate three-dimensional ("3D") image reconstruction of the anatomy in the grid coordinate system (i.e., patient coordinate system). Therefore, prior to EM-tracked prostate brachytherapy procedure 10, it is also necessary to facilitate an accurate and repeatable definition of the grid plane to thereby ensure high EM tracking accuracy during procedure 10.
- 3D three-dimensional
- the present invention proposes to provide a system for quality assurance in validating and improving a performance accuracy of the EM tracking system and an easy-to-use system for establishing a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.).
- interventional tools e.g., ultrasound probes, catheters, needles, etc.
- One form of the present invention is an EM quality assurance ("EMQA") system employing an EM field generator, an EM sensor block, an EMQA workstation and a reference EM sensor operable to be registered to the EM sensor block.
- the EM sensor block includes one or more EM sensors positioned and oriented to represent a simulated electromagnetic tracking of one or more interventional tools inserted through the electromagnetic sensor block (40) into an anatomical region.
- the EMQA workstation tests an electromagnetic tracking accuracy of an insertion of the interventional tool(s) through the electromagnetic sensor block into the anatomical region and computes at least one metric indicative of a quality of the electromagnetic tracking accuracy of a tracking location of each of the at least one EM sensor.
- a second form of the present invention is an EM tracking configuration system employing the aforementioned EMQA system and an EM data coordination ("DC") system on the same or different platforms.
- the EMDC system employs an EM field generator, one or more EM calibration tools, and a EMDC workstation. Each EM calibration tool has one or more EM sensors.
- the EM field generator generates an EM field encircling the EM calibration tool(s) mechanically interacting with a grid for guiding one or more interventional tools into an anatomical region
- the EMDC workstation establishes a coordination system for electromagnetically tracking an insertion of the interventional tool(s) through the grid into the anatomical region.
- an exemplary embodiment of an EM tracking configuration system of the present invention as shown in FIG. 1 will be provided herein. From the description of the exemplary embodiment of the EM tracking configuration system, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to (1) an implementation of the EM tracking configuration system as a stand-alone system for quality assurance and data coordination of EM tracking of interventional tools and (2) an incorporation of the EM tracking configuration system into various types of standard and innovative planning/guidance/navigation EM tracking platforms as known in the art.
- the EM tracking configuration system of the present invention is employs an EM quality assurance ("EMQA") system 30 and an EM data coordination system (“EMDC”) system 70, both utilizing EM field generator 20 of any type as known in the art and one or more EM sensors 22 of any type as known in the art.
- EMQA EM quality assurance
- EMDC EM data coordination system
- the EM tracking configuration system is utilized to qualitatively configure EM field generator 20 and EM sensors 22 in a tracking arrangement specific to a patient-equipment geometry of a particular interventional procedure.
- EMQA system 30 employs (1) a EM sensor block 40 containing a known positional and orientational arrangement of EM sensors 22 with respect to each other, and (2) an EM quality assurance ("EMQA") workstation 50 executing one or more validation test(s) of EM sensors 22 as contained within EM sensor block 40 based on a positioning of EM field generator 20 relative to EM sensor block 40 analogous to a positioning of EM field generator 20 relative to EM sensors 22 as coupled to interventional tools (e.g., ultrasound probe, catheter, needle, etc.) during an interventional procedure.
- interventional tools e.g., ultrasound probe, catheter, needle, etc.
- EM sensors 22 may be removably or permanently contained within channels of EM sensor block 40, and the validation test(s) executed by EMQA workstation 50 may incorporate an additional EM sensor 22 as a reference EM sensor attached to or spatially positioned from EM sensor block 40 within the FOV of EM field generator 20.
- EMDC system 70 employs (1) one or more EM calibration tools 80 in a known working relationship with EM sensors 22, and (2) an EM data coordination ("EMDC") system 90 to establish a patient coordinate system for EM tracking of interventional tools (e.g., ultrasound probe, catheter, needle, etc.).
- interventional tools e.g., ultrasound probe, catheter, needle, etc.
- EM calibration tools 80 may include one or more interventional tools to be utilized during the interventional procedure, and one or more pieces of equipment to be utilized during the interventional procedure for guiding the interventional tools may serve as the basis for establishing the patent coordinate system.
- (1) EM sensor block 40 may serve as an EM calibration tool 80
- (2) EMQA workstation 50 and EMDC workstation 90 may be individual physical workstations or logic workstations installed within a single physical platform (e.g., an EM planning/guidance/navigation platform).
- exemplary embodiments of the present invention will be provided herein directed to EMQA system 30 as shown in FIGS. 3-6 and EMDC system as shown in FIGS. 7-12 in the context of a prostate brachytherapy procedure. From the description of the exemplary embodiments, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to any type of interventional procedure.
- a transparent, non-magnetic EM sensor block 41 contains a EM sensor group 42 and an EM sensor group 43.
- the EM sensors of groups 42 and 43 are EM coils permanently embedded in channels extending through EM sensor block 41.
- the EM sensors of groups 42 and 43 are EM coils removably inserted within the channels (e.g., via a guidewire).
- inter-sensor distances and sensor orientations of EM sensor groups 42 and 43 on EM sensor block 41 are chosen so as to represent a typical prostrate brachytherapy scenario.
- an average height of a prostate and a rectum from a treatment table 44 is known apriori. Therefore, EM sensor grouping 42 is distanced relative to treatment table 44 whereby a subset of EM sensor group 42 represents channels covering a patient prostate area for guiding a catheter or a needle into the patient prostate area highlighted by a gray circle encircling the subset of EM sensor group 42.
- EM sensor group 43 is distanced relative to treatment table 44 whereby EM sensor group 43 represents channels covering a patient rectum area for guiding a transrectal ultrasound (“TRUS") probe into the patient rectum area highlighted by a gray circle encircling EM sensor grouping 43.
- EM sensors 22A and 22B of EM sensor group 42 represent channels covering a patient prostate area 18 for guiding a catheter 16 into patient prostate area 18, and an EM sensor 22C of EM sensor group 43 represents channels covering a patient rectum area 19 for guiding a transrectal ultrasound (“TRUS”) probe 17 into patient rectum area 19.
- an EMQA workstation 51 employs a network 52 of modules 53-55 and a EM reference sensor 22R for implementing a EM quality assurance method, which is not part of the invention, as represented by a flowchart 60 of FIG. 5 .
- modules 53-55 are structurally configured as hardware, software, firmware and/or circuitry of workstation 51, and EM reference sensor 22R is of any type suitable to be coupled to treatment table 44 or any other fixed object within a FOV of EM field generator 20.
- EM field generator 20 is coupled to a mount 23 and angled toward EM sensor block 41, and EM sensors 22A-22C of EM sensor block 41 are utilized as tracking locations. Nonetheless, in practice, EM field generator 20 may have any orientation toward EM sensor block 41, and more or less EM sensors 22 may be utilized as tracking locations.
- a stage S62 of flowchart 60 encompasses an EM user interface 53 ( FIG. 3 ), as directed by a user, acquiring EM data derived from EM field 21 of EM field generator 20 encircling EM sensors 22A-22C and 22R.
- EM user interface 53 may provide feedback to the user indicative of whether EM reference sensor 22R is in an "acceptable" position with respect to a position of EM field generator 20. If not, EM field generator 20 and/or EM reference sensor 22R may be repositioned to position EM reference sensor 22R in an "acceptable" position with respect to a position of EM field generator 20.
- a stage S64 of flowchart 60 encompasses an EM tester 54 ( FIG. 3 ) computing one or more metrics indicative of a quality of EM field generator 20 in tracking locations of EM sensors 22A-22C.
- EM tester 54 computes a temporal measurement noise in a position estimate of EM sensors 22A-22C.
- EM tester 54 computes an EM-estimated inter-sensor distance of EM sensors 22A-22C and compares the computation to the known geometry of EM sensor block 41.
- EM tester 54 computes an absolute position of EM reference sensor 22R with respect to EM field generator 20.
- EM tester 54 computes two (2) or more of metric embodiments (i)-(iii) and assigns a cumulative "quality score" to the overall configuration of EM sensor block 41 and EM field generator 20.
- Stage S64 further encompasses EM tester 54 ( FIG. 3 ) providing any suitable type of user feedback representative of the computed quality of EM field generator 20 in tracking locations of EM sensors 22A-22C.
- a green light may be indicative of an acceptable configuration of EM sensor block 41 and EM field generator 20
- a red light may be indicative of an unacceptable configuration of EM sensor block 41 and EM field generator 20.
- a two-dimensional (“2D”) or a three-dimensional (“3D”) accuracy map 56 for EM field generator 20 is generated and displayed to indicate the accuracy in tracking locations of EM sensors 22A-22C.
- optional stage S66 of flowchart 60 encompasses an EM distortion corrector 55 ( FIG. 6 ) estimating a function f to correct any distortion within EM field 21.
- a transformation ( T EMi , i ⁇ 1,2,3 ⁇ ) from each of EM sensors 22A-22C ( C EMi , i ⁇ 1,2,3 ⁇ ) to a reference coordinate system ( C Ref ) associated with EM reference sensor 22R is known from a precise design of EM sensor block 41 in view of EM reference sensor 22R being contained within or registered to EM sensor block 41. Therefore, T EMi ⁇ Ref are known transformations.
- correction function f is normally performed prior to the prostate brachytherapy procedure whereby during the procedure, various EM-EM transformations are utilized (e.g., EM needle -> reference, EM TRUS -> reference, etc.).
- various EM-EM transformations are utilized (e.g., EM needle -> reference, EM TRUS -> reference, etc.).
- This new probe position is more accurate and takes into account any distortion within EM field 21.
- EM distortion corrector 55 may also include multiple locations for sensors 22A-22C and 22R. Therefore, for each such set 'x' of locations, a correction function 'f x ' may be calculated. During the procedure, one of the functions 'f x ' is used, depending on which EM transformation needs to be corrected. The appropriate function 'f x ' is chosen based on sensor locations for the transformation to be corrected.
- the QA procedure is intended to be performed on EM sensor block 41 in a clinical environment just prior to the prostate brachytherapy procedure. Additionally, a positioning of EM reference sensor 22R on treatment table 44 may be re-verified prior to the procedure with the patient already on treatment table 44. This may represent the final QA check for EM system accuracy prior to the prostate brachytherapy procedure.
- a set of EM calibration tools 81 employs (1) an EM calibration device 82 structurally configured to be controllable by hand or a robot, (2) a grid calibration frame 83 structurally configured to be attached to a prostate brachytherapy grid (aka template) as known in the art (e.g., grid 120 as shown in FIG. 10 ) and facilitate the use of EM calibration device 82, and (3) an EM calibration device 84 structurally configured to be mated with a prostate brachytherapy grid.
- a prostate brachytherapy grid aka template
- an EM calibration device 84 structurally configured to be mated with a prostate brachytherapy grid.
- EM calibration tools 81 are provided for facilitating a EMDC workstation 91 employing a network 92 of modules 93 and 94 for implementing a patient coordinate system establishment method as represented by a flowchart 100 of FIG. 8 .
- modules 93 and 94 are structurally configured as hardware, software, firmware and/or circuitry of workstation 91.
- a stage S102 of flowchart 100 encompasses an EM data acquirer 93 acquiring EM data via manual or robotic control of one or more of EM calibration tools 81
- a stage S104 of flowchart 100 encompasses an EM data coordinator 94 establishing a patient coordinate system from the EM data.
- EM data coordinator 94 may implement a standard practice or an adaptive version thereof in establishing the coordinate system from the EM data.
- a standard version of the present invention involves a definition of a grid plane in EM space by fitting the acquired EM data points to a "ground truth grid", which is obtained from a known inter-hole distances for the grid.
- a greater weight may be assigned to the specific grid holes utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes.
- an EM calibration tool 82 includes a cylindrical extrusion 82A extending from a primary cylindrical body 82B for holding an EM tracked tool, such as, for example, EM guidewire 110.
- an EM tracked tool such as, for example, EM guidewire 110.
- a distal end 110d of EM guidewire 110 is inserted through body 82B to the extrusion 82A, and a cap 82C is screwed upon body 82B to securely fix a distal end 110d of EM guidewire 110 within extrusion 82A.
- extrusion 82A is dimensioned to snugly fit within a hole of a grid 120.
- EM calibration tool 82 may be inserted into specific holes of grid 120 utilized for needle/catheter insertion to thereby ensure highest accuracy for such grid holes.
- grid calibration frame 83 includes a frame 83A having an array of continuous channels 83B sized to snugly fit extrusion 82A of EM calibration tool 82.
- frame 83A is designed to be attached to a grid 120, and as tool 82 is manually or robotically traversed through channels 83B, EM calibration tool 82 may be inserted into one or more holes of a grid 120 to acquire EM data.
- EM calibration tool 82 may be inserted into specific holes of grid 120 utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes.
- channel array 83A may omit the holes shown in FIG. 11A whereby intersections of channel array 83A are on top of the holes of grid 120 when the frame 83 is attached to grid 120.
- EM calibration tool 82 is moved inside the channels without being inserted into any grid holes, and the EM-position of EM calibration tool 82 is recorded continuously to reconstruct the channel positions in the EM coordinate system.
- the recorded intersection points representative of the grid holes are localized in EM coordinate system using this data to calibrate the grid.
- EM calibration frame 84 has one or several EM position sensors 84B (e.g., five or six degrees of freedom DOF) attached to a frame 84A with a known calibration between the coordinate system of frame 84A and EM position sensors 84B.
- Frame 84A is briefly placed into grid 120, and the EM recording from EM positions sensors 84B is obtained, which allows direct calculation of the EM grid calibration without any manual positioning of a separate tracked tool.
- EM position sensors 84B are sensor coils in known locations relative to frame 84A, and oriented perpendicular to the frame surface whereby the orientation of these sensor coils is identical to the orientation to a needle that may be pushed through holes of grid 120 during the clinical procedure. This identical alignment of the sensor coils ensures optimal EM tracking accuracy.
- EM data acquirer 93 may automatically record EM data at each grid hole when utilizing EM calibration tool 82. Specifically, for manual control of EM calibration tool 82, EM data acquirer 93 evaluates an incoming EM data stream and detects when EM calibration tool 82 is stationary for a pre-determined period of time as an indication that EM calibration tool 82 has been positioned in the appropriate grid hole. A time threshold to detect whether user intends to save the current EM data as the desired coordinate corresponding to the grid hole may be set according to the preferences of the user. Alternatively, for robotic control of tool 82, EM data acquirer 93 may synchronize a recording of the data with an operation of the robot.
- EM data acquirer 93 may notify the user of achieving a desired accuracy of calibration while reaching for more grid holes.
- the calibration fit error is calculated on the fly while more grid hole coordinates are recorded and once the desired pre-selected error is achieved, then the user is notified to stop reaching for more grid holes.
- the notification may be in the form of reporting an error value or showing a color representation (e.g., red for less accuracy than desired and green once reaching the desired accuracy). This is achieved by knowing the physical geometry of the grid and choosing grid holes in a specific order.
- an accurate definition of a grid plane by EMDC workstation 91 is important to ensure that the data coordinate system used is in sync with the physical location of the grid and the prostate. This in turn ensures accuracy in needle/catheter/probe position estimation and 3D image reconstruction, and also allows further QA of the EM system.
- grid 120 was illustrated to facilitate an understanding of the EMDC system of the present invention.
- a grid/template may have any arrangement of holes/channels dependent upon a particular interventional procedure utilizing a EMDC system of the present invention.
- FIGS. 1-9 those having ordinary skill in the art will appreciate numerous benefits of the present invention including, but not limited to, a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.).
- interventional tools e.g., ultrasound probes, catheters, needles, etc.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Veterinary Medicine (AREA)
- Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Pathology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Radiology & Medical Imaging (AREA)
- Robotics (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Biophysics (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
- Radiation-Therapy Devices (AREA)
- Surgical Instruments (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Instructional Devices (AREA)
- Endoscopes (AREA)
Description
- The present invention generally relates to an electromagnetic ("EM") tracking system incorporated within an interventional procedure (e.g., a prostate brachytherapy procedure). The present invention specifically relates to a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.) Document
WO2013/144832 discloses an electromagnetic quality assurance system according to the preamble of claim 1. - The present invention is disclosed in the appended set of claims.
- As shown in
FIG. 1 , in an exemplaryprostate brachytherapy procedure 10 with EM tracking functionality as known in the art, anEM field 21 is generated by anEM field generator 20 that is located close to a pelvic region of apatient 11. For a conventional planar EM field generator 20 (e.g., a brick-shaped EM field generator), a tracking field of view ("FOV") may be 50 × 50 × 50 cm. A typical position forEM field generator 20 during theprostate brachytherapy 10 would be above an abdomen ofpatient 11, because this position typically leads to minimal physical interference with the existing clinical setup.EM field generator 20 is usually held in place using a mounting arm (not shown) that is attached to a treatment table (not shown).EM field generator 20 may be parallel to the table or angled towards the prostate, depending on the patient-specific geometry and set-up. - More importantly during
prostate brachytherapy 10, the position ofEM field generator 20 with respect to the tracked pelvic region ofpatient 11 plays a vital role in an achievable tracking accuracy of an intervention of a catheter/needle 13 with aprostate 15 ofpatient 11 as guided by agrid template 12 and an achievable tracking accuracy of an imaging ofprostate 15 by anultrasound probe 14 as guided bygrid template 12. In other words, the accuracy of the EM measurements from each EM sensor (not shown) coupled to catheter/needle 13 and toultrasound probe 14 depends on a position of each EM sensor relative toEM field generator 20. This is due to the fact thatEM field 21 produced byEM field generator 20 is not perfectly homogeneous. More particularly, there may be sections ofEM field 21 where the tracking accuracy may be compromised in terms of increased absolute position errors and/or noise in the measurements. Therefore, prior to EM-trackedprostate brachytherapy procedure 10, it is necessary to validate the accuracy of the EM system in the clinical environment. - Furthermore, a treatment plan based on the transrectal ultrasound ("TRUS") images from
ultrasound probe 14 may indicate a distance through holes ofgrid 12 of each catheter/needle 13 to achieve an intended dose delivery forprostate 15. In such a fusion brachytherapy system ofEM field generator 20 andultrasound probe 14,grid 12 also serves to determine a common data coordinate system for EM data and TRUS data. To establish this coordinate system in EM space prior toprostate brachytherapy procedure 10, an EM-tracked tool (not shown) is positioned at different holes ofgrid 12 and the recorded EM data is fit to the known grid hole pattern. - More particularly, to achieve an accurate definition of the coordinate system, the EM-tracked tool must be positioned perfectly perpendicular to each grid hole and at the same depth. Otherwise, if the EM-tracked tool is not perpendicular to the grid hole and/or is inserted to varying depths in different holes, the resulting estimated grid plane will not be accurately representative of the
actual grid 12. This will result in errors in the estimated location of catheter/needle 13 with respect togrid 12 as compared to the actual location of catheter/needle 13 with respect togrid 12. It will also result in a distorted/inaccurate three-dimensional ("3D") image reconstruction of the anatomy in the grid coordinate system (i.e., patient coordinate system). Therefore, prior to EM-trackedprostate brachytherapy procedure 10, it is also necessary to facilitate an accurate and repeatable definition of the grid plane to thereby ensure high EM tracking accuracy duringprocedure 10. - The present invention proposes to provide a system for quality assurance in validating and improving a performance accuracy of the EM tracking system and an easy-to-use system for establishing a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.).
- One form of the present invention is an EM quality assurance ("EMQA") system employing an EM field generator, an EM sensor block, an EMQA workstation and a reference EM sensor operable to be registered to the EM sensor block. The EM sensor block includes one or more EM sensors positioned and oriented to represent a simulated electromagnetic tracking of one or more interventional tools inserted through the electromagnetic sensor block (40) into an anatomical region. As the EM field generator generates an EM field encircling the EM sensor(s) and the reference EM sensor, the EMQA workstation tests an electromagnetic tracking accuracy of an insertion of the interventional tool(s) through the electromagnetic sensor block into the anatomical region and computes at least one metric indicative of a quality of the electromagnetic tracking accuracy of a tracking location of each of the at least one EM sensor.
- A second form of the present invention is an EM tracking configuration system employing the aforementioned EMQA system and an EM data coordination ("DC") system on the same or different platforms. The EMDC system employs an EM field generator, one or more EM calibration tools, and a EMDC workstation. Each EM calibration tool has one or more EM sensors. As the EM field generator generates an EM field encircling the EM calibration tool(s) mechanically interacting with a grid for guiding one or more interventional tools into an anatomical region, the EMDC workstation establishes a coordination system for electromagnetically tracking an insertion of the interventional tool(s) through the grid into the anatomical region.
- The foregoing forms and other forms of the present invention as well as various features and advantages of the present invention will become further apparent from the following detailed description of various embodiments of the present invention read in conjunction with the accompanying drawings. The detailed description and drawings are merely illustrative of the present invention rather than limiting, the scope of the present invention being defined by the appended claims and equivalents thereof.
-
FIG. 1 illustrates an exemplary prostate brachytherapy procedure as known in the art. -
FIG. 2 illustrates an exemplary embodiment of a EM tracking configuration system in accordance with the present invention. -
FIG. 3 illustrates an exemplary embodiment of an EM quality assurance system in accordance with the present invention. -
FIG. 4 illustrates an exemplary EM quality assurance set-up in accordance with the present invention. -
FIG. 5 illustrates a flowchart representative of an exemplary embodiment of an EM quality assurance method in accordance with present disclosure. -
FIG. 6 illustrates an exemplary distortion correction in accordance with the present invention. -
FIG. 7 illustrates an exemplary embodiment of an EM data coordination system in accordance with the present invention. -
FIG. 8 illustrates a flowchart representative of an exemplary embodiment of an EM data coordination method in accordance with present disclosure. -
FIGS. 9A-9C illustrate an exemplary embodiment of an EM calibration device in accordance with the present invention. -
FIG. 10 illustrates a grid template as known in the art. -
FIGS. 11A and 11B illustrate an exemplary embodiment of a grid calibration frame in accordance with the present invention. -
FIG. 12 illustrates an exemplary embodiment of a EM calibration frame in accordance with the present invention. - To facilitate an understanding of the present invention, an exemplary embodiment of an EM tracking configuration system of the present invention as shown in
FIG. 1 will be provided herein. From the description of the exemplary embodiment of the EM tracking configuration system, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to (1) an implementation of the EM tracking configuration system as a stand-alone system for quality assurance and data coordination of EM tracking of interventional tools and (2) an incorporation of the EM tracking configuration system into various types of standard and innovative planning/guidance/navigation EM tracking platforms as known in the art. - Referring to
FIG. 1 , the EM tracking configuration system of the present invention is employs an EM quality assurance ("EMQA")system 30 and an EM data coordination system ("EMDC")system 70, both utilizingEM field generator 20 of any type as known in the art and one ormore EM sensors 22 of any type as known in the art. The EM tracking configuration system is utilized to qualitatively configureEM field generator 20 andEM sensors 22 in a tracking arrangement specific to a patient-equipment geometry of a particular interventional procedure. - To this end, for quality assurance in validating and improving a performance accuracy of
EM field generator 20 in trackingEM sensors 22, EMQAsystem 30 employs (1) aEM sensor block 40 containing a known positional and orientational arrangement ofEM sensors 22 with respect to each other, and (2) an EM quality assurance ("EMQA")workstation 50 executing one or more validation test(s) ofEM sensors 22 as contained withinEM sensor block 40 based on a positioning ofEM field generator 20 relative toEM sensor block 40 analogous to a positioning ofEM field generator 20 relative toEM sensors 22 as coupled to interventional tools (e.g., ultrasound probe, catheter, needle, etc.) during an interventional procedure. In practice,EM sensors 22 may be removably or permanently contained within channels ofEM sensor block 40, and the validation test(s) executed by EMQAworkstation 50 may incorporate anadditional EM sensor 22 as a reference EM sensor attached to or spatially positioned fromEM sensor block 40 within the FOV ofEM field generator 20. - On a patient by patient basis,
EMDC system 70 employs (1) one or moreEM calibration tools 80 in a known working relationship withEM sensors 22, and (2) an EM data coordination ("EMDC")system 90 to establish a patient coordinate system for EM tracking of interventional tools (e.g., ultrasound probe, catheter, needle, etc.). In practice,EM calibration tools 80 may include one or more interventional tools to be utilized during the interventional procedure, and one or more pieces of equipment to be utilized during the interventional procedure for guiding the interventional tools may serve as the basis for establishing the patent coordinate system. - Also in practice, (1)
EM sensor block 40 may serve as anEM calibration tool 80, and (2) EMQAworkstation 50 and EMDCworkstation 90 may be individual physical workstations or logic workstations installed within a single physical platform (e.g., an EM planning/guidance/navigation platform). - To facilitate an understanding of the present invention, exemplary embodiments of the present invention will be provided herein directed to
EMQA system 30 as shown inFIGS. 3-6 and EMDC system as shown inFIGS. 7-12 in the context of a prostate brachytherapy procedure. From the description of the exemplary embodiments, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to any type of interventional procedure. - Referring to
FIG. 3 , for the exemplary embodiment of EMQA system 30 (FIG. 2 ), a transparent, non-magneticEM sensor block 41 contains aEM sensor group 42 and anEM sensor group 43. In a first embodiment, the EM sensors of 42 and 43 are EM coils permanently embedded in channels extending throughgroups EM sensor block 41. In a second embodiment, the EM sensors of 42 and 43 are EM coils removably inserted within the channels (e.g., via a guidewire).groups - As shown in
FIG. 3 , inter-sensor distances and sensor orientations of 42 and 43 onEM sensor groups EM sensor block 41 are chosen so as to represent a typical prostrate brachytherapy scenario. Specifically, an average height of a prostate and a rectum from a treatment table 44 is known apriori. Therefore,EM sensor grouping 42 is distanced relative to treatment table 44 whereby a subset ofEM sensor group 42 represents channels covering a patient prostate area for guiding a catheter or a needle into the patient prostate area highlighted by a gray circle encircling the subset ofEM sensor group 42. Similarly,EM sensor group 43 is distanced relative to treatment table 44 wherebyEM sensor group 43 represents channels covering a patient rectum area for guiding a transrectal ultrasound ("TRUS") probe into the patient rectum area highlighted by a gray circle encirclingEM sensor grouping 43. For example, as shown in a side view ofEM sensor block 41 inFIG. 4 , 22A and 22B ofEM sensors EM sensor group 42 represent channels covering apatient prostate area 18 for guiding acatheter 16 intopatient prostate area 18, and anEM sensor 22C ofEM sensor group 43 represents channels covering apatient rectum area 19 for guiding a transrectal ultrasound ("TRUS")probe 17 intopatient rectum area 19. - Referring back to
FIG. 3 , for the exemplary embodiment ofEMQA system 30, anEMQA workstation 51 employs anetwork 52 of modules 53-55 and aEM reference sensor 22R for implementing a EM quality assurance method, which is not part of the invention, as represented by aflowchart 60 ofFIG. 5 . In practice, modules 53-55 are structurally configured as hardware, software, firmware and/or circuitry ofworkstation 51, andEM reference sensor 22R is of any type suitable to be coupled to treatment table 44 or any other fixed object within a FOV ofEM field generator 20. -
Flowchart 60 will now be described herein in the context ofFIG. 4 , wherebyEM field generator 20 is coupled to amount 23 and angled towardEM sensor block 41, andEM sensors 22A-22C ofEM sensor block 41 are utilized as tracking locations. Nonetheless, in practice,EM field generator 20 may have any orientation towardEM sensor block 41, and more orless EM sensors 22 may be utilized as tracking locations. - Referring to
FIG. 5 , a stage S62 offlowchart 60 encompasses an EM user interface 53 (FIG. 3 ), as directed by a user, acquiring EM data derived fromEM field 21 ofEM field generator 20 encirclingEM sensors 22A-22C and 22R. In practice, if specific regions ofEM field 21 afflicted with lower accuracy are known,EM user interface 53 may provide feedback to the user indicative of whetherEM reference sensor 22R is in an "acceptable" position with respect to a position ofEM field generator 20. If not,EM field generator 20 and/orEM reference sensor 22R may be repositioned to positionEM reference sensor 22R in an "acceptable" position with respect to a position ofEM field generator 20. - A stage S64 of
flowchart 60 encompasses an EM tester 54 (FIG. 3 ) computing one or more metrics indicative of a quality ofEM field generator 20 in tracking locations ofEM sensors 22A-22C. - In a first metric embodiment (i),
EM tester 54 computes a temporal measurement noise in a position estimate ofEM sensors 22A-22C. - In a second metric embodiment (ii),
EM tester 54 computes an EM-estimated inter-sensor distance ofEM sensors 22A-22C and compares the computation to the known geometry ofEM sensor block 41. - In a third metric embodiment (iii),
EM tester 54 computes an absolute position ofEM reference sensor 22R with respect toEM field generator 20. - In a fourth metric embodiment (iv),
EM tester 54 computes two (2) or more of metric embodiments (i)-(iii) and assigns a cumulative "quality score" to the overall configuration ofEM sensor block 41 andEM field generator 20. - Stage S64 further encompasses EM tester 54 (
FIG. 3 ) providing any suitable type of user feedback representative of the computed quality ofEM field generator 20 in tracking locations ofEM sensors 22A-22C. - In a first feedback embodiment, a green light may be indicative of an acceptable configuration of
EM sensor block 41 andEM field generator 20, and a red light may be indicative of an unacceptable configuration ofEM sensor block 41 andEM field generator 20. - In a second feedback embodiment, as exemplary shown in
FIG. 3 , a two-dimensional ("2D") or a three-dimensional ("3D")accuracy map 56 forEM field generator 20 is generated and displayed to indicate the accuracy in tracking locations ofEM sensors 22A-22C. - As applicable to any unacceptable inaccuracy in tracking locations of
EM sensors 22A-22C, optional stage S66 offlowchart 60 encompasses an EM distortion corrector 55 (FIG. 6 ) estimating a function f to correct any distortion withinEM field 21. In one embodiment, as exemplarily shown inFIG. 6 , a transformation (TEMi, i∈{1,2,3}) from each ofEM sensors 22A-22C (CEMi, i∈{1,2,3 }) to a reference coordinate system (CRef ) associated withEM reference sensor 22R is known from a precise design ofEM sensor block 41 in view ofEM reference sensor 22R being contained within or registered toEM sensor block 41. Therefore, T EMi→Ref are known transformations. - Furthermore, corresponding transformation matrices T' EMi→Ref are measured by
EM distortion corrector 55 in terms of measured relative position/pose of theEM sensors 22A-22C to the measured pose ofEM reference sensor 22R whereby measured transformation matrices T' EMi→Ref may be different from known transformation matrices T EMi→Ref due to any inaccuracies ofEM field generator 20 and distortions ofEM field 20 insideEM sensor block 41. Therefore a correction function f may be estimated byEM distortion corrector 55 in accordance with the following equation [1]: - In practice, the above estimation of correction function f is normally performed prior to the prostate brachytherapy procedure whereby during the procedure, various EM-EM transformations are utilized (e.g., EM needle -> reference, EM TRUS -> reference, etc.). For example, an EM measurement of a position of a TRUS probe may be corrected in accordance with the following equation [2]:
where, T' P→Rej is the measured probe to reference transformation matrix by the EM tracking system and T P→Ref is the corrected probe to reference transformation matrix. This new probe position is more accurate and takes into account any distortion withinEM field 21. - In practice,
EM distortion corrector 55 may also include multiple locations forsensors 22A-22C and 22R. Therefore, for each such set 'x' of locations, a correction function 'fx' may be calculated. During the procedure, one of the functions 'fx' is used, depending on which EM transformation needs to be corrected. The appropriate function 'fx' is chosen based on sensor locations for the transformation to be corrected. - Referring back to
FIGS. 3 and 4 , the QA procedure is intended to be performed onEM sensor block 41 in a clinical environment just prior to the prostate brachytherapy procedure. Additionally, a positioning ofEM reference sensor 22R on treatment table 44 may be re-verified prior to the procedure with the patient already on treatment table 44. This may represent the final QA check for EM system accuracy prior to the prostate brachytherapy procedure. - Referring to
FIG. 7 , for the exemplary embodiment of EMCD system 70 (FIG. 2 ), a set ofEM calibration tools 81 employs (1) anEM calibration device 82 structurally configured to be controllable by hand or a robot, (2) agrid calibration frame 83 structurally configured to be attached to a prostate brachytherapy grid (aka template) as known in the art (e.g.,grid 120 as shown inFIG. 10 ) and facilitate the use ofEM calibration device 82, and (3) anEM calibration device 84 structurally configured to be mated with a prostate brachytherapy grid.EM calibration tools 81 are provided for facilitating aEMDC workstation 91 employing anetwork 92 of 93 and 94 for implementing a patient coordinate system establishment method as represented by amodules flowchart 100 ofFIG. 8 . In practice, 93 and 94 are structurally configured as hardware, software, firmware and/or circuitry ofmodules workstation 91. - Generally, referring to
FIGS. 7 and 8 , a stage S102 offlowchart 100 encompasses anEM data acquirer 93 acquiring EM data via manual or robotic control of one or more ofEM calibration tools 81, and a stage S104 offlowchart 100 encompasses anEM data coordinator 94 establishing a patient coordinate system from the EM data. In practice,EM data coordinator 94 may implement a standard practice or an adaptive version thereof in establishing the coordinate system from the EM data. For example, a standard version of the present invention involves a definition of a grid plane in EM space by fitting the acquired EM data points to a "ground truth grid", which is obtained from a known inter-hole distances for the grid. Additionally, in an adaptive version, during the fitting process, a greater weight may be assigned to the specific grid holes utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes. The following is a description of exemplary embodiments of eachEM calibration tool 81 in the context of the exemplary adaptive version of stage S104. - Referring to
FIG. 9 , anEM calibration tool 82 includes acylindrical extrusion 82A extending from a primarycylindrical body 82B for holding an EM tracked tool, such as, for example, EM guidewire 110. As best shown inFIG. 9B , adistal end 110d of EM guidewire 110 is inserted throughbody 82B to theextrusion 82A, and acap 82C is screwed uponbody 82B to securely fix adistal end 110d of EM guidewire 110 withinextrusion 82A. As best shown inFIG. 9C ,extrusion 82A is dimensioned to snugly fit within a hole of agrid 120. As related to the adaptive mode of stage S104 (FIG. 8 ),EM calibration tool 82 may be inserted into specific holes ofgrid 120 utilized for needle/catheter insertion to thereby ensure highest accuracy for such grid holes. - Referring to
FIG. 11 ,grid calibration frame 83 includes aframe 83A having an array ofcontinuous channels 83B sized to snugly fitextrusion 82A ofEM calibration tool 82. As best shown inFIG. 11B ,frame 83A is designed to be attached to agrid 120, and astool 82 is manually or robotically traversed throughchannels 83B,EM calibration tool 82 may be inserted into one or more holes of agrid 120 to acquire EM data. In particular, as related to the adaptive mode of stage S104 (FIG. 8 ),EM calibration tool 82 may be inserted into specific holes ofgrid 120 utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes. - Alternatively,
channel array 83A may omit the holes shown inFIG. 11A whereby intersections ofchannel array 83A are on top of the holes ofgrid 120 when theframe 83 is attached togrid 120. As such,EM calibration tool 82 is moved inside the channels without being inserted into any grid holes, and the EM-position ofEM calibration tool 82 is recorded continuously to reconstruct the channel positions in the EM coordinate system. The recorded intersection points representative of the grid holes are localized in EM coordinate system using this data to calibrate the grid. - Referring to
FIG. 12 ,EM calibration frame 84 has one or severalEM position sensors 84B (e.g., five or six degrees of freedom DOF) attached to aframe 84A with a known calibration between the coordinate system offrame 84A andEM position sensors 84B.Frame 84A is briefly placed intogrid 120, and the EM recording fromEM positions sensors 84B is obtained, which allows direct calculation of the EM grid calibration without any manual positioning of a separate tracked tool. In one embodiment,EM position sensors 84B are sensor coils in known locations relative to frame 84A, and oriented perpendicular to the frame surface whereby the orientation of these sensor coils is identical to the orientation to a needle that may be pushed through holes ofgrid 120 during the clinical procedure. This identical alignment of the sensor coils ensures optimal EM tracking accuracy. - Referring back to
FIG. 7 , in practice,EM data acquirer 93 may automatically record EM data at each grid hole when utilizingEM calibration tool 82. Specifically, for manual control ofEM calibration tool 82,EM data acquirer 93 evaluates an incoming EM data stream and detects whenEM calibration tool 82 is stationary for a pre-determined period of time as an indication thatEM calibration tool 82 has been positioned in the appropriate grid hole. A time threshold to detect whether user intends to save the current EM data as the desired coordinate corresponding to the grid hole may be set according to the preferences of the user. Alternatively, for robotic control oftool 82,EM data acquirer 93 may synchronize a recording of the data with an operation of the robot. - Also in practice,
EM data acquirer 93 may notify the user of achieving a desired accuracy of calibration while reaching for more grid holes. The calibration fit error is calculated on the fly while more grid hole coordinates are recorded and once the desired pre-selected error is achieved, then the user is notified to stop reaching for more grid holes. The notification may be in the form of reporting an error value or showing a color representation (e.g., red for less accuracy than desired and green once reaching the desired accuracy). This is achieved by knowing the physical geometry of the grid and choosing grid holes in a specific order. - Referring to
FIGS. 7 and 8 , an accurate definition of a grid plane byEMDC workstation 91 is important to ensure that the data coordinate system used is in sync with the physical location of the grid and the prostate. This in turn ensures accuracy in needle/catheter/probe position estimation and 3D image reconstruction, and also allows further QA of the EM system. - Referring to
FIG. 10 ,grid 120 was illustrated to facilitate an understanding of the EMDC system of the present invention. In practice, a grid/template may have any arrangement of holes/channels dependent upon a particular interventional procedure utilizing a EMDC system of the present invention. - Referring to
FIGS. 1-9 , those having ordinary skill in the art will appreciate numerous benefits of the present invention including, but not limited to, a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.). - While various embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that the embodiments of the present invention as described herein are illustrative, and various changes and modifications may be made and equivalents may be substituted for elements thereof without departing from the true scope of the present invention. In addition, many modifications may be made to adapt the teachings of the present invention without departing from its central scope. Therefore, it is intended that the present invention not be limited to the particular embodiments disclosed as the best mode contemplated for carrying out the present invention, but that the present invention includes all embodiments falling within the scope of the appended claims.
Claims (14)
- An electromagnetic quality assurance system (30), comprising:an electromagnetic field generator (20) operable to generate an electromagnetic field (21);an electromagnetic sensor block (40) including at least one electromagnetic sensor (22) positioned and oriented to represent a simulated electromagnetic tracking of at least one interventional tool inserted through the electromagnetic sensor block (40) into an anatomical region; andan electromagnetic quality assurance workstation (50) operably connected to the at least one electromagnetic sensor (22), characterized in that the electromagnetic quality assurance system further comprises:a reference electromagnetic sensor (22R) operable to be registered to the electromagnetic sensor block (40),wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22) and the reference electromagnetic sensor (22R), the electromagnetic quality assurance workstation (50) is operable to test an electromagnetic tracking accuracy of an insertion of the at least one interventional tool through the electromagnetic sensor block (40) into the anatomical region, wherein the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of the electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22).
- The electromagnetic quality assurance system (30) of claim 1,
wherein the electromagnetic sensor block (40) includes at least one channel extending through the electromagnetic sensor block (40); and
wherein each electromagnetic sensor (22) is contained within one of the at least one channels. - The electromagnetic quality assurance system (30) of claim 1,
wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22), the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22). - The electromagnetic quality assurance system (30) of claim 1,
wherein, responsive to the at least one metric indicating a distortion within the electromagnetic field (21), the electromagnetic quality assurance workstation (50) is further operable to correct the distortion within the electromagnetic field (21) as a function of the electromagnetic tracking of the tracking location of each of the at least one electromagnetic sensor (22) relative to a registered location of the reference electromagnetic sensor (22R). - An electromagnetic tracking configuration system, comprising:an electromagnetic quality assurance system (30) according to any one of the claims 1 to 4, andan electromagnetic data coordination system (70) includingat least one electromagnetic calibration tool (80), each electromagnetic calibration tool (80) including at least one electromagnetic sensor (22), andan electromagnetic data coordination workstation (90) operably connected to the at least one electromagnetic calibration tool (80),wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling a mechanical interaction of the at least one electromagnetic calibration tool (80) with a grid (120) for guiding at least one interventional tool through the gird (120) into an anatomical region, the electromagnetic data coordination workstation (90) is operable to establish a coordination system for electromagnetically tracking an insertion of the at least one interventional tool through the grid (120) into the anatomical region.
- The electromagnetic tracking configuration system of claim 5,
wherein the electromagnetic sensor block (40) includes at least one channel extending through the electromagnetic sensor block (40); and
wherein each electromagnetic sensor (22) is contained within one of the at least one channels. - The electromagnetic tracking configuration system of claim 5,
wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22), the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22). - The electromagnetic tracking configuration system of claim 5, further comprising:a reference electromagnetic sensor (22R) operable to be registered to the electromagnetic sensor block (40),wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22) and the reference electromagnetic sensor (22R), the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22).
- The electromagnetic tracking configuration system of claim 8,
wherein, responsive to the at least one metric indicating a distortion within the electromagnetic field (21), the electromagnetic quality assurance workstation (50) is further operable to correct the distortion within the electromagnetic field (21) as a function of the electromagnetic tracking of the tracking location of each of the at least one electromagnetic sensor (22) relative to a registered location of the reference electromagnetic sensor (22R). - The electromagnetic data coordination system (70) of claim 5,
wherein the at least one electromagnetic calibration tool (80) includes an electromagnetic calibration device (82) configured and dimensioned to receive an electromagnetic guidewire (110);
wherein the electromagnetic calibration device (82) has a distal extrusion operable to insert a distal end of the electromagnetic guidewire into the grid (120) at a fixed depth; and
wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling an insertion of the distal extrusion the electromagnetic calibration device (82) into one of the channels of the grid (120), the electromagnetic data coordination workstation (90) is further operable to acquire data indicative of an electromagnetic tracking of the channels of the grid (120). - The electromagnetic tracking configuration system of claim 5,
wherein the at least one electromagnetic calibration tool (80) includes a grid calibration frame (83) operable to be attached to the grid (120);
wherein, upon being attached to the grid (120), the grid calibration frame (83) includes a channel array perpendicularly extending across each channel of the grid (120);
wherein the at least one electromagnetic calibration tool (80) further includes an electromagnetic calibration device (82) configured and dimensioned to traverse the channel array of the grid calibration frame (83); and
wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the electromagnetic calibration device (82) traversing the channel array of the grid calibration frame (83), the electromagnetic data coordination workstation (90) is further operable to establish acquire data indicative of an electromagnetic tracking of the channels of the grid (120). - The electromagnetic tracking configuration system of claim 5,
wherein the at least one electromagnetic calibration tool (80) includes a grid calibration frame (83) operable to be attached to the grid (120);
wherein, upon being attached to the grid (120), the grid calibration frame (83) includes a channel array having a hole aligned with each channel of the grid (120);
wherein the at least one electromagnetic calibration tool (80) further includes an electromagnetic calibration device (82) configured and dimensioned to traverse the channel array of the grid calibration frame (83) and to be inserted with each hole of the grid calibration frame (83); and
wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the electromagnetic calibration device (82) traversing the channel array of the grid calibration frame (83), the electromagnetic data coordination workstation (90) is further operable to establish acquire data indicative of an electromagnetic tracking of an electromagnetic tracking of the channels of the grid (120) as the electromagnetic calibration device (82) is inserted into each hole of the grid calibration frame (83). - The electromagnetic tracking configuration system of claim 5,
wherein the at least one electromagnetic calibration tool (80) includes an electromagnetic calibration frame operable to be attached to the grid (120);
wherein, upon being attached to the grid (120), the electromagnetic calibration frame (84) includes an electromagnetic sensor (22) inserted within one of the at least one channel of the grid (120);
wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22) inserted within the at least one channel of the grid (120), the electromagnetic data coordination workstation (90) is further operable to establish acquire data indicative of an electromagnetic tracking of an electromagnetic tracking of the channels of the grid (120). - The electromagnetic tracking configuration system of claim 5, wherein the electromagnetic quality assurance workstation (50) and the electromagnetic data coordination workstation (90) share the same hardware platform.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201461969285P | 2014-03-24 | 2014-03-24 | |
| PCT/IB2015/051924 WO2015145300A2 (en) | 2014-03-24 | 2015-03-17 | Quality assurance and data coordination for electromagnetic tracking systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP3122268A2 EP3122268A2 (en) | 2017-02-01 |
| EP3122268B1 true EP3122268B1 (en) | 2019-01-02 |
Family
ID=52998188
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP15718266.8A Not-in-force EP3122268B1 (en) | 2014-03-24 | 2015-03-17 | Quality assurance and data coordination for electromagnetic tracking systems |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US10786310B2 (en) |
| EP (1) | EP3122268B1 (en) |
| JP (1) | JP6545184B2 (en) |
| CN (1) | CN106132323B (en) |
| WO (1) | WO2015145300A2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110363734A (en) * | 2019-06-27 | 2019-10-22 | 上海交通大学 | Method and system for reconstructing microscopic fluorescence images of thick samples |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10506947B2 (en) * | 2014-12-11 | 2019-12-17 | Koninklijke Philips N.V. | Automated selection of optimal calibration in tracked interventional procedures |
| US10816585B2 (en) | 2014-12-24 | 2020-10-27 | Koninklijke Philips N.V. | Tracking quality control for electromagnetic guidance |
| US10359458B2 (en) * | 2015-10-05 | 2019-07-23 | Covidien Lp | Systems and methods for automated mapping and accuracy-testing |
| US10357326B1 (en) * | 2016-07-29 | 2019-07-23 | Devicor Medical Products, Inc. | MRI breast biopsy targeting grid and cube |
| EP3558132A1 (en) * | 2016-12-21 | 2019-10-30 | Koninklijke Philips N.V. | System and method for fast and automated ultrasound probe calibration |
| EP3381513A1 (en) | 2017-03-30 | 2018-10-03 | Servicio Cántabro de Salud | System and device for positioning medical needles |
| EP3508252A1 (en) * | 2018-01-05 | 2019-07-10 | Koninklijke Philips N.V. | Invivo dosimeter positioning using catheter reconstruction |
| CN108324373B (en) * | 2018-03-19 | 2020-11-27 | 南开大学 | A method for realizing precise positioning of puncture surgical robot based on electromagnetic positioning system |
| US11719850B2 (en) * | 2019-06-20 | 2023-08-08 | Sony Interactive Entertainment Inc. | Detecting and compensating for magnetic interference in electromagnetic (EM) positional tracking |
| CA3156428A1 (en) * | 2019-11-05 | 2021-05-14 | Cianna Medical, Inc. | Systems and methods for imaging a body region using implanted markers |
| EP4186562B1 (en) * | 2021-11-26 | 2023-11-29 | Vilnius University | System and method for brachytherapy procedure planning and verification |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5494039A (en) | 1993-07-16 | 1996-02-27 | Cryomedical Sciences, Inc. | Biopsy needle insertion guide and method of use in prostate cryosurgery |
| US6438401B1 (en) * | 2000-04-28 | 2002-08-20 | Alpha Intervention Technology, Inc. | Indentification and quantification of needle displacement departures from treatment plan |
| US7085400B1 (en) | 2000-06-14 | 2006-08-01 | Surgical Navigation Technologies, Inc. | System and method for image based sensor calibration |
| ATE312648T1 (en) * | 2002-06-17 | 2005-12-15 | Nucletron Bv | SYSTEM FOR REAL-TIME PLANNING OF RADIATION THERAPY |
| US7908690B2 (en) * | 2003-09-30 | 2011-03-22 | Sentinelle Medical, Inc. | Supine patient support for medical imaging |
| US7527593B2 (en) * | 2005-06-11 | 2009-05-05 | Fidel Howard F | Active template guide plate and system and method for utilizing same |
| JP2009531116A (en) * | 2006-03-31 | 2009-09-03 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Local error compensation system in electromagnetic tracking system |
| EP2001363B1 (en) * | 2006-03-31 | 2017-09-27 | Philips Electronics LTD | System and instrumentation for image guided prostate treatment |
| US7879045B2 (en) | 2007-04-10 | 2011-02-01 | Medtronic, Inc. | System for guiding instruments having different sizes |
| CN101861526A (en) * | 2007-11-14 | 2010-10-13 | 皇家飞利浦电子股份有限公司 | System and method for tracking ultrasound auto-calibration |
| US20100016710A1 (en) * | 2008-07-11 | 2010-01-21 | Dinesh Kumar | Prostate treatment apparatus |
| US9113816B2 (en) * | 2008-11-11 | 2015-08-25 | Eigen, Inc. | System and method for prostate biopsy |
| BR112012015204A2 (en) * | 2009-12-23 | 2019-09-24 | Medi Physics Inc | "Brachytherapy device, brachytherapy cuff, kit, and method for inserting a brachytherapy needle into a patient." |
| US20140357977A1 (en) * | 2011-05-12 | 2014-12-04 | William Beaumont Hospital | Catheter Placement Detection System and Method for Surgical Procedures |
| US20130144832A1 (en) | 2011-12-04 | 2013-06-06 | Aizhong Li | Apparatus and process for nondeterministic computing |
| JP6298443B2 (en) | 2012-03-29 | 2018-03-20 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Quality assurance system and method for navigation assistance procedures |
| US20130303895A1 (en) | 2012-05-14 | 2013-11-14 | Delphinus Medical Technologies, Inc. | System and Method for Performing an Image-Guided Biopsy |
| WO2013177061A1 (en) * | 2012-05-21 | 2013-11-28 | The Regents Of The University Of Colorado, A Body Corporate | Three-dimensional mapping and therapy of prostate cancer |
| JP6328110B2 (en) * | 2012-07-17 | 2018-05-23 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Determination device for determining the orientation and shape of an introduction element |
| NL2010838C2 (en) * | 2013-05-22 | 2014-11-26 | Nucletron Operations Bv | An afterloading device, and use thereof. |
-
2015
- 2015-03-17 EP EP15718266.8A patent/EP3122268B1/en not_active Not-in-force
- 2015-03-17 JP JP2016558218A patent/JP6545184B2/en not_active Expired - Fee Related
- 2015-03-17 CN CN201580015866.2A patent/CN106132323B/en not_active Expired - Fee Related
- 2015-03-17 WO PCT/IB2015/051924 patent/WO2015145300A2/en active Application Filing
- 2015-03-17 US US15/124,078 patent/US10786310B2/en not_active Expired - Fee Related
Non-Patent Citations (1)
| Title |
|---|
| None * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110363734A (en) * | 2019-06-27 | 2019-10-22 | 上海交通大学 | Method and system for reconstructing microscopic fluorescence images of thick samples |
| CN110363734B (en) * | 2019-06-27 | 2021-07-13 | 上海交通大学 | Method and system for reconstructing microscopic fluorescence images of thick samples |
Also Published As
| Publication number | Publication date |
|---|---|
| JP6545184B2 (en) | 2019-07-17 |
| CN106132323A (en) | 2016-11-16 |
| WO2015145300A3 (en) | 2015-12-03 |
| US20170014192A1 (en) | 2017-01-19 |
| CN106132323B (en) | 2019-06-04 |
| WO2015145300A2 (en) | 2015-10-01 |
| JP2017510349A (en) | 2017-04-13 |
| EP3122268A2 (en) | 2017-02-01 |
| US10786310B2 (en) | 2020-09-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3122268B1 (en) | Quality assurance and data coordination for electromagnetic tracking systems | |
| US12042671B2 (en) | Method of calibration of a stereoscopic camera system for use with a radio therapy treatment apparatus | |
| US9165114B2 (en) | Method and system for characterizing and visualizing electromagnetic tracking errors | |
| US12133723B2 (en) | Position determination system and method | |
| Bharat et al. | Electromagnetic tracking for catheter reconstruction in ultrasound-guided high-dose-rate brachytherapy of the prostate | |
| US20140257080A1 (en) | System for ultrasound image guided procedure | |
| US10816585B2 (en) | Tracking quality control for electromagnetic guidance | |
| US10016148B2 (en) | Method and apparatus for correction of multiple EM sensor positions | |
| EP3082612A2 (en) | Electromagnetic tracker based ultrasound probe calibration | |
| US20140178832A1 (en) | System and method for providing compact navigation-based surgical guide in dental implant surgery | |
| EP3893017A1 (en) | Navigation field distortion detection | |
| CN102525657A (en) | Probe tracking using multiple tracking methods | |
| CN101329164A (en) | A Global Calibration Method for Stereo Vision Probes | |
| Leotta | An efficient calibration method for freehand 3-D ultrasound imaging systems | |
| EP3795065B1 (en) | Method and apparatus for correcting an inconsistent physical location of a single back patch | |
| Zheng et al. | A novel method for accurate needle-tip identification in trans-rectal ultrasound-based high-dose-rate prostate brachytherapy | |
| US20160012584A1 (en) | Methods for image processing | |
| US11317823B2 (en) | Detection of electromagnetic field interference | |
| EP2700361A1 (en) | Method for quickly and precisely calibrating medical imaging component after changing position | |
| US10952797B2 (en) | Tracking a rigid tool in a patient body | |
| IL266588A (en) | Correcting map shifting of a catheter position tracking system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20161024 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20171013 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20180817 |
|
| RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: TAHMASEBI MARAGHOOSH, AMIR, MOHAMMAD Inventor name: KRUECKER, JOCHEN Inventor name: DALAL, SANDEEP, M. Inventor name: KUNG, CYNTHIA, MING-FU Inventor name: BHARAT, SHYAM Inventor name: BONILLAS VACA, ANTONIO Inventor name: STANTON, DOUGLAS, ALLEN Inventor name: DEHGHAN MARVAST, EHSAN |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1083416 Country of ref document: AT Kind code of ref document: T Effective date: 20190115 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015022738 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20190102 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1083416 Country of ref document: AT Kind code of ref document: T Effective date: 20190102 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190502 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190402 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190502 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190403 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190402 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015022738 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190317 |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190331 |
|
| 26N | No opposition filed |
Effective date: 20191003 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190331 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190317 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190331 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190331 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190331 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190317 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20150317 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190102 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20220628 Year of fee payment: 9 Ref country code: GB Payment date: 20230321 Year of fee payment: 9 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602015022738 Country of ref document: DE |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20240317 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20241001 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240317 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240317 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20241001 |