+

EP3122268B1 - Quality assurance and data coordination for electromagnetic tracking systems - Google Patents

Quality assurance and data coordination for electromagnetic tracking systems Download PDF

Info

Publication number
EP3122268B1
EP3122268B1 EP15718266.8A EP15718266A EP3122268B1 EP 3122268 B1 EP3122268 B1 EP 3122268B1 EP 15718266 A EP15718266 A EP 15718266A EP 3122268 B1 EP3122268 B1 EP 3122268B1
Authority
EP
European Patent Office
Prior art keywords
electromagnetic
grid
tracking
sensor
calibration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP15718266.8A
Other languages
German (de)
French (fr)
Other versions
EP3122268A2 (en
Inventor
Shyam Bharat
Ehsan DEHGHAN MARVAST
Cynthia Ming-fu KUNG
Amir Mohammad TAHMASEBI MARAGHOOSH
Sandeep M. Dalal
Jochen Kruecker
Antonio BONILLAS VACA
Douglas Allen STANTON
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of EP3122268A2 publication Critical patent/EP3122268A2/en
Application granted granted Critical
Publication of EP3122268B1 publication Critical patent/EP3122268B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3403Needle locating or guiding means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; Determining position of diagnostic devices within or on the body of the patient
    • A61B5/061Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body
    • A61B5/062Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body using magnetic field
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00Radiation therapy
    • A61N5/10X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
    • A61N5/1001X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy using radiation sources introduced into or applied onto the body; brachytherapy
    • A61N5/1027Interstitial radiation therapy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00Radiation therapy
    • A61N5/10X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
    • A61N5/1048Monitoring, verifying, controlling systems and methods
    • A61N5/1075Monitoring, verifying, controlling systems and methods for testing, calibrating, or quality assurance of the radiation treatment apparatus
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B17/00234Surgical instruments, devices or methods for minimally invasive surgery
    • A61B2017/00238Type of minimally invasive operation
    • A61B2017/00274Prostate operation, e.g. prostatectomy, turp, bhp treatment
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B2017/00681Aspects not otherwise provided for
    • A61B2017/00725Calibration or performance testing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3403Needle locating or guiding means
    • A61B2017/3405Needle locating or guiding means using mechanical guide means
    • A61B2017/3411Needle locating or guiding means using mechanical guide means with a plurality of holes, e.g. holes in matrix arrangement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2051Electromagnetic tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02Operational features
    • A61B2560/0223Operational features of calibration, e.g. protocols for calibrating sensors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00Radiation therapy
    • A61N5/10X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
    • A61N5/1001X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy using radiation sources introduced into or applied onto the body; brachytherapy
    • A61N5/1007Arrangements or means for the introduction of sources into the body
    • A61N2005/1012Templates or grids for guiding the introduction of sources
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00Radiation therapy
    • A61N5/10X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
    • A61N5/1001X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy using radiation sources introduced into or applied onto the body; brachytherapy

Definitions

  • the present invention generally relates to an electromagnetic ("EM") tracking system incorporated within an interventional procedure (e.g., a prostate brachytherapy procedure).
  • the present invention specifically relates to a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.)
  • Document WO2013/144832 discloses an electromagnetic quality assurance system according to the preamble of claim 1.
  • an EM field 21 is generated by an EM field generator 20 that is located close to a pelvic region of a patient 11.
  • a tracking field of view may be 50 ⁇ 50 ⁇ 50 cm.
  • a typical position for EM field generator 20 during the prostate brachytherapy 10 would be above an abdomen of patient 11, because this position typically leads to minimal physical interference with the existing clinical setup.
  • EM field generator 20 is usually held in place using a mounting arm (not shown) that is attached to a treatment table (not shown).
  • EM field generator 20 may be parallel to the table or angled towards the prostate, depending on the patient-specific geometry and set-up.
  • the position of EM field generator 20 with respect to the tracked pelvic region of patient 11 plays a vital role in an achievable tracking accuracy of an intervention of a catheter/needle 13 with a prostate 15 of patient 11 as guided by a grid template 12 and an achievable tracking accuracy of an imaging of prostate 15 by an ultrasound probe 14 as guided by grid template 12.
  • the accuracy of the EM measurements from each EM sensor (not shown) coupled to catheter/needle 13 and to ultrasound probe 14 depends on a position of each EM sensor relative to EM field generator 20. This is due to the fact that EM field 21 produced by EM field generator 20 is not perfectly homogeneous.
  • a treatment plan based on the transrectal ultrasound (“TRUS") images from ultrasound probe 14 may indicate a distance through holes of grid 12 of each catheter/needle 13 to achieve an intended dose delivery for prostate 15.
  • grid 12 also serves to determine a common data coordinate system for EM data and TRUS data.
  • an EM-tracked tool (not shown) is positioned at different holes of grid 12 and the recorded EM data is fit to the known grid hole pattern.
  • the EM-tracked tool must be positioned perfectly perpendicular to each grid hole and at the same depth. Otherwise, if the EM-tracked tool is not perpendicular to the grid hole and/or is inserted to varying depths in different holes, the resulting estimated grid plane will not be accurately representative of the actual grid 12. This will result in errors in the estimated location of catheter/needle 13 with respect to grid 12 as compared to the actual location of catheter/needle 13 with respect to grid 12. It will also result in a distorted/inaccurate three-dimensional ("3D") image reconstruction of the anatomy in the grid coordinate system (i.e., patient coordinate system). Therefore, prior to EM-tracked prostate brachytherapy procedure 10, it is also necessary to facilitate an accurate and repeatable definition of the grid plane to thereby ensure high EM tracking accuracy during procedure 10.
  • 3D three-dimensional
  • the present invention proposes to provide a system for quality assurance in validating and improving a performance accuracy of the EM tracking system and an easy-to-use system for establishing a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.).
  • interventional tools e.g., ultrasound probes, catheters, needles, etc.
  • One form of the present invention is an EM quality assurance ("EMQA") system employing an EM field generator, an EM sensor block, an EMQA workstation and a reference EM sensor operable to be registered to the EM sensor block.
  • the EM sensor block includes one or more EM sensors positioned and oriented to represent a simulated electromagnetic tracking of one or more interventional tools inserted through the electromagnetic sensor block (40) into an anatomical region.
  • the EMQA workstation tests an electromagnetic tracking accuracy of an insertion of the interventional tool(s) through the electromagnetic sensor block into the anatomical region and computes at least one metric indicative of a quality of the electromagnetic tracking accuracy of a tracking location of each of the at least one EM sensor.
  • a second form of the present invention is an EM tracking configuration system employing the aforementioned EMQA system and an EM data coordination ("DC") system on the same or different platforms.
  • the EMDC system employs an EM field generator, one or more EM calibration tools, and a EMDC workstation. Each EM calibration tool has one or more EM sensors.
  • the EM field generator generates an EM field encircling the EM calibration tool(s) mechanically interacting with a grid for guiding one or more interventional tools into an anatomical region
  • the EMDC workstation establishes a coordination system for electromagnetically tracking an insertion of the interventional tool(s) through the grid into the anatomical region.
  • an exemplary embodiment of an EM tracking configuration system of the present invention as shown in FIG. 1 will be provided herein. From the description of the exemplary embodiment of the EM tracking configuration system, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to (1) an implementation of the EM tracking configuration system as a stand-alone system for quality assurance and data coordination of EM tracking of interventional tools and (2) an incorporation of the EM tracking configuration system into various types of standard and innovative planning/guidance/navigation EM tracking platforms as known in the art.
  • the EM tracking configuration system of the present invention is employs an EM quality assurance ("EMQA") system 30 and an EM data coordination system (“EMDC”) system 70, both utilizing EM field generator 20 of any type as known in the art and one or more EM sensors 22 of any type as known in the art.
  • EMQA EM quality assurance
  • EMDC EM data coordination system
  • the EM tracking configuration system is utilized to qualitatively configure EM field generator 20 and EM sensors 22 in a tracking arrangement specific to a patient-equipment geometry of a particular interventional procedure.
  • EMQA system 30 employs (1) a EM sensor block 40 containing a known positional and orientational arrangement of EM sensors 22 with respect to each other, and (2) an EM quality assurance ("EMQA") workstation 50 executing one or more validation test(s) of EM sensors 22 as contained within EM sensor block 40 based on a positioning of EM field generator 20 relative to EM sensor block 40 analogous to a positioning of EM field generator 20 relative to EM sensors 22 as coupled to interventional tools (e.g., ultrasound probe, catheter, needle, etc.) during an interventional procedure.
  • interventional tools e.g., ultrasound probe, catheter, needle, etc.
  • EM sensors 22 may be removably or permanently contained within channels of EM sensor block 40, and the validation test(s) executed by EMQA workstation 50 may incorporate an additional EM sensor 22 as a reference EM sensor attached to or spatially positioned from EM sensor block 40 within the FOV of EM field generator 20.
  • EMDC system 70 employs (1) one or more EM calibration tools 80 in a known working relationship with EM sensors 22, and (2) an EM data coordination ("EMDC") system 90 to establish a patient coordinate system for EM tracking of interventional tools (e.g., ultrasound probe, catheter, needle, etc.).
  • interventional tools e.g., ultrasound probe, catheter, needle, etc.
  • EM calibration tools 80 may include one or more interventional tools to be utilized during the interventional procedure, and one or more pieces of equipment to be utilized during the interventional procedure for guiding the interventional tools may serve as the basis for establishing the patent coordinate system.
  • (1) EM sensor block 40 may serve as an EM calibration tool 80
  • (2) EMQA workstation 50 and EMDC workstation 90 may be individual physical workstations or logic workstations installed within a single physical platform (e.g., an EM planning/guidance/navigation platform).
  • exemplary embodiments of the present invention will be provided herein directed to EMQA system 30 as shown in FIGS. 3-6 and EMDC system as shown in FIGS. 7-12 in the context of a prostate brachytherapy procedure. From the description of the exemplary embodiments, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to any type of interventional procedure.
  • a transparent, non-magnetic EM sensor block 41 contains a EM sensor group 42 and an EM sensor group 43.
  • the EM sensors of groups 42 and 43 are EM coils permanently embedded in channels extending through EM sensor block 41.
  • the EM sensors of groups 42 and 43 are EM coils removably inserted within the channels (e.g., via a guidewire).
  • inter-sensor distances and sensor orientations of EM sensor groups 42 and 43 on EM sensor block 41 are chosen so as to represent a typical prostrate brachytherapy scenario.
  • an average height of a prostate and a rectum from a treatment table 44 is known apriori. Therefore, EM sensor grouping 42 is distanced relative to treatment table 44 whereby a subset of EM sensor group 42 represents channels covering a patient prostate area for guiding a catheter or a needle into the patient prostate area highlighted by a gray circle encircling the subset of EM sensor group 42.
  • EM sensor group 43 is distanced relative to treatment table 44 whereby EM sensor group 43 represents channels covering a patient rectum area for guiding a transrectal ultrasound (“TRUS") probe into the patient rectum area highlighted by a gray circle encircling EM sensor grouping 43.
  • EM sensors 22A and 22B of EM sensor group 42 represent channels covering a patient prostate area 18 for guiding a catheter 16 into patient prostate area 18, and an EM sensor 22C of EM sensor group 43 represents channels covering a patient rectum area 19 for guiding a transrectal ultrasound (“TRUS”) probe 17 into patient rectum area 19.
  • an EMQA workstation 51 employs a network 52 of modules 53-55 and a EM reference sensor 22R for implementing a EM quality assurance method, which is not part of the invention, as represented by a flowchart 60 of FIG. 5 .
  • modules 53-55 are structurally configured as hardware, software, firmware and/or circuitry of workstation 51, and EM reference sensor 22R is of any type suitable to be coupled to treatment table 44 or any other fixed object within a FOV of EM field generator 20.
  • EM field generator 20 is coupled to a mount 23 and angled toward EM sensor block 41, and EM sensors 22A-22C of EM sensor block 41 are utilized as tracking locations. Nonetheless, in practice, EM field generator 20 may have any orientation toward EM sensor block 41, and more or less EM sensors 22 may be utilized as tracking locations.
  • a stage S62 of flowchart 60 encompasses an EM user interface 53 ( FIG. 3 ), as directed by a user, acquiring EM data derived from EM field 21 of EM field generator 20 encircling EM sensors 22A-22C and 22R.
  • EM user interface 53 may provide feedback to the user indicative of whether EM reference sensor 22R is in an "acceptable" position with respect to a position of EM field generator 20. If not, EM field generator 20 and/or EM reference sensor 22R may be repositioned to position EM reference sensor 22R in an "acceptable" position with respect to a position of EM field generator 20.
  • a stage S64 of flowchart 60 encompasses an EM tester 54 ( FIG. 3 ) computing one or more metrics indicative of a quality of EM field generator 20 in tracking locations of EM sensors 22A-22C.
  • EM tester 54 computes a temporal measurement noise in a position estimate of EM sensors 22A-22C.
  • EM tester 54 computes an EM-estimated inter-sensor distance of EM sensors 22A-22C and compares the computation to the known geometry of EM sensor block 41.
  • EM tester 54 computes an absolute position of EM reference sensor 22R with respect to EM field generator 20.
  • EM tester 54 computes two (2) or more of metric embodiments (i)-(iii) and assigns a cumulative "quality score" to the overall configuration of EM sensor block 41 and EM field generator 20.
  • Stage S64 further encompasses EM tester 54 ( FIG. 3 ) providing any suitable type of user feedback representative of the computed quality of EM field generator 20 in tracking locations of EM sensors 22A-22C.
  • a green light may be indicative of an acceptable configuration of EM sensor block 41 and EM field generator 20
  • a red light may be indicative of an unacceptable configuration of EM sensor block 41 and EM field generator 20.
  • a two-dimensional (“2D”) or a three-dimensional (“3D”) accuracy map 56 for EM field generator 20 is generated and displayed to indicate the accuracy in tracking locations of EM sensors 22A-22C.
  • optional stage S66 of flowchart 60 encompasses an EM distortion corrector 55 ( FIG. 6 ) estimating a function f to correct any distortion within EM field 21.
  • a transformation ( T EMi , i ⁇ 1,2,3 ⁇ ) from each of EM sensors 22A-22C ( C EMi , i ⁇ 1,2,3 ⁇ ) to a reference coordinate system ( C Ref ) associated with EM reference sensor 22R is known from a precise design of EM sensor block 41 in view of EM reference sensor 22R being contained within or registered to EM sensor block 41. Therefore, T EMi ⁇ Ref are known transformations.
  • correction function f is normally performed prior to the prostate brachytherapy procedure whereby during the procedure, various EM-EM transformations are utilized (e.g., EM needle -> reference, EM TRUS -> reference, etc.).
  • various EM-EM transformations are utilized (e.g., EM needle -> reference, EM TRUS -> reference, etc.).
  • This new probe position is more accurate and takes into account any distortion within EM field 21.
  • EM distortion corrector 55 may also include multiple locations for sensors 22A-22C and 22R. Therefore, for each such set 'x' of locations, a correction function 'f x ' may be calculated. During the procedure, one of the functions 'f x ' is used, depending on which EM transformation needs to be corrected. The appropriate function 'f x ' is chosen based on sensor locations for the transformation to be corrected.
  • the QA procedure is intended to be performed on EM sensor block 41 in a clinical environment just prior to the prostate brachytherapy procedure. Additionally, a positioning of EM reference sensor 22R on treatment table 44 may be re-verified prior to the procedure with the patient already on treatment table 44. This may represent the final QA check for EM system accuracy prior to the prostate brachytherapy procedure.
  • a set of EM calibration tools 81 employs (1) an EM calibration device 82 structurally configured to be controllable by hand or a robot, (2) a grid calibration frame 83 structurally configured to be attached to a prostate brachytherapy grid (aka template) as known in the art (e.g., grid 120 as shown in FIG. 10 ) and facilitate the use of EM calibration device 82, and (3) an EM calibration device 84 structurally configured to be mated with a prostate brachytherapy grid.
  • a prostate brachytherapy grid aka template
  • an EM calibration device 84 structurally configured to be mated with a prostate brachytherapy grid.
  • EM calibration tools 81 are provided for facilitating a EMDC workstation 91 employing a network 92 of modules 93 and 94 for implementing a patient coordinate system establishment method as represented by a flowchart 100 of FIG. 8 .
  • modules 93 and 94 are structurally configured as hardware, software, firmware and/or circuitry of workstation 91.
  • a stage S102 of flowchart 100 encompasses an EM data acquirer 93 acquiring EM data via manual or robotic control of one or more of EM calibration tools 81
  • a stage S104 of flowchart 100 encompasses an EM data coordinator 94 establishing a patient coordinate system from the EM data.
  • EM data coordinator 94 may implement a standard practice or an adaptive version thereof in establishing the coordinate system from the EM data.
  • a standard version of the present invention involves a definition of a grid plane in EM space by fitting the acquired EM data points to a "ground truth grid", which is obtained from a known inter-hole distances for the grid.
  • a greater weight may be assigned to the specific grid holes utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes.
  • an EM calibration tool 82 includes a cylindrical extrusion 82A extending from a primary cylindrical body 82B for holding an EM tracked tool, such as, for example, EM guidewire 110.
  • an EM tracked tool such as, for example, EM guidewire 110.
  • a distal end 110d of EM guidewire 110 is inserted through body 82B to the extrusion 82A, and a cap 82C is screwed upon body 82B to securely fix a distal end 110d of EM guidewire 110 within extrusion 82A.
  • extrusion 82A is dimensioned to snugly fit within a hole of a grid 120.
  • EM calibration tool 82 may be inserted into specific holes of grid 120 utilized for needle/catheter insertion to thereby ensure highest accuracy for such grid holes.
  • grid calibration frame 83 includes a frame 83A having an array of continuous channels 83B sized to snugly fit extrusion 82A of EM calibration tool 82.
  • frame 83A is designed to be attached to a grid 120, and as tool 82 is manually or robotically traversed through channels 83B, EM calibration tool 82 may be inserted into one or more holes of a grid 120 to acquire EM data.
  • EM calibration tool 82 may be inserted into specific holes of grid 120 utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes.
  • channel array 83A may omit the holes shown in FIG. 11A whereby intersections of channel array 83A are on top of the holes of grid 120 when the frame 83 is attached to grid 120.
  • EM calibration tool 82 is moved inside the channels without being inserted into any grid holes, and the EM-position of EM calibration tool 82 is recorded continuously to reconstruct the channel positions in the EM coordinate system.
  • the recorded intersection points representative of the grid holes are localized in EM coordinate system using this data to calibrate the grid.
  • EM calibration frame 84 has one or several EM position sensors 84B (e.g., five or six degrees of freedom DOF) attached to a frame 84A with a known calibration between the coordinate system of frame 84A and EM position sensors 84B.
  • Frame 84A is briefly placed into grid 120, and the EM recording from EM positions sensors 84B is obtained, which allows direct calculation of the EM grid calibration without any manual positioning of a separate tracked tool.
  • EM position sensors 84B are sensor coils in known locations relative to frame 84A, and oriented perpendicular to the frame surface whereby the orientation of these sensor coils is identical to the orientation to a needle that may be pushed through holes of grid 120 during the clinical procedure. This identical alignment of the sensor coils ensures optimal EM tracking accuracy.
  • EM data acquirer 93 may automatically record EM data at each grid hole when utilizing EM calibration tool 82. Specifically, for manual control of EM calibration tool 82, EM data acquirer 93 evaluates an incoming EM data stream and detects when EM calibration tool 82 is stationary for a pre-determined period of time as an indication that EM calibration tool 82 has been positioned in the appropriate grid hole. A time threshold to detect whether user intends to save the current EM data as the desired coordinate corresponding to the grid hole may be set according to the preferences of the user. Alternatively, for robotic control of tool 82, EM data acquirer 93 may synchronize a recording of the data with an operation of the robot.
  • EM data acquirer 93 may notify the user of achieving a desired accuracy of calibration while reaching for more grid holes.
  • the calibration fit error is calculated on the fly while more grid hole coordinates are recorded and once the desired pre-selected error is achieved, then the user is notified to stop reaching for more grid holes.
  • the notification may be in the form of reporting an error value or showing a color representation (e.g., red for less accuracy than desired and green once reaching the desired accuracy). This is achieved by knowing the physical geometry of the grid and choosing grid holes in a specific order.
  • an accurate definition of a grid plane by EMDC workstation 91 is important to ensure that the data coordinate system used is in sync with the physical location of the grid and the prostate. This in turn ensures accuracy in needle/catheter/probe position estimation and 3D image reconstruction, and also allows further QA of the EM system.
  • grid 120 was illustrated to facilitate an understanding of the EMDC system of the present invention.
  • a grid/template may have any arrangement of holes/channels dependent upon a particular interventional procedure utilizing a EMDC system of the present invention.
  • FIGS. 1-9 those having ordinary skill in the art will appreciate numerous benefits of the present invention including, but not limited to, a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.).
  • interventional tools e.g., ultrasound probes, catheters, needles, etc.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Robotics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Radiation-Therapy Devices (AREA)
  • Surgical Instruments (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Instructional Devices (AREA)
  • Endoscopes (AREA)

Description

  • The present invention generally relates to an electromagnetic ("EM") tracking system incorporated within an interventional procedure (e.g., a prostate brachytherapy procedure). The present invention specifically relates to a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.) Document WO2013/144832 discloses an electromagnetic quality assurance system according to the preamble of claim 1.
  • The present invention is disclosed in the appended set of claims.
  • As shown in FIG. 1, in an exemplary prostate brachytherapy procedure 10 with EM tracking functionality as known in the art, an EM field 21 is generated by an EM field generator 20 that is located close to a pelvic region of a patient 11. For a conventional planar EM field generator 20 (e.g., a brick-shaped EM field generator), a tracking field of view ("FOV") may be 50 × 50 × 50 cm. A typical position for EM field generator 20 during the prostate brachytherapy 10 would be above an abdomen of patient 11, because this position typically leads to minimal physical interference with the existing clinical setup. EM field generator 20 is usually held in place using a mounting arm (not shown) that is attached to a treatment table (not shown). EM field generator 20 may be parallel to the table or angled towards the prostate, depending on the patient-specific geometry and set-up.
  • More importantly during prostate brachytherapy 10, the position of EM field generator 20 with respect to the tracked pelvic region of patient 11 plays a vital role in an achievable tracking accuracy of an intervention of a catheter/needle 13 with a prostate 15 of patient 11 as guided by a grid template 12 and an achievable tracking accuracy of an imaging of prostate 15 by an ultrasound probe 14 as guided by grid template 12. In other words, the accuracy of the EM measurements from each EM sensor (not shown) coupled to catheter/needle 13 and to ultrasound probe 14 depends on a position of each EM sensor relative to EM field generator 20. This is due to the fact that EM field 21 produced by EM field generator 20 is not perfectly homogeneous. More particularly, there may be sections of EM field 21 where the tracking accuracy may be compromised in terms of increased absolute position errors and/or noise in the measurements. Therefore, prior to EM-tracked prostate brachytherapy procedure 10, it is necessary to validate the accuracy of the EM system in the clinical environment.
  • Furthermore, a treatment plan based on the transrectal ultrasound ("TRUS") images from ultrasound probe 14 may indicate a distance through holes of grid 12 of each catheter/needle 13 to achieve an intended dose delivery for prostate 15. In such a fusion brachytherapy system of EM field generator 20 and ultrasound probe 14, grid 12 also serves to determine a common data coordinate system for EM data and TRUS data. To establish this coordinate system in EM space prior to prostate brachytherapy procedure 10, an EM-tracked tool (not shown) is positioned at different holes of grid 12 and the recorded EM data is fit to the known grid hole pattern.
  • More particularly, to achieve an accurate definition of the coordinate system, the EM-tracked tool must be positioned perfectly perpendicular to each grid hole and at the same depth. Otherwise, if the EM-tracked tool is not perpendicular to the grid hole and/or is inserted to varying depths in different holes, the resulting estimated grid plane will not be accurately representative of the actual grid 12. This will result in errors in the estimated location of catheter/needle 13 with respect to grid 12 as compared to the actual location of catheter/needle 13 with respect to grid 12. It will also result in a distorted/inaccurate three-dimensional ("3D") image reconstruction of the anatomy in the grid coordinate system (i.e., patient coordinate system). Therefore, prior to EM-tracked prostate brachytherapy procedure 10, it is also necessary to facilitate an accurate and repeatable definition of the grid plane to thereby ensure high EM tracking accuracy during procedure 10.
  • The present invention proposes to provide a system for quality assurance in validating and improving a performance accuracy of the EM tracking system and an easy-to-use system for establishing a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.).
  • One form of the present invention is an EM quality assurance ("EMQA") system employing an EM field generator, an EM sensor block, an EMQA workstation and a reference EM sensor operable to be registered to the EM sensor block. The EM sensor block includes one or more EM sensors positioned and oriented to represent a simulated electromagnetic tracking of one or more interventional tools inserted through the electromagnetic sensor block (40) into an anatomical region. As the EM field generator generates an EM field encircling the EM sensor(s) and the reference EM sensor, the EMQA workstation tests an electromagnetic tracking accuracy of an insertion of the interventional tool(s) through the electromagnetic sensor block into the anatomical region and computes at least one metric indicative of a quality of the electromagnetic tracking accuracy of a tracking location of each of the at least one EM sensor.
  • A second form of the present invention is an EM tracking configuration system employing the aforementioned EMQA system and an EM data coordination ("DC") system on the same or different platforms. The EMDC system employs an EM field generator, one or more EM calibration tools, and a EMDC workstation. Each EM calibration tool has one or more EM sensors. As the EM field generator generates an EM field encircling the EM calibration tool(s) mechanically interacting with a grid for guiding one or more interventional tools into an anatomical region, the EMDC workstation establishes a coordination system for electromagnetically tracking an insertion of the interventional tool(s) through the grid into the anatomical region.
  • The foregoing forms and other forms of the present invention as well as various features and advantages of the present invention will become further apparent from the following detailed description of various embodiments of the present invention read in conjunction with the accompanying drawings. The detailed description and drawings are merely illustrative of the present invention rather than limiting, the scope of the present invention being defined by the appended claims and equivalents thereof.
    • FIG. 1 illustrates an exemplary prostate brachytherapy procedure as known in the art.
    • FIG. 2 illustrates an exemplary embodiment of a EM tracking configuration system in accordance with the present invention.
    • FIG. 3 illustrates an exemplary embodiment of an EM quality assurance system in accordance with the present invention.
    • FIG. 4 illustrates an exemplary EM quality assurance set-up in accordance with the present invention.
    • FIG. 5 illustrates a flowchart representative of an exemplary embodiment of an EM quality assurance method in accordance with present disclosure.
    • FIG. 6 illustrates an exemplary distortion correction in accordance with the present invention.
    • FIG. 7 illustrates an exemplary embodiment of an EM data coordination system in accordance with the present invention.
    • FIG. 8 illustrates a flowchart representative of an exemplary embodiment of an EM data coordination method in accordance with present disclosure.
    • FIGS. 9A-9C illustrate an exemplary embodiment of an EM calibration device in accordance with the present invention.
    • FIG. 10 illustrates a grid template as known in the art.
    • FIGS. 11A and 11B illustrate an exemplary embodiment of a grid calibration frame in accordance with the present invention.
    • FIG. 12 illustrates an exemplary embodiment of a EM calibration frame in accordance with the present invention.
  • To facilitate an understanding of the present invention, an exemplary embodiment of an EM tracking configuration system of the present invention as shown in FIG. 1 will be provided herein. From the description of the exemplary embodiment of the EM tracking configuration system, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to (1) an implementation of the EM tracking configuration system as a stand-alone system for quality assurance and data coordination of EM tracking of interventional tools and (2) an incorporation of the EM tracking configuration system into various types of standard and innovative planning/guidance/navigation EM tracking platforms as known in the art.
  • Referring to FIG. 1, the EM tracking configuration system of the present invention is employs an EM quality assurance ("EMQA") system 30 and an EM data coordination system ("EMDC") system 70, both utilizing EM field generator 20 of any type as known in the art and one or more EM sensors 22 of any type as known in the art. The EM tracking configuration system is utilized to qualitatively configure EM field generator 20 and EM sensors 22 in a tracking arrangement specific to a patient-equipment geometry of a particular interventional procedure.
  • To this end, for quality assurance in validating and improving a performance accuracy of EM field generator 20 in tracking EM sensors 22, EMQA system 30 employs (1) a EM sensor block 40 containing a known positional and orientational arrangement of EM sensors 22 with respect to each other, and (2) an EM quality assurance ("EMQA") workstation 50 executing one or more validation test(s) of EM sensors 22 as contained within EM sensor block 40 based on a positioning of EM field generator 20 relative to EM sensor block 40 analogous to a positioning of EM field generator 20 relative to EM sensors 22 as coupled to interventional tools (e.g., ultrasound probe, catheter, needle, etc.) during an interventional procedure. In practice, EM sensors 22 may be removably or permanently contained within channels of EM sensor block 40, and the validation test(s) executed by EMQA workstation 50 may incorporate an additional EM sensor 22 as a reference EM sensor attached to or spatially positioned from EM sensor block 40 within the FOV of EM field generator 20.
  • On a patient by patient basis, EMDC system 70 employs (1) one or more EM calibration tools 80 in a known working relationship with EM sensors 22, and (2) an EM data coordination ("EMDC") system 90 to establish a patient coordinate system for EM tracking of interventional tools (e.g., ultrasound probe, catheter, needle, etc.). In practice, EM calibration tools 80 may include one or more interventional tools to be utilized during the interventional procedure, and one or more pieces of equipment to be utilized during the interventional procedure for guiding the interventional tools may serve as the basis for establishing the patent coordinate system.
  • Also in practice, (1) EM sensor block 40 may serve as an EM calibration tool 80, and (2) EMQA workstation 50 and EMDC workstation 90 may be individual physical workstations or logic workstations installed within a single physical platform (e.g., an EM planning/guidance/navigation platform).
  • To facilitate an understanding of the present invention, exemplary embodiments of the present invention will be provided herein directed to EMQA system 30 as shown in FIGS. 3-6 and EMDC system as shown in FIGS. 7-12 in the context of a prostate brachytherapy procedure. From the description of the exemplary embodiments, those having ordinary skill in the art will appreciate how to apply the operating principles of the present invention to any type of interventional procedure.
  • Referring to FIG. 3, for the exemplary embodiment of EMQA system 30 (FIG. 2), a transparent, non-magnetic EM sensor block 41 contains a EM sensor group 42 and an EM sensor group 43. In a first embodiment, the EM sensors of groups 42 and 43 are EM coils permanently embedded in channels extending through EM sensor block 41. In a second embodiment, the EM sensors of groups 42 and 43 are EM coils removably inserted within the channels (e.g., via a guidewire).
  • As shown in FIG. 3, inter-sensor distances and sensor orientations of EM sensor groups 42 and 43 on EM sensor block 41 are chosen so as to represent a typical prostrate brachytherapy scenario. Specifically, an average height of a prostate and a rectum from a treatment table 44 is known apriori. Therefore, EM sensor grouping 42 is distanced relative to treatment table 44 whereby a subset of EM sensor group 42 represents channels covering a patient prostate area for guiding a catheter or a needle into the patient prostate area highlighted by a gray circle encircling the subset of EM sensor group 42. Similarly, EM sensor group 43 is distanced relative to treatment table 44 whereby EM sensor group 43 represents channels covering a patient rectum area for guiding a transrectal ultrasound ("TRUS") probe into the patient rectum area highlighted by a gray circle encircling EM sensor grouping 43. For example, as shown in a side view of EM sensor block 41 in FIG. 4, EM sensors 22A and 22B of EM sensor group 42 represent channels covering a patient prostate area 18 for guiding a catheter 16 into patient prostate area 18, and an EM sensor 22C of EM sensor group 43 represents channels covering a patient rectum area 19 for guiding a transrectal ultrasound ("TRUS") probe 17 into patient rectum area 19.
  • Referring back to FIG. 3, for the exemplary embodiment of EMQA system 30, an EMQA workstation 51 employs a network 52 of modules 53-55 and a EM reference sensor 22R for implementing a EM quality assurance method, which is not part of the invention, as represented by a flowchart 60 of FIG. 5. In practice, modules 53-55 are structurally configured as hardware, software, firmware and/or circuitry of workstation 51, and EM reference sensor 22R is of any type suitable to be coupled to treatment table 44 or any other fixed object within a FOV of EM field generator 20.
  • Flowchart 60 will now be described herein in the context of FIG. 4, whereby EM field generator 20 is coupled to a mount 23 and angled toward EM sensor block 41, and EM sensors 22A-22C of EM sensor block 41 are utilized as tracking locations. Nonetheless, in practice, EM field generator 20 may have any orientation toward EM sensor block 41, and more or less EM sensors 22 may be utilized as tracking locations.
  • Referring to FIG. 5, a stage S62 of flowchart 60 encompasses an EM user interface 53 (FIG. 3), as directed by a user, acquiring EM data derived from EM field 21 of EM field generator 20 encircling EM sensors 22A-22C and 22R. In practice, if specific regions of EM field 21 afflicted with lower accuracy are known, EM user interface 53 may provide feedback to the user indicative of whether EM reference sensor 22R is in an "acceptable" position with respect to a position of EM field generator 20. If not, EM field generator 20 and/or EM reference sensor 22R may be repositioned to position EM reference sensor 22R in an "acceptable" position with respect to a position of EM field generator 20.
  • A stage S64 of flowchart 60 encompasses an EM tester 54 (FIG. 3) computing one or more metrics indicative of a quality of EM field generator 20 in tracking locations of EM sensors 22A-22C.
  • In a first metric embodiment (i), EM tester 54 computes a temporal measurement noise in a position estimate of EM sensors 22A-22C.
  • In a second metric embodiment (ii), EM tester 54 computes an EM-estimated inter-sensor distance of EM sensors 22A-22C and compares the computation to the known geometry of EM sensor block 41.
  • In a third metric embodiment (iii), EM tester 54 computes an absolute position of EM reference sensor 22R with respect to EM field generator 20.
  • In a fourth metric embodiment (iv), EM tester 54 computes two (2) or more of metric embodiments (i)-(iii) and assigns a cumulative "quality score" to the overall configuration of EM sensor block 41 and EM field generator 20.
  • Stage S64 further encompasses EM tester 54 (FIG. 3) providing any suitable type of user feedback representative of the computed quality of EM field generator 20 in tracking locations of EM sensors 22A-22C.
  • In a first feedback embodiment, a green light may be indicative of an acceptable configuration of EM sensor block 41 and EM field generator 20, and a red light may be indicative of an unacceptable configuration of EM sensor block 41 and EM field generator 20.
  • In a second feedback embodiment, as exemplary shown in FIG. 3, a two-dimensional ("2D") or a three-dimensional ("3D") accuracy map 56 for EM field generator 20 is generated and displayed to indicate the accuracy in tracking locations of EM sensors 22A-22C.
  • As applicable to any unacceptable inaccuracy in tracking locations of EM sensors 22A-22C, optional stage S66 of flowchart 60 encompasses an EM distortion corrector 55 (FIG. 6) estimating a function f to correct any distortion within EM field 21. In one embodiment, as exemplarily shown in FIG. 6, a transformation (TEMi, i∈{1,2,3}) from each of EM sensors 22A-22C (CEMi, i∈{1,2,3 }) to a reference coordinate system (CRef ) associated with EM reference sensor 22R is known from a precise design of EM sensor block 41 in view of EM reference sensor 22R being contained within or registered to EM sensor block 41. Therefore, T EMiRef are known transformations.
  • Furthermore, corresponding transformation matrices T' EMiRef are measured by EM distortion corrector 55 in terms of measured relative position/pose of the EM sensors 22A-22C to the measured pose of EM reference sensor 22R whereby measured transformation matrices T' EMiRef may be different from known transformation matrices T EMiRef due to any inaccuracies of EM field generator 20 and distortions of EM field 20 inside EM sensor block 41. Therefore a correction function f may be estimated by EM distortion corrector 55 in accordance with the following equation [1]: T EMi Ref = f T EMi Ref
    Figure imgb0001
  • In practice, the above estimation of correction function f is normally performed prior to the prostate brachytherapy procedure whereby during the procedure, various EM-EM transformations are utilized (e.g., EM needle -> reference, EM TRUS -> reference, etc.). For example, an EM measurement of a position of a TRUS probe may be corrected in accordance with the following equation [2]: T P Ref = f T P Ref
    Figure imgb0002
    where, T' PRej is the measured probe to reference transformation matrix by the EM tracking system and T PRef is the corrected probe to reference transformation matrix. This new probe position is more accurate and takes into account any distortion within EM field 21.
  • In practice, EM distortion corrector 55 may also include multiple locations for sensors 22A-22C and 22R. Therefore, for each such set 'x' of locations, a correction function 'fx' may be calculated. During the procedure, one of the functions 'fx' is used, depending on which EM transformation needs to be corrected. The appropriate function 'fx' is chosen based on sensor locations for the transformation to be corrected.
  • Referring back to FIGS. 3 and 4, the QA procedure is intended to be performed on EM sensor block 41 in a clinical environment just prior to the prostate brachytherapy procedure. Additionally, a positioning of EM reference sensor 22R on treatment table 44 may be re-verified prior to the procedure with the patient already on treatment table 44. This may represent the final QA check for EM system accuracy prior to the prostate brachytherapy procedure.
  • Referring to FIG. 7, for the exemplary embodiment of EMCD system 70 (FIG. 2), a set of EM calibration tools 81 employs (1) an EM calibration device 82 structurally configured to be controllable by hand or a robot, (2) a grid calibration frame 83 structurally configured to be attached to a prostate brachytherapy grid (aka template) as known in the art (e.g., grid 120 as shown in FIG. 10) and facilitate the use of EM calibration device 82, and (3) an EM calibration device 84 structurally configured to be mated with a prostate brachytherapy grid. EM calibration tools 81 are provided for facilitating a EMDC workstation 91 employing a network 92 of modules 93 and 94 for implementing a patient coordinate system establishment method as represented by a flowchart 100 of FIG. 8. In practice, modules 93 and 94 are structurally configured as hardware, software, firmware and/or circuitry of workstation 91.
  • Generally, referring to FIGS. 7 and 8, a stage S102 of flowchart 100 encompasses an EM data acquirer 93 acquiring EM data via manual or robotic control of one or more of EM calibration tools 81, and a stage S104 of flowchart 100 encompasses an EM data coordinator 94 establishing a patient coordinate system from the EM data. In practice, EM data coordinator 94 may implement a standard practice or an adaptive version thereof in establishing the coordinate system from the EM data. For example, a standard version of the present invention involves a definition of a grid plane in EM space by fitting the acquired EM data points to a "ground truth grid", which is obtained from a known inter-hole distances for the grid. Additionally, in an adaptive version, during the fitting process, a greater weight may be assigned to the specific grid holes utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes. The following is a description of exemplary embodiments of each EM calibration tool 81 in the context of the exemplary adaptive version of stage S104.
  • Referring to FIG. 9, an EM calibration tool 82 includes a cylindrical extrusion 82A extending from a primary cylindrical body 82B for holding an EM tracked tool, such as, for example, EM guidewire 110. As best shown in FIG. 9B, a distal end 110d of EM guidewire 110 is inserted through body 82B to the extrusion 82A, and a cap 82C is screwed upon body 82B to securely fix a distal end 110d of EM guidewire 110 within extrusion 82A. As best shown in FIG. 9C, extrusion 82A is dimensioned to snugly fit within a hole of a grid 120. As related to the adaptive mode of stage S104 (FIG. 8), EM calibration tool 82 may be inserted into specific holes of grid 120 utilized for needle/catheter insertion to thereby ensure highest accuracy for such grid holes.
  • Referring to FIG. 11, grid calibration frame 83 includes a frame 83A having an array of continuous channels 83B sized to snugly fit extrusion 82A of EM calibration tool 82. As best shown in FIG. 11B, frame 83A is designed to be attached to a grid 120, and as tool 82 is manually or robotically traversed through channels 83B, EM calibration tool 82 may be inserted into one or more holes of a grid 120 to acquire EM data. In particular, as related to the adaptive mode of stage S104 (FIG. 8), EM calibration tool 82 may be inserted into specific holes of grid 120 utilized for needle/catheter/probe insertion to thereby ensure highest accuracy for such grid holes.
  • Alternatively, channel array 83A may omit the holes shown in FIG. 11A whereby intersections of channel array 83A are on top of the holes of grid 120 when the frame 83 is attached to grid 120. As such, EM calibration tool 82 is moved inside the channels without being inserted into any grid holes, and the EM-position of EM calibration tool 82 is recorded continuously to reconstruct the channel positions in the EM coordinate system. The recorded intersection points representative of the grid holes are localized in EM coordinate system using this data to calibrate the grid.
  • Referring to FIG. 12, EM calibration frame 84 has one or several EM position sensors 84B (e.g., five or six degrees of freedom DOF) attached to a frame 84A with a known calibration between the coordinate system of frame 84A and EM position sensors 84B. Frame 84A is briefly placed into grid 120, and the EM recording from EM positions sensors 84B is obtained, which allows direct calculation of the EM grid calibration without any manual positioning of a separate tracked tool. In one embodiment, EM position sensors 84B are sensor coils in known locations relative to frame 84A, and oriented perpendicular to the frame surface whereby the orientation of these sensor coils is identical to the orientation to a needle that may be pushed through holes of grid 120 during the clinical procedure. This identical alignment of the sensor coils ensures optimal EM tracking accuracy.
  • Referring back to FIG. 7, in practice, EM data acquirer 93 may automatically record EM data at each grid hole when utilizing EM calibration tool 82. Specifically, for manual control of EM calibration tool 82, EM data acquirer 93 evaluates an incoming EM data stream and detects when EM calibration tool 82 is stationary for a pre-determined period of time as an indication that EM calibration tool 82 has been positioned in the appropriate grid hole. A time threshold to detect whether user intends to save the current EM data as the desired coordinate corresponding to the grid hole may be set according to the preferences of the user. Alternatively, for robotic control of tool 82, EM data acquirer 93 may synchronize a recording of the data with an operation of the robot.
  • Also in practice, EM data acquirer 93 may notify the user of achieving a desired accuracy of calibration while reaching for more grid holes. The calibration fit error is calculated on the fly while more grid hole coordinates are recorded and once the desired pre-selected error is achieved, then the user is notified to stop reaching for more grid holes. The notification may be in the form of reporting an error value or showing a color representation (e.g., red for less accuracy than desired and green once reaching the desired accuracy). This is achieved by knowing the physical geometry of the grid and choosing grid holes in a specific order.
  • Referring to FIGS. 7 and 8, an accurate definition of a grid plane by EMDC workstation 91 is important to ensure that the data coordinate system used is in sync with the physical location of the grid and the prostate. This in turn ensures accuracy in needle/catheter/probe position estimation and 3D image reconstruction, and also allows further QA of the EM system.
  • Referring to FIG. 10, grid 120 was illustrated to facilitate an understanding of the EMDC system of the present invention. In practice, a grid/template may have any arrangement of holes/channels dependent upon a particular interventional procedure utilizing a EMDC system of the present invention.
  • Referring to FIGS. 1-9, those having ordinary skill in the art will appreciate numerous benefits of the present invention including, but not limited to, a quality assurance for validating and improving a performance accuracy of the EM tracking system and to an establishment of a patent coordinate system for EM tracking of interventional tools (e.g., ultrasound probes, catheters, needles, etc.).
  • While various embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that the embodiments of the present invention as described herein are illustrative, and various changes and modifications may be made and equivalents may be substituted for elements thereof without departing from the true scope of the present invention. In addition, many modifications may be made to adapt the teachings of the present invention without departing from its central scope. Therefore, it is intended that the present invention not be limited to the particular embodiments disclosed as the best mode contemplated for carrying out the present invention, but that the present invention includes all embodiments falling within the scope of the appended claims.

Claims (14)

  1. An electromagnetic quality assurance system (30), comprising:
    an electromagnetic field generator (20) operable to generate an electromagnetic field (21);
    an electromagnetic sensor block (40) including at least one electromagnetic sensor (22) positioned and oriented to represent a simulated electromagnetic tracking of at least one interventional tool inserted through the electromagnetic sensor block (40) into an anatomical region; and
    an electromagnetic quality assurance workstation (50) operably connected to the at least one electromagnetic sensor (22), characterized in that the electromagnetic quality assurance system further comprises:
    a reference electromagnetic sensor (22R) operable to be registered to the electromagnetic sensor block (40),
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22) and the reference electromagnetic sensor (22R), the electromagnetic quality assurance workstation (50) is operable to test an electromagnetic tracking accuracy of an insertion of the at least one interventional tool through the electromagnetic sensor block (40) into the anatomical region, wherein the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of the electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22).
  2. The electromagnetic quality assurance system (30) of claim 1,
    wherein the electromagnetic sensor block (40) includes at least one channel extending through the electromagnetic sensor block (40); and
    wherein each electromagnetic sensor (22) is contained within one of the at least one channels.
  3. The electromagnetic quality assurance system (30) of claim 1,
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22), the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22).
  4. The electromagnetic quality assurance system (30) of claim 1,
    wherein, responsive to the at least one metric indicating a distortion within the electromagnetic field (21), the electromagnetic quality assurance workstation (50) is further operable to correct the distortion within the electromagnetic field (21) as a function of the electromagnetic tracking of the tracking location of each of the at least one electromagnetic sensor (22) relative to a registered location of the reference electromagnetic sensor (22R).
  5. An electromagnetic tracking configuration system, comprising:
    an electromagnetic quality assurance system (30) according to any one of the claims 1 to 4, and
    an electromagnetic data coordination system (70) including
    at least one electromagnetic calibration tool (80), each electromagnetic calibration tool (80) including at least one electromagnetic sensor (22), and
    an electromagnetic data coordination workstation (90) operably connected to the at least one electromagnetic calibration tool (80),
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling a mechanical interaction of the at least one electromagnetic calibration tool (80) with a grid (120) for guiding at least one interventional tool through the gird (120) into an anatomical region, the electromagnetic data coordination workstation (90) is operable to establish a coordination system for electromagnetically tracking an insertion of the at least one interventional tool through the grid (120) into the anatomical region.
  6. The electromagnetic tracking configuration system of claim 5,
    wherein the electromagnetic sensor block (40) includes at least one channel extending through the electromagnetic sensor block (40); and
    wherein each electromagnetic sensor (22) is contained within one of the at least one channels.
  7. The electromagnetic tracking configuration system of claim 5,
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22), the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22).
  8. The electromagnetic tracking configuration system of claim 5, further comprising:
    a reference electromagnetic sensor (22R) operable to be registered to the electromagnetic sensor block (40),
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22) and the reference electromagnetic sensor (22R), the electromagnetic quality assurance workstation (50) is further operable to compute at least one metric indicative of a quality of electromagnetic tracking accuracy of a tracking location of each of the at least one electromagnetic sensor (22).
  9. The electromagnetic tracking configuration system of claim 8,
    wherein, responsive to the at least one metric indicating a distortion within the electromagnetic field (21), the electromagnetic quality assurance workstation (50) is further operable to correct the distortion within the electromagnetic field (21) as a function of the electromagnetic tracking of the tracking location of each of the at least one electromagnetic sensor (22) relative to a registered location of the reference electromagnetic sensor (22R).
  10. The electromagnetic data coordination system (70) of claim 5,
    wherein the at least one electromagnetic calibration tool (80) includes an electromagnetic calibration device (82) configured and dimensioned to receive an electromagnetic guidewire (110);
    wherein the electromagnetic calibration device (82) has a distal extrusion operable to insert a distal end of the electromagnetic guidewire into the grid (120) at a fixed depth; and
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling an insertion of the distal extrusion the electromagnetic calibration device (82) into one of the channels of the grid (120), the electromagnetic data coordination workstation (90) is further operable to acquire data indicative of an electromagnetic tracking of the channels of the grid (120).
  11. The electromagnetic tracking configuration system of claim 5,
    wherein the at least one electromagnetic calibration tool (80) includes a grid calibration frame (83) operable to be attached to the grid (120);
    wherein, upon being attached to the grid (120), the grid calibration frame (83) includes a channel array perpendicularly extending across each channel of the grid (120);
    wherein the at least one electromagnetic calibration tool (80) further includes an electromagnetic calibration device (82) configured and dimensioned to traverse the channel array of the grid calibration frame (83); and
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the electromagnetic calibration device (82) traversing the channel array of the grid calibration frame (83), the electromagnetic data coordination workstation (90) is further operable to establish acquire data indicative of an electromagnetic tracking of the channels of the grid (120).
  12. The electromagnetic tracking configuration system of claim 5,
    wherein the at least one electromagnetic calibration tool (80) includes a grid calibration frame (83) operable to be attached to the grid (120);
    wherein, upon being attached to the grid (120), the grid calibration frame (83) includes a channel array having a hole aligned with each channel of the grid (120);
    wherein the at least one electromagnetic calibration tool (80) further includes an electromagnetic calibration device (82) configured and dimensioned to traverse the channel array of the grid calibration frame (83) and to be inserted with each hole of the grid calibration frame (83); and
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the electromagnetic calibration device (82) traversing the channel array of the grid calibration frame (83), the electromagnetic data coordination workstation (90) is further operable to establish acquire data indicative of an electromagnetic tracking of an electromagnetic tracking of the channels of the grid (120) as the electromagnetic calibration device (82) is inserted into each hole of the grid calibration frame (83).
  13. The electromagnetic tracking configuration system of claim 5,
    wherein the at least one electromagnetic calibration tool (80) includes an electromagnetic calibration frame operable to be attached to the grid (120);
    wherein, upon being attached to the grid (120), the electromagnetic calibration frame (84) includes an electromagnetic sensor (22) inserted within one of the at least one channel of the grid (120);
    wherein, responsive to the electromagnetic field generator (20) generating the electromagnetic field (21) encircling the at least one electromagnetic sensor (22) inserted within the at least one channel of the grid (120), the electromagnetic data coordination workstation (90) is further operable to establish acquire data indicative of an electromagnetic tracking of an electromagnetic tracking of the channels of the grid (120).
  14. The electromagnetic tracking configuration system of claim 5, wherein the electromagnetic quality assurance workstation (50) and the electromagnetic data coordination workstation (90) share the same hardware platform.
EP15718266.8A 2014-03-24 2015-03-17 Quality assurance and data coordination for electromagnetic tracking systems Not-in-force EP3122268B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201461969285P 2014-03-24 2014-03-24
PCT/IB2015/051924 WO2015145300A2 (en) 2014-03-24 2015-03-17 Quality assurance and data coordination for electromagnetic tracking systems

Publications (2)

Publication Number Publication Date
EP3122268A2 EP3122268A2 (en) 2017-02-01
EP3122268B1 true EP3122268B1 (en) 2019-01-02

Family

ID=52998188

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15718266.8A Not-in-force EP3122268B1 (en) 2014-03-24 2015-03-17 Quality assurance and data coordination for electromagnetic tracking systems

Country Status (5)

Country Link
US (1) US10786310B2 (en)
EP (1) EP3122268B1 (en)
JP (1) JP6545184B2 (en)
CN (1) CN106132323B (en)
WO (1) WO2015145300A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110363734A (en) * 2019-06-27 2019-10-22 上海交通大学 Method and system for reconstructing microscopic fluorescence images of thick samples

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10506947B2 (en) * 2014-12-11 2019-12-17 Koninklijke Philips N.V. Automated selection of optimal calibration in tracked interventional procedures
US10816585B2 (en) 2014-12-24 2020-10-27 Koninklijke Philips N.V. Tracking quality control for electromagnetic guidance
US10359458B2 (en) * 2015-10-05 2019-07-23 Covidien Lp Systems and methods for automated mapping and accuracy-testing
US10357326B1 (en) * 2016-07-29 2019-07-23 Devicor Medical Products, Inc. MRI breast biopsy targeting grid and cube
EP3558132A1 (en) * 2016-12-21 2019-10-30 Koninklijke Philips N.V. System and method for fast and automated ultrasound probe calibration
EP3381513A1 (en) 2017-03-30 2018-10-03 Servicio Cántabro de Salud System and device for positioning medical needles
EP3508252A1 (en) * 2018-01-05 2019-07-10 Koninklijke Philips N.V. Invivo dosimeter positioning using catheter reconstruction
CN108324373B (en) * 2018-03-19 2020-11-27 南开大学 A method for realizing precise positioning of puncture surgical robot based on electromagnetic positioning system
US11719850B2 (en) * 2019-06-20 2023-08-08 Sony Interactive Entertainment Inc. Detecting and compensating for magnetic interference in electromagnetic (EM) positional tracking
CA3156428A1 (en) * 2019-11-05 2021-05-14 Cianna Medical, Inc. Systems and methods for imaging a body region using implanted markers
EP4186562B1 (en) * 2021-11-26 2023-11-29 Vilnius University System and method for brachytherapy procedure planning and verification

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5494039A (en) 1993-07-16 1996-02-27 Cryomedical Sciences, Inc. Biopsy needle insertion guide and method of use in prostate cryosurgery
US6438401B1 (en) * 2000-04-28 2002-08-20 Alpha Intervention Technology, Inc. Indentification and quantification of needle displacement departures from treatment plan
US7085400B1 (en) 2000-06-14 2006-08-01 Surgical Navigation Technologies, Inc. System and method for image based sensor calibration
ATE312648T1 (en) * 2002-06-17 2005-12-15 Nucletron Bv SYSTEM FOR REAL-TIME PLANNING OF RADIATION THERAPY
US7908690B2 (en) * 2003-09-30 2011-03-22 Sentinelle Medical, Inc. Supine patient support for medical imaging
US7527593B2 (en) * 2005-06-11 2009-05-05 Fidel Howard F Active template guide plate and system and method for utilizing same
JP2009531116A (en) * 2006-03-31 2009-09-03 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Local error compensation system in electromagnetic tracking system
EP2001363B1 (en) * 2006-03-31 2017-09-27 Philips Electronics LTD System and instrumentation for image guided prostate treatment
US7879045B2 (en) 2007-04-10 2011-02-01 Medtronic, Inc. System for guiding instruments having different sizes
CN101861526A (en) * 2007-11-14 2010-10-13 皇家飞利浦电子股份有限公司 System and method for tracking ultrasound auto-calibration
US20100016710A1 (en) * 2008-07-11 2010-01-21 Dinesh Kumar Prostate treatment apparatus
US9113816B2 (en) * 2008-11-11 2015-08-25 Eigen, Inc. System and method for prostate biopsy
BR112012015204A2 (en) * 2009-12-23 2019-09-24 Medi Physics Inc "Brachytherapy device, brachytherapy cuff, kit, and method for inserting a brachytherapy needle into a patient."
US20140357977A1 (en) * 2011-05-12 2014-12-04 William Beaumont Hospital Catheter Placement Detection System and Method for Surgical Procedures
US20130144832A1 (en) 2011-12-04 2013-06-06 Aizhong Li Apparatus and process for nondeterministic computing
JP6298443B2 (en) 2012-03-29 2018-03-20 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Quality assurance system and method for navigation assistance procedures
US20130303895A1 (en) 2012-05-14 2013-11-14 Delphinus Medical Technologies, Inc. System and Method for Performing an Image-Guided Biopsy
WO2013177061A1 (en) * 2012-05-21 2013-11-28 The Regents Of The University Of Colorado, A Body Corporate Three-dimensional mapping and therapy of prostate cancer
JP6328110B2 (en) * 2012-07-17 2018-05-23 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Determination device for determining the orientation and shape of an introduction element
NL2010838C2 (en) * 2013-05-22 2014-11-26 Nucletron Operations Bv An afterloading device, and use thereof.

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110363734A (en) * 2019-06-27 2019-10-22 上海交通大学 Method and system for reconstructing microscopic fluorescence images of thick samples
CN110363734B (en) * 2019-06-27 2021-07-13 上海交通大学 Method and system for reconstructing microscopic fluorescence images of thick samples

Also Published As

Publication number Publication date
JP6545184B2 (en) 2019-07-17
CN106132323A (en) 2016-11-16
WO2015145300A3 (en) 2015-12-03
US20170014192A1 (en) 2017-01-19
CN106132323B (en) 2019-06-04
WO2015145300A2 (en) 2015-10-01
JP2017510349A (en) 2017-04-13
EP3122268A2 (en) 2017-02-01
US10786310B2 (en) 2020-09-29

Similar Documents

Publication Publication Date Title
EP3122268B1 (en) Quality assurance and data coordination for electromagnetic tracking systems
US12042671B2 (en) Method of calibration of a stereoscopic camera system for use with a radio therapy treatment apparatus
US9165114B2 (en) Method and system for characterizing and visualizing electromagnetic tracking errors
US12133723B2 (en) Position determination system and method
Bharat et al. Electromagnetic tracking for catheter reconstruction in ultrasound-guided high-dose-rate brachytherapy of the prostate
US20140257080A1 (en) System for ultrasound image guided procedure
US10816585B2 (en) Tracking quality control for electromagnetic guidance
US10016148B2 (en) Method and apparatus for correction of multiple EM sensor positions
EP3082612A2 (en) Electromagnetic tracker based ultrasound probe calibration
US20140178832A1 (en) System and method for providing compact navigation-based surgical guide in dental implant surgery
EP3893017A1 (en) Navigation field distortion detection
CN102525657A (en) Probe tracking using multiple tracking methods
CN101329164A (en) A Global Calibration Method for Stereo Vision Probes
Leotta An efficient calibration method for freehand 3-D ultrasound imaging systems
EP3795065B1 (en) Method and apparatus for correcting an inconsistent physical location of a single back patch
Zheng et al. A novel method for accurate needle-tip identification in trans-rectal ultrasound-based high-dose-rate prostate brachytherapy
US20160012584A1 (en) Methods for image processing
US11317823B2 (en) Detection of electromagnetic field interference
EP2700361A1 (en) Method for quickly and precisely calibrating medical imaging component after changing position
US10952797B2 (en) Tracking a rigid tool in a patient body
IL266588A (en) Correcting map shifting of a catheter position tracking system

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20161024

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20171013

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180817

RIN1 Information on inventor provided before grant (corrected)

Inventor name: TAHMASEBI MARAGHOOSH, AMIR, MOHAMMAD

Inventor name: KRUECKER, JOCHEN

Inventor name: DALAL, SANDEEP, M.

Inventor name: KUNG, CYNTHIA, MING-FU

Inventor name: BHARAT, SHYAM

Inventor name: BONILLAS VACA, ANTONIO

Inventor name: STANTON, DOUGLAS, ALLEN

Inventor name: DEHGHAN MARVAST, EHSAN

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1083416

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015022738

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190102

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1083416

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190502

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190402

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190502

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190402

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015022738

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190317

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190331

26N No opposition filed

Effective date: 20191003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190317

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190331

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190317

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150317

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190102

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20220628

Year of fee payment: 9

Ref country code: GB

Payment date: 20230321

Year of fee payment: 9

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602015022738

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20240317

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20241001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240317

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240317

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20241001

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载