US20130303887A1 - Apparatus and method for four dimensional soft tissue navigation - Google Patents

Apparatus and method for four dimensional soft tissue navigation Download PDF

Info

Publication number
US20130303887A1
US20130303887A1 US13/817,730 US201113817730A US2013303887A1 US 20130303887 A1 US20130303887 A1 US 20130303887A1 US 201113817730 A US201113817730 A US 201113817730A US 2013303887 A1 US2013303887 A1 US 2013303887A1
Authority
US
United States
Prior art keywords
patient
image
endoscope
instrument
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/817,730
Inventor
Troy L. Holsing
Mark Hunter
Christopher Lee
Marc Wennogle
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Veran Medical Technologies Inc
Original Assignee
Veran Medical Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Veran Medical Technologies Inc filed Critical Veran Medical Technologies Inc
Priority to US13/817,730 priority Critical patent/US20130303887A1/en
Assigned to VERAN MEDICAL TECHNOLOGIES, INC. reassignment VERAN MEDICAL TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: WENNOGLE, MARC, HUNTER, MARK, LEE, CHRISTOPHER, HOLSING, TROY L.
Publication of US20130303887A1 publication Critical patent/US20130303887A1/en
Assigned to PROLOG CAPITAL II, L.P. reassignment PROLOG CAPITAL II, L.P. SECURITY AGREEMENT Assignors: VERAN MEDICAL TECHNOLOGIES, INC.
Assigned to VERAN MEDICAL TECHNOLOGIES, INC. reassignment VERAN MEDICAL TECHNOLOGIES, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: PROLOG CAPITAL II, L.P.
Assigned to MADRYN HEALTH PARTNERS, LP reassignment MADRYN HEALTH PARTNERS, LP SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: VERAN MEDICAL TECHNOLOGIES, INC.
Assigned to WESTERN ALLIANCE BANK reassignment WESTERN ALLIANCE BANK SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: VERAN MEDICAL TECHNOLOGIES, INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
    • A61B5/061Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body
    • A61B5/062Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body using magnetic field
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00043Operational features of endoscopes provided with output arrangements
    • A61B1/00045Display arrangement
    • A61B1/0005Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00071Insertion part of the endoscope body
    • A61B1/0008Insertion part of the endoscope body characterised by distal tip features
    • A61B1/00094Suction openings
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/267Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the respiratory tract, e.g. laryngoscopes, bronchoscopes
    • A61B1/2676Bronchoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062Arrangements for scanning
    • A61B5/0066Optical coherence imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
    • A61B5/061Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
    • A61B5/061Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body
    • A61B5/064Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body using markers
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
    • A61B5/065Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
    • A61B5/065Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
    • A61B5/066Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/113Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]
    • A61B5/346Analysis of electrocardiograms
    • A61B5/349Detecting specific parameters of the electrocardiograph cycle
    • A61B5/352Detecting R peaks, e.g. for synchronising diagnostic apparatus; Estimating R-R interval
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/41Detecting, measuring or recording for evaluating the immune or lymphatic systems
    • A61B5/414Evaluating particular organs or parts of the immune or lymphatic systems
    • A61B5/415Evaluating particular organs or parts of the immune or lymphatic systems the glands, e.g. tonsils, adenoids or thymus
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/41Detecting, measuring or recording for evaluating the immune or lymphatic systems
    • A61B5/414Evaluating particular organs or parts of the immune or lymphatic systems
    • A61B5/418Evaluating particular organs or parts of the immune or lymphatic systems lymph vessels, ducts or nodes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0833Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures
    • A61B8/0841Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures for locating instruments
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/12Diagnosis using ultrasonic, sonic or infrasonic waves in body cavities or body tracts, e.g. by using catheters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M25/00Catheters; Hollow probes
    • A61M25/01Introducing, guiding, advancing, emplacing or holding catheters
    • A61M25/09Guide wires
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2051Electromagnetic tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2061Tracking techniques using shape-sensors, e.g. fiber shape sensors with Bragg gratings
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2063Acoustic tracking systems, e.g. using ultrasound
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2065Tracking using image or pattern recognition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2068Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M25/00Catheters; Hollow probes
    • A61M25/01Introducing, guiding, advancing, emplacing or holding catheters
    • A61M25/09Guide wires
    • A61M2025/09175Guide wires having specific characteristics at the distal tip
    • A61M2025/09183Guide wires having specific characteristics at the distal tip having tools at the distal tip
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30061Lung

Definitions

  • the invention relates generally to a medical device and particularly to an apparatus and methods associated with a range of image guided medical procedures.
  • IGS image guided surgery
  • IGI image guided intervention
  • IGS can include 2-dimensional (2-D), 3-dimensional (3-D), and 4-dimensional (4-D) applications.
  • the fourth dimension of IGS can include multiple parameters either individually or together such as time, motion, electrical signals, pressure, airflow, blood flow, respiration, heartbeat, and other patient measured parameters.
  • Imaging modalities can capture the movement of dynamic anatomy.
  • Such modalities include electrocardiogram (ECG)-gated or respiratory-gated magnetic resonance imaging (MRI) devices, ECG-gated or respiratory-gated computer tomography (CT) devices, standard computed tomography (CT), 3D Fluoroscopic images (Angio-suites), and cinematography (CINE) fluoroscopy and ultrasound.
  • ECG electrocardiogram
  • CT computer tomography
  • CINE cinematography fluoroscopy and ultrasound.
  • Multiple image datasets can be acquired at different times, cycles of patient signals, or physical states of the patient.
  • the dynamic imaging modalities can capture the movement of anatomy over a periodic cycle of that movement by sampling the anatomy at several instants during its characteristic movement and then creating a set of image frames or volumes.
  • a method includes receiving during a first time interval image data associated with an image of a dynamic body.
  • the image data includes an indication of a position of a first marker on a patient tracking device (PTD) coupled to the dynamic body and a position of a second marker on the PTD.
  • PTD patient tracking device
  • Some registration methods such as 2D to 3D registration techniques allow for the image data containing the target or patient anatomy of interest to not contain the PTD.
  • a registration step is performed to calculate the transformation from image space to patient space using an additional dataset to register (i.e., a 2D fluoroscopic set of images is used to register a 3D fluoroscopic dataset).
  • This technique is not limited to fluoroscopic procedures as it can implemented in any procedure acquiring 2D images such as ultrasound, OCT (optical coherence tomography), EBUS (endobronchial ultrasound), or IVUS (intravascular ultrasound).
  • This technique uses the markers that are within multiple 2D images to register the 3D volume that is reconstructed from these 2D images.
  • the reconstructed 3D volume is smaller than the field of view of the 2D images, so this technique allows for the PTD markers to be visible in a subset of the 2D images, but not within the 3D volume.
  • the first marker is coupled to the PTD at a first location and the second marker is coupled to the PTD at a second location. A distance between the position of the first marker and the position of the second marker is determined.
  • a second time interval after the first time interval data associated with a position of a first localization element coupled to the PTD at the first location and data associated with a position of a second localization element coupled to the PTD at the second location are received.
  • a distance between the first localization element and the second localization element based on the data associated with the position of the first localization element and the position of the second localization element is determined.
  • a difference is calculated between the distance between the first marker and the second marker during the first time interval and the distance between the first localization element and the second localization element during the second time interval.
  • the PTD device can be tracked continuously during the procedure and a sequence of motion of the PTD device that represents the patient motion of an organ or the patient's respiratory cycle can be collected. The sequence of motion can then be analyzed to find unique similar points within the dataset and grouped.
  • FIG. 1 is a schematic illustration of various devices used with a method according to an embodiment of the invention.
  • FIG. 2 is a schematic illustration of various devices used with a method according to an embodiment of the invention.
  • FIG. 3 is a schematic illustrating vector distances on an apparatus according to an embodiment of the invention.
  • FIG. 4A is a schematic illustrating vector distances from a localization device according to an embodiment of the invention.
  • FIG. 4B is a schematic illustrating vector distances from image data according to an embodiment of the invention.
  • FIG. 5 is a front perspective view of an apparatus according to an embodiment of the invention.
  • FIG. 6 is a graphical representation illustrating the function of an apparatus according to an embodiment of the invention.
  • FIG. 7 is a flowchart illustrating a method according to an embodiment of the invention.
  • FIG. 8 shows the layout of a system that may be used to carry out image guided interventions using certain of the present methods that involve gated datasets.
  • FIG. 9 illustrates one example of samples of a periodic human characteristic signal (specifically, an ECG waveform) associated, or gated, with images of dynamic anatomy.
  • a periodic human characteristic signal specifically, an ECG waveform
  • FIG. 10 is a diagram of an exemplary surgical instrument navigation system in accordance with present invention.
  • FIG. 11 is a flowchart that depicts a technique for simulating a virtual volumetric scene of a body cavity from a point of view of a surgical instrument positioned within the patient in accordance with the present invention
  • FIG. 12 is an exemplary display from the surgical instrument navigation system of the present invention.
  • FIG. 13 is a flowchart that depicts a technique for synchronizing the display of an indicia or graphical representation of the surgical instrument with cardiac or respiratory cycle of the patient in accordance with the present invention.
  • FIG. 14 is a flowchart that depicts a technique for generating four-dimensional image data that is synchronized with the patient in accordance with the present invention.
  • FIG. 15 is a graph depicting an axis or point that the instrument (e.g., a bronchoscope) deflects in a single planar direction.
  • the graph shows the instrument (e.g., a bronchoscope) being maneuvered in six different orientations in a 3D localizer volume, with all orientations converging about a common axis or point of deflection.
  • FIG. 16 is a graph depicting the eigenvalues (e 0 ,e 1 ,e 2 ) for a moving 3.0 sec PCA (principal component analysis) window over a data file including 1800 samples.
  • the square wave represents an on/off “wiggle detector” state based on the algorithm described herein, and this square wave demonstrates that the algorithm exhibits no false negatives for the validation test data and that the seven exemplary “wiggle” periods are clearly matched to the “on” state of the wiggle detector.
  • the implementation of the algorithm uses low pass filtering and an appropriate comparator function to eliminate any false positive traces or spots (“blips”) indicated in FIG. 16 .
  • FIG. 17 is an image of an exemplary synthetic radiograph in accordance with the present invention, depicting the historical instrument position trace.
  • FIG. 18 depicts an exemplary curvature warning system in accordance with the invention described herein.
  • FIG. 19 depicts an exemplary real-time respiration compensation algorithm.
  • FIG. 20 depicts additional and alternative exemplary embodiments of the invention described herein.
  • FIG. 21 depicts additional and alternative exemplary embodiments of the invention described herein.
  • FIGS. 22A and 22B depict additional and alternative exemplary embodiments of the invention described herein.
  • FIG. 23 depicts additional and alternative exemplary embodiments of the invention described herein.
  • FIGS. 24A and 24B depict exemplary embodiments of an port offset device in accordance with the invention described herein.
  • FIG. 25 depicts exemplary embodiments of a actuatable sensor-equipped forceps device in accordance with the invention described herein.
  • a method that comprises receiving a position of an instrument reference marker coupled to an instrument; transforming the position into image space using a position of a non-tissue internal reference marker implanted in a patient; and superimposing a representation of the instrument on an image in which the non-tissue internal reference marker appears possesses at least the receiving, transforming, and superimposing steps, but is not limited to possessing only those steps.
  • the method also covers instances where the transforming includes transforming the position into image space using a transformation that is based, in part, on the position of the non-tissue internal reference marker implanted in the patient, and calculating the transformation using image space coordinates of the internal reference marker in the image.
  • the term “use” should be interpreted the same way. Thus, a calculation that uses certain items uses at least those items, but also covers the use of additional items.
  • a step that calls for creating a dataset that includes images one of the images (a) depicting a non-tissue internal reference marker, (b) being linked to non-tissue internal reference marker positional information, and (c) being at least 2-dimensional covers the creation of at least such a dataset, but also covers the creation of a dataset that includes images, where each image (a) depicts the non-tissue internal reference marker, and (b) is linked to non-tissue internal reference marker positional information.
  • a and “an” are defined as one or more than one.
  • the term “another” is defined as at least a second or more.
  • the term “coupled” encompasses both direct and indirect connections, and is not limited to mechanical connections.
  • An apparatus includes a PTD and two or more markers coupled to the PTD.
  • the apparatus can also include two or more localization elements coupled to the PTD proximate the markers.
  • the apparatus is configured to be coupled to a dynamic body, such as selected dynamic anatomy of a patient.
  • Dynamic anatomy can be, for example, any anatomy that moves during its normal function (e.g., the heart, lungs, kidneys, liver and blood vessels).
  • a processor such as a computer, is configured to receive image data associated with the dynamic body taken during a pre-surgical or pre-procedural first time interval.
  • the image data can include an indication of a position of each of the markers for multiple instants in time during the first time interval.
  • the processor can also receive position data associated with the localization elements during a second time interval in which a surgical procedure or other medical procedure is being performed.
  • the processor can use the position data received from the localization elements to determine a distance between the elements for a given instant in time during the second time interval.
  • the processor can also use the image data to determine the distance between the markers for a given instant in time during the first time interval.
  • the processor can then find a match between an image where the distance between the markers at a given instant in time during the first time interval is the same as the distance between the elements associated with those markers at a given instant in time during the medical procedure, or second time interval.
  • the processor can determine a sequence of motion of the markers and match this sequence of motion to the recorded motion of the markers over the complete procedure or significant period of time. Distance alone between the markers may not be sufficient to match the patient space to image space in many instances, it is important for the system to know the direction the markers are moving and the range and speed of this motion to find the appropriate sequence of motion for a complex signal or sequence
  • a physician or other healthcare professional can use the images selected by the processor during a medical procedure performed during the second time interval.
  • a medical procedure is performed on a targeted anatomy of a patient, such as a heart or lung
  • the physician may not be able to utilize an imaging device during the medical procedure to guide him to the targeted area within the patient.
  • a PTD according to an embodiment of the invention can be positioned or coupled to the patient proximate the targeted anatomy prior to the medical procedure, and pre-procedural images can be taken of the targeted area during a first time interval.
  • Markers or fiducials coupled to the PTD can be viewed with the image data, which can include an indication of the position of the markers during a given path of motion of the targeted anatomy (e.g., the heart) during the first time interval. Such motion can be due, for example, to inspiration (i.e., inhaling) and expiration (i.e., exhaling) of the patient, or due to the heart beating.
  • the processor receives data from the localization elements associated with a position of the elements at a given instant in time during the medical procedure (or second time interval).
  • the distance between selected pairs of markers can be determined from the image data and the distance, range, acceleration, and speed between corresponding selected pairs of localization elements can be determined based on the element data for given instants in time. From multiple image datasets the range and speed of the markers motion can be calculated.
  • the distance between a selected pair of elements can be used to determine an intra-procedural distance between the pair of corresponding markers to which the localization elements are coupled.
  • An image from the pre-procedural image data taken during the first time interval can then be selected where the distance between the pair of selected markers in that image corresponds with or closely approximates the same distance determined using the localization elements at a given instant in time during the second time interval.
  • This process can be done continuously during the medical procedure, producing simulated real-time, intra-procedural images illustrating the orientation and shape of the targeted anatomy as a catheter, sheath, needle, forceps, guidewire, fiducial delivery devices, therapy device (ablation modeling, drug diffusion modeling, etc.), or similar structure(s) is/are navigated to the targeted anatomy.
  • the physician can view selected image(s) of the targeted anatomy that correspond to and simulate real-time movement of the anatomy.
  • the location(s) of a sensor e.g., an electromagnetic coil sensor
  • the location(s) of a sensor can be superimposed on an image of a catheter.
  • the superimposed image(s) of the catheter can then be superimposed on the selected image(s) from the first time interval, providing simulated real-time images of the catheter location relative to the targeted anatomy.
  • a real-time pathway registration is applied to a pre-acquired dataset that does not contain the PTD.
  • the pre-acquired dataset can be at only one cycle of a patient's respiratory, heartbeat, or other path of motion.
  • a PTD can be subsequently applied to the patient, and the PTD signal can be used to collect registration information throughout full range or path of motion but only that information that is captured at a similar PTD orientation, shape, or point along the PTD cycle of motion is used.
  • This method enhances the registration accuracy by ensuring that the registration points being used to register are at the same point during the initial dataset acquisition.
  • the method uses multiple subsets of the acquired registration data that are collected based on the PTD signal. These multiple subsets are then applied against the pre-acquired dataset to find the optimal registration fit.
  • the device can be integrated with one or more fiber optic localization (FDL) devices and/or techniques.
  • the sensor such as an EM sensor
  • the FDL provides shape sensing of the airway, vessel, pathway, organ, environment and surroundings.
  • Conventional FDL techniques can be employed.
  • the FDL device can be used to create localization information for the complete pathway or to refine the localization accuracy in a particular segment of the pathway.
  • the system can use a weighted algorithm between multiple localization devices to determine the location and orientation of the instrument in the patient.
  • the FDL device can also be used as or in conjunction with the PTD to track the patient's motion such as respiration or heartbeat.
  • video input of the bronchoscope to adjust the virtual “fly-through” view to be consistent with the user's normal perspective.
  • conventional video processing and matching techniques can be used to align the real-time video and the virtual image.
  • Angular information can be derived from the location of patient anatomy in the image and the relative size of each within the image.
  • the system can determine which the direction of the display. This can be done using, for example, translation, rotation, or a combination of both. Comparing the real-time image captured to the virtual image constructed from the 3D dataset (i.e., CT) the system can use this information to align the virtual image and/or enhance the system accuracy.
  • a high-speed three-dimensional imaging device such as an optical coherence tomography (OCT) device
  • OCT optical coherence tomography
  • a device can only view 1-2 mm below the surface.
  • OCT optical coherence tomography
  • multiple 3D volumes of data can be collected and a larger 3D volume of collected data can be constructed. Knowing the 3D location and orientation of the multiple 3D volumes will allow the user to view a more robust image of, for example, pre-cancerous changes in the esophagus or colon.
  • This data can also be correlated to pre-acquired or intra-procedurally acquired CT, fluoroscopic, ultrasound, or 3D fluoroscopic images to provide additional information.
  • an endolumenal system as described herein is that a user could overlay the planned pathway information on to the actual/real-time video image of the scope or imaging device (such as ultrasound based device). Additionally, the system and apparatus could provide a visual cue on the real-time video image showing the correct direction or pathway to take.
  • a 5DOF sensor and a limited or known range of motion of a localization device to determine its orientation in the field. This is particularly relevant, for example, in determining which way is up or down or the overall rotation of an image in 3D space. In bronchoscopy, for instance, this can be used to orient the bronchoscopic view to the user's normal expected visual orientation. Because a bronchoscope is typically only able to move in one plane up and down, the system can use the 3D location of a tip sensor moving up and down to determine the sixth degree of freedom.
  • a user could steer the bronchoscope to a bifurcation or close to a bifurcation and then perform a motion with the scope (e.g., up and down) using the thumb control to wiggle or flutter the tip and sensor.
  • the system can determine the orientation and display the correct image.
  • 5DOF sensing of instrument tip POSE position and orientation determines 5 of the 6 POSE parameters (x, y, z, pitch, and yaw).
  • Such sensing may be unable in certain applications, however, to determine the instantaneous roll of the device. This roll determination can be critical in matching the video coming from the device to the images.
  • the techniques described herein advantageously allow for users to relate orientation of a virtual endoscopic “fly-thru” display to actual video orientation presented by the endoscopic instrument.
  • the methods described herein provides for the user to select a location, most typically at a branching point in the bronchial tree, and perform a “wiggle” maneuver with the tip of the device.
  • the wiggle maneuver generally consists of three steps:
  • the physical or translational location of device is substantially secured or held in place.
  • the user should ensure that the scope is held securely so it cannot translate relative to the airway.
  • a manifestation of an algorithm to detect this operation consists of recognizing a unique signature of motion over time.
  • One such technique for example, consists of two parts:
  • orientation of the tip to the eigenvector E 0 which represents the historical vector of motion for the instrument tip, is compared.
  • An exemplary way to do this is the dot product of the measured tip vector and E 0 , which represents the acute angle.
  • the orientation of the tip should show a rhythmic oscillation of about 90° (approximate range could be for instance +/ ⁇ )45°.
  • This comparison of tip orientation to E 0 provides the basis for a determination of the wiggle plane normal using, for example, a cross-product or gram-schmidt orthogonalization.
  • the physical wiggle plane normal is in a constant relationship to the coordinate space of the video signal, and thus can be related (calibrated) thereto.
  • the wiggle techniques described herein for determining direction and orientation may be used in a range of different endoscopic applications.
  • the above examples and embodiments generally refer to the use of the wiggle maneuver in connection with bronchoscopic applications, it will be understood that the techniques described herein may also be used in other applications including, but not limited to, enteroscopy, colonoscopy, sigmoidoscopy, rhinoscopy, proctoscopy, otoscopy, cystoscopy, gynoscopy, colposcopy, hysteroscopy, falloposcopy, laparoscopy, arthroscopy, thoracoscopy, amnioscopy, fetoscopy, panendoscopy, epiduroscopy, and the like.
  • the wiggle techniques described herein may also be applicable in non-medical endoscopic uses, such as the internal inspection of complex technical systems, surveillance, and the like.
  • the methods described herein employ successive approximation techniques of pathway planning, and enhanced localization accuracy to use traveled pathway information to continuously, substantially continuously, or serially update pathway planning and localization accuracy.
  • the limits of automatic pathway or vessel segments are generally defined, for example, by the quality of the image data provided or the state the patient may be in when the image data is acquired. Therefore, in some cases the pathway segmentation may not extend completely to the target (that is, the pathway segmentation stops short of the target).
  • One method to enhance the segmentation involves using the traveled path of a tracked instrument to add branches and segment(s) to the pathway. Methods may include multiple approaches described herein such as recording traveled paths or using the additional path traveled information to iteratively segment vessels or airways from the image dataset.
  • real-time pathway registration uses full 5D and/or 6D information and/or details of instrument location to enhance registration.
  • These and other methods can employ distance, proximity, and/or angle information, for example, to determine the pathway being traversed in order to optimize localization accuracy. This can be particularly beneficial at the bifurcation(s) of vessels and airways, where an initial (or subsequent) selection of the correct direction is important to accurately navigate the desired pathway.
  • Using both 3D localization and the orientational and/or directional angle of the device can, in various embodiments, be helpful in maximizing accuracy in applications such as an endolumenal navigation system.
  • the various parameters can be weighted in real-time (or near-real-time) for improved application or use of the relevant information.
  • distance information can be used in the relevant algorithms without taking angle information into account, or vice versa.
  • the various parameters can be equally applied (e.g., 50% angle, 50% proximity).
  • different percentages can be applied to emphasize or weigh one parameter over another (e.g., 15% angle, 85% proximity; 20% angle, 80% proximity; 25% angle, 75% proximity; 30% angle, 70% proximity; 35% angle, 65% proximity; 40% angle, 60% proximity; or 45% angle, 65% proximity; or, alternatively, 15% proximity, 85% angle; 20% proximity, 80% angle; 25% proximity, 75% angle; 30% proximity, 70% angle; 35% proximity, 65% angle; 40% proximity, 60% angle; 45% proximity, 65% angle).
  • a branch e.g., an arterial branch
  • the real-time pathway registration uses path traveled of the instrument location to enhance registration. Using path traveled to exclude other potential navigational solutions enhances navigational accuracy. Many times in patient anatomy vessel or airway branches may twist around and come close to one another, but it is obvious from earlier location(s) recorded along the path traveled that only one branch can be the correct navigated location.
  • the respiratory signal derived from the PTD is used to gate the localization information of the instrument in the airway. This can assist in determining multiple airway models, for example, by performing a best fit of the real-time patient airway model to the CT data to derive the optimal registration and gated period in the patient's respiratory cycle.
  • the respiratory signal can be derived from devices other than the PTD, such a device that records the resistance between two locations on the patient. For example, this method is similar to a variable potentiometer in that the resistance of the patient changes between two fixed points as the patient inhales and exhales. Thus, the resistance can be measured to create a respiratory signal.
  • 3D location information is used to extend the segmented airway model.
  • the 3D airway can be extended as the instrument is passed along the airway by using this location information as an additional parameter to segment the airway from the CT data.
  • the 3D location information of the instrument can be used to provide seed points, manual extension, or an additional variable of likelihood of a segmented vessel or airway existing in the 3D image volume.
  • These added airways can be displayed in a different format or color (for example) to indicate to the user that they are extending the segmented airway using instrument location information.
  • the embodiments described herein have applicability in “Inspiration to Expiration”-type CT scan fusion.
  • the user navigates on the expiration CT scan for optimal accuracy, while using the inspiration scan to obtain maximum airway segmentation.
  • a user could complete planning and pathway segmentation on an inspiration scan of the patient.
  • a deformation or vector field is created between at least two datasets. The deformation or vector field may then be applied to the segmented vessels and/or airways and the user's planned path and target.
  • the deformation or vector field can also be applied to multiple datasets or in a progressive way to create a moving underlying dataset that matches the patient's respiratory or cardiac motion.
  • “Inspiration to Expiration” CT fusion using the lung lobe centroid and vector change to modify an airway model may also be applicable.
  • this technique may be used to translate and scale each airway based on the lung lobe change between scans.
  • the lung is constructed of multiple lobes and these lobes are commonly analyzed for volume, shape, and translation change. Each lobe changes in a very different way during the patient's breathing cycle. Using this information to scale and translate the airways that are located in each lobe, it is possible to adapt for airway movement.
  • This scaled airway model can then be linked to the 4D tracking of the patient as described herein.
  • a cine loop of ultrasound data is collected in conjunction with the patient's respiratory cycle information.
  • This can serve to limit registration point selection, in order to be consistent with the patient's respiratory cycle that a 3D dataset such as CT, MR, or PET has acquired.
  • This technique advantageously maximizes registration accuracy, a major flaw in conventional systems in the prior art.
  • the systems and methods described herein involve modifying inspiration CT scans to the expiration cycle for navigation. It is well understood that the patient's airways are contained within multiple lobes of the lung. It is also understood that airways significantly change between inspiration and expiration. In order to have the most accurate map for navigation it would be beneficial to include the detail of the inspiration scan, coupled with the ability to navigate it accurately during expiration, which is the most repeatable point in a patient's breath cycle. In preferred embodiments, this modification can be carried out in accordance with the following steps:
  • This vector can then be used to shift the airways that are associated with each lung lobe.
  • a centroid for the airway can be calculated based on the segmented branches. For each airway branch in the segmentation, it includes a tag that associates it with the respective lung lobe.
  • the central airway including the main carina and initial airway branches for each lobe that is linked according to the expiration scan location of these points.
  • a plane can be defined using the main carina and initial airway branch exits to determine the vector change for each lobe.
  • left inferior lobe the bottom lobe of the lung on the left side of the body.
  • left superior lobe the top lobe of the lung on the left side of the body.
  • this process is repeated for each lobe.
  • the completion of 5 lobes will result in a Navigation Airway Map for the patient.
  • the target location for the patient can be selected in the expiration scan and applied to the Navigation Airway Map.
  • it may be selected in the Inspiration scan and adjusted based on the same or similar criteria as the inspiration airways. In either case, it can be adjusted individually or linked to the airway via a 3D network and moved in the same transformation.
  • the device includes, for example, a snap-on or otherwise affixable feature (that is, offsets) to the endoscopic (e.g., bronchoscopic) port that is capable of holding a navigated guidewire or instrument in a known or preset (i.e., predetermined) location to maintain device location and free the physician/user's hand.
  • the device includes one or more offset portions that can be adjusted by combining and/or removing multiple offset segments.
  • the device includes one or more offset portions that can be adjusted by the removal of one or more removable offset segments separated by perforations (i.e., in a disposable fashion).
  • the device includes an offset that is capable of adjustment using a screw mechanism (i.e., the length of the offset can be adjusted by screwing the offset in and out).
  • each offset can be represented on the navigation screen showing offset distance from the tip of the endoscope or working channel sheath.
  • the endoscope or attachment thereof in various embodiments, may include one or more offsets, two or more offsets, three or more offsets, four or more offsets, or five or more offsets. In other embodiments, more than five offsets may be included, e.g., 6-12 offsets, 6-18 offsets, 6-24 offsets, or more).
  • Another aspect of the invention is a closed loop system that allows the navigation system to steer the working channel using shape memory alloy/metal type materials.
  • An instrument would have tracking sensors located at the tip for directional guidance as described herein that drive the micro-actuators along the shaft to turn corners. Using feedback from multiple sensors along the shaft it is also possible to determine the maximum points of friction and adjust the shape of the device to allow for easier insertion.
  • One simple metric that can be used, for example, is the difference in the shape or bend of the device to the segmented pathway of the vessel or airway, described in further detail below.
  • Other embodiments include, for example, detachable sensors to a fiducial structure (e.g., a reduced cost patient pad).
  • a sensor as described herein e.g., an electromagnetic (EM) sensor
  • EM electromagnetic
  • the device is an aspiration needle and the needle tip and the sensor move together.
  • the device is a brush, forceps, or forceps tissue capture mechanism and these components and the sensor move together.
  • the device may additionally include an actuating handle (e.g., finger holds) that is coupled with the sensor, thus allowing movement tracking.
  • a sensor e.g., an EM sensor
  • EM sensor e.g., an EM sensor
  • the user can have the direction of the side exiting working channel defined on the navigation screen. That is, the image plane that is generated is one at a side exiting working channel or port, as opposed to a point or position distal to the device. This will advantageously allow easier targeting of lesions that may not be directly in the airway, but rather partially or even completely outside of the airway.
  • the catheter is steered slightly past the target to align the side exiting port/working channel; the sampling component (e.g., forceps, needle, brush) is then extended out the catheter.
  • the directional aspect of the instrument can be viewed on the navigation screen and a simulated device can be shown to demonstrate to the user the tissue that will be sampled.
  • These applications may be particularly useful in the sampling of lymph nodes that are outside the patient airways.
  • the device may be capable of creating an endobronchial ultrasound (EBUS)-like view.
  • EBUS endobronchial ultrasound
  • an image plane oriented with the working channel plane can be created and the instrument can be shown sampling the target on this plane.
  • the image(s) may be oriented in a plane or orthogonally.
  • EM sensor as LC or energy transmission device.
  • This stored energy could be used to actuate a sampling device such as forceps or power a diagnostic sensor.
  • an elastic tube length of scope or steerable catheter to add a sensor (e.g., an EM sensor) to a device.
  • a sensor e.g., an EM sensor
  • This may take the form of a flexible sheath or tube the length of a bronchoscope or steerable catheter that can be added to existing conventional instrumentation.
  • the conventional device does not have to modified.
  • a very thin wall device can be slid other the length of the scope or catheter and it can be made navigational.
  • the PTD comprises a pad that can be placed on the patient and left for a few hours or a few days.
  • a device could be placed on a patient prior to a 3D image acquisition such as CT or MR.
  • the device would contain EM (or other) sensors and an EM/LC tank circuit that would allow it be charged up or turned on once localization was ready to commence.
  • the device could be wireless and transmit induced voltage levels back to the system to navigate in a 3D coordinate space as described herein.
  • the device could either have a separate fiducial structure in a known orientation to the EM sensors, have the configuration learned by the system, or have EM sensors that act as fiducials in the 3D image scan.
  • a 2D/3D algorithm can be employed in accordance with various embodiments, whereby multiple 2D images of a patient are acquired for a 3D volume reconstruction.
  • the complete PTD (which may include one, two or multiple (e.g., at least 3) sensors or fiducials) does not need to be seen in each image; e.g., some images may only show one sensor or a part thereof, but the entire collection of 2D images can be compiled and used to find the whole or entire PTD relative to the target.
  • 180 2D images can be used to construct a complete 3D volume (where only a fraction (e.g., 10-30) of the 2D images include all or a portion of the PTD. This facilitates easier device placement and allows the user to focus on the target, as the PTD and target do not necessarily need to be in the same initial 3D volume.
  • One aspect is directed to recording 3D location and bronchoscopic video to construct a 3D model of the patient's airway.
  • This 3D video can be recorded over multiple sessions (e.g., weeks between recording) and color, size, and shape analysis/change can be determined and/or compared for diagnostic purposes. Not only can airway lumen size and/or shape be compared, but a deformation or vector field can also be compared for the multiple sessions. This can be particularly valuable in determining overall lung function change as well as local changes to muscle and tissue elasticity.
  • Another similar aspect is directed to recording 3D location and EBUS video or images to construct a 3D model of the patient's airway or a lesion.
  • the EBUS image is very small and 2D.
  • recording multiple planes of EBUS can be used to create a 3D image of the lesion, lymph node, or blood vessels.
  • Providing correlated CT information to the EBUS image can be valuable in determining the location of structures in the patient.
  • Yet another similar aspect is directed to recording 3D location and IVUS video or images to construct a 3D model of the patient's blood vessels or plaques.
  • the IVUS image is typically very small and 2D. Recording multiple planes of IVUS can be used to create a 3D image of the blood vessels and malformations. Providing correlated CT information to the IVUS image can be valuable in determining the location of structures in the patient.
  • OCT may additionally or alternatively employed.
  • the methods described herein involve increasing registration accuracy for Ultrasound (US) to CT or any other 3D image dataset such as MR, CT-PET, and 3D Ultrasound.
  • US Ultrasound
  • 3D Ultrasound 3D image dataset
  • Using 4D tracking of the patient respiratory signal and collecting a cine loop of ultrasound images one can maximize the US to CT fusion accuracy by limiting the point or plane selection for registration to the correct respiratory cycle that matches the 3D dataset.
  • the process involves the use of a patient tracker on the patient and a tracker on the US transducer; using a localizer (such as an EM localization system) to record a cine loop of US images and match the images in the cine loop to the respiratory signal.
  • a localizer such as an EM localization system
  • Collecting a cine loop of US data for registration is valuable in that the user does not necessarily have to select a moving point while the patient is breathing. The user can simply scroll through the cine loop and, with an indicator of the point in the respiratory cycle, select the points that are best used for registration from a static image.
  • the user selects, for example, at least 3 points in the US & CT datasets, or a plane and at least one point to register the US space to the 3D CT dataset space.
  • the points and plane are selected at the same respiratory point as the 3D CT dataset.
  • the 3D CT dataset would be acquired at exhalation. Therefore, the user preferably selects registration points at exhalation or significant errors can be incorporated into the US to CT registration. If a user was to select a plane that was at a different point in the respiratory cycle, for instance, there would be significant translation error in the registration. There would likely also be significant rotational error in the registration if the points were acquired at different points in the respiratory cycle.
  • cardiac information heartbeat
  • cardiac data heartbeat
  • respiration and cardiac data could be used together. This is particularly relevant in connection with locations close to the heart or within the heart.
  • the user selects points that are sufficiently far apart for the best accuracy. This can be done, for example, by requiring the user to record a cine loop of data that extends over the whole patient organ.
  • the user is not allowed to pick multiple points in the same image.
  • centroid finding algorithm Another technique for maximizing registration accuracy is a centroid finding algorithm that can be used for refining point locations in a local area.
  • a user will want to select a vessel bifurcation.
  • the vessel bifurcation will be seen as a bright white location on the CT and US images.
  • An algorithm can be used to help the user select the optimal center location for these locations.
  • the local algorithm can be employed to find similar white voxels that are connected and, for that shape in the 3D space, refine the point to the centroid or any other optimal point (such as, for example, the most anterior or most posterior point).
  • serial orientation or positioning of multiple sensors allows the determination of one or more parameters such as shape, position, orientation, and mechanical status of a complete or partial section of guidewire or other device or instrument.
  • the placement of multiple sensors can assist in visualizing the shape of the device and any bends in the path by providing a number of data points on the path (e.g., 8 sensors, spaced 1 mm apart) to create a 3D shape model of the device.
  • Various parameters can be used to track past or present movement and changes in device shape including, for example, elasticity, bend radius, limiting, and durometer rating of the device material.
  • These parameters and accompanying data can provide visual cues to the user during the procedure, for example, when the device has a certain bend or curvature (based on path or surroundings), e.g., to provide a notice or warning that the device is on the correct or incorrect path, or to provide notice regarding, or track, a particular parameter(s) that the user is interested in.
  • a sensor pathway is generally depicted in FIG. 18 , which shows exemplary curvature warning scenarios in the differently marked sections or segments.
  • a breathing patient for example, or a patient with a moving vessel related to heartbeat
  • the patient's tracked or physiological signal is used to determine 4D patient motion cycle, and with the instrument's traveled path, one can determine the optical location relative to a segmented airway or vessel and use this information to provide the optimal virtual display.
  • FIGS. 1 and 2 are schematic illustrations of devices that can be used in conjunction with, or to perform, various procedures described herein.
  • an apparatus 10 includes a PTD 20 .
  • the PTD 20 can be coupled to a dynamic body B.
  • the dynamic body B can be, for example, a selected dynamic portion of the anatomy of a patient.
  • the PTD 20 can be a variety of different shapes and sizes.
  • the PTD 20 is substantially planar, such as in the form of a patch that can be disposed at a variety of locations on a patient's body.
  • Such a PTD 20 can be coupled to the dynamic body with adhesive, straps, hook and pile, snaps, or any other suitable coupling method.
  • the PTD can be a catheter type device with a pigtail or anchoring mechanism that allows it to be attached to an internal organ or along a vessel.
  • Two or more markers or fiducials 22 are coupled to the PTD 20 at selected locations as shown in FIG. 1 .
  • the markers 22 are constructed of a material that can be viewed on an image, such as an X-ray or CT.
  • the markers 22 can be, for example, radiopaque, and can be coupled to the PTD 20 using any known methods of coupling such devices.
  • FIGS. 1 and 2 illustrate the apparatus 10 having four markers 22 , but any number of two or more markers can be used.
  • the marker or fiducials and the localization element can be the same device.
  • An imaging device 40 can be used to take images of the dynamic body B while the PTD 20 is coupled to the dynamic body B, pre-procedurally during a first time interval.
  • the markers 22 are visible on the images and can provide an indication of a position of each of the markers 22 during the first time interval.
  • the position of the markers 22 at given instants in time through a path of motion of the dynamic body B can be illustrated with the images.
  • the imaging device 40 can be, for example, a computed tomography (CT) device (e.g., respiratory-gated CT device, ECG-gated CT device), a magnetic resonance imaging (MRI) device (e.g., respiratory-gated MRI device, ECG-gated MRI device), an X-ray device, or any other suitable medical imaging device.
  • CT computed tomography
  • MRI magnetic resonance imaging
  • the imaging device 40 is a computed tomography—positron emission tomography device that produces a fused computed tomography—positron emission tomography image dataset.
  • the imaging device 40 can be in communication with a processor 30 and send, transfer, copy and/or provide image data taken during the first time interval associated with the dynamic body B to the processor 30 .
  • the processor 30 includes a processor-readable medium storing code representing instructions to cause the processor 30 to perform a process.
  • the processor 30 can be, for example, a commercially available personal computer, or a less complex computing or processing device that is dedicated to performing one or more specific tasks.
  • the processor 30 can be a terminal dedicated to providing an interactive graphical user interface (GUI).
  • GUI graphical user interface
  • the processor 30 can be a commercially available microprocessor.
  • the processor 30 can be an application-specific integrated circuit (ASIC) or a combination of ASICs, which are designed to achieve one or more specific functions, or enable one or more specific devices or applications.
  • the processor 30 can be an analog or digital circuit, or a combination of multiple circuits.
  • the processor 30 can include a memory component 32 .
  • the memory component 32 can include one or more types of memory.
  • the memory component 32 can include a read only memory (ROM) component and a random access memory (RAM) component.
  • the memory component can also include other types of memory that are suitable for storing data in a form retrievable by the processor 30 .
  • EPROM electronically programmable read only memory
  • EEPROM erasable electronically programmable read only memory
  • flash memory as well as other suitable forms of memory can be included within the memory component.
  • the processor 30 can also include a variety of other components, such as for example, coprocessors, graphic processors, etc., depending upon the desired functionality of the code.
  • the processor 30 can store data in the memory component 32 or retrieve data previously stored in the memory component 32 .
  • the components of the processor 30 can communicate with devices external to the processor 30 by way of an input/output (I/O) component (not shown).
  • I/O component can include a variety of suitable communication interfaces.
  • the I/O component can include, for example, wired connections, such as standard serial ports, parallel ports, universal serial bus (USB) ports, S-video ports, local area network (LAN) ports, small computer system interface (SCCI) ports, and so forth.
  • the I/O component can include, for example, wireless connections, such as infrared ports, optical ports, Bluetooth® wireless ports, wireless LAN ports, or the like.
  • the processor 30 can be connected to a network, which may be any form of interconnecting network including an intranet, such as a local or wide area network, or an extranet, such as the World Wide Web or the Internet.
  • the network can be physically implemented on a wireless or wired network, on leased or dedicated lines, including a virtual private network (VPN).
  • VPN virtual private network
  • the processor 30 can receive image data from the imaging device 40 .
  • the processor 30 can identify the position of selected markers 22 within the image data or voxel space using various segmentation techniques, such as Hounsfield unit thresholding, convolution, connected component, or other combinatory image processing and segmentation techniques.
  • the processor 30 can determine a distance and direction between the position of any two markers 22 during multiple instants in time during the first time interval, and store the image data, as well as the position and distance data, within the memory component 32 . Multiple images can be produced providing a visual image at multiple instants in time through the path of motion of the dynamic body.
  • the processor 30 can also include a receiving device or localization device 34 , which is described in more detail below.
  • a deformation field may also be included in the analysis in various embodiments described herein.
  • the deformation field can be applied to fuse 3D fluoroscopic images to CT images in order to compensate for different patient orientations, patient position, respiration, deformation induced by the catheter or other instrument, and/or other changes or perturbations that occur due to therapy delivery or resection or ablation of tissue.
  • real-time respiration compensation can be determined by applying an inspiration-to-expiration deformation vector field.
  • the instrument location can be calculated using the deformation vector field.
  • a real-time instrument tip correction vector can be applied to a 3D localized instrument tip.
  • the real-time correction vector is computed by scaling an inspiration-to-expiration deformation vector (found from the inspiration-to-expiration deformation vector field) based on the PTD respiratory signal. This correction vector can then be applied to the 3D localized instrument tip. This can further optimize accuracy during navigation.
  • l′ is a respiration compensated version of l.
  • FIG. 19 and the above discussion generally relate to real-time respiration motion, it will be understood that these calculations and determinations may also be applied to real-time heartbeat and/or vessel motion compensation, or any other motion of a dynamic body as described herein.
  • the deformation matrix is calculated based upon inspiration and expiration.
  • the deformation matrix is calculated based upon heartbeat.
  • the deformation matrix is based upon vessel motion.
  • Deformation on 2D images can also be calculated based upon therapeutic change of tissue, changes in Houndsfield units for images, patient motion compensation during the imaging sequence, therapy monitoring, and temperature monitoring with fluoroscopic imaging, among other things.
  • One potential issue with conventional therapy delivery, for instance, is monitoring the therapy for temperature or tissue changes.
  • this monitoring can be carried out using intermittent fluoroscopic imaging, where the images are compensated between acquisition times to show very small changes in image density, which can represent temperature changes or tissue changes as a result of the therapy and/or navigation.
  • One method of reducing radiation during the acquisition of a 3D fluoroscopic dataset is to use a deformation field between acquired 2D images to reduce the actual number of 2D images that need to be acquired to create the 3D dataset.
  • the deformation field is used to calculate the deformation between images in the acquisition sequence to produce 2D images between the acquired slices, and these new slices can be used to calculate the 3D fluoroscopic dataset.
  • 90 2D images can be acquired over a 360 degree acquisition sequence and the data from the images that would have ordinarily been acquired between each slice can be calculated and imported into the 3D reconstruction algorithm.
  • the radiation is effectively reduced by 50%.
  • two or more localization elements 24 are coupled to the PTD 20 proximate the locations of the markers 22 for use during a medical procedure to be performed during a second time interval.
  • the localization elements 24 can be, for example, electromagnetic coils, infrared light emitting diodes, and/or optical passive reflective markers.
  • the localization elements 24 can also be, or be integrated with, one or more fiber optic localization (FDL) devices.
  • the markers 22 can include plastic or non-ferrous fixtures or dovetails or other suitable connectors used to couple the localization elements 24 to the markers 22 .
  • a medical procedure can then be performed with the PTD 20 coupled to the dynamic body B at the same location as during the first time interval when the pre-procedural images were taken.
  • the localization elements 24 are in communication or coupled to the localization device 34 included within processor 30 .
  • the localization device 34 can be, for example, an analog to digital converter that measures voltages induced onto localization coils in the field; creates a digital voltage reading; and maps that voltage reading to a metric positional measurement based on a characterized volume of voltages to millimeters from a fixed field emitter.
  • Position data associated with the elements 24 can be transmitted or sent to the localization device 34 continuously during the medical procedure during the second time interval.
  • the position of the localization elements 24 can be captured at given instants in time during the second time interval.
  • the localization device 34 can use the position data of the elements 24 to deduce coordinates or positions associated with the markers 22 intra-procedurally during the second time interval.
  • the distance, range, acceleration, and speed between one or more selected pairs of localization elements 24 (and corresponding markers 22 ) can then be determined and various algorithms can be used to analyze and compare the distance between selected elements 24 at given instants in time, to the distances between and orientation among corresponding markers 22 observed in the pre-operative images.
  • An image can then be selected from the pre-operative images taken during the first time interval that indicates a distance or is grouped in a similar sequence of motion between corresponding markers 22 at a given instant in time, that most closely approximates or matches the distance or similar sequence of motion between the selected elements 24 .
  • the process of comparing the distances is described in more detail below.
  • the apparatus 10 and processor 30 can be used to provide images corresponding to the actual movement of the targeted anatomy during the medical procedure being performed during the second time interval.
  • the images illustrate the orientation and shape of the targeted anatomy during a path of motion of the anatomy, for example, during inhaling and exhaling.
  • FIG. 3 illustrates an example set of distances or vectors d 1 through d 6 between a set of markers 122 , labeled m 1 through m 9 that are disposed at spaced locations on a PTD 120 .
  • pre-procedure images can be taken of a dynamic body for which the PTD 120 is to be coupled during a first time interval.
  • the distances between the markers can be determined for multiple instants in time through the path of motion of the dynamic body.
  • localization elements (not shown in FIG. 3 ) coupled proximate to the location of markers 122 can provide position data for the elements to a localization device (not shown in FIG. 3 ).
  • the localization device can use the position data to determine distances or vectors between the elements for multiple instants in time during the medical procedure or second time interval.
  • FIG. 4A shows an example of distance or vector data from the localization device.
  • Vectors a 1 through a 6 represent distance data for one instant in time and vectors n 1 through n 6 for another instant in time, during a time interval from a to n.
  • the vector data can be used to select an image from the pre-procedural images that includes distances between the markers m 1 through m 9 that correspond to or closely approximate the distances a 1 through a 6 for time a, for example, between the localization elements.
  • the same process can be performed for the vectors n 1 through n 6 captured during time n.
  • One method of selecting the appropriate image from the pre-procedural images is to execute an algorithm that can sum all of the distances a 1 through a 6 and then search for and match this sum to an image containing a sum of all of the distances d 1 through d 6 obtained pre-procedurally from the image data that is equal to the sum of the distances a 1 through a 6 .
  • the difference between these sums is equal to zero, the relative position and orientation of the anatomy or dynamic body D during the medical procedure will substantially match the position and orientation of the anatomy in the particular image.
  • the image associated with distances d 1 through d 6 that match or closely approximate the distances a 1 through a 6 can then be selected and displayed. For example, FIG.
  • FIG. 4B illustrates examples of pre-procedural images, Image a and Image n, of a dynamic body D that correspond to the distances a 1 through a 6 and n 1 through n 6 , respectively.
  • An example of an algorithm for determining a match is as follows:
  • the image is a match to the vector or distance data obtained during the medical procedure.
  • FIG. 5 illustrates an apparatus 210 according to an embodiment of the invention.
  • the apparatus 210 includes a tubular shaped PTD 220 that can be constructed with a rigid material or, alternatively, a flexible and/or stretchable material.
  • the PTD 220 is substantially rigid in structure.
  • the PTD 220 has a flexible or stretchable structure.
  • the PTD 220 can be positioned over a portion of a patient's body, such as around the upper or lower torso of the patient.
  • the stretchability of the PTD 220 allows the PTD 220 to at least partially constrict some of the movement of the portion of the body for which it is coupled.
  • the apparatus 210 further includes multiple markers or fiducials 222 coupled to the PTD 220 at spaced locations.
  • a plurality of localization elements 224 are removably coupled proximate to the locations of markers 222 , such that during a first time interval as described above, images can be taken without the elements 224 being coupled to the PTD 220 .
  • the localization elements need not be removably coupled.
  • the elements can be fixedly coupled to the PTD.
  • the elements can be coupled to the PTD during the pre-procedure imaging.
  • FIG. 6 is a graphical illustration indicating how the apparatus 210 (shown without localization elements 224 ) can move and change orientation and shape during movement of a dynamic body, such as a mammalian body M.
  • the graph is one example of how the lung volume can change during inhalation (inspiration) and exhalation (expiration) of the mammalian body M.
  • the corresponding changes in shape and orientation of the apparatus 210 during inhalation and exhalation are also illustrated.
  • the six markers 222 shown in FIG. 5 are labeled a, b, c, d, e, and f. As described above, images of the apparatus 110 can be taken during a first time interval.
  • the images can include an indication of relative position of each of the markers 222 , that is the markers 222 are visible in the images, and the position of each marker 222 can then be observed over a period of time.
  • a distance between any two markers 222 can then be determined for any given instant of time during the first time interval. For example, a distance X between markers a and b is illustrated, and a distance Y between markers b and f is illustrated. These distances can be determined for any given instant in time during the first time interval from an associated image that illustrates the position and orientation of the markers 222 . As illustrated, during expiration of the mammalian body M at times indicated as A and C, the distance X is smaller than during inspiration of the mammalian body M, at the time indicated as B.
  • the distance Y is greater during inspiration than during expiration.
  • the distance between any pair of markers 222 can be determined and used in the processes described herein.
  • the above embodiments are merely examples of possible pair selections. For example, a distance between a position of marker e and a position of marker b may be determined.
  • multiple pairs or only one pair may be selected for a given procedure.
  • FIG. 7 is a flowchart illustrating a method according to an embodiment of the invention.
  • a method 50 includes at step 52 receiving image data during a pre-procedural or first time interval.
  • images are taken of a dynamic body using an appropriate imaging modality (e.g., CT Scan, MRI, etc.).
  • the image data is associated with one or more images taken of a PTD (as described herein) coupled to a dynamic body, where the PTD includes two or more markers coupled thereto.
  • the image data of the dynamic body is correlated with image data related to the PTD.
  • the one or more images can be taken using a variety of different imaging modalities as described previously.
  • the image data can include an indication of a position of a first marker and an indication of a position of a second marker, as illustrated at step 54 .
  • the image data can include position data for multiple positions of the markers during a range or path of motion of the dynamic body over a selected time interval.
  • the image data can include position data associated with multiple markers, however, only two are described here for simplicity.
  • a distance between the position of the first marker and the position of the second marker can be determined for multiple instants in time during the first time interval, at step 56 .
  • the determination can include determining the distance based on the observable distance between the markers on a given image.
  • the image data, including all of the images received during the first time interval, the position, and the distance data can be stored in a memory and/or recorded at step 58 .
  • position data can be received for a first localization element and a second localization element.
  • the localization elements can be coupled to the PTD proximate the locations of the markers, such that the position data associated with the elements can be used to determine the relative position of the markers in real-time during the medical procedure.
  • the position data of the elements can be stored and/or recorded at step 62 .
  • a distance between the first and second localization elements can be determined at step 64 . Although only two localization elements are described, as with the markers, position data associated with more than two localization elements can be received and the distances between the additional elements can be determined.
  • the next step is to determine which image from the one or more images taken during the first time interval represents the relative position and/or orientation of the dynamic body at a given instant in time during the second time interval or during the medical procedure. To determine this, at step 66 , the distance between the positions of the first and second localization elements at a given instant in time during the second time interval are compared to the distance(s) determined in step 56 between the positions of the first and second markers obtained with the image data during the first time interval.
  • An image can be selected from the first time interval that best represents the same position and orientation of the dynamic body at a given instant in time during the medical procedure.
  • the difference between the distance between a given pair of localization elements during the second time interval is used to select the image that contains the same distance between the same given pair of markers from the image data received during the first time interval.
  • This can be accomplished, for example, by executing an algorithm to perform the calculations.
  • the algorithm can sum the distances between all of the selected pairs of elements for a given instant in time during the second time interval and sum the distances between all of the associated selected pairs of markers for each instant in time during the first time interval when the pre-procedural image data was received.
  • FIG. 8 shows one embodiment of a system (system 100 ) that includes components that can be used to perform image guided interventions using a gated imaging modality, such as ECG-gated MRI, or ECG-gated CT.
  • a gated imaging modality such as ECG-gated MRI, or ECG-gated CT.
  • the figure depicts a patient 10 positioned on an operating table 12 with a physician 14 performing a medical procedure on him.
  • FIG. 8 depicts physician 14 steering a medical instrument 16 through the patient's internal anatomy in order to deliver therapy.
  • instrument 16 is depicted as a catheter entering the right atrium by way of the inferior vena cava preceded by a femoral artery access point; however, the present systems are not limited to catheter use indications.
  • the position of virtually any instrument may be tracked as discussed below and a representation of it superimposed on the proper image, consistent with the present methods, apparatuses, and systems.
  • An “instrument” is any device controlled by physician 10 for the purpose of delivering therapy, and includes needles, guidewires, stents, filters, occluders, retrieval devices, imaging devices (such as OCT, EBUS, IVUS, and the like), and leads.
  • Instrument 16 is fitted with one or more instrument reference markers 18 .
  • a tracker 20 (which is sometimes referred to in the art as a “tracking system”) is configured to track the type of reference marker or markers coupled to instrument 16 .
  • Tracker 20 can be any type of tracking system, including but not limited to an electromagnetic tracking system.
  • An example of a suitable electromagnetic tracking system is the AURORA electromagnetic tracking system, commercially available from Northern Digital Inc. in Waterloo, Ontario Canada. If tracker 20 is an electromagnetic tracking system, element 20 would represent an electromagnetic field generator that emits a series of electromagnetic fields designed to engulf patient 10 , and reference marker or markers 18 coupled to medical instrument 16 could be coils that would receive an induced voltage that could be monitored and translated into a coordinate position of the marker(s).
  • an angled coil sensor is employed during the targeted navigation.
  • the coil is wrapped at an acute angle (i.e., the angle is less than about 90°) relative to the axial length of the sensor.
  • the coil is positioned (e.g., wrapped) at an angle of from about 30° to about 60° relative to the axial length. In one preferred embodiment, the coil is positioned at about a 45° angle relative to the axial length.
  • the positioning of the coil in accordance with the exemplary embodiments described herein advantageously provides a directional vector that is not parallel with the sensor core.
  • the physical axis is different and, as the sensor moves, this additional directional vector can be quantified and used to detect up and down (and other directional) movement.
  • This motion can be captured over time as described herein to determine orientation and prepare and display the more accurate images.
  • An external reference marker 22 can be placed in a location close to the region of the patient where the procedure is to be performed, yet in a stable location that will not move (or that will move a negligible amount) with the patient's heart beat and respiration. If patient 10 is securely fixed to table 12 for the procedure, external reference marker 22 (which may be described as “static”) can be affixed to table 12 . If patient 10 is not completely secured to table 12 , external reference marker 22 can be placed on region of the back of patient 10 exhibiting the least amount of movement. Tracker 20 can be configured to track external reference marker 22 .
  • Non-tissue internal reference markers 24 can be placed in the gross region where the image guided navigation will be carried out.
  • Non-tissue internal reference marker(s) 24 should be placed in an anatomic location that exhibits movement that is correlated with the movement of the anatomy intended for image guided navigation. This location will be internal to the patient, in the gross location of the anatomy of interest.
  • Converter 26 can be configured to convert analog measurements received from the reference markers and tracker 20 into digital data understandable by image guidance computing platform 30 , and relay that data to image guidance computing platform 30 to which converter 26 can be coupled.
  • Image guidance computing platform 30 can take the form of a computer, and may include a monitor on which a representation of one or more instruments used during the IGI can be displayed over an image of the anatomy of interest.
  • System 100 also includes a periodic human characteristic signal monitor, such as ECG monitor 32 , which can be configured to receive a periodic human characteristic signal.
  • ECG monitor 32 can be configured to receive an ECG signal in the form of the ECG data transmitted to it by ECG leads 34 coupled to patient 10 .
  • the periodic human characteristic signal monitor (e.g., ECG monitor 32 ) can also be configured to relay a periodic human characteristic signal (e.g., ECG data) to image guidance computing platform 30 , to which it can be coupled.
  • non-tissue internal reference marker(s) 24 Prior to the start of the image guided intervention, non-tissue internal reference marker(s) 24 —but not necessarily static external reference marker 22 —should be placed in the gross region of interest for the procedure.
  • patient 10 is to be scanned with an imaging device, such as gated scanner 40 , and the resulting gated image dataset transferred to image guidance computing platform 30 , to which the imaging device is coupled and which can reside in the operating or procedure theatre.
  • imaging devices and more specifically suitable gated scanners, include ECG-gated MRI scanners and ECG-gated CT scanners.
  • a hospital network 50 may be used to couple gated scanner 40 to image guidance computing platform 30 .
  • the imaging device e.g., gated scanner 40
  • the imaging device can be configured to create a gated dataset that includes pre-operative images, one or more of which (up to all) are taken using the imaging device and are linked to a sample of a periodic human characteristic signal (e.g., a sample, or a phase, of an ECG signal).
  • a periodic human characteristic signal e.g., a sample, or a phase, of an ECG signal.
  • FIG. 9 highlights the relationship between the samples (S 1 . . . Sn) and the images (I 1 . . . In) that were captured by gated scanner 40 .
  • Designations P, Q, R, S, and T are designations well known in the art; they designate depolarizations and re-polarizations of the heart.
  • Gated scanner 40 essentially creates an image of the anatomy of interest at a particular instant in time during the anatomy's periodic movement. Image I 1 corresponds to the image that was captured at the S 1 moment of patient 10 's ECG cycle. Similarly, I 2 is correlated with S 2 , and In with Sn.
  • FIG. 10 is a diagram of another exemplary surgical instrument navigation system 10 .
  • the surgical instrument navigation system 10 is operable to visually simulate a virtual volumetric scene within the body of a patient, such as an internal body cavity, from a point of view of a surgical instrument 12 residing in the cavity of a patient 13 .
  • the surgical instrument navigation system 10 is primarily comprised of a surgical instrument 12 , a data processor 16 having a display 18 , and a tracking subsystem 20 .
  • the surgical instrument navigation system 10 may further include (or accompanied by) an imaging device 14 that is operable to provide image data to the system.
  • the surgical instrument 12 is preferably a relatively inexpensive, flexible and/or steerable catheter that may be of a disposable type.
  • the surgical instrument 12 is modified to include one or more tracking sensors that are detectable by the tracking subsystem 20 .
  • tracking sensors that are detectable by the tracking subsystem 20 .
  • other types of surgical instruments e.g., a guide wire, a needle, a forcep, a pointer probe, a stent, a seed, an implant, an endoscope, an energy delivery device, a therapy delivery device, etc.
  • at least some of these surgical instruments may be wireless or have wireless communications links.
  • the surgical instruments may encompass medical devices which are used for exploratory purposes, testing purposes or other types of medical procedures.
  • the volumetric scan data is then registered as shown at 34 .
  • Registration of the dynamic reference frame 19 generally relates information in the volumetric scan data to the region of interest associated with the patient. This process is referred to as registering image space to patient space. Often, the image space must also be registered to another image space. Registration is accomplished through knowledge of the coordinate vectors of at least three non-collinear points in the image space and the patient space.
  • the imaging device 14 is used to capture volumetric scan data 32 representative of an internal region of interest within the patient 13 .
  • the three-dimensional scan data is preferably obtained prior to surgery on the patient 13 .
  • the captured volumetric scan data may be stored in a data store associated with the data processor 16 for subsequent processing.
  • the principles of the present invention may also extend to scan data acquired during surgery.
  • volumetric scan data may be acquired using various known medical imaging devices 14 , including but not limited to a magnetic resonance imaging (MRI) device, a computed tomography (CT) imaging device, a positron emission tomography (PET) imaging device, a 2D or 3D fluoroscopic imaging device, and 2D, 3D or 4D ultrasound imaging devices.
  • MRI magnetic resonance imaging
  • CT computed tomography
  • PET positron emission tomography
  • 2D or 3D fluoroscopic imaging device a 2D or 3D fluoroscopic imaging device
  • 2D, 3D or 4D ultrasound imaging devices In the case of a two-dimensional ultrasound imaging device or other two-dimensional image acquisition device, a series of two-dimensional data sets may be acquired and then assembled into volumetric data as is well known in the art using a two-dimensional to three-dimensional conversion.
  • the multi-dimensional imaging modalities described herein may also be coupled with digitally reconstructed radiography (DRR) techniques.
  • DRR digitally reconstructed radiography
  • a fluoroscopic image acquisition for example, radiation passes through a physical media to create a projection image on a radiation-sensitive film or an electronic image intensifier.
  • a simulated image can be generated in conjunction with DRR methodologies.
  • DRR is generally known in the art, and is described, for example, by Lemieux et al. (Med. Phys. 21(11), November 1994, pp. 1749-60).
  • a fluoroscopic image is formed by computationally projecting volume elements, or voxels, of the 3D or 4D dataset onto one or more selected image planes.
  • volume elements or voxels
  • a fluoroscopic image is formed by computationally projecting volume elements, or voxels, of the 3D or 4D dataset onto one or more selected image planes.
  • this provides another method to see the up-and-down (and other directional) movement of the instrument.
  • This arrangement further provides the ability to see how the device moves in an image(s), which translates to improved movement of the device in a patient.
  • An exemplary pathway in accordance with the disclosure herein can be seen in FIG. 17 .
  • a dynamic reference frame 19 is attached to the patient proximate to the region of interest within the patient 13 .
  • the region of interest is a vessel or a cavity within the patient, it is readily understood that the dynamic reference frame 19 may be placed within the patient 13 .
  • the dynamic reference frame 19 is also modified to include tracking sensors detectable by the tracking subsystem 20 .
  • the tracking subsystem 20 is operable to determine position data for the dynamic reference frame 19 as further described below.
  • the volumetric scan data is then registered as shown at 34 .
  • Registration of the dynamic reference frame 19 generally relates information in the volumetric scan data to the region of interest associated with the patient. This process is referred to as registering image space to patient space. Often, the image space must also be registered to another image space. Registration is accomplished through knowledge of the coordinate vectors of at least three non-collinear points in the image space and the patient space.
  • Registration for image guided surgery can be completed by different known techniques.
  • point-to-point registration is accomplished by identifying points in an image space and then touching the same points in patient space. These points are generally anatomical landmarks that are easily identifiable on the patient.
  • surface registration involves the user's generation of a surface in patient space by either selecting multiple points or scanning, and then accepting the best fit to that surface in image space by iteratively calculating with the data processor until a surface match is identified.
  • repeat fixation devices entail the user repeatedly removing and replacing a device (i.e., dynamic reference frame, etc.) in known relation to the patient or image fiducials of the patient.
  • automatic registration by first attaching the dynamic reference frame to the patient prior to acquiring image data.
  • FIG. 12 illustrates another type of secondary image 28 which may be displayed in conjunction with the primary perspective image 38 .
  • the primary perspective image is an interior view of an air passage within the patient 13 .
  • the secondary image 28 is an exterior view of the air passage which includes an indicia or graphical representation 29 that corresponds to the location of the surgical instrument 12 within the air passage.
  • the indicia 29 is shown as a crosshairs. It is envisioned that other indicia may be used to signify the location of the surgical instrument in the secondary image.
  • the secondary image 28 is constructed by superimposing the indicia 29 of the surgical instrument 12 onto the manipulated image data 38 .
  • the display of an indicia of the surgical instrument 12 on the secondary image may be synchronized with an anatomical function, such as the cardiac or respiratory cycle, of the patient.
  • an anatomical function such as the cardiac or respiratory cycle
  • the cardiac or respiratory cycle of the patient may cause the surgical instrument 12 to flutter or jitter within the patient.
  • a surgical instrument 12 positioned in or near a chamber of the heart will move in relation to the patient's heart beat.
  • the indicia of the surgical instrument 12 will likewise flutter or jitter on the displayed image 40 .
  • other anatomical functions which may effect the position of the surgical instrument 12 within the patient are also within the scope of the present invention.
  • position data for the surgical instrument 12 is acquired at a repetitive point within each cycle of either the cardiac cycle or the respiratory cycle of the patient.
  • the imaging device 14 is used to capture volumetric scan data 42 representative of an internal region of interest within a given patient.
  • a secondary image may then be rendered 44 from the volumetric scan data by the data processor 16 .
  • the surgical instrument navigation system 10 may further include a timing signal generator 26 .
  • the timing signal generator 26 is operable to generate and transmit a timing signal 46 that correlates to at least one of (or both) the cardiac cycle or the respiratory cycle of the patient 13 .
  • the timing signal might be in the form of a periodic clock signal.
  • the timing signal may be derived from an electrocardiogram signal from the patient 13 .
  • One skilled in the art will readily recognize other techniques for deriving a timing signal that correlate to at least one of the cardiac or respiratory cycle or other anatomical cycle of the patient.
  • the indicia of the surgical instrument 12 tracks the movement of the surgical instrument 12 as it is moved by the surgeon within the patient 13 .
  • the display of the indicia of the surgical instrument 12 is periodically updated 48 based on the timing signal from the timing signal generator 26 .
  • the timing generator 26 is electrically connected to the tracking subsystem 20 .
  • the tracking subsystem 20 is in turn operable to report position data for the surgical instrument 12 in response to a timing signal received from the timing signal generator 26 .
  • the position of the indicia of the surgical instrument 12 is then updated 50 on the display of the image data.
  • the surgical instrument navigation system 10 may be further adapted to display four-dimensional image data for a region of interest as shown in FIG. 14 .
  • the imaging device 14 is operable to capture volumetric scan data 62 for an internal region of interest over a period of time, such that the region of interest includes motion that is caused by either the cardiac cycle or the respiratory cycle of the patient 13 .
  • a volumetric perspective view of the region may be rendered 64 from the volumetric scan data 62 by the data processor 16 as described above.
  • the four-dimensional image data may be further supplemented with other patient data, such as temperature or blood pressure, using coloring coding techniques.
  • the data processor 16 is adapted to receive a timing signal from the timing signal generator 26 .
  • the timing signal generator 26 is operable to generate and transmit a timing signal that correlates to either the cardiac cycle or the respiratory cycle of the patient 13 .
  • the volumetric perspective image may be synchronized 66 with the cardiac or respiratory cycle of the patient 13 .
  • the synchronized image 66 is then displayed 68 on the display 18 of the system.
  • the four-dimensional synchronized image may be either (or both of) the primary image rendered from the point of view of the surgical instrument or the secondary image depicting the indicia of the position of the surgical instrument 12 within the patient 13 . It is readily understood that the synchronization process is also applicable to two-dimensional image data acquire over time.
  • the surgical navigation system can use prior knowledge such as the segmented vessel or airway structure to compensate for error in the tracking subsystem or for inaccuracies caused by an anatomical shift occurring since acquisition of scan data. For instance, it is known that the surgical instrument 12 being localized is located within a given vessel or airway and, therefore should be displayed within the vessel or airway. Statistical methods can be used to determine the most likely location; within the vessel or airway with respect to the reported location and then compensate so the display accurately represents the instrument 12 within the center of the vessel or airway.
  • the center of the vessel or airway can be found by segmenting the vessels or airways from the three-dimensional datasets and using commonly known imaging techniques to define the centerline of the vessel or airway tree.
  • Statistical methods may also be used to determine if the surgical instrument 12 has potentially punctured the vessel or airway. This can be done by determining the reported location is too far from the centerline or the trajectory of the path traveled is greater than a certain angle (worse case 90 degrees) with respect to the vessel or airway. Reporting this type of trajectory (error) is very important to the clinicians.
  • the tracking along the center of the vessel may also be further refined by correcting for motion of the respiratory or cardiac cycle, as described above. While navigating along the vessel or airway tree prior knowledge about the last known location can be used to aid in determining the new location.
  • the instrument or navigated device must follow a pre-defined vessel or airway tree and therefore can not jump from one branch to the other without traveling along a path that would be allowed.
  • the orientation of the instrument or navigated device can also be used to select the most likely pathway that is being traversed. The orientation information can be used to increase the probability or weight for selected location or to exclude potential pathways and therefore enhance system accuracy.
  • the surgical instrument navigation system of the present invention may also incorporate atlas maps. It is envisioned that three-dimensional or four-dimensional atlas maps may be registered with patient specific scan data or generic anatomical models. Atlas maps may contain kinematic information (e.g., heart and lung models) that can be synchronized with four-dimensional image data, thereby supplementing the real-time information. In addition, the kinematic information may be combined with localization information from several instruments to provide a complete four-dimensional model of organ motion. The atlas maps may also be used to localize bones or soft tissue which can assist in determining placement and location of implants.
  • Atlas maps may contain kinematic information (e.g., heart and lung models) that can be synchronized with four-dimensional image data, thereby supplementing the real-time information.
  • the kinematic information may be combined with localization information from several instruments to provide a complete four-dimensional model of organ motion.
  • the atlas maps may also be used to localize bones or soft tissue which can assist in determining placement and location
  • FIG. 20 illustrates in one exemplary embodiment the use of Inspiration/arms-up CT and Expiration/arms-down CT for image guided navigation purposes.
  • Stage (A) shows an Inspiration/arms-up pathway registration; this is, generally speaking, the preferred CT scan acquisition state for automatic segmentation of the tracheo-bronchial tree.
  • Stage (B) shows FRC/arms-down segmentation (wherein FRC refers to the Functional Residual Capacity (i.e., the lung volume at the end of a normal expiration, when the muscles of respiration are completely relaxed; at FRC (and typically at FRC only), the tendency of the lungs to collapse is exactly balanced by the tendency of the chest wall to expand).
  • FRC refers to the Functional Residual Capacity
  • FRC/arms-down is, generally, the preferred navigational state for image guided pulmonary navigation.
  • inspiration (arms-up) state of the lungs can contribute significant error to the image guided navigation.
  • the airways are segmented using full inspiration/arms-up CT acquisition, and mapped to a less-fully segmented, FRC/arms-down CT acquisition. As shown, the results can then be conformed to produce a fully segmented, tracheo-bronchial tree, at the proper spatial representation for patient FRC (Stage (C)).
  • FIG. 21 depicts a CT minP/maxP volume reading including a scenario whereby precise navigation (e.g., using an EM sensor) near a target lesion is carried out with incomplete segmentation results.
  • This scenario provides the user with a view or image 1600 using minP (minimum intensity projection or maxP (maximum intensity projection) volume renderings to simultaneously integrate one or more of: (i) the last known segmented airway 1601 ; (ii) the target(s) 1602 ; (iii) a visually distinct representation of previously traversed paths that are “bad” (i.e., incorrect) 1603 ; (iv) the distance and angle 1604 to the target (e.g., a target lesion) using a vector fit to the last 1 cm (or so) of travel (in addition to, or in place of, instantaneous orientation provided by a 5DOF tip sensor as described herein); and (v) to incorporate user provided “way points” to create a final-approach tube 1605 to the target.
  • the 4D dataset may be acquired through respiratory gating or tracheal temporal registration.
  • acceleration of N data collectors e.g., magnetic or MEMS accelerometers, for instance
  • the various sensors 1701 and tracheal sensor 1702 provide data as described herein, as does sternum sensor 1703 (e.g., x, y, and z dynamic tracking).
  • Device 1704 e.g., biopsy needle or other device or instrument described herein
  • FIG. 23 An exemplary apparatus and method for respiratory 4D data acquisition and navigation is depicted in FIG. 23 .
  • a respiratory problem or issue is scanned (e.g., by a CT and/or MR scanner) and signal S from the PTD is provide to the CT/IR unit (lower box).
  • the 4D registration based on the motion of the fiducial and tracker units (which could be, e.g., EM sensors, MEMS devices, combinations thereof, and the like) is provided to the user (shown in FIG. 18 as an interventional radiologist (IR)) on computer C.
  • IR interventional radiologist
  • the system is capable of displaying the current position of the device tip in the image data shown to the IR, using the fiducial or tracker locations in the scan coupled with the real-time motion information provided by the device tip (e.g., which can include a sensor as described herein), thus providing registration.
  • the device tip e.g., which can include a sensor as described herein
  • FIGS. 24A and 24B show a scope or other instrument 1500 including one or more offset devices 1501 at port 1502 .
  • the offset device(s) is/are capable of holding the tracked guidewire 1503 (including brush 1504 at the scope tip) in place and provide a substantially fixed distance or length of extension out of the scope (or virtual scope) to take a sample.
  • brush 1504 at the guidewire tip may be any of a variety of devices, including forceps, needles (e.g., a biopsy needle), and the like.
  • multiple offsets 1501 can be provided in stages that allow extension of the guidewire, e.g., at 1 cm, 2 cm, 3 cm, and so on, whereby the user can adjust the offsets by removal or repositioning (removed offsets 1501 R, for example, are depicted in dashed lines within the port in FIG. 15B ).
  • FIG. 24A shows the brush tip 1504 at the tip of the scope (i.e., prior to extension)
  • FIG. 24B shows the guidewire and tip extended (e.g., 2 cm of extension) by the removal or repositioning of two offsets 1501 R.
  • FIG. 25 a representative actuatable sensor/forceps device in accordance with the embodiments described herein is depicted.
  • the coil of an EM (or other) sensor 1601 disposed in a catheter (or similar device) body 1600 can act as a solenoid to actuate a forceps 1602 .
  • the solenoid coil is used as an EM sensor in a “passive” mode, but can be activated by energy stored in an ultra-capacitor 1603 which actuates the forceps via armature 1604 in an “active” mode.
  • the previous description of the embodiments is provided to enable any person skilled in the art to make or use the invention. While the invention has been particularly shown and described with reference to embodiments thereof, it will be understood by those skilled in art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.
  • the PTD, markers and localization elements can be constructed from any suitable material, and can be a variety of different shapes and sizes, not necessarily specifically illustrated, while still remaining within the scope of the invention.

Abstract

A surgical instrument navigation system is provided that visually simulates a virtual volumetric scene of a body cavity of a patient from a point of view of a surgical instrument residing in the cavity of the patient. The surgical instrument navigation system includes: a surgical instrument; an imaging device which is operable to capture scan data representative of an internal region of interest within a given patient; a tracking subsystem that employs electro-magnetic sensing to capture in real-time position data indicative of the position of the surgical instrument; a data processor which is operable to render a volumetric, perspective image of the internal region of interest from a point of view of the surgical instrument; and a display which is operable to display the volumetric perspective image of the patient.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of U.S. Provisional Application Ser. Nos. 61/375,439, filed Aug. 20, 2010, 61/375,484, filed Aug. 20, 2010, 61/375,523, filed Aug. 20, 2010, and 61/375,533, filed Aug. 20, 2010, each of which are hereby incorporated by reference in their entirety, including any figures, tables, and drawings.
  • BACKGROUND
  • The invention relates generally to a medical device and particularly to an apparatus and methods associated with a range of image guided medical procedures.
  • Image guided surgery (IGS), also known as image guided intervention (IGI), enhances a physician's ability to locate instruments within anatomy during a medical procedure. IGS can include 2-dimensional (2-D), 3-dimensional (3-D), and 4-dimensional (4-D) applications. The fourth dimension of IGS can include multiple parameters either individually or together such as time, motion, electrical signals, pressure, airflow, blood flow, respiration, heartbeat, and other patient measured parameters.
  • Existing imaging modalities can capture the movement of dynamic anatomy. Such modalities include electrocardiogram (ECG)-gated or respiratory-gated magnetic resonance imaging (MRI) devices, ECG-gated or respiratory-gated computer tomography (CT) devices, standard computed tomography (CT), 3D Fluoroscopic images (Angio-suites), and cinematography (CINE) fluoroscopy and ultrasound. Multiple image datasets can be acquired at different times, cycles of patient signals, or physical states of the patient. The dynamic imaging modalities can capture the movement of anatomy over a periodic cycle of that movement by sampling the anatomy at several instants during its characteristic movement and then creating a set of image frames or volumes.
  • A need exists for an apparatus that can be used with such imaging devices to capture pre-procedural or intra-procedural images of a targeted anatomical body and use those images intra-procedurally to help guide a physician to the correct location of the anatomical body during a medical procedure.
  • SUMMARY OF THE INVENTION
  • A method includes receiving during a first time interval image data associated with an image of a dynamic body. The image data includes an indication of a position of a first marker on a patient tracking device (PTD) coupled to the dynamic body and a position of a second marker on the PTD. Some registration methods such as 2D to 3D registration techniques allow for the image data containing the target or patient anatomy of interest to not contain the PTD. A registration step is performed to calculate the transformation from image space to patient space using an additional dataset to register (i.e., a 2D fluoroscopic set of images is used to register a 3D fluoroscopic dataset). This technique is not limited to fluoroscopic procedures as it can implemented in any procedure acquiring 2D images such as ultrasound, OCT (optical coherence tomography), EBUS (endobronchial ultrasound), or IVUS (intravascular ultrasound). This technique uses the markers that are within multiple 2D images to register the 3D volume that is reconstructed from these 2D images. The reconstructed 3D volume is smaller than the field of view of the 2D images, so this technique allows for the PTD markers to be visible in a subset of the 2D images, but not within the 3D volume. In certain embodiments, the first marker is coupled to the PTD at a first location and the second marker is coupled to the PTD at a second location. A distance between the position of the first marker and the position of the second marker is determined. During a second time interval after the first time interval, data associated with a position of a first localization element coupled to the PTD at the first location and data associated with a position of a second localization element coupled to the PTD at the second location are received. A distance between the first localization element and the second localization element based on the data associated with the position of the first localization element and the position of the second localization element is determined. A difference is calculated between the distance between the first marker and the second marker during the first time interval and the distance between the first localization element and the second localization element during the second time interval. In addition the PTD device can be tracked continuously during the procedure and a sequence of motion of the PTD device that represents the patient motion of an organ or the patient's respiratory cycle can be collected. The sequence of motion can then be analyzed to find unique similar points within the dataset and grouped.
  • Other objects and features will be in part apparent and in part pointed out hereinafter.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The details of the present invention, both as to its construction and operation can best be understood with reference to the accompanying drawings, in which like numerals refer to like parts, and in which:
  • FIG. 1 is a schematic illustration of various devices used with a method according to an embodiment of the invention.
  • FIG. 2 is a schematic illustration of various devices used with a method according to an embodiment of the invention.
  • FIG. 3 is a schematic illustrating vector distances on an apparatus according to an embodiment of the invention.
  • FIG. 4A is a schematic illustrating vector distances from a localization device according to an embodiment of the invention.
  • FIG. 4B is a schematic illustrating vector distances from image data according to an embodiment of the invention.
  • FIG. 5 is a front perspective view of an apparatus according to an embodiment of the invention.
  • FIG. 6 is a graphical representation illustrating the function of an apparatus according to an embodiment of the invention.
  • FIG. 7 is a flowchart illustrating a method according to an embodiment of the invention.
  • FIG. 8 shows the layout of a system that may be used to carry out image guided interventions using certain of the present methods that involve gated datasets.
  • FIG. 9 illustrates one example of samples of a periodic human characteristic signal (specifically, an ECG waveform) associated, or gated, with images of dynamic anatomy.
  • FIG. 10 is a diagram of an exemplary surgical instrument navigation system in accordance with present invention;
  • FIG. 11 is a flowchart that depicts a technique for simulating a virtual volumetric scene of a body cavity from a point of view of a surgical instrument positioned within the patient in accordance with the present invention;
  • FIG. 12 is an exemplary display from the surgical instrument navigation system of the present invention;
  • FIG. 13 is a flowchart that depicts a technique for synchronizing the display of an indicia or graphical representation of the surgical instrument with cardiac or respiratory cycle of the patient in accordance with the present invention; and
  • FIG. 14 is a flowchart that depicts a technique for generating four-dimensional image data that is synchronized with the patient in accordance with the present invention.
  • FIG. 15 is a graph depicting an axis or point that the instrument (e.g., a bronchoscope) deflects in a single planar direction. The graph shows the instrument (e.g., a bronchoscope) being maneuvered in six different orientations in a 3D localizer volume, with all orientations converging about a common axis or point of deflection.
  • FIG. 16 is a graph depicting the eigenvalues (e0,e1,e2) for a moving 3.0 sec PCA (principal component analysis) window over a data file including 1800 samples. The square wave represents an on/off “wiggle detector” state based on the algorithm described herein, and this square wave demonstrates that the algorithm exhibits no false negatives for the validation test data and that the seven exemplary “wiggle” periods are clearly matched to the “on” state of the wiggle detector. The implementation of the algorithm uses low pass filtering and an appropriate comparator function to eliminate any false positive traces or spots (“blips”) indicated in FIG. 16.
  • FIG. 17 is an image of an exemplary synthetic radiograph in accordance with the present invention, depicting the historical instrument position trace.
  • FIG. 18 depicts an exemplary curvature warning system in accordance with the invention described herein.
  • FIG. 19 depicts an exemplary real-time respiration compensation algorithm.
  • FIG. 20 depicts additional and alternative exemplary embodiments of the invention described herein.
  • FIG. 21 depicts additional and alternative exemplary embodiments of the invention described herein.
  • FIGS. 22A and 22B depict additional and alternative exemplary embodiments of the invention described herein.
  • FIG. 23 depicts additional and alternative exemplary embodiments of the invention described herein.
  • FIGS. 24A and 24B depict exemplary embodiments of an port offset device in accordance with the invention described herein.
  • FIG. 25 depicts exemplary embodiments of a actuatable sensor-equipped forceps device in accordance with the invention described herein.
  • DETAILED DESCRIPTION
  • The accompanying Figures and this description depict and describe embodiments of a navigation system (and related methods and devices) in accordance with the present invention, and features and components thereof. It should also be noted that any references herein to front and back, right and left, top and bottom and upper and lower are intended for convenience of description, not to limit the present invention or its components to any one positional or spatial orientation.
  • It is noted that the terms “comprise” (and any form of comprise, such as “comprises” and “comprising”), “have” (and any form of have, such as “has” and “having”), “contain” (and any form of contain, such as “contains” and “containing”), and “include” (and any form of include, such as “includes” and “including”) are open-ended linking verbs. Thus, a method, an apparatus, or a system that “comprises,” “has,” “contains,” or “includes” one or more items possesses at least those one or more items, but is not limited to possessing only those one or more items. For example, a method that comprises receiving a position of an instrument reference marker coupled to an instrument; transforming the position into image space using a position of a non-tissue internal reference marker implanted in a patient; and superimposing a representation of the instrument on an image in which the non-tissue internal reference marker appears possesses at least the receiving, transforming, and superimposing steps, but is not limited to possessing only those steps. Accordingly, the method also covers instances where the transforming includes transforming the position into image space using a transformation that is based, in part, on the position of the non-tissue internal reference marker implanted in the patient, and calculating the transformation using image space coordinates of the internal reference marker in the image. The term “use” should be interpreted the same way. Thus, a calculation that uses certain items uses at least those items, but also covers the use of additional items.
  • Individual elements or steps of the present methods, apparatuses, and systems are to be treated in the same manner. Thus, a step that calls for creating a dataset that includes images, one of the images (a) depicting a non-tissue internal reference marker, (b) being linked to non-tissue internal reference marker positional information, and (c) being at least 2-dimensional covers the creation of at least such a dataset, but also covers the creation of a dataset that includes images, where each image (a) depicts the non-tissue internal reference marker, and (b) is linked to non-tissue internal reference marker positional information.
  • The terms “a” and “an” are defined as one or more than one. The term “another” is defined as at least a second or more. The term “coupled” encompasses both direct and indirect connections, and is not limited to mechanical connections.
  • Those of skill in the art will appreciate that in the detailed description below, certain well known components and assembly techniques have been omitted so that the present methods, apparatuses, and systems are not obscured in unnecessary detail.
  • An apparatus according to an embodiment of the invention includes a PTD and two or more markers coupled to the PTD. The apparatus can also include two or more localization elements coupled to the PTD proximate the markers. The apparatus is configured to be coupled to a dynamic body, such as selected dynamic anatomy of a patient. Dynamic anatomy can be, for example, any anatomy that moves during its normal function (e.g., the heart, lungs, kidneys, liver and blood vessels). A processor, such as a computer, is configured to receive image data associated with the dynamic body taken during a pre-surgical or pre-procedural first time interval. The image data can include an indication of a position of each of the markers for multiple instants in time during the first time interval. The processor can also receive position data associated with the localization elements during a second time interval in which a surgical procedure or other medical procedure is being performed. The processor can use the position data received from the localization elements to determine a distance between the elements for a given instant in time during the second time interval. The processor can also use the image data to determine the distance between the markers for a given instant in time during the first time interval. The processor can then find a match between an image where the distance between the markers at a given instant in time during the first time interval is the same as the distance between the elements associated with those markers at a given instant in time during the medical procedure, or second time interval. Additionally, the processor can determine a sequence of motion of the markers and match this sequence of motion to the recorded motion of the markers over the complete procedure or significant period of time. Distance alone between the markers may not be sufficient to match the patient space to image space in many instances, it is important for the system to know the direction the markers are moving and the range and speed of this motion to find the appropriate sequence of motion for a complex signal or sequence of motion by the patient.
  • A physician or other healthcare professional can use the images selected by the processor during a medical procedure performed during the second time interval. For example, when a medical procedure is performed on a targeted anatomy of a patient, such as a heart or lung, the physician may not be able to utilize an imaging device during the medical procedure to guide him to the targeted area within the patient. A PTD according to an embodiment of the invention can be positioned or coupled to the patient proximate the targeted anatomy prior to the medical procedure, and pre-procedural images can be taken of the targeted area during a first time interval. Markers or fiducials coupled to the PTD can be viewed with the image data, which can include an indication of the position of the markers during a given path of motion of the targeted anatomy (e.g., the heart) during the first time interval. Such motion can be due, for example, to inspiration (i.e., inhaling) and expiration (i.e., exhaling) of the patient, or due to the heart beating. During a medical procedure, performed during a second time interval, such as a procedure on a heart or lung, the processor receives data from the localization elements associated with a position of the elements at a given instant in time during the medical procedure (or second time interval). The distance between selected pairs of markers can be determined from the image data and the distance, range, acceleration, and speed between corresponding selected pairs of localization elements can be determined based on the element data for given instants in time. From multiple image datasets the range and speed of the markers motion can be calculated.
  • Because the localization elements are coupled to the PTD proximate the location of the markers, the distance between a selected pair of elements can be used to determine an intra-procedural distance between the pair of corresponding markers to which the localization elements are coupled. An image from the pre-procedural image data taken during the first time interval can then be selected where the distance between the pair of selected markers in that image corresponds with or closely approximates the same distance determined using the localization elements at a given instant in time during the second time interval. This process can be done continuously during the medical procedure, producing simulated real-time, intra-procedural images illustrating the orientation and shape of the targeted anatomy as a catheter, sheath, needle, forceps, guidewire, fiducial delivery devices, therapy device (ablation modeling, drug diffusion modeling, etc.), or similar structure(s) is/are navigated to the targeted anatomy. Thus, during the medical procedure, the physician can view selected image(s) of the targeted anatomy that correspond to and simulate real-time movement of the anatomy. In addition, during a medical procedure being performed during the second time interval, such as navigating a catheter or other instrument or component thereof to a targeted anatomy, the location(s) of a sensor (e.g., an electromagnetic coil sensor) coupled to the catheter during the second time interval can be superimposed on an image of a catheter. The superimposed image(s) of the catheter can then be superimposed on the selected image(s) from the first time interval, providing simulated real-time images of the catheter location relative to the targeted anatomy. This process and other related methods are described in pending U.S. patent application Ser. No. 10/273,598, entitled Methods, Apparatuses, and Systems Useful in Conducting Image Guided Interventions, filed Nov. 8, 2003, the entire disclosure of which is incorporated herein by reference.
  • In one embodiment, a real-time pathway registration is applied to a pre-acquired dataset that does not contain the PTD. It will be understood that the pre-acquired dataset can be at only one cycle of a patient's respiratory, heartbeat, or other path of motion. In order to optimize the registration of a pre-acquired dataset that does not contain the PTD, a PTD can be subsequently applied to the patient, and the PTD signal can be used to collect registration information throughout full range or path of motion but only that information that is captured at a similar PTD orientation, shape, or point along the PTD cycle of motion is used. This method enhances the registration accuracy by ensuring that the registration points being used to register are at the same point during the initial dataset acquisition. In preferred embodiments, the method uses multiple subsets of the acquired registration data that are collected based on the PTD signal. These multiple subsets are then applied against the pre-acquired dataset to find the optimal registration fit.
  • In another embodiment, the device can be integrated with one or more fiber optic localization (FDL) devices and/or techniques. In this way, the sensor (such as an EM sensor) provides the 3D spatial orientation of the device, while the FDL provides shape sensing of the airway, vessel, pathway, organ, environment and surroundings. Conventional FDL techniques can be employed. In various embodiments, for example, the FDL device can be used to create localization information for the complete pathway or to refine the localization accuracy in a particular segment of the pathway. By either using 3D localization information, shape, or both detected by the FDL device, the system can use a weighted algorithm between multiple localization devices to determine the location and orientation of the instrument in the patient. The FDL device can also be used as or in conjunction with the PTD to track the patient's motion such as respiration or heartbeat.
  • Other aspects involve using a guidewire or other navigated instrument with one to one rotation to continuously align a virtual display view to be consistent with the actual bronchoscopic video view. A similar technique can be used with OCT, IVUS, or EBUS devices to orient the virtual view to the image captured by the OCT, IVUS, or EBUS devices.
  • Other aspects involve using video input of the bronchoscope to adjust the virtual “fly-through” view to be consistent with the user's normal perspective. For example, conventional video processing and matching techniques can be used to align the real-time video and the virtual image.
  • Other aspects involve using bronchoscopic video to provide angular information at a current location to provide targeting or directional cues to the user. Angular information can be derived from the location of patient anatomy in the image and the relative size of each within the image. Using information extracted from the video captured by the bronchoscope, the system can determine which the direction of the display. This can be done using, for example, translation, rotation, or a combination of both. Comparing the real-time image captured to the virtual image constructed from the 3D dataset (i.e., CT) the system can use this information to align the virtual image and/or enhance the system accuracy.
  • In another aspect, a high-speed three-dimensional imaging device, such as an optical coherence tomography (OCT) device, can be tracked. In accordance with conventional methods, such a device can only view 1-2 mm below the surface. With an EM sensor attached in accordance with the systems and methods described herein, multiple 3D volumes of data can be collected and a larger 3D volume of collected data can be constructed. Knowing the 3D location and orientation of the multiple 3D volumes will allow the user to view a more robust image of, for example, pre-cancerous changes in the esophagus or colon. This data can also be correlated to pre-acquired or intra-procedurally acquired CT, fluoroscopic, ultrasound, or 3D fluoroscopic images to provide additional information.
  • Among several potential enhancements that could be provided by an endolumenal system as described herein is that a user could overlay the planned pathway information on to the actual/real-time video image of the scope or imaging device (such as ultrasound based device). Additionally, the system and apparatus could provide a visual cue on the real-time video image showing the correct direction or pathway to take.
  • Additionally, or alternatively, one could use a 5DOF sensor and a limited or known range of motion of a localization device to determine its orientation in the field. This is particularly relevant, for example, in determining which way is up or down or the overall rotation of an image in 3D space. In bronchoscopy, for instance, this can be used to orient the bronchoscopic view to the user's normal expected visual orientation. Because a bronchoscope is typically only able to move in one plane up and down, the system can use the 3D location of a tip sensor moving up and down to determine the sixth degree of freedom. In this implementation, a user could steer the bronchoscope to a bifurcation or close to a bifurcation and then perform a motion with the scope (e.g., up and down) using the thumb control to wiggle or flutter the tip and sensor. With this motion (i.e., described herein generally as the “wiggle maneuver”), the system can determine the orientation and display the correct image. Typically, 5DOF sensing of instrument tip POSE (position and orientation) determines 5 of the 6 POSE parameters (x, y, z, pitch, and yaw). Such sensing may be unable in certain applications, however, to determine the instantaneous roll of the device. This roll determination can be critical in matching the video coming from the device to the images. The techniques described herein advantageously allow for users to relate orientation of a virtual endoscopic “fly-thru” display to actual video orientation presented by the endoscopic instrument.
  • In general, the methods described herein provides for the user to select a location, most typically at a branching point in the bronchial tree, and perform a “wiggle” maneuver with the tip of the device. In preferred embodiments, the wiggle maneuver generally consists of three steps:
  • (i). At desired branch or other point, the physical or translational location of device is substantially secured or held in place. For example, with a bronchoscope, the user should ensure that the scope is held securely so it cannot translate relative to the airway.
  • (ii). Perform a tip wiggle in plane by a rhythmic actuation of the scope steering mechanism. The magnitude of the actuation should be sufficient in force for the tip to cover an approximate 1 cm-2 cm range of motion, but less motion may be sufficient in some applications or embodiments.
  • (iii). Continue the wiggle maneuver, keeping the scope itself substantially stationary until the systems described herein and related software defines the sixth degree of freedom, and the orientation of the video display of scope matches the virtual “fly-thru”.
  • Algorithmically, a manifestation of an algorithm to detect this operation consists of recognizing a unique signature of motion over time. One such technique, for example, consists of two parts:
  • (a) performance of a continuous PCA analysis of a specified time window of 5DOF sensor locations. A repeated motion in a plane by the instrument tip will produce a covariance matrix such that the foremost eigenvalue (e0) will reflect the variance of a 1 cm-2 cm motion over a given time window. In addition, the secondary and tertiary eigenvalues (e1 and e2) will reflect a very small variance, as the tip should preferably be moving in an arc constrained to the plane defined by the spline mechanism of the scope.
  • (b) once an appropriate PCA signature is detected, orientation of the tip to the eigenvector E0, which represents the historical vector of motion for the instrument tip, is compared. An exemplary way to do this is the dot product of the measured tip vector and E0, which represents the acute angle.

  • r=V·E0
  • By way of example and not by way of limitation, in an ideal wiggle maneuver, the orientation of the tip should show a rhythmic oscillation of about 90° (approximate range could be for instance +/−)45°. This comparison of tip orientation to E0 provides the basis for a determination of the wiggle plane normal using, for example, a cross-product or gram-schmidt orthogonalization. The physical wiggle plane normal is in a constant relationship to the coordinate space of the video signal, and thus can be related (calibrated) thereto.
  • Interestingly, this algorithm can be used in a variety of different modes to detect certain forms of scope motion:
      • stationary scope (wherein the e0, e1, and e2 values will be very small and roughly equal, representing the small magnitude, unbiased Gaussian noise of the direct localization measurement);
      • scope in motion along a straight line in space, such as when traversing individual segments (wherein the e0 will be very large, with very small e1 and e2 values, representing a large co-linear translation in space). In addition, the absolute value of r will be close to 1, indicating that the orientation of the tip is nearly collinear with the translation of the tip over time.
  • In general, the wiggle techniques described herein for determining direction and orientation, including “up” and “down” orientation relative to (or independent of) the instrument steering mechanism, may used in a range of different endoscopic applications. Although the above examples and embodiments generally refer to the use of the wiggle maneuver in connection with bronchoscopic applications, it will be understood that the techniques described herein may also be used in other applications including, but not limited to, enteroscopy, colonoscopy, sigmoidoscopy, rhinoscopy, proctoscopy, otoscopy, cystoscopy, gynoscopy, colposcopy, hysteroscopy, falloposcopy, laparoscopy, arthroscopy, thoracoscopy, amnioscopy, fetoscopy, panendoscopy, epiduroscopy, and the like. The wiggle techniques described herein may also be applicable in non-medical endoscopic uses, such as the internal inspection of complex technical systems, surveillance, and the like.
  • In general, the methods described herein employ successive approximation techniques of pathway planning, and enhanced localization accuracy to use traveled pathway information to continuously, substantially continuously, or serially update pathway planning and localization accuracy. The limits of automatic pathway or vessel segments are generally defined, for example, by the quality of the image data provided or the state the patient may be in when the image data is acquired. Therefore, in some cases the pathway segmentation may not extend completely to the target (that is, the pathway segmentation stops short of the target). One method to enhance the segmentation involves using the traveled path of a tracked instrument to add branches and segment(s) to the pathway. Methods may include multiple approaches described herein such as recording traveled paths or using the additional path traveled information to iteratively segment vessels or airways from the image dataset. Having the additional knowledge that an instrument actually traveled the path can enable an automatic segmentation algorithm to extend the vessels and airways that it can calculate and find. This can be particularly valuable in situations where airways or vessels may be obstructed or pinched off. This technique can also be a valuable tool in recording the paths traveled by the instrument to give an indication to the user of “good” and “bad” (i.e., correct or incorrect, direct or indirect, etc.) directions based, for instance, on trial and error.
  • According to the various methods and systems described herein, therefore, in some embodiments real-time pathway registration uses full 5D and/or 6D information and/or details of instrument location to enhance registration. These and other methods can employ distance, proximity, and/or angle information, for example, to determine the pathway being traversed in order to optimize localization accuracy. This can be particularly beneficial at the bifurcation(s) of vessels and airways, where an initial (or subsequent) selection of the correct direction is important to accurately navigate the desired pathway. Using both 3D localization and the orientational and/or directional angle of the device can, in various embodiments, be helpful in maximizing accuracy in applications such as an endolumenal navigation system. Advance knowledge of the various segmented vessels and/or airways in a procedural or pre-procedural setting, and the orientation and/or direction of the navigated instrument, can further enhance accuracy. In certain embodiments, the various parameters (e.g., distance, angle, etc.) can be weighted in real-time (or near-real-time) for improved application or use of the relevant information. For example, distance information can be used in the relevant algorithms without taking angle information into account, or vice versa. Or, for example, the various parameters can be equally applied (e.g., 50% angle, 50% proximity). Additionally or alternatively, different percentages can be applied to emphasize or weigh one parameter over another (e.g., 15% angle, 85% proximity; 20% angle, 80% proximity; 25% angle, 75% proximity; 30% angle, 70% proximity; 35% angle, 65% proximity; 40% angle, 60% proximity; or 45% angle, 65% proximity; or, alternatively, 15% proximity, 85% angle; 20% proximity, 80% angle; 25% proximity, 75% angle; 30% proximity, 70% angle; 35% proximity, 65% angle; 40% proximity, 60% angle; 45% proximity, 65% angle). In operation, it may be preferable to more heavily weigh angle information when the instrument arrives at a branch (e.g., an arterial branch) in order to facilitate or improve directional decision-making in real-time; weighting the parameters in this manner, therefore, can further improve accuracy.
  • According to one embodiment, the real-time pathway registration uses path traveled of the instrument location to enhance registration. Using path traveled to exclude other potential navigational solutions enhances navigational accuracy. Many times in patient anatomy vessel or airway branches may twist around and come close to one another, but it is obvious from earlier location(s) recorded along the path traveled that only one branch can be the correct navigated location.
  • According to one particular embodiment, the respiratory signal derived from the PTD is used to gate the localization information of the instrument in the airway. This can assist in determining multiple airway models, for example, by performing a best fit of the real-time patient airway model to the CT data to derive the optimal registration and gated period in the patient's respiratory cycle. Additionally or alternatively, the respiratory signal can be derived from devices other than the PTD, such a device that records the resistance between two locations on the patient. For example, this method is similar to a variable potentiometer in that the resistance of the patient changes between two fixed points as the patient inhales and exhales. Thus, the resistance can be measured to create a respiratory signal.
  • According to another particular embodiment, 3D location information is used to extend the segmented airway model. The 3D airway can be extended as the instrument is passed along the airway by using this location information as an additional parameter to segment the airway from the CT data. Using an iterative segmentation process, for instance, the 3D location information of the instrument can be used to provide seed points, manual extension, or an additional variable of likelihood of a segmented vessel or airway existing in the 3D image volume. These added airways can be displayed in a different format or color (for example) to indicate to the user that they are extending the segmented airway using instrument location information.
  • In general, the embodiments described herein have applicability in “Inspiration to Expiration”-type CT scan fusion. According to various methods, the user navigates on the expiration CT scan for optimal accuracy, while using the inspiration scan to obtain maximum airway segmentation. In one embodiment, for example, a user could complete planning and pathway segmentation on an inspiration scan of the patient. Preferably, a deformation or vector field is created between at least two datasets. The deformation or vector field may then be applied to the segmented vessels and/or airways and the user's planned path and target. In these and other embodiments, the deformation or vector field can also be applied to multiple datasets or in a progressive way to create a moving underlying dataset that matches the patient's respiratory or cardiac motion.
  • By way of example, “Inspiration to Expiration” CT fusion using the lung lobe centroid and vector change to modify an airway model may also be applicable. In accordance with various embodiments, this technique may be used to translate and scale each airway based on the lung lobe change between scans. The lung is constructed of multiple lobes and these lobes are commonly analyzed for volume, shape, and translation change. Each lobe changes in a very different way during the patient's breathing cycle. Using this information to scale and translate the airways that are located in each lobe, it is possible to adapt for airway movement. This scaled airway model can then be linked to the 4D tracking of the patient as described herein.
  • In one preferred embodiment, for example, a cine loop of ultrasound data is collected in conjunction with the patient's respiratory cycle information. This can serve to limit registration point selection, in order to be consistent with the patient's respiratory cycle that a 3D dataset such as CT, MR, or PET has acquired. This technique advantageously maximizes registration accuracy, a major flaw in conventional systems in the prior art.
  • In various aspects, the systems and methods described herein involve modifying inspiration CT scans to the expiration cycle for navigation. It is well understood that the patient's airways are contained within multiple lobes of the lung. It is also understood that airways significantly change between inspiration and expiration. In order to have the most accurate map for navigation it would be beneficial to include the detail of the inspiration scan, coupled with the ability to navigate it accurately during expiration, which is the most repeatable point in a patient's breath cycle. In preferred embodiments, this modification can be carried out in accordance with the following steps:
  • 1) Scan patient at both inspiration and expiration;
  • 2) Segment the airways in both the inspiration and expiration;
  • 3) Segment the lung lobes in both the inspiration and expiration (as the lung lobes are identifiable in both the inspiration and expiration scans with a high degree of accuracy);
  • 4) Determine a volume difference for each lung lobe between inspiration and expiration, use this change to shrink the airway size from the inspiration to the expiration cycle. Preferably, this is done for each individual lobe, as the percentage change will typically be different for each lobe.
  • 5) Determine the centroid for each lung lobe and the vector change in motion from the main carina in both scans. This vector can then be used to shift the airways that are associated with each lung lobe. A centroid for the airway can be calculated based on the segmented branches. For each airway branch in the segmentation, it includes a tag that associates it with the respective lung lobe. The central airway including the main carina and initial airway branches for each lobe that is linked according to the expiration scan location of these points. Next, a plane can be defined using the main carina and initial airway branch exits to determine the vector change for each lobe.
  • Among the lobes to modify, for example:
  • left inferior lobe—the bottom lobe of the lung on the left side of the body.
  • left superior lobe—the top lobe of the lung on the left side of the body.
  • right inferior lobe—the bottom lobe of the lung on the right side of the body.
  • right middle lobe—the middle lobe of the lung on the right side of the body.
  • right superior lobe—the top lobe of the lung on the right side of the body.
  • Exemplary calculations are as follows:

  • Inspiration Airway−Left Inferior Lobe(LIL)×70%(reduction in volume Inspiration to Expiration calculated)=ExAirwayLlL
  • Determine Expiration Central Airway points (Main Carina and Initial Airway branches) based upon segmentation
  • Shift ExAirwayLIL by vector distance (3 cm, 45 degrees up and back from main carina) that LIL centroid moved from inspiration to expiration
  • Preferably, this process is repeated for each lobe. In preferred embodiments, the completion of 5 lobes will result in a Navigation Airway Map for the patient.
  • In various embodiments, the target location for the patient can be selected in the expiration scan and applied to the Navigation Airway Map. Alternatively, it may be selected in the Inspiration scan and adjusted based on the same or similar criteria as the inspiration airways. In either case, it can be adjusted individually or linked to the airway via a 3D network and moved in the same transformation.
  • One aspect of the present invention is directed to a endoscopic port offset device. The device includes, for example, a snap-on or otherwise affixable feature (that is, offsets) to the endoscopic (e.g., bronchoscopic) port that is capable of holding a navigated guidewire or instrument in a known or preset (i.e., predetermined) location to maintain device location and free the physician/user's hand. In one embodiment, for example, the device includes one or more offset portions that can be adjusted by combining and/or removing multiple offset segments. In another embodiment, for example, the device includes one or more offset portions that can be adjusted by the removal of one or more removable offset segments separated by perforations (i.e., in a disposable fashion). In yet another embodiment, the device includes an offset that is capable of adjustment using a screw mechanism (i.e., the length of the offset can be adjusted by screwing the offset in and out). In various embodiments, each offset can be represented on the navigation screen showing offset distance from the tip of the endoscope or working channel sheath. The endoscope or attachment thereof, in various embodiments, may include one or more offsets, two or more offsets, three or more offsets, four or more offsets, or five or more offsets. In other embodiments, more than five offsets may be included, e.g., 6-12 offsets, 6-18 offsets, 6-24 offsets, or more).
  • Another aspect of the invention is a closed loop system that allows the navigation system to steer the working channel using shape memory alloy/metal type materials. An instrument would have tracking sensors located at the tip for directional guidance as described herein that drive the micro-actuators along the shaft to turn corners. Using feedback from multiple sensors along the shaft it is also possible to determine the maximum points of friction and adjust the shape of the device to allow for easier insertion. One simple metric that can be used, for example, is the difference in the shape or bend of the device to the segmented pathway of the vessel or airway, described in further detail below.
  • Other embodiments include, for example, detachable sensors to a fiducial structure (e.g., a reduced cost patient pad).
  • In accordance with other embodiments, for example, a sensor as described herein (e.g., an electromagnetic (EM) sensor) is affixed (preferably permanently affixed, but may also be removable) to a device or instrument so that both the device or instrument (or component thereof) and the sensor move together, such that they can be imaged and viewed. In one embodiment, for example, the device is an aspiration needle and the needle tip and the sensor move together. In another embodiment, for example, the device is a brush, forceps, or forceps tissue capture mechanism and these components and the sensor move together. In these and other embodiments, the device may additionally include an actuating handle (e.g., finger holds) that is coupled with the sensor, thus allowing movement tracking. These various embodiments advantageously allow the device (and components thereof) to be tracked using the sensor, improving overall accuracy and reliability.
  • In one particular embodiment, a sensor (e.g., an EM sensor) is positioned at or near the tip of a steerable catheter which further includes a side exiting working channel for forceps, aspiration needle, a brush, combinations thereof, and the like. Using the sensor (which in preferred embodiments is a 6DOF sensor as described herein), the user can have the direction of the side exiting working channel defined on the navigation screen. That is, the image plane that is generated is one at a side exiting working channel or port, as opposed to a point or position distal to the device. This will advantageously allow easier targeting of lesions that may not be directly in the airway, but rather partially or even completely outside of the airway. In accordance with an exemplary method of using the device, the catheter is steered slightly past the target to align the side exiting port/working channel; the sampling component (e.g., forceps, needle, brush) is then extended out the catheter. The directional aspect of the instrument can be viewed on the navigation screen and a simulated device can be shown to demonstrate to the user the tissue that will be sampled. These applications may be particularly useful in the sampling of lymph nodes that are outside the patient airways. In some embodiments, for example, the device may be capable of creating an endobronchial ultrasound (EBUS)-like view. For example, an image plane oriented with the working channel plane can be created and the instrument can be shown sampling the target on this plane. In various alternative embodiments, the image(s) may be oriented in a plane or orthogonally.
  • Other embodiments include, for example, using EM sensor as LC or energy transmission device. This stored energy could be used to actuate a sampling device such as forceps or power a diagnostic sensor.
  • Other embodiments include, for example, using an elastic tube length of scope or steerable catheter to add a sensor (e.g., an EM sensor) to a device. This may take the form of a flexible sheath or tube the length of a bronchoscope or steerable catheter that can be added to existing conventional instrumentation. In this way, the conventional device does not have to modified. For instance, a very thin wall device can be slid other the length of the scope or catheter and it can be made navigational.
  • In accordance with another general aspect, the PTD comprises a pad that can be placed on the patient and left for a few hours or a few days. For example, such a device could be placed on a patient prior to a 3D image acquisition such as CT or MR. The device would contain EM (or other) sensors and an EM/LC tank circuit that would allow it be charged up or turned on once localization was ready to commence. The device could be wireless and transmit induced voltage levels back to the system to navigate in a 3D coordinate space as described herein.
  • In various embodiments, the device could either have a separate fiducial structure in a known orientation to the EM sensors, have the configuration learned by the system, or have EM sensors that act as fiducials in the 3D image scan.
  • As discussed herein, auto registration of a device is conducted, at least initially, by finding the PTD. In general, the PTD needs to be within the 3D volume, but for some devices the 3D volume may be too small to include both the PTD and the target. To overcome this, a 2D/3D algorithm can be employed in accordance with various embodiments, whereby multiple 2D images of a patient are acquired for a 3D volume reconstruction. The complete PTD (which may include one, two or multiple (e.g., at least 3) sensors or fiducials) does not need to be seen in each image; e.g., some images may only show one sensor or a part thereof, but the entire collection of 2D images can be compiled and used to find the whole or entire PTD relative to the target. For example, 180 2D images (or more or less depending on patient/device position, etc.) can be used to construct a complete 3D volume (where only a fraction (e.g., 10-30) of the 2D images include all or a portion of the PTD. This facilitates easier device placement and allows the user to focus on the target, as the PTD and target do not necessarily need to be in the same initial 3D volume.
  • One aspect is directed to recording 3D location and bronchoscopic video to construct a 3D model of the patient's airway. This 3D video can be recorded over multiple sessions (e.g., weeks between recording) and color, size, and shape analysis/change can be determined and/or compared for diagnostic purposes. Not only can airway lumen size and/or shape be compared, but a deformation or vector field can also be compared for the multiple sessions. This can be particularly valuable in determining overall lung function change as well as local changes to muscle and tissue elasticity.
  • Another similar aspect is directed to recording 3D location and EBUS video or images to construct a 3D model of the patient's airway or a lesion. Typically, the EBUS image is very small and 2D. Thus, recording multiple planes of EBUS can be used to create a 3D image of the lesion, lymph node, or blood vessels. Providing correlated CT information to the EBUS image can be valuable in determining the location of structures in the patient.
  • Yet another similar aspect is directed to recording 3D location and IVUS video or images to construct a 3D model of the patient's blood vessels or plaques. Like EBUS, the IVUS image is typically very small and 2D. Recording multiple planes of IVUS can be used to create a 3D image of the blood vessels and malformations. Providing correlated CT information to the IVUS image can be valuable in determining the location of structures in the patient. In accordance with this and other aspects, OCT may additionally or alternatively employed.
  • In general, the methods described herein involve increasing registration accuracy for Ultrasound (US) to CT or any other 3D image dataset such as MR, CT-PET, and 3D Ultrasound. Using 4D tracking of the patient respiratory signal and collecting a cine loop of ultrasound images, one can maximize the US to CT fusion accuracy by limiting the point or plane selection for registration to the correct respiratory cycle that matches the 3D dataset. The process involves the use of a patient tracker on the patient and a tracker on the US transducer; using a localizer (such as an EM localization system) to record a cine loop of US images and match the images in the cine loop to the respiratory signal.
  • Collecting a cine loop of US data for registration is valuable in that the user does not necessarily have to select a moving point while the patient is breathing. The user can simply scroll through the cine loop and, with an indicator of the point in the respiratory cycle, select the points that are best used for registration from a static image.
  • The user then selects, for example, at least 3 points in the US & CT datasets, or a plane and at least one point to register the US space to the 3D CT dataset space. Preferably, the points and plane are selected at the same respiratory point as the 3D CT dataset. Normally, for example, the 3D CT dataset would be acquired at exhalation. Therefore, the user preferably selects registration points at exhalation or significant errors can be incorporated into the US to CT registration. If a user was to select a plane that was at a different point in the respiratory cycle, for instance, there would be significant translation error in the registration. There would likely also be significant rotational error in the registration if the points were acquired at different points in the respiratory cycle.
  • The methods and systems described herein can be expanded to use other patient sensing information such as cardiac information (heartbeat) as a single source 4D signal or multiple sensed signal approach in that respiration and cardiac data could be used together. This is particularly relevant in connection with locations close to the heart or within the heart.
  • Preferably, the user selects points that are sufficiently far apart for the best accuracy. This can be done, for example, by requiring the user to record a cine loop of data that extends over the whole patient organ. Preferably, the user is not allowed to pick multiple points in the same image.
  • Another technique for maximizing registration accuracy is a centroid finding algorithm that can be used for refining point locations in a local area. Often, a user will want to select a vessel bifurcation. The vessel bifurcation will be seen as a bright white location on the CT and US images. An algorithm can be used to help the user select the optimal center location for these locations. Once a user selects a point on the image, the local algorithm can be employed to find similar white voxels that are connected and, for that shape in the 3D space, refine the point to the centroid or any other optimal point (such as, for example, the most anterior or most posterior point).
  • In general, the systems and methods described herein can be implemented regardless of the number of sensors that are used. In some embodiments, serial orientation or positioning of multiple sensors allows the determination of one or more parameters such as shape, position, orientation, and mechanical status of a complete or partial section of guidewire or other device or instrument. For example, the placement of multiple sensors can assist in visualizing the shape of the device and any bends in the path by providing a number of data points on the path (e.g., 8 sensors, spaced 1 mm apart) to create a 3D shape model of the device. Various parameters can be used to track past or present movement and changes in device shape including, for example, elasticity, bend radius, limiting, and durometer rating of the device material. These parameters and accompanying data can provide visual cues to the user during the procedure, for example, when the device has a certain bend or curvature (based on path or surroundings), e.g., to provide a notice or warning that the device is on the correct or incorrect path, or to provide notice regarding, or track, a particular parameter(s) that the user is interested in. Such a sensor pathway is generally depicted in FIG. 18, which shows exemplary curvature warning scenarios in the differently marked sections or segments.
  • In various aspects and embodiments described herein, one can use the knowledge of the path traveled by the instrument and segmented airway or vessel from the acquired image (e.g., CT) to limit the possibilities of where the instrument is located in the patient. The techniques described herein, therefore, can be valuable to improve virtual displays for users. Fly through, Fly-above, or image displays related to segmented paths are commonly dependent upon relative closeness to the segmented path. For a breathing patient, for example, or a patient with a moving vessel related to heartbeat, it is valuable to use the path traveled information to determine where in the 4D patient motion cycle the system is located within the patient. By comparing the 3D location, the patient's tracked or physiological signal is used to determine 4D patient motion cycle, and with the instrument's traveled path, one can determine the optical location relative to a segmented airway or vessel and use this information to provide the optimal virtual display.
  • FIGS. 1 and 2 are schematic illustrations of devices that can be used in conjunction with, or to perform, various procedures described herein. As shown in FIG. 1, an apparatus 10 includes a PTD 20. The PTD 20 can be coupled to a dynamic body B. The dynamic body B can be, for example, a selected dynamic portion of the anatomy of a patient. The PTD 20 can be a variety of different shapes and sizes. For example, in one embodiment the PTD 20 is substantially planar, such as in the form of a patch that can be disposed at a variety of locations on a patient's body. Such a PTD 20 can be coupled to the dynamic body with adhesive, straps, hook and pile, snaps, or any other suitable coupling method. In another embodiment the PTD can be a catheter type device with a pigtail or anchoring mechanism that allows it to be attached to an internal organ or along a vessel.
  • Two or more markers or fiducials 22 are coupled to the PTD 20 at selected locations as shown in FIG. 1. The markers 22 are constructed of a material that can be viewed on an image, such as an X-ray or CT. The markers 22 can be, for example, radiopaque, and can be coupled to the PTD 20 using any known methods of coupling such devices. FIGS. 1 and 2 illustrate the apparatus 10 having four markers 22, but any number of two or more markers can be used. In one embodiment the marker or fiducials and the localization element can be the same device.
  • An imaging device 40 can be used to take images of the dynamic body B while the PTD 20 is coupled to the dynamic body B, pre-procedurally during a first time interval. As stated above, the markers 22 are visible on the images and can provide an indication of a position of each of the markers 22 during the first time interval. The position of the markers 22 at given instants in time through a path of motion of the dynamic body B can be illustrated with the images. The imaging device 40 can be, for example, a computed tomography (CT) device (e.g., respiratory-gated CT device, ECG-gated CT device), a magnetic resonance imaging (MRI) device (e.g., respiratory-gated MRI device, ECG-gated MRI device), an X-ray device, or any other suitable medical imaging device. In one embodiment, the imaging device 40 is a computed tomography—positron emission tomography device that produces a fused computed tomography—positron emission tomography image dataset. The imaging device 40 can be in communication with a processor 30 and send, transfer, copy and/or provide image data taken during the first time interval associated with the dynamic body B to the processor 30.
  • The processor 30 includes a processor-readable medium storing code representing instructions to cause the processor 30 to perform a process. The processor 30 can be, for example, a commercially available personal computer, or a less complex computing or processing device that is dedicated to performing one or more specific tasks. For example, the processor 30 can be a terminal dedicated to providing an interactive graphical user interface (GUI). The processor 30, according to one or more embodiments of the invention, can be a commercially available microprocessor. Alternatively, the processor 30 can be an application-specific integrated circuit (ASIC) or a combination of ASICs, which are designed to achieve one or more specific functions, or enable one or more specific devices or applications. In yet another embodiment, the processor 30 can be an analog or digital circuit, or a combination of multiple circuits.
  • The processor 30 can include a memory component 32. The memory component 32 can include one or more types of memory. For example, the memory component 32 can include a read only memory (ROM) component and a random access memory (RAM) component. The memory component can also include other types of memory that are suitable for storing data in a form retrievable by the processor 30. For example, electronically programmable read only memory (EPROM), erasable electronically programmable read only memory (EEPROM), flash memory, as well as other suitable forms of memory can be included within the memory component. The processor 30 can also include a variety of other components, such as for example, coprocessors, graphic processors, etc., depending upon the desired functionality of the code.
  • The processor 30 can store data in the memory component 32 or retrieve data previously stored in the memory component 32. The components of the processor 30 can communicate with devices external to the processor 30 by way of an input/output (I/O) component (not shown). According to one or more embodiments of the invention, the I/O component can include a variety of suitable communication interfaces. For example, the I/O component can include, for example, wired connections, such as standard serial ports, parallel ports, universal serial bus (USB) ports, S-video ports, local area network (LAN) ports, small computer system interface (SCCI) ports, and so forth. Additionally, the I/O component can include, for example, wireless connections, such as infrared ports, optical ports, Bluetooth® wireless ports, wireless LAN ports, or the like.
  • The processor 30 can be connected to a network, which may be any form of interconnecting network including an intranet, such as a local or wide area network, or an extranet, such as the World Wide Web or the Internet. The network can be physically implemented on a wireless or wired network, on leased or dedicated lines, including a virtual private network (VPN).
  • As stated above, the processor 30 can receive image data from the imaging device 40. The processor 30 can identify the position of selected markers 22 within the image data or voxel space using various segmentation techniques, such as Hounsfield unit thresholding, convolution, connected component, or other combinatory image processing and segmentation techniques. The processor 30 can determine a distance and direction between the position of any two markers 22 during multiple instants in time during the first time interval, and store the image data, as well as the position and distance data, within the memory component 32. Multiple images can be produced providing a visual image at multiple instants in time through the path of motion of the dynamic body. The processor 30 can also include a receiving device or localization device 34, which is described in more detail below.
  • A deformation field may also be included in the analysis in various embodiments described herein. For example, the deformation field can be applied to fuse 3D fluoroscopic images to CT images in order to compensate for different patient orientations, patient position, respiration, deformation induced by the catheter or other instrument, and/or other changes or perturbations that occur due to therapy delivery or resection or ablation of tissue.
  • In some embodiments, for example, real-time respiration compensation can be determined by applying an inspiration-to-expiration deformation vector field. In combination with the PTD respiratory signal, for example, the instrument location can be calculated using the deformation vector field. A real-time instrument tip correction vector can be applied to a 3D localized instrument tip. The real-time correction vector is computed by scaling an inspiration-to-expiration deformation vector (found from the inspiration-to-expiration deformation vector field) based on the PTD respiratory signal. This correction vector can then be applied to the 3D localized instrument tip. This can further optimize accuracy during navigation.
  • An example of an algorithm for real-time respiration compensation can be found in FIG. 19. In accordance with this algorithm, for each l:
  • (a) find vi such that scalar d is minimized;
  • (b) compute c, wherein:

  • c=−v i t
      • and (c) compute l′, wherein:

  • l′=l+c
  • Thus, l′ is a respiration compensated version of l.
  • Although FIG. 19 and the above discussion generally relate to real-time respiration motion, it will be understood that these calculations and determinations may also be applied to real-time heartbeat and/or vessel motion compensation, or any other motion of a dynamic body as described herein. In one embodiment, for example, the deformation matrix is calculated based upon inspiration and expiration. In another embodiment, for example, the deformation matrix is calculated based upon heartbeat. In yet another embodiment, for example, the deformation matrix is based upon vessel motion. In these and other embodiments, it is also possible to extend these calculations and determinations to develop multiple deformation matrices across multiple patient datasets, by acquiring the multiple datasets over the course of, for example, a single heartbeat cycle or a single respiratory cycle.
  • Deformation on 2D images can also be calculated based upon therapeutic change of tissue, changes in Houndsfield units for images, patient motion compensation during the imaging sequence, therapy monitoring, and temperature monitoring with fluoroscopic imaging, among other things. One potential issue with conventional therapy delivery, for instance, is monitoring the therapy for temperature or tissue changes. In accordance with the methods described herein, this monitoring can be carried out using intermittent fluoroscopic imaging, where the images are compensated between acquisition times to show very small changes in image density, which can represent temperature changes or tissue changes as a result of the therapy and/or navigation.
  • In general, it may also be preferable to reduce the level of radiation that patients are exposed to before or during a procedure (or pre-procedural analysis) as described herein. One method of reducing radiation during the acquisition of a 3D fluoroscopic dataset (or other dataset described herein), for example, is to use a deformation field between acquired 2D images to reduce the actual number of 2D images that need to be acquired to create the 3D dataset. In one particular embodiment, the deformation field is used to calculate the deformation between images in the acquisition sequence to produce 2D images between the acquired slices, and these new slices can be used to calculate the 3D fluoroscopic dataset. For example, if 180 2D image slices were previously required, e.g., an image(s) taken every 2 degrees of a 360 degree acquisition sequence, in accordance with some embodiments 90 2D images can be acquired over a 360 degree acquisition sequence and the data from the images that would have ordinarily been acquired between each slice can be calculated and imported into the 3D reconstruction algorithm. Thus, the radiation is effectively reduced by 50%.
  • As shown in FIG. 2, two or more localization elements 24 are coupled to the PTD 20 proximate the locations of the markers 22 for use during a medical procedure to be performed during a second time interval. The localization elements 24 can be, for example, electromagnetic coils, infrared light emitting diodes, and/or optical passive reflective markers. The localization elements 24 can also be, or be integrated with, one or more fiber optic localization (FDL) devices. The markers 22 can include plastic or non-ferrous fixtures or dovetails or other suitable connectors used to couple the localization elements 24 to the markers 22. A medical procedure can then be performed with the PTD 20 coupled to the dynamic body B at the same location as during the first time interval when the pre-procedural images were taken. During the medical procedure, the localization elements 24 are in communication or coupled to the localization device 34 included within processor 30. The localization device 34 can be, for example, an analog to digital converter that measures voltages induced onto localization coils in the field; creates a digital voltage reading; and maps that voltage reading to a metric positional measurement based on a characterized volume of voltages to millimeters from a fixed field emitter. Position data associated with the elements 24 can be transmitted or sent to the localization device 34 continuously during the medical procedure during the second time interval. Thus, the position of the localization elements 24 can be captured at given instants in time during the second time interval. Because the localization elements 24 are coupled to the PTD 20 proximate the markers 22, the localization device 34 can use the position data of the elements 24 to deduce coordinates or positions associated with the markers 22 intra-procedurally during the second time interval. The distance, range, acceleration, and speed between one or more selected pairs of localization elements 24 (and corresponding markers 22) can then be determined and various algorithms can be used to analyze and compare the distance between selected elements 24 at given instants in time, to the distances between and orientation among corresponding markers 22 observed in the pre-operative images.
  • An image can then be selected from the pre-operative images taken during the first time interval that indicates a distance or is grouped in a similar sequence of motion between corresponding markers 22 at a given instant in time, that most closely approximates or matches the distance or similar sequence of motion between the selected elements 24. The process of comparing the distances is described in more detail below. Thus, the apparatus 10 and processor 30 can be used to provide images corresponding to the actual movement of the targeted anatomy during the medical procedure being performed during the second time interval. The images illustrate the orientation and shape of the targeted anatomy during a path of motion of the anatomy, for example, during inhaling and exhaling.
  • FIG. 3 illustrates an example set of distances or vectors d1 through d6 between a set of markers 122, labeled m1 through m9 that are disposed at spaced locations on a PTD 120. As described above, pre-procedure images can be taken of a dynamic body for which the PTD 120 is to be coupled during a first time interval. The distances between the markers can be determined for multiple instants in time through the path of motion of the dynamic body. Then, during a medical procedure, performed during a second time interval, localization elements (not shown in FIG. 3) coupled proximate to the location of markers 122 can provide position data for the elements to a localization device (not shown in FIG. 3). The localization device can use the position data to determine distances or vectors between the elements for multiple instants in time during the medical procedure or second time interval.
  • FIG. 4A shows an example of distance or vector data from the localization device. Vectors a1 through a6 represent distance data for one instant in time and vectors n1 through n6 for another instant in time, during a time interval from a to n. As previously described, the vector data can be used to select an image from the pre-procedural images that includes distances between the markers m1 through m9 that correspond to or closely approximate the distances a1 through a6 for time a, for example, between the localization elements. The same process can be performed for the vectors n1 through n6 captured during time n.
  • One method of selecting the appropriate image from the pre-procedural images is to execute an algorithm that can sum all of the distances a1 through a6 and then search for and match this sum to an image containing a sum of all of the distances d1 through d6 obtained pre-procedurally from the image data that is equal to the sum of the distances a1 through a6. When the difference between these sums is equal to zero, the relative position and orientation of the anatomy or dynamic body D during the medical procedure will substantially match the position and orientation of the anatomy in the particular image. The image associated with distances d1 through d6 that match or closely approximate the distances a1 through a6 can then be selected and displayed. For example, FIG. 4B illustrates examples of pre-procedural images, Image a and Image n, of a dynamic body D that correspond to the distances a1 through a6 and n1 through n6, respectively. An example of an algorithm for determining a match is as follows:
  • Does Σai=Σdi (i=1 to 6 in this example) OR
  • Does Σ(ai−di)=0 (i=1 to 6 in this example).
  • If yes to either of these, then the image is a match to the vector or distance data obtained during the medical procedure.
  • FIG. 5 illustrates an apparatus 210 according to an embodiment of the invention. The apparatus 210 includes a tubular shaped PTD 220 that can be constructed with a rigid material or, alternatively, a flexible and/or stretchable material. In one embodiment, for example, the PTD 220 is substantially rigid in structure. In another embodiment, for example, the PTD 220 has a flexible or stretchable structure. The PTD 220 can be positioned over a portion of a patient's body, such as around the upper or lower torso of the patient. In the embodiments in which the PTD 220 is constructed with a stretchable and/or flexible material, for instance, the stretchability of the PTD 220 allows the PTD 220 to at least partially constrict some of the movement of the portion of the body for which it is coupled. The apparatus 210 further includes multiple markers or fiducials 222 coupled to the PTD 220 at spaced locations. A plurality of localization elements 224 are removably coupled proximate to the locations of markers 222, such that during a first time interval as described above, images can be taken without the elements 224 being coupled to the PTD 220. The localization elements need not be removably coupled. For example, the elements can be fixedly coupled to the PTD. In addition, the elements can be coupled to the PTD during the pre-procedure imaging.
  • FIG. 6 is a graphical illustration indicating how the apparatus 210 (shown without localization elements 224) can move and change orientation and shape during movement of a dynamic body, such as a mammalian body M. The graph is one example of how the lung volume can change during inhalation (inspiration) and exhalation (expiration) of the mammalian body M. The corresponding changes in shape and orientation of the apparatus 210 during inhalation and exhalation are also illustrated. The six markers 222 shown in FIG. 5 are labeled a, b, c, d, e, and f. As described above, images of the apparatus 110 can be taken during a first time interval. The images can include an indication of relative position of each of the markers 222, that is the markers 222 are visible in the images, and the position of each marker 222 can then be observed over a period of time. A distance between any two markers 222 can then be determined for any given instant of time during the first time interval. For example, a distance X between markers a and b is illustrated, and a distance Y between markers b and f is illustrated. These distances can be determined for any given instant in time during the first time interval from an associated image that illustrates the position and orientation of the markers 222. As illustrated, during expiration of the mammalian body M at times indicated as A and C, the distance X is smaller than during inspiration of the mammalian body M, at the time indicated as B. Likewise, the distance Y is greater during inspiration than during expiration. The distance between any pair of markers 222 can be determined and used in the processes described herein. Thus, the above embodiments are merely examples of possible pair selections. For example, a distance between a position of marker e and a position of marker b may be determined. In addition, multiple pairs or only one pair may be selected for a given procedure.
  • FIG. 7 is a flowchart illustrating a method according to an embodiment of the invention. A method 50 includes at step 52 receiving image data during a pre-procedural or first time interval. As discussed above, images are taken of a dynamic body using an appropriate imaging modality (e.g., CT Scan, MRI, etc.). The image data is associated with one or more images taken of a PTD (as described herein) coupled to a dynamic body, where the PTD includes two or more markers coupled thereto. In other words, the image data of the dynamic body is correlated with image data related to the PTD. The one or more images can be taken using a variety of different imaging modalities as described previously. The image data can include an indication of a position of a first marker and an indication of a position of a second marker, as illustrated at step 54. The image data can include position data for multiple positions of the markers during a range or path of motion of the dynamic body over a selected time interval. As described above, the image data can include position data associated with multiple markers, however, only two are described here for simplicity. A distance between the position of the first marker and the position of the second marker can be determined for multiple instants in time during the first time interval, at step 56. As also described above, the determination can include determining the distance based on the observable distance between the markers on a given image. The image data, including all of the images received during the first time interval, the position, and the distance data can be stored in a memory and/or recorded at step 58.
  • Then at step 60, during a second time interval, while performing a medical procedure on the patient with the PTD positioned on the patient at substantially the same location, position data can be received for a first localization element and a second localization element. The localization elements can be coupled to the PTD proximate the locations of the markers, such that the position data associated with the elements can be used to determine the relative position of the markers in real-time during the medical procedure. The position data of the elements can be stored and/or recorded at step 62.
  • A distance between the first and second localization elements can be determined at step 64. Although only two localization elements are described, as with the markers, position data associated with more than two localization elements can be received and the distances between the additional elements can be determined.
  • The next step is to determine which image from the one or more images taken during the first time interval represents the relative position and/or orientation of the dynamic body at a given instant in time during the second time interval or during the medical procedure. To determine this, at step 66, the distance between the positions of the first and second localization elements at a given instant in time during the second time interval are compared to the distance(s) determined in step 56 between the positions of the first and second markers obtained with the image data during the first time interval.
  • An image can be selected from the first time interval that best represents the same position and orientation of the dynamic body at a given instant in time during the medical procedure. To do this, the difference between the distance between a given pair of localization elements during the second time interval is used to select the image that contains the same distance between the same given pair of markers from the image data received during the first time interval. This can be accomplished, for example, by executing an algorithm to perform the calculations. When there are multiple pairs of markers and localization elements, the algorithm can sum the distances between all of the selected pairs of elements for a given instant in time during the second time interval and sum the distances between all of the associated selected pairs of markers for each instant in time during the first time interval when the pre-procedural image data was received.
  • When an image is found that provides the sum of distances for the selected pairs of markers that is substantially the same as the sum of the distances between the localization elements during the second time interval, then that image is selected at step 68. The selected image can then be displayed at step 70. The physician can then observe the image during the medical procedure on a targeted portion of the dynamic body. Thus, during the medical procedure, the above process can be continuously executed such that multiple images are displayed and images corresponding to real-time positions of the dynamic body can be viewed.
  • FIG. 8 shows one embodiment of a system (system 100) that includes components that can be used to perform image guided interventions using a gated imaging modality, such as ECG-gated MRI, or ECG-gated CT. The figure depicts a patient 10 positioned on an operating table 12 with a physician 14 performing a medical procedure on him.
  • Specifically, FIG. 8 depicts physician 14 steering a medical instrument 16 through the patient's internal anatomy in order to deliver therapy. In this particular instance, instrument 16 is depicted as a catheter entering the right atrium by way of the inferior vena cava preceded by a femoral artery access point; however, the present systems are not limited to catheter use indications. The position of virtually any instrument may be tracked as discussed below and a representation of it superimposed on the proper image, consistent with the present methods, apparatuses, and systems. An “instrument” is any device controlled by physician 10 for the purpose of delivering therapy, and includes needles, guidewires, stents, filters, occluders, retrieval devices, imaging devices (such as OCT, EBUS, IVUS, and the like), and leads. Instrument 16 is fitted with one or more instrument reference markers 18. A tracker 20 (which is sometimes referred to in the art as a “tracking system”) is configured to track the type of reference marker or markers coupled to instrument 16. Tracker 20 can be any type of tracking system, including but not limited to an electromagnetic tracking system. An example of a suitable electromagnetic tracking system is the AURORA electromagnetic tracking system, commercially available from Northern Digital Inc. in Waterloo, Ontario Canada. If tracker 20 is an electromagnetic tracking system, element 20 would represent an electromagnetic field generator that emits a series of electromagnetic fields designed to engulf patient 10, and reference marker or markers 18 coupled to medical instrument 16 could be coils that would receive an induced voltage that could be monitored and translated into a coordinate position of the marker(s).
  • As noted herein, a variety of instruments and devices can be used in conjunction with the systems and methods described herein. In one embodiment, for example, an angled coil sensor is employed during the targeted navigation. In accordance with this embodiment, for example, instead of using a conventional wire sensor wrapped at about a 90° angle (i.e., roughly perpendicular) to the axial length (or core) of the sensor, the coil is wrapped at an acute angle (i.e., the angle is less than about 90°) relative to the axial length of the sensor. In one embodiment, the coil is positioned (e.g., wrapped) at an angle of from about 30° to about 60° relative to the axial length. In one preferred embodiment, the coil is positioned at about a 45° angle relative to the axial length. The positioning of the coil in accordance with the exemplary embodiments described herein advantageously provides a directional vector that is not parallel with the sensor core. Thus, the physical axis is different and, as the sensor moves, this additional directional vector can be quantified and used to detect up and down (and other directional) movement. This motion can be captured over time as described herein to determine orientation and prepare and display the more accurate images.
  • An external reference marker 22 can be placed in a location close to the region of the patient where the procedure is to be performed, yet in a stable location that will not move (or that will move a negligible amount) with the patient's heart beat and respiration. If patient 10 is securely fixed to table 12 for the procedure, external reference marker 22 (which may be described as “static”) can be affixed to table 12. If patient 10 is not completely secured to table 12, external reference marker 22 can be placed on region of the back of patient 10 exhibiting the least amount of movement. Tracker 20 can be configured to track external reference marker 22.
  • One or more non-tissue internal reference markers 24 can be placed in the gross region where the image guided navigation will be carried out. Non-tissue internal reference marker(s) 24 should be placed in an anatomic location that exhibits movement that is correlated with the movement of the anatomy intended for image guided navigation. This location will be internal to the patient, in the gross location of the anatomy of interest.
  • Medical instrument 16, instrument reference marker(s) 18, external reference marker 22, and non-tissue internal reference marker(s) 24 can be coupled to converter 26 of system 100. Converter 26, one example of which may be referred to in the art as a break-out box, can be configured to convert analog measurements received from the reference markers and tracker 20 into digital data understandable by image guidance computing platform 30, and relay that data to image guidance computing platform 30 to which converter 26 can be coupled. Image guidance computing platform 30 can take the form of a computer, and may include a monitor on which a representation of one or more instruments used during the IGI can be displayed over an image of the anatomy of interest.
  • System 100 also includes a periodic human characteristic signal monitor, such as ECG monitor 32, which can be configured to receive a periodic human characteristic signal. For example, ECG monitor 32 can be configured to receive an ECG signal in the form of the ECG data transmitted to it by ECG leads 34 coupled to patient 10. The periodic human characteristic signal monitor (e.g., ECG monitor 32) can also be configured to relay a periodic human characteristic signal (e.g., ECG data) to image guidance computing platform 30, to which it can be coupled.
  • Prior to the start of the image guided intervention, non-tissue internal reference marker(s) 24—but not necessarily static external reference marker 22—should be placed in the gross region of interest for the procedure. After placement of non-tissue internal reference marker(s) 24, patient 10 is to be scanned with an imaging device, such as gated scanner 40, and the resulting gated image dataset transferred to image guidance computing platform 30, to which the imaging device is coupled and which can reside in the operating or procedure theatre. Examples of suitable imaging devices, and more specifically suitable gated scanners, include ECG-gated MRI scanners and ECG-gated CT scanners. A hospital network 50 may be used to couple gated scanner 40 to image guidance computing platform 30.
  • The imaging device (e.g., gated scanner 40) can be configured to create a gated dataset that includes pre-operative images, one or more of which (up to all) are taken using the imaging device and are linked to a sample of a periodic human characteristic signal (e.g., a sample, or a phase, of an ECG signal). Once patient 10 is scanned using the imaging device and the gated dataset is transferred to and received by image guidance computing platform 30, patient 10 can be secured to operating table 12 and the equipment making up system 100 (e.g., tracker 20, converter 26, image guidance computing platform 30, ECG monitor 32, and gated scanner 40) set up as shown in FIG. 9. Information can then flow among the system 100 components.
  • At this point, a gated dataset created by gated scanner 40 resides on image guidance computing platform 30. FIG. 9 highlights the relationship between the samples (S1 . . . Sn) and the images (I1 . . . In) that were captured by gated scanner 40. Designations P, Q, R, S, and T are designations well known in the art; they designate depolarizations and re-polarizations of the heart. Gated scanner 40 essentially creates an image of the anatomy of interest at a particular instant in time during the anatomy's periodic movement. Image I1 corresponds to the image that was captured at the S1 moment of patient 10's ECG cycle. Similarly, I2 is correlated with S2, and In with Sn.
  • FIG. 10 is a diagram of another exemplary surgical instrument navigation system 10. In accordance with one aspect of the present invention, the surgical instrument navigation system 10 is operable to visually simulate a virtual volumetric scene within the body of a patient, such as an internal body cavity, from a point of view of a surgical instrument 12 residing in the cavity of a patient 13. To do so, the surgical instrument navigation system 10 is primarily comprised of a surgical instrument 12, a data processor 16 having a display 18, and a tracking subsystem 20. The surgical instrument navigation system 10 may further include (or accompanied by) an imaging device 14 that is operable to provide image data to the system.
  • The surgical instrument 12 is preferably a relatively inexpensive, flexible and/or steerable catheter that may be of a disposable type. The surgical instrument 12 is modified to include one or more tracking sensors that are detectable by the tracking subsystem 20. It is readily understood that other types of surgical instruments (e.g., a guide wire, a needle, a forcep, a pointer probe, a stent, a seed, an implant, an endoscope, an energy delivery device, a therapy delivery device, etc.) are also within the scope of the present invention. It is also envisioned that at least some of these surgical instruments may be wireless or have wireless communications links. It is also envisioned that the surgical instruments may encompass medical devices which are used for exploratory purposes, testing purposes or other types of medical procedures.
  • The volumetric scan data is then registered as shown at 34. Registration of the dynamic reference frame 19 generally relates information in the volumetric scan data to the region of interest associated with the patient. This process is referred to as registering image space to patient space. Often, the image space must also be registered to another image space. Registration is accomplished through knowledge of the coordinate vectors of at least three non-collinear points in the image space and the patient space.
  • Referring to FIG. 11, the imaging device 14 is used to capture volumetric scan data 32 representative of an internal region of interest within the patient 13. The three-dimensional scan data is preferably obtained prior to surgery on the patient 13. In this case, the captured volumetric scan data may be stored in a data store associated with the data processor 16 for subsequent processing. However, one skilled in the art will readily recognize that the principles of the present invention may also extend to scan data acquired during surgery. It is readily understood that volumetric scan data may be acquired using various known medical imaging devices 14, including but not limited to a magnetic resonance imaging (MRI) device, a computed tomography (CT) imaging device, a positron emission tomography (PET) imaging device, a 2D or 3D fluoroscopic imaging device, and 2D, 3D or 4D ultrasound imaging devices. In the case of a two-dimensional ultrasound imaging device or other two-dimensional image acquisition device, a series of two-dimensional data sets may be acquired and then assembled into volumetric data as is well known in the art using a two-dimensional to three-dimensional conversion.
  • The multi-dimensional imaging modalities described herein may also be coupled with digitally reconstructed radiography (DRR) techniques. In accordance with a fluoroscopic image acquisition, for example, radiation passes through a physical media to create a projection image on a radiation-sensitive film or an electronic image intensifier. Given a 3D or 4D dataset as described herein, for example, a simulated image can be generated in conjunction with DRR methodologies. DRR is generally known in the art, and is described, for example, by Lemieux et al. (Med. Phys. 21(11), November 1994, pp. 1749-60).
  • When a DRR image is created, a fluoroscopic image is formed by computationally projecting volume elements, or voxels, of the 3D or 4D dataset onto one or more selected image planes. Using a 3D or 4D dataset of a given patient as described herein, for example, it is possible to generate a DRR image that is similar in appearance to a corresponding patient image. This similarity can be due, at least in part, to similar intrinsic imaging parameters (e.g., projective transformations, distortion corrections, etc.) and extrinsic imaging parameters (e.g., orientation, view direction, etc.). The intrinsic imaging parameters can be derived, for instance, from the calibration of the equipment. Advantageously, this provides another method to see the up-and-down (and other directional) movement of the instrument. This arrangement further provides the ability to see how the device moves in an image(s), which translates to improved movement of the device in a patient. An exemplary pathway in accordance with the disclosure herein can be seen in FIG. 17.
  • A dynamic reference frame 19 is attached to the patient proximate to the region of interest within the patient 13. To the extent that the region of interest is a vessel or a cavity within the patient, it is readily understood that the dynamic reference frame 19 may be placed within the patient 13. To determine its location, the dynamic reference frame 19 is also modified to include tracking sensors detectable by the tracking subsystem 20. The tracking subsystem 20 is operable to determine position data for the dynamic reference frame 19 as further described below.
  • The volumetric scan data is then registered as shown at 34. Registration of the dynamic reference frame 19 generally relates information in the volumetric scan data to the region of interest associated with the patient. This process is referred to as registering image space to patient space. Often, the image space must also be registered to another image space. Registration is accomplished through knowledge of the coordinate vectors of at least three non-collinear points in the image space and the patient space.
  • Registration for image guided surgery can be completed by different known techniques. First, point-to-point registration is accomplished by identifying points in an image space and then touching the same points in patient space. These points are generally anatomical landmarks that are easily identifiable on the patient. Second, surface registration involves the user's generation of a surface in patient space by either selecting multiple points or scanning, and then accepting the best fit to that surface in image space by iteratively calculating with the data processor until a surface match is identified. Third, repeat fixation devices entail the user repeatedly removing and replacing a device (i.e., dynamic reference frame, etc.) in known relation to the patient or image fiducials of the patient. Fourth, automatic registration by first attaching the dynamic reference frame to the patient prior to acquiring image data. It is envisioned that other known registration procedures are also within the scope of the present invention, such as that disclosed in U.S. Ser. No. 09/274,972, filed on Mar. 23, 1999, entitled “NAVIGATIONAL GUIDANCE VIA COMPUTER-ASSISTED FLUOROSCOPIC IMAGING”, which is hereby incorporated by reference.
  • FIG. 12 illustrates another type of secondary image 28 which may be displayed in conjunction with the primary perspective image 38. In this instance, the primary perspective image is an interior view of an air passage within the patient 13. The secondary image 28 is an exterior view of the air passage which includes an indicia or graphical representation 29 that corresponds to the location of the surgical instrument 12 within the air passage. In FIG. 12, the indicia 29 is shown as a crosshairs. It is envisioned that other indicia may be used to signify the location of the surgical instrument in the secondary image. As further described below, the secondary image 28 is constructed by superimposing the indicia 29 of the surgical instrument 12 onto the manipulated image data 38.
  • Referring to FIG. 13, the display of an indicia of the surgical instrument 12 on the secondary image may be synchronized with an anatomical function, such as the cardiac or respiratory cycle, of the patient. In certain instances, the cardiac or respiratory cycle of the patient may cause the surgical instrument 12 to flutter or jitter within the patient. For instance, a surgical instrument 12 positioned in or near a chamber of the heart will move in relation to the patient's heart beat. In these instance, the indicia of the surgical instrument 12 will likewise flutter or jitter on the displayed image 40. It is envisioned that other anatomical functions which may effect the position of the surgical instrument 12 within the patient are also within the scope of the present invention.
  • To eliminate the flutter of the indicia on the displayed image 40, position data for the surgical instrument 12 is acquired at a repetitive point within each cycle of either the cardiac cycle or the respiratory cycle of the patient. As described above, the imaging device 14 is used to capture volumetric scan data 42 representative of an internal region of interest within a given patient. A secondary image may then be rendered 44 from the volumetric scan data by the data processor 16.
  • In order to synchronize the acquisition of position data for the surgical instrument 12, the surgical instrument navigation system 10 may further include a timing signal generator 26. The timing signal generator 26 is operable to generate and transmit a timing signal 46 that correlates to at least one of (or both) the cardiac cycle or the respiratory cycle of the patient 13. For a patient having a consistent rhythmic cycle, the timing signal might be in the form of a periodic clock signal. Alternatively, the timing signal may be derived from an electrocardiogram signal from the patient 13. One skilled in the art will readily recognize other techniques for deriving a timing signal that correlate to at least one of the cardiac or respiratory cycle or other anatomical cycle of the patient.
  • As described above, the indicia of the surgical instrument 12 tracks the movement of the surgical instrument 12 as it is moved by the surgeon within the patient 13. Rather than display the indicia of the surgical instrument 12 on a real-time basis, the display of the indicia of the surgical instrument 12 is periodically updated 48 based on the timing signal from the timing signal generator 26. In one exemplary embodiment, the timing generator 26 is electrically connected to the tracking subsystem 20. The tracking subsystem 20 is in turn operable to report position data for the surgical instrument 12 in response to a timing signal received from the timing signal generator 26. The position of the indicia of the surgical instrument 12 is then updated 50 on the display of the image data. It is readily understood that other techniques for synchronizing the display of an indicia of the surgical instrument 12 based on the timing signal are within the scope of the present invention, thereby eliminating any flutter or jitter which may appear on the displayed image 52. It is also envisioned that a path (or projected path) of the surgical instrument 12 may also be illustrated on the displayed image data 52.
  • In another aspect of the present invention, the surgical instrument navigation system 10 may be further adapted to display four-dimensional image data for a region of interest as shown in FIG. 14. In this case, the imaging device 14 is operable to capture volumetric scan data 62 for an internal region of interest over a period of time, such that the region of interest includes motion that is caused by either the cardiac cycle or the respiratory cycle of the patient 13. A volumetric perspective view of the region may be rendered 64 from the volumetric scan data 62 by the data processor 16 as described above. The four-dimensional image data may be further supplemented with other patient data, such as temperature or blood pressure, using coloring coding techniques.
  • In order to synchronize the display of the volumetric perspective view in real-time with the cardiac or respiratory cycle of the patient, the data processor 16 is adapted to receive a timing signal from the timing signal generator 26. As described above, the timing signal generator 26 is operable to generate and transmit a timing signal that correlates to either the cardiac cycle or the respiratory cycle of the patient 13. In this way, the volumetric perspective image may be synchronized 66 with the cardiac or respiratory cycle of the patient 13. The synchronized image 66 is then displayed 68 on the display 18 of the system. The four-dimensional synchronized image may be either (or both of) the primary image rendered from the point of view of the surgical instrument or the secondary image depicting the indicia of the position of the surgical instrument 12 within the patient 13. It is readily understood that the synchronization process is also applicable to two-dimensional image data acquire over time.
  • To enhance visualization and refine accuracy of the displayed image data, the surgical navigation system can use prior knowledge such as the segmented vessel or airway structure to compensate for error in the tracking subsystem or for inaccuracies caused by an anatomical shift occurring since acquisition of scan data. For instance, it is known that the surgical instrument 12 being localized is located within a given vessel or airway and, therefore should be displayed within the vessel or airway. Statistical methods can be used to determine the most likely location; within the vessel or airway with respect to the reported location and then compensate so the display accurately represents the instrument 12 within the center of the vessel or airway. The center of the vessel or airway can be found by segmenting the vessels or airways from the three-dimensional datasets and using commonly known imaging techniques to define the centerline of the vessel or airway tree. Statistical methods may also be used to determine if the surgical instrument 12 has potentially punctured the vessel or airway. This can be done by determining the reported location is too far from the centerline or the trajectory of the path traveled is greater than a certain angle (worse case 90 degrees) with respect to the vessel or airway. Reporting this type of trajectory (error) is very important to the clinicians. The tracking along the center of the vessel may also be further refined by correcting for motion of the respiratory or cardiac cycle, as described above. While navigating along the vessel or airway tree prior knowledge about the last known location can be used to aid in determining the new location. The instrument or navigated device must follow a pre-defined vessel or airway tree and therefore can not jump from one branch to the other without traveling along a path that would be allowed. The orientation of the instrument or navigated device can also be used to select the most likely pathway that is being traversed. The orientation information can be used to increase the probability or weight for selected location or to exclude potential pathways and therefore enhance system accuracy.
  • The surgical instrument navigation system of the present invention may also incorporate atlas maps. It is envisioned that three-dimensional or four-dimensional atlas maps may be registered with patient specific scan data or generic anatomical models. Atlas maps may contain kinematic information (e.g., heart and lung models) that can be synchronized with four-dimensional image data, thereby supplementing the real-time information. In addition, the kinematic information may be combined with localization information from several instruments to provide a complete four-dimensional model of organ motion. The atlas maps may also be used to localize bones or soft tissue which can assist in determining placement and location of implants.
  • FIG. 20, for example, illustrates in one exemplary embodiment the use of Inspiration/arms-up CT and Expiration/arms-down CT for image guided navigation purposes. Stage (A) shows an Inspiration/arms-up pathway registration; this is, generally speaking, the preferred CT scan acquisition state for automatic segmentation of the tracheo-bronchial tree. Stage (B), on the other hand, shows FRC/arms-down segmentation (wherein FRC refers to the Functional Residual Capacity (i.e., the lung volume at the end of a normal expiration, when the muscles of respiration are completely relaxed; at FRC (and typically at FRC only), the tendency of the lungs to collapse is exactly balanced by the tendency of the chest wall to expand). FRC/arms-down is, generally, the preferred navigational state for image guided pulmonary navigation. Unfortunately, however, using the inspiration (arms-up) state of the lungs for navigation can contribute significant error to the image guided navigation. Thus, in accordance with various embodiments described herein, the airways are segmented using full inspiration/arms-up CT acquisition, and mapped to a less-fully segmented, FRC/arms-down CT acquisition. As shown, the results can then be conformed to produce a fully segmented, tracheo-bronchial tree, at the proper spatial representation for patient FRC (Stage (C)).
  • FIG. 21 depicts a CT minP/maxP volume reading including a scenario whereby precise navigation (e.g., using an EM sensor) near a target lesion is carried out with incomplete segmentation results. This scenario provides the user with a view or image 1600 using minP (minimum intensity projection or maxP (maximum intensity projection) volume renderings to simultaneously integrate one or more of: (i) the last known segmented airway 1601; (ii) the target(s) 1602; (iii) a visually distinct representation of previously traversed paths that are “bad” (i.e., incorrect) 1603; (iv) the distance and angle 1604 to the target (e.g., a target lesion) using a vector fit to the last 1 cm (or so) of travel (in addition to, or in place of, instantaneous orientation provided by a 5DOF tip sensor as described herein); and (v) to incorporate user provided “way points” to create a final-approach tube 1605 to the target. As described herein, the image 1600 may also provide a real-time or simulated real-time rendering of the device 1606 (e.g., the device tip as shown with a virtual extension 1607 to the target).
  • Referring now to FIGS. 22A and 22B, one exemplary embodiment of a 4D thoracic registration is depicted. In general, the 4D dataset may be acquired through respiratory gating or tracheal temporal registration. In accordance with the methods described herein, for example, acceleration of N data collectors (e.g., magnetic or MEMS accelerometers, for instance) are measured to register the thorax in time and space, using the general formula: dataTthorax=F(t). As shown in FIGS. 22A and 22B, the various sensors 1701 and tracheal sensor 1702 provide data as described herein, as does sternum sensor 1703 (e.g., x, y, and z dynamic tracking). Device 1704 (e.g., biopsy needle or other device or instrument described herein) is further capable of tracking position and trajectory (as described herein).
  • An exemplary apparatus and method for respiratory 4D data acquisition and navigation is depicted in FIG. 23. As shown in the upper box, a respiratory problem or issue is scanned (e.g., by a CT and/or MR scanner) and signal S from the PTD is provide to the CT/IR unit (lower box). The 4D registration based on the motion of the fiducial and tracker units (which could be, e.g., EM sensors, MEMS devices, combinations thereof, and the like) is provided to the user (shown in FIG. 18 as an interventional radiologist (IR)) on computer C. The system is capable of displaying the current position of the device tip in the image data shown to the IR, using the fiducial or tracker locations in the scan coupled with the real-time motion information provided by the device tip (e.g., which can include a sensor as described herein), thus providing registration.
  • A representative offset device in accordance in certain embodiments of the disclosure herein is depicted in FIGS. 24A and 24B, which show a scope or other instrument 1500 including one or more offset devices 1501 at port 1502. The offset device(s) is/are capable of holding the tracked guidewire 1503 (including brush 1504 at the scope tip) in place and provide a substantially fixed distance or length of extension out of the scope (or virtual scope) to take a sample. It will be understood that brush 1504 at the guidewire tip may be any of a variety of devices, including forceps, needles (e.g., a biopsy needle), and the like. As shown, multiple offsets 1501 can be provided in stages that allow extension of the guidewire, e.g., at 1 cm, 2 cm, 3 cm, and so on, whereby the user can adjust the offsets by removal or repositioning (removed offsets 1501R, for example, are depicted in dashed lines within the port in FIG. 15B). Thus, FIG. 24A shows the brush tip 1504 at the tip of the scope (i.e., prior to extension), whereas FIG. 24B shows the guidewire and tip extended (e.g., 2 cm of extension) by the removal or repositioning of two offsets 1501R.
  • In FIG. 25 a representative actuatable sensor/forceps device in accordance with the embodiments described herein is depicted. As shown, the coil of an EM (or other) sensor 1601 disposed in a catheter (or similar device) body 1600 can act as a solenoid to actuate a forceps 1602. In accordance with the illustrated embodiment, for example, the solenoid coil is used as an EM sensor in a “passive” mode, but can be activated by energy stored in an ultra-capacitor 1603 which actuates the forceps via armature 1604 in an “active” mode.
  • CONCLUSION
  • While various embodiments of the invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. Thus, the breadth and scope of the invention should not be limited by any of the above-described embodiments, but should be defined only in accordance with the following claims and their equivalents.
  • The previous description of the embodiments is provided to enable any person skilled in the art to make or use the invention. While the invention has been particularly shown and described with reference to embodiments thereof, it will be understood by those skilled in art that various changes in form and details may be made therein without departing from the spirit and scope of the invention. For example, the PTD, markers and localization elements can be constructed from any suitable material, and can be a variety of different shapes and sizes, not necessarily specifically illustrated, while still remaining within the scope of the invention.

Claims (34)

1. An image-guided method comprising directing an endoscope including a tip sensor to an anatomical position in a patient;
orienting an endoscopic view to a visual orientation of a user;
activating a steering mechanism of the endoscope to agitate the tip sensor in a plane; and
determining the orientation and location of the tip sensor in the patient and correlating the tip sensor location and orientation with one or more patient images.
2. The image-guided method of claim 1 wherein the anatomical position is a branching point of a bronchial tree.
3. The image-guided method of claim 1, wherein the tip sensor is an angled coil sensor, the coil being disposed at a 45° angle relative to a core portion of the tip sensor.
4. The image-guided method of claim 1, wherein orientation and location determination comprise applying a deformation vector field.
5. The image-guided method of claim 1, wherein the one or more patient images are derived from an imaging device in conjunction with a patient tracking device disposed at an external region of the patient.
6. A method of using a guidewire or other navigated instrument with one to one rotation to continuously align a virtual display view to be consistent with an actual bronchoscopic video view.
7. A method of using a video input of the bronchoscope to adjust the virtual fly-through view to be consistent with a user's normal perspective.
8. The method of claim 7 wherein video processing and matching techniques can be used between the real-time video and the virtual image to align.
9. A method of using bronchoscopic video to provide angular information at a current location to provide targeting or directional cues to the user.
10. The method of claim 9 wherein the angular information is derived from the location of patient anatomy in the image and the relative size of each within the image.
11. A system or apparatus comprising one or more components for carrying out one or more elements of the method of claim 7.
12. A non-transitory processor-readable medium storing code representing instructions to cause a processor to perform a process, the code comprising code to carry out one or more elements of the method of claim 7.
13. An imaging method comprising tracking the traveled path of an instrument in a patient and correlating the tracked path with one or more sets of image data derived from an imaging device in conjunction with a patient tracking device.
14. The method of claim 13 wherein a respiratory signal or a heartbeat signal derived from the patient tracking device is used to gate localization data of the instrument in an anatomical position of the patient to determine on or more patient airway models and correlate the instrument position to the image data to provide a registration of the one or more patient airway models during a respiratory cycle of the patient.
15. The method of claim 13 wherein the patient airway model determination comprises the addition of patient airway data to the image data.
16. The method of claim 15 wherein the patient airway data comprises branching points or segments of branching points in a bronchial tree.
17. The method of claim 13, wherein the correlation of the tracked path comprises applying a deformation vector field.
18. A system or apparatus comprising one or more components for carrying out one or more elements of the method of claim 13.
19. A non-transitory processor-readable medium storing code representing instructions to cause a processor to perform a process, the code comprising code to carry out one or more elements of the method of claim 13.
20. A endoscope or attachment thereof including one or more offset devices proximate a port of the endoscope or attachment, the offset devices capable of securing a navigated guidewire in a predetermined location.
21. The endoscope or attachment of claim 20 wherein a guidewire of the endoscope comprises one or more detachable sensors on a fiducial structure.
22. The endoscope or attachment of claim 20 wherein the endoscope comprises an sensor affixed proximate to an aspiration needle disposed at an end of the endoscope or attachment, wherein the needle tip and the sensor move in conjunction with one another upon actuation of the endoscope by a user.
23. The endoscope or attachment of claim 20 wherein the endoscope comprises an sensor affixed proximate to a brush disposed at an end of the endoscope or attachment, wherein the brush and the sensor move in conjunction with one another upon actuation of the endoscope by a user.
24. The endoscope or attachment of claim 20 wherein the endoscope comprises an sensor affixed proximate to a forceps disposed at an end of the endoscope or attachment, wherein the forceps and the sensor move in conjunction with one another upon actuation of the endoscope by a user.
25. The endoscope or attachment of claim 20, wherein the endoscope or attachment comprises three or more offset devices.
26. The endoscope or attachment of claim 20 wherein the endoscope or attachment includes two or more offsets in a series, each offset being positioned 1 cm from each other.
27. A system or method comprising the use of an endoscope or attachment of claim 20 in a medical procedure.
28. A method of constructing a three-dimensional model of an airway or vessel of a patient comprising correlating a three-dimensional location of instrument at an internal position of the patient with image data collected in conjunction with a patient tracking device disposed on an external position of the patient.
29. The method of claim 28 wherein the construction comprises recording three-dimensional location of an instrument and corresponding EBUS video or images to construct a three-dimensional model of the patient's airway or a lesion therein.
30. The method of claim 28 wherein the construction comprises recording three-dimensional location and corresponding IVUS video or images to construct a three-dimensional model of the patient's vessel or a plaque therein.
31. The method of claim 28 wherein the construction comprises recording three-dimensional location and corresponding OCT images to construct a three-dimensional model of the patient's vessel or a plaque therein.
32. The method of claim 28 wherein the construction comprises the use of a fiber optic localization (FDL) device disposed on an instrument positioned within an airway or vessel of the patient and further comprises generating localization information and shape sensing information and applying an algorithm to said localization and shape sensing information to determine the location and orientation of the instrument within the patient.
33. A system or apparatus comprising one or more components for carrying out one or more elements of the method of claim 28.
34. A non-transitory processor-readable medium storing code representing instructions to cause a processor to perform a process, the code comprising code to carry out one or more elements of the method of claim 28.
US13/817,730 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation Abandoned US20130303887A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/817,730 US20130303887A1 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US37552310P 2010-08-20 2010-08-20
US37553310P 2010-08-20 2010-08-20
US37543910P 2010-08-20 2010-08-20
US37548410P 2010-08-20 2010-08-20
US13/817,730 US20130303887A1 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation
PCT/US2011/048669 WO2012024686A2 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2011/048669 A-371-Of-International WO2012024686A2 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/665,135 Continuation US20200060512A1 (en) 2010-08-20 2019-10-28 Apparatus and method for four dimensional soft tissue navigation

Publications (1)

Publication Number Publication Date
US20130303887A1 true US20130303887A1 (en) 2013-11-14

Family

ID=45594602

Family Applications (15)

Application Number Title Priority Date Filing Date
US13/215,036 Active US10264947B2 (en) 2010-08-20 2011-08-22 Apparatus and method for airway registration and navigation
US13/817,730 Abandoned US20130303887A1 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation
US13/215,017 Active 2031-08-26 US8696549B2 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US13/215,041 Active US10165928B2 (en) 2010-08-20 2011-08-22 Systems, instruments, and methods for four dimensional soft tissue navigation
US13/215,050 Abandoned US20120071753A1 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation including endoscopic mapping
US14/182,896 Abandoned US20140232840A1 (en) 2010-08-20 2014-02-18 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US14/989,692 Abandoned US20160354159A1 (en) 2010-08-20 2016-01-06 Apparatus and method for four dimensional soft tissue navigation including endoscopic mapping
US16/221,886 Abandoned US20190231168A1 (en) 2010-08-20 2018-12-17 Systems, Instruments, and Methods for Four Dimensional Soft Tissue Navigation
US16/357,442 Active 2031-12-29 US10898057B2 (en) 2010-08-20 2019-03-19 Apparatus and method for airway registration and navigation
US16/358,882 Active 2032-02-27 US11109740B2 (en) 2010-08-20 2019-03-20 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US16/371,576 Abandoned US20190223689A1 (en) 2010-08-20 2019-04-01 Apparatus and Method for Four Dimensional Soft Tissue Navigation Including Endoscopic Mapping
US16/665,135 Abandoned US20200060512A1 (en) 2010-08-20 2019-10-28 Apparatus and method for four dimensional soft tissue navigation
US17/156,051 Pending US20210137351A1 (en) 2010-08-20 2021-01-22 Apparatus and Method for Airway Registration and Navigation
US17/466,555 Active 2031-09-04 US11690527B2 (en) 2010-08-20 2021-09-03 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US17/698,112 Abandoned US20220361729A1 (en) 2010-08-20 2022-03-18 Apparatus and method for four dimensional soft tissue navigation

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/215,036 Active US10264947B2 (en) 2010-08-20 2011-08-22 Apparatus and method for airway registration and navigation

Family Applications After (13)

Application Number Title Priority Date Filing Date
US13/215,017 Active 2031-08-26 US8696549B2 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US13/215,041 Active US10165928B2 (en) 2010-08-20 2011-08-22 Systems, instruments, and methods for four dimensional soft tissue navigation
US13/215,050 Abandoned US20120071753A1 (en) 2010-08-20 2011-08-22 Apparatus and method for four dimensional soft tissue navigation including endoscopic mapping
US14/182,896 Abandoned US20140232840A1 (en) 2010-08-20 2014-02-18 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US14/989,692 Abandoned US20160354159A1 (en) 2010-08-20 2016-01-06 Apparatus and method for four dimensional soft tissue navigation including endoscopic mapping
US16/221,886 Abandoned US20190231168A1 (en) 2010-08-20 2018-12-17 Systems, Instruments, and Methods for Four Dimensional Soft Tissue Navigation
US16/357,442 Active 2031-12-29 US10898057B2 (en) 2010-08-20 2019-03-19 Apparatus and method for airway registration and navigation
US16/358,882 Active 2032-02-27 US11109740B2 (en) 2010-08-20 2019-03-20 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US16/371,576 Abandoned US20190223689A1 (en) 2010-08-20 2019-04-01 Apparatus and Method for Four Dimensional Soft Tissue Navigation Including Endoscopic Mapping
US16/665,135 Abandoned US20200060512A1 (en) 2010-08-20 2019-10-28 Apparatus and method for four dimensional soft tissue navigation
US17/156,051 Pending US20210137351A1 (en) 2010-08-20 2021-01-22 Apparatus and Method for Airway Registration and Navigation
US17/466,555 Active 2031-09-04 US11690527B2 (en) 2010-08-20 2021-09-03 Apparatus and method for four dimensional soft tissue navigation in endoscopic applications
US17/698,112 Abandoned US20220361729A1 (en) 2010-08-20 2022-03-18 Apparatus and method for four dimensional soft tissue navigation

Country Status (3)

Country Link
US (15) US10264947B2 (en)
EP (2) EP3659490A1 (en)
WO (1) WO2012024686A2 (en)

Cited By (93)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120289777A1 (en) * 2011-05-13 2012-11-15 Intuitive Surgical Operations, Inc. Medical system providing dynamic registration of a model of an anatomical structure for image-guided surgery
US20140316256A1 (en) * 2011-02-03 2014-10-23 Medtronic, Inc. Display Of An Acquired Cine Loop For Procedure Navigation
US9078685B2 (en) 2007-02-16 2015-07-14 Globus Medical, Inc. Method and system for performing invasive medical procedures using a surgical robot
CN104939908A (en) * 2015-06-08 2015-09-30 温州医科大学附属第一医院 Guiding assembly for ureteroscope operation
WO2016004302A1 (en) * 2014-07-02 2016-01-07 Covidien Lp Alignment ct
WO2016004007A1 (en) * 2014-07-02 2016-01-07 Covidien Lp Intelligent display
US9782229B2 (en) 2007-02-16 2017-10-10 Globus Medical, Inc. Surgical robot platform
US20180158190A1 (en) * 2013-03-15 2018-06-07 Conavi Medical Inc. Data display and processing algorithms for 3d imaging systems
US10080615B2 (en) 2015-08-12 2018-09-25 Globus Medical, Inc. Devices and methods for temporary mounting of parts to bone
US10117632B2 (en) 2016-02-03 2018-11-06 Globus Medical, Inc. Portable medical imaging system with beam scanning collimator
US10136954B2 (en) 2012-06-21 2018-11-27 Globus Medical, Inc. Surgical tool systems and method
US10231791B2 (en) 2012-06-21 2019-03-19 Globus Medical, Inc. Infrared signal based position recognition system for use with a robot-assisted surgery
US10292778B2 (en) 2014-04-24 2019-05-21 Globus Medical, Inc. Surgical instrument holder for use with a robotic surgical system
US10357184B2 (en) 2012-06-21 2019-07-23 Globus Medical, Inc. Surgical tool systems and method
US10448910B2 (en) 2016-02-03 2019-10-22 Globus Medical, Inc. Portable medical imaging system
US20190366124A1 (en) * 2017-02-24 2019-12-05 Brainlab Ag Deep inspiration breath-hold setup using x-ray imaging
US10569794B2 (en) 2015-10-13 2020-02-25 Globus Medical, Inc. Stabilizer wheel assembly and methods of use
US10573023B2 (en) 2018-04-09 2020-02-25 Globus Medical, Inc. Predictive visualization of medical imaging scanner component movement
US10580217B2 (en) 2015-02-03 2020-03-03 Globus Medical, Inc. Surgeon head-mounted display apparatuses
US10646283B2 (en) 2018-02-19 2020-05-12 Globus Medical Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
US10660712B2 (en) 2011-04-01 2020-05-26 Globus Medical Inc. Robotic system and method for spinal and other surgeries
US10675094B2 (en) 2017-07-21 2020-06-09 Globus Medical Inc. Robot surgical platform
US10813704B2 (en) 2013-10-04 2020-10-27 Kb Medical, Sa Apparatus and systems for precise guidance of surgical tools
US10842453B2 (en) 2016-02-03 2020-11-24 Globus Medical, Inc. Portable medical imaging system
US10866119B2 (en) 2016-03-14 2020-12-15 Globus Medical, Inc. Metal detector for detecting insertion of a surgical device into a hollow tube
US10893912B2 (en) 2006-02-16 2021-01-19 Globus Medical Inc. Surgical tool systems and methods
US10898252B2 (en) 2017-11-09 2021-01-26 Globus Medical, Inc. Surgical robotic systems for bending surgical rods, and related methods and devices
US10925681B2 (en) 2015-07-31 2021-02-23 Globus Medical Inc. Robot arm and methods of use
US10939968B2 (en) 2014-02-11 2021-03-09 Globus Medical Inc. Sterile handle for controlling a robotic surgical system from a sterile field
US10945742B2 (en) 2014-07-14 2021-03-16 Globus Medical Inc. Anti-skid surgical instrument for use in preparing holes in bone tissue
US10973594B2 (en) 2015-09-14 2021-04-13 Globus Medical, Inc. Surgical robotic systems and methods thereof
US11045179B2 (en) 2019-05-20 2021-06-29 Global Medical Inc Robot-mounted retractor system
US11045267B2 (en) 2012-06-21 2021-06-29 Globus Medical, Inc. Surgical robotic automation with tracking markers
US11058378B2 (en) 2016-02-03 2021-07-13 Globus Medical, Inc. Portable medical imaging system
JP2021522918A (en) * 2018-05-07 2021-09-02 ザ クリーヴランド クリニック ファウンデーションThe Cleveland Clinic Foundation Live 3D holographic guidance and navigation for performing interventional surgery
US11109922B2 (en) 2012-06-21 2021-09-07 Globus Medical, Inc. Surgical tool systems and method
US11116576B2 (en) 2012-06-21 2021-09-14 Globus Medical Inc. Dynamic reference arrays and methods of use
US11134862B2 (en) 2017-11-10 2021-10-05 Globus Medical, Inc. Methods of selecting surgical implants and related devices
US11153555B1 (en) 2020-05-08 2021-10-19 Globus Medical Inc. Extended reality headset camera system for computer assisted navigation in surgery
US11207150B2 (en) 2020-02-19 2021-12-28 Globus Medical, Inc. Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment
US11253327B2 (en) 2012-06-21 2022-02-22 Globus Medical, Inc. Systems and methods for automatically changing an end-effector on a surgical robot
US11253216B2 (en) 2020-04-28 2022-02-22 Globus Medical Inc. Fixtures for fluoroscopic imaging systems and related navigation systems and methods
US11266470B2 (en) 2015-02-18 2022-03-08 KB Medical SA Systems and methods for performing minimally invasive spinal surgery with a robotic surgical system using a percutaneous technique
US11278360B2 (en) 2018-11-16 2022-03-22 Globus Medical, Inc. End-effectors for surgical robotic systems having sealed optical components
US11298196B2 (en) 2012-06-21 2022-04-12 Globus Medical Inc. Surgical robotic automation with tracking markers and controlled tool advancement
US11317971B2 (en) 2012-06-21 2022-05-03 Globus Medical, Inc. Systems and methods related to robotic guidance in surgery
US11317973B2 (en) 2020-06-09 2022-05-03 Globus Medical, Inc. Camera tracking bar for computer assisted navigation during surgery
US11317978B2 (en) 2019-03-22 2022-05-03 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11337769B2 (en) 2015-07-31 2022-05-24 Globus Medical, Inc. Robot arm and methods of use
US11337742B2 (en) 2018-11-05 2022-05-24 Globus Medical Inc Compliant orthopedic driver
US11357548B2 (en) 2017-11-09 2022-06-14 Globus Medical, Inc. Robotic rod benders and related mechanical and motor housings
US11382700B2 (en) 2020-05-08 2022-07-12 Globus Medical Inc. Extended reality headset tool tracking and control
US11382713B2 (en) 2020-06-16 2022-07-12 Globus Medical, Inc. Navigated surgical system with eye to XR headset display calibration
US11382699B2 (en) 2020-02-10 2022-07-12 Globus Medical Inc. Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery
US11382549B2 (en) 2019-03-22 2022-07-12 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, and related methods and devices
US11395706B2 (en) 2012-06-21 2022-07-26 Globus Medical Inc. Surgical robot platform
US11399900B2 (en) 2012-06-21 2022-08-02 Globus Medical, Inc. Robotic systems providing co-registration using natural fiducials and related methods
US11419616B2 (en) 2019-03-22 2022-08-23 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11426178B2 (en) 2019-09-27 2022-08-30 Globus Medical Inc. Systems and methods for navigating a pin guide driver
US11439444B1 (en) 2021-07-22 2022-09-13 Globus Medical, Inc. Screw tower and rod reduction tool
US11510750B2 (en) 2020-05-08 2022-11-29 Globus Medical, Inc. Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications
US11510684B2 (en) 2019-10-14 2022-11-29 Globus Medical, Inc. Rotary motion passive end effector for surgical robots in orthopedic surgeries
US11523785B2 (en) 2020-09-24 2022-12-13 Globus Medical, Inc. Increased cone beam computed tomography volume length without requiring stitching or longitudinal C-arm movement
US11529195B2 (en) 2017-01-18 2022-12-20 Globus Medical Inc. Robotic navigation of robotic surgical systems
US11571265B2 (en) 2019-03-22 2023-02-07 Globus Medical Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11571171B2 (en) 2019-09-24 2023-02-07 Globus Medical, Inc. Compound curve cable chain
US11602402B2 (en) 2018-12-04 2023-03-14 Globus Medical, Inc. Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems
US11607149B2 (en) 2012-06-21 2023-03-21 Globus Medical Inc. Surgical tool systems and method
US11628023B2 (en) 2019-07-10 2023-04-18 Globus Medical, Inc. Robotic navigational system for interbody implants
US11628039B2 (en) 2006-02-16 2023-04-18 Globus Medical Inc. Surgical tool systems and methods
US11717350B2 (en) 2020-11-24 2023-08-08 Globus Medical Inc. Methods for robotic assistance and navigation in spinal surgery and related systems
US11737766B2 (en) 2014-01-15 2023-08-29 Globus Medical Inc. Notched apparatus for guidance of an insertable instrument along an axis during spinal surgery
US11737831B2 (en) 2020-09-02 2023-08-29 Globus Medical Inc. Surgical object tracking template generation for computer assisted navigation during surgical procedure
US11744655B2 (en) 2018-12-04 2023-09-05 Globus Medical, Inc. Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems
US11794338B2 (en) 2017-11-09 2023-10-24 Globus Medical Inc. Robotic rod benders and related mechanical and motor housings
US11793588B2 (en) 2020-07-23 2023-10-24 Globus Medical, Inc. Sterile draping of robotic arms
US11793570B2 (en) 2012-06-21 2023-10-24 Globus Medical Inc. Surgical robotic automation with tracking markers
US11806084B2 (en) 2019-03-22 2023-11-07 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, and related methods and devices
US11813030B2 (en) 2017-03-16 2023-11-14 Globus Medical, Inc. Robotic navigation of robotic surgical systems
US11819365B2 (en) 2012-06-21 2023-11-21 Globus Medical, Inc. System and method for measuring depth of instrumentation
US11850009B2 (en) 2021-07-06 2023-12-26 Globus Medical, Inc. Ultrasonic robotic surgical navigation
US11857266B2 (en) 2012-06-21 2024-01-02 Globus Medical, Inc. System for a surveillance marker in robotic-assisted surgery
US11857149B2 (en) 2012-06-21 2024-01-02 Globus Medical, Inc. Surgical robotic systems with target trajectory deviation monitoring and related methods
US11864839B2 (en) 2012-06-21 2024-01-09 Globus Medical Inc. Methods of adjusting a virtual implant and related surgical navigation systems
US11864745B2 (en) 2012-06-21 2024-01-09 Globus Medical, Inc. Surgical robotic system with retractor
US11864857B2 (en) 2019-09-27 2024-01-09 Globus Medical, Inc. Surgical robot with passive end effector
US11872000B2 (en) 2015-08-31 2024-01-16 Globus Medical, Inc Robotic surgical systems and methods
US11877807B2 (en) 2020-07-10 2024-01-23 Globus Medical, Inc Instruments for navigated orthopedic surgeries
US11883217B2 (en) 2016-02-03 2024-01-30 Globus Medical, Inc. Portable medical imaging system and method
US11890066B2 (en) 2019-09-30 2024-02-06 Globus Medical, Inc Surgical robot with passive end effector
US11911115B2 (en) 2021-12-20 2024-02-27 Globus Medical Inc. Flat panel registration fixture and method of using same
US11911225B2 (en) 2012-06-21 2024-02-27 Globus Medical Inc. Method and system for improving 2D-3D registration convergence
US11911112B2 (en) 2020-10-27 2024-02-27 Globus Medical, Inc. Robotic navigational system

Families Citing this family (160)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070066881A1 (en) 2005-09-13 2007-03-22 Edwards Jerome R Apparatus and method for image guided accuracy verification
WO2007033206A2 (en) 2005-09-13 2007-03-22 Veran Medical Technologies, Inc. Apparatus and method for image guided accuracy verification
US8090166B2 (en) 2006-09-21 2012-01-03 Surgix Ltd. Medical image analysis
US9375164B2 (en) 2007-03-08 2016-06-28 Sync-Rx, Ltd. Co-use of endoluminal data and extraluminal imaging
US11064964B2 (en) 2007-03-08 2021-07-20 Sync-Rx, Ltd Determining a characteristic of a lumen by measuring velocity of a contrast agent
US11197651B2 (en) 2007-03-08 2021-12-14 Sync-Rx, Ltd. Identification and presentation of device-to-vessel relative motion
US10716528B2 (en) 2007-03-08 2020-07-21 Sync-Rx, Ltd. Automatic display of previously-acquired endoluminal images
JP5639764B2 (en) * 2007-03-08 2014-12-10 シンク−アールエックス,リミティド Imaging and tools for use with moving organs
US9968256B2 (en) 2007-03-08 2018-05-15 Sync-Rx Ltd. Automatic identification of a tool
US9629571B2 (en) 2007-03-08 2017-04-25 Sync-Rx, Ltd. Co-use of endoluminal data and extraluminal imaging
US8542900B2 (en) * 2007-03-08 2013-09-24 Sync-Rx Ltd. Automatic reduction of interfering elements from an image stream of a moving organ
IL184151A0 (en) 2007-06-21 2007-10-31 Diagnostica Imaging Software Ltd X-ray measurement method
EP2310839A4 (en) 2008-06-18 2011-08-03 Surgix Ltd A method and system for stitching multiple images into a panoramic image
ES2450391T3 (en) * 2008-06-19 2014-03-24 Sync-Rx, Ltd. Progressive progress of a medical instrument
US10362962B2 (en) 2008-11-18 2019-07-30 Synx-Rx, Ltd. Accounting for skipped imaging locations during movement of an endoluminal imaging probe
US9974509B2 (en) 2008-11-18 2018-05-22 Sync-Rx Ltd. Image super enhancement
US9101286B2 (en) 2008-11-18 2015-08-11 Sync-Rx, Ltd. Apparatus and methods for determining a dimension of a portion of a stack of endoluminal data points
US9144394B2 (en) 2008-11-18 2015-09-29 Sync-Rx, Ltd. Apparatus and methods for determining a plurality of local calibration factors for an image
US9095313B2 (en) 2008-11-18 2015-08-04 Sync-Rx, Ltd. Accounting for non-uniform longitudinal motion during movement of an endoluminal imaging probe
US8855744B2 (en) 2008-11-18 2014-10-07 Sync-Rx, Ltd. Displaying a device within an endoluminal image stack
US11064903B2 (en) 2008-11-18 2021-07-20 Sync-Rx, Ltd Apparatus and methods for mapping a sequence of images to a roadmap image
US10004387B2 (en) 2009-03-26 2018-06-26 Intuitive Surgical Operations, Inc. Method and system for assisting an operator in endoscopic navigation
US8337397B2 (en) * 2009-03-26 2012-12-25 Intuitive Surgical Operations, Inc. Method and system for providing visual guidance to an operator for steering a tip of an endoscopic device toward one or more landmarks in a patient
US8348831B2 (en) * 2009-12-15 2013-01-08 Zhejiang University Device and method for computer simulated marking targeting biopsy
CN102883651B (en) * 2010-01-28 2016-04-27 宾夕法尼亚州研究基金会 Can be applicable to the global registration system and method based on image that bronchoscope guides
US8672837B2 (en) 2010-06-24 2014-03-18 Hansen Medical, Inc. Methods and devices for controlling a shapeable medical device
EP3659490A1 (en) 2010-08-20 2020-06-03 Veran Medical Technologies, Inc. Apparatus and method for four dimensional soft tissue navigation
BR112013005879A2 (en) * 2010-09-15 2016-05-10 Konink Philps Electronics Nv '' Robot guidance system, control units for an endoscope and robot guidance method ''
US8568326B2 (en) * 2010-10-13 2013-10-29 Volcano Corporation Intravascular ultrasound pigtail catheter
JP5715372B2 (en) * 2010-10-15 2015-05-07 オリンパス株式会社 Image processing apparatus, method of operating image processing apparatus, and endoscope apparatus
US20120190970A1 (en) 2010-11-10 2012-07-26 Gnanasekar Velusamy Apparatus and method for stabilizing a needle
WO2012071110A1 (en) * 2010-11-24 2012-05-31 Boston Scientific Scimed, Inc. Systems and methods for detecting and displaying body lumen bifurcations
JP6099640B2 (en) 2011-06-23 2017-03-22 シンク−アールエックス,リミティド Lumen background sharpening
US11911117B2 (en) 2011-06-27 2024-02-27 Board Of Regents Of The University Of Nebraska On-board tool tracking system and methods of computer assisted surgery
US9498231B2 (en) 2011-06-27 2016-11-22 Board Of Regents Of The University Of Nebraska On-board tool tracking system and methods of computer assisted surgery
CN106913366B (en) 2011-06-27 2021-02-26 内布拉斯加大学评议会 On-tool tracking system and computer-assisted surgery method
US9295449B2 (en) * 2012-01-23 2016-03-29 Ultrasonix Medical Corporation Landmarks for ultrasound imaging
JP5918548B2 (en) * 2012-01-24 2016-05-18 富士フイルム株式会社 Endoscopic image diagnosis support apparatus, operation method thereof, and endoscopic image diagnosis support program
US20130211244A1 (en) * 2012-01-25 2013-08-15 Surgix Ltd. Methods, Devices, Systems, Circuits and Associated Computer Executable Code for Detecting and Predicting the Position, Orientation and Trajectory of Surgical Tools
US9972082B2 (en) 2012-02-22 2018-05-15 Veran Medical Technologies, Inc. Steerable surgical catheter having biopsy devices and related systems and methods for four dimensional soft tissue navigation
EP2838426A4 (en) * 2012-04-17 2015-12-23 Collage Medical Imaging Ltd Organ mapping system using an optical coherence tomography probe
JP6226963B2 (en) * 2012-05-09 2017-11-08 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Method for medical tracking interface to output tracking data, medical tracking interface and computer program
US10085671B2 (en) * 2012-05-14 2018-10-02 Intuitive Surgical Operations, Inc. Systems and methods for deformation compensation using shape sensing
JP6134789B2 (en) 2012-06-26 2017-05-24 シンク−アールエックス,リミティド Image processing related to flow in luminal organs
US20140005527A1 (en) * 2012-06-29 2014-01-02 General Electric Company Method and system for dynamic referencing and registration used with surgical and interventional procedures
US9183354B2 (en) 2012-08-15 2015-11-10 Musc Foundation For Research Development Systems and methods for image guided surgery
CN108042092B (en) * 2012-10-12 2023-02-28 直观外科手术操作公司 Determining a position of a medical device in a branched anatomical structure
BR112015013808A2 (en) * 2012-12-17 2017-07-11 Koninklijke Philips Nv point-of-view tracking and imaging device, and computer-readable media for point-of-view tracking and imaging
WO2014106137A1 (en) * 2012-12-28 2014-07-03 The General Hospital Corporation Optical probe apparatus, systems, methods for guiding tissue asessment
US10595830B2 (en) * 2013-02-11 2020-03-24 Covidien Lp Cytology sampling system and method of utilizing the same
CN104797186B (en) * 2013-03-06 2016-10-12 奥林巴斯株式会社 Endoscopic system
US9057600B2 (en) 2013-03-13 2015-06-16 Hansen Medical, Inc. Reducing incremental measurement sensor error
US20140267330A1 (en) * 2013-03-14 2014-09-18 Volcano Corporation Systems and methods for managing medical image data for multiple users
US10799316B2 (en) 2013-03-15 2020-10-13 Synaptive Medical (Barbados) Inc. System and method for dynamic validation, correction of registration for surgical navigation
US10105149B2 (en) 2013-03-15 2018-10-23 Board Of Regents Of The University Of Nebraska On-board tool tracking system and methods of computer assisted surgery
US9014851B2 (en) 2013-03-15 2015-04-21 Hansen Medical, Inc. Systems and methods for tracking robotically controlled medical instruments
US9271663B2 (en) 2013-03-15 2016-03-01 Hansen Medical, Inc. Flexible instrument localization from both remote and elongation sensors
US9629595B2 (en) 2013-03-15 2017-04-25 Hansen Medical, Inc. Systems and methods for localizing, tracking and/or controlling medical instruments
JP6161687B2 (en) * 2013-03-28 2017-07-12 オリンパス株式会社 Endoscope system and method for operating endoscope system
US10426345B2 (en) 2013-04-04 2019-10-01 Children's National Medical Center System for generating composite images for endoscopic surgery of moving and deformable anatomy
US11020016B2 (en) 2013-05-30 2021-06-01 Auris Health, Inc. System and method for displaying anatomy and devices on a movable display
US10448861B2 (en) * 2013-09-06 2019-10-22 Covidien Lp System and method for light based lung visualization
US11246666B2 (en) 2013-09-06 2022-02-15 The Brigham And Women's Hospital, Inc. System and method for a tissue resection margin measurement device
US10201265B2 (en) 2013-09-06 2019-02-12 Covidien Lp Microwave ablation catheter, handle, and system
WO2015035287A1 (en) 2013-09-06 2015-03-12 Covidien Lp Microwave ablation catheter, handle, and system
US10098565B2 (en) 2013-09-06 2018-10-16 Covidien Lp System and method for lung visualization using ultrasound
US10028649B2 (en) * 2013-12-02 2018-07-24 Welch Allyn, Inc. Digital colposcope system
US10390796B2 (en) * 2013-12-04 2019-08-27 Siemens Medical Solutions Usa, Inc. Motion correction in three-dimensional elasticity ultrasound imaging
CN105813563B (en) * 2013-12-12 2019-12-20 皇家飞利浦有限公司 Method and system for electromagnetic tracking using magnetic tracker for respiratory monitoring
DE102014200326A1 (en) * 2014-01-10 2015-07-16 Siemens Aktiengesellschaft A method of supporting navigation of a medical instrument
US9990776B2 (en) * 2014-03-14 2018-06-05 Synaptive Medical (Barbados) Inc. System and method for projected tool trajectories for surgical navigation systems
DE102014205313B4 (en) * 2014-03-21 2015-10-15 Siemens Aktiengesellschaft Method for registering a near-infrared spectroscopy map and an anatomy image data set and x-ray device
US20150305612A1 (en) 2014-04-23 2015-10-29 Mark Hunter Apparatuses and methods for registering a real-time image feed from an imaging device to a steerable catheter
US20150305650A1 (en) 2014-04-23 2015-10-29 Mark Hunter Apparatuses and methods for endobronchial navigation to and confirmation of the location of a target tissue and percutaneous interception of the target tissue
EP3136960A1 (en) * 2014-04-29 2017-03-08 Koninklijke Philips N.V. Device for determining a specific position of a catheter
EP2944283B1 (en) 2014-05-14 2018-08-15 Stryker European Holdings I, LLC Navigation system for tracking the position of a work target
US9603668B2 (en) 2014-07-02 2017-03-28 Covidien Lp Dynamic 3D lung map view for tool navigation inside the lung
US9754367B2 (en) 2014-07-02 2017-09-05 Covidien Lp Trachea marking
US20160000414A1 (en) 2014-07-02 2016-01-07 Covidien Lp Methods for marking biopsy location
JP6603245B2 (en) 2014-07-02 2019-11-06 コヴィディエン リミテッド パートナーシップ System and method for lung segmentation
WO2016004310A2 (en) 2014-07-02 2016-01-07 Covidien Lp Real-time automatic registration feedback
US9770216B2 (en) 2014-07-02 2017-09-26 Covidien Lp System and method for navigating within the lung
US9530219B2 (en) 2014-07-02 2016-12-27 Covidien Lp System and method for detecting trachea
WO2016018646A1 (en) * 2014-07-28 2016-02-04 Intuitive Surgical Operations, Inc. Systems and methods for intraoperative segmentation
US10966688B2 (en) * 2014-08-26 2021-04-06 Rational Surgical Solutions, Llc Image registration for CT or MR imagery and ultrasound imagery using mobile device
WO2016091766A1 (en) * 2014-12-10 2016-06-16 Koninklijke Philips N.V. Supporting a user in performing an embolization procedure
US10939864B2 (en) 2015-02-03 2021-03-09 Arizona Board Of Regents On Behalf Of The University Of Arizona Falloposcope and method for ovarian cancer detection
CN104720752B (en) * 2015-02-13 2017-09-15 亚太仿生学有限公司 A kind of detector and system and device for thermal imaging inside cavity structure
JP6492188B2 (en) * 2015-02-13 2019-03-27 セント・ジュード・メディカル・インターナショナル・ホールディング・エスエーアールエルSt. Jude Medical International Holding S.a,r.l. Tracking-based 3D model enhancements
US20160331343A1 (en) * 2015-05-11 2016-11-17 Veran Medical Technologies, Inc. Medical apparatus with translatable imaging device for real-time confirmation of interception of target tissue
DE102015213935B4 (en) * 2015-07-23 2019-02-14 Siemens Healthcare Gmbh A medical imaging device having a positioning unit and a method for determining a position on a positioning surface
EP4070723A1 (en) 2015-09-18 2022-10-12 Auris Health, Inc. Navigation of tubular networks
US10986990B2 (en) 2015-09-24 2021-04-27 Covidien Lp Marker placement
JP2018538019A (en) 2015-10-14 2018-12-27 サージヴィジオ Fluorescence navigation system for navigating tools against medical images
US10709352B2 (en) 2015-10-27 2020-07-14 Covidien Lp Method of using lung airway carina locations to improve ENB registration
US10143526B2 (en) 2015-11-30 2018-12-04 Auris Health, Inc. Robot-assisted driving systems and methods
JP6835850B2 (en) * 2015-12-29 2021-02-24 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Systems, control units, and methods for controlling surgical robots
JP6976266B2 (en) * 2016-03-10 2021-12-08 ボディ・ビジョン・メディカル・リミテッドBody Vision Medical Ltd. Methods and systems for using multi-view pose estimation
CN107456278B (en) * 2016-06-06 2021-03-05 北京理工大学 Endoscopic surgery navigation method and system
US10342633B2 (en) * 2016-06-20 2019-07-09 Toshiba Medical Systems Corporation Medical image data processing system and method
US10478143B2 (en) 2016-08-02 2019-11-19 Covidien Lp System and method of generating and updatng a three dimensional model of a luminal network
CN106236264B (en) * 2016-08-24 2020-05-08 李国新 Gastrointestinal surgery navigation method and system based on optical tracking and image matching
CN106236263A (en) * 2016-08-24 2016-12-21 李国新 The gastrointestinal procedures air navigation aid decomposed based on scene and system
US10631933B2 (en) 2016-08-31 2020-04-28 Covidien Lp Pathway planning for use with a navigation planning and procedure system
US10238455B2 (en) 2016-08-31 2019-03-26 Covidien Lp Pathway planning for use with a navigation planning and procedure system
US10939963B2 (en) 2016-09-01 2021-03-09 Covidien Lp Systems and methods for providing proximity awareness to pleural boundaries, vascular structures, and other critical intra-thoracic structures during electromagnetic navigation bronchoscopy
CN106419815B (en) * 2016-09-19 2018-09-18 成都测迪森生物科技有限公司 A kind of mobile laryngoscope with wearing function
US10799092B2 (en) * 2016-09-19 2020-10-13 Covidien Lp System and method for cleansing segments of a luminal network
CN106419814B (en) * 2016-09-19 2018-11-20 成都测迪森生物科技有限公司 A kind of movable high-efficiency laryngoscope
KR101931747B1 (en) * 2016-10-28 2019-03-13 삼성메디슨 주식회사 Biopsy apparatus and method for operating the same
KR20190067917A (en) 2016-11-02 2019-06-17 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Continuous political system and method for visual guided surgery
US10244926B2 (en) 2016-12-28 2019-04-02 Auris Health, Inc. Detecting endolumenal buckling of flexible instruments
EP3579769A4 (en) * 2017-02-08 2020-11-18 Veran Medical Technologies, Inc. Localization needle
WO2018183727A1 (en) 2017-03-31 2018-10-04 Auris Health, Inc. Robotic systems for navigation of luminal networks that compensate for physiological noise
EP3409193B1 (en) * 2017-06-02 2019-12-25 Siemens Healthcare GmbH Positioning of an mr body coil
US10575907B2 (en) 2017-06-21 2020-03-03 Biosense Webster (Israel) Ltd. Registration with trajectory information with shape sensing
US10022192B1 (en) 2017-06-23 2018-07-17 Auris Health, Inc. Automatically-initialized robotic systems for navigation of luminal networks
CN110913788B (en) 2017-06-28 2024-03-12 奥瑞斯健康公司 Electromagnetic distortion detection
CN110809452B (en) 2017-06-28 2023-05-23 奥瑞斯健康公司 Electromagnetic field generator alignment
US10359464B2 (en) 2017-09-18 2019-07-23 Biosense Webster (Israel) Ltd. Cable and associated continuity monitoring system and method
WO2019075074A1 (en) * 2017-10-10 2019-04-18 Covidien Lp System and method for identifying and marking a target in a fluoroscopic three-dimensional reconstruction
US11058493B2 (en) 2017-10-13 2021-07-13 Auris Health, Inc. Robotic system configured for navigation path tracing
US10555778B2 (en) 2017-10-13 2020-02-11 Auris Health, Inc. Image-based branch detection and mapping for navigation
KR20200100613A (en) 2017-12-14 2020-08-26 아우리스 헬스, 인코포레이티드 System and method for estimating instrument position
AU2018390476A1 (en) * 2017-12-18 2020-05-21 Auris Health, Inc. Methods and systems for instrument tracking and navigation within luminal networks
US11224392B2 (en) 2018-02-01 2022-01-18 Covidien Lp Mapping disease spread
US10489911B2 (en) * 2018-02-08 2019-11-26 Apn Health, Llc Determining respiratory phase from fluoroscopic images
US10893842B2 (en) 2018-02-08 2021-01-19 Covidien Lp System and method for pose estimation of an imaging device and for determining the location of a medical device with respect to a target
US11464576B2 (en) 2018-02-09 2022-10-11 Covidien Lp System and method for displaying an alignment CT
US11373330B2 (en) * 2018-03-27 2022-06-28 Siemens Healthcare Gmbh Image-based guidance for device path planning based on penalty function values and distances between ROI centerline and backprojected instrument centerline
MX2020010117A (en) 2018-03-28 2020-11-06 Auris Health Inc Systems and methods for displaying estimated location of instrument.
WO2019191144A1 (en) 2018-03-28 2019-10-03 Auris Health, Inc. Systems and methods for registration of location sensors
US10643333B2 (en) * 2018-04-12 2020-05-05 Veran Medical Technologies Apparatuses and methods for navigation in and Local segmentation extension of anatomical treelike structures
MX2020012902A (en) 2018-05-30 2021-02-26 Auris Health Inc Systems and methods for location sensor-based branch prediction.
CN110831538B (en) 2018-05-31 2023-01-24 奥瑞斯健康公司 Image-based airway analysis and mapping
WO2019231891A1 (en) 2018-05-31 2019-12-05 Auris Health, Inc. Path-based navigation of tubular networks
EP3801280A4 (en) 2018-05-31 2022-03-09 Auris Health, Inc. Robotic systems and methods for navigation of luminal network that detect physiological noise
US11033721B2 (en) * 2018-06-22 2021-06-15 Acclarent, Inc. Guidewire for dilating eustachian tube via middle ear
US11204677B2 (en) * 2018-10-22 2021-12-21 Acclarent, Inc. Method for real time update of fly-through camera placement
US11113868B2 (en) 2018-12-04 2021-09-07 Intuitive Research And Technology Corporation Rastered volume renderer and manipulator
US11145111B2 (en) 2018-12-04 2021-10-12 Intuitive Research And Technology Corporation Volumetric slicer
US11877806B2 (en) 2018-12-06 2024-01-23 Covidien Lp Deformable registration of computer-generated airway models to airway trees
CN109745120B (en) * 2018-12-24 2020-07-31 罗雄彪 Image registration conversion parameter optimization method and system
US11571268B1 (en) 2019-04-02 2023-02-07 Canon U.S.A., Inc. Medical continuum robot extraction and methods thereof
US20200375665A1 (en) * 2019-05-31 2020-12-03 Canon U.S.A., Inc. Medical continuum robot and methods thereof
CN211131187U (en) * 2019-08-29 2020-07-31 蓝明 Device for interventional operation of heart and blood vessel through radial artery or ulnar artery
EP4021331A4 (en) 2019-08-30 2023-08-30 Auris Health, Inc. Systems and methods for weight-based registration of location sensors
WO2021038495A1 (en) 2019-08-30 2021-03-04 Auris Health, Inc. Instrument image reliability systems and methods
CN114641252B (en) * 2019-09-03 2023-09-01 奥瑞斯健康公司 Electromagnetic Distortion Detection and Compensation
CN114901192A (en) 2019-12-31 2022-08-12 奥瑞斯健康公司 Alignment technique for percutaneous access
EP4084721A4 (en) 2019-12-31 2024-01-03 Auris Health Inc Anatomical feature identification and targeting
WO2021137108A1 (en) 2019-12-31 2021-07-08 Auris Health, Inc. Alignment interfaces for percutaneous access
US11701492B2 (en) 2020-06-04 2023-07-18 Covidien Lp Active distal tip drive
EP3967232A1 (en) * 2020-09-10 2022-03-16 Koninklijke Philips N.V. Method for providing a source of secondary medical imaging
CN112891685B (en) * 2021-01-14 2022-07-01 四川大学华西医院 Method and system for intelligently detecting position of blood vessel
CN116916848A (en) * 2021-02-03 2023-10-20 加利福尼亚大学董事会 Surgical awareness framework for robotic tissue manipulation
CN113413213B (en) * 2021-07-14 2023-03-14 广州医科大学附属第一医院(广州呼吸中心) CT result processing method, navigation processing method, device and detection system
WO2023081342A1 (en) * 2021-11-05 2023-05-11 Board Of Regents, The University Of Texas System Four-dimensional tactile sensing system, device, and method
CN116416412A (en) * 2021-12-31 2023-07-11 杭州堃博生物科技有限公司 Auxiliary navigation method, device and equipment for bronchoscope
CN114387320B (en) * 2022-03-25 2022-07-19 武汉楚精灵医疗科技有限公司 Medical image registration method, device, terminal and computer-readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070167738A1 (en) * 2004-01-20 2007-07-19 Koninklijke Philips Electronics N.V. Device and method for navigating a catheter
US7302295B2 (en) * 2003-09-18 2007-11-27 Cardiac Pacemakers, Inc. Method and apparatus for mimicking respiratory sinus arrhythmia with cardiac pacing controlled via external respiration therapy device
US20110311115A1 (en) * 2010-06-18 2011-12-22 Siemens Corporation Method and system for validating image registration
US20120288173A1 (en) * 2011-05-13 2012-11-15 Broncus Technologies, Inc. Surgical assistance planning method using lung motion analysis

Family Cites Families (378)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3788324A (en) 1972-05-05 1974-01-29 P Lim External catheter device
JPS5933388B2 (en) 1976-03-19 1984-08-15 高美 上原 Single-operable biopsy fiberscope
US4583538A (en) 1984-05-04 1986-04-22 Onik Gary M Method and apparatus for stereotaxic placement of probes in the body utilizing CT scanner localization
DE3717871C3 (en) 1987-05-27 1995-05-04 Georg Prof Dr Schloendorff Method and device for reproducible visual representation of a surgical intervention
CA2003497C (en) 1989-11-21 1999-04-06 Michael M. Greenberg Probe-correlated viewing of anatomical image data
US5158088A (en) 1990-11-14 1992-10-27 Advanced Technology Laboratories, Inc. Ultrasonic diagnostic systems for imaging medical instruments within the body
US5053042A (en) 1990-01-16 1991-10-01 Bidwell Clifford D Biopsy needle guide for use with CT scanner
US6347240B1 (en) 1990-10-19 2002-02-12 St. Louis University System and method for use in displaying images of a body part
US6405072B1 (en) 1991-01-28 2002-06-11 Sherwood Services Ag Apparatus and method for determining a location of an anatomical target with reference to a medical apparatus
US6485413B1 (en) 1991-04-29 2002-11-26 The General Hospital Corporation Methods and apparatus for forward-directed optical scanning instruments
US5417210A (en) * 1992-05-27 1995-05-23 International Business Machines Corporation System and method for augmentation of endoscopic surgery
US5279309A (en) 1991-06-13 1994-01-18 International Business Machines Corporation Signaling device and method for monitoring positions in a surgical operation
US5251635A (en) 1991-09-03 1993-10-12 General Electric Company Stereoscopic X-ray fluoroscopy system using radiofrequency fields
EP0531081A1 (en) 1991-09-03 1993-03-10 General Electric Company Tracking system to follow the position and orientation of a device with radiofrequency fields
US5265610A (en) 1991-09-03 1993-11-30 General Electric Company Multi-planar X-ray fluoroscopy system using radiofrequency fields
US5348011A (en) 1991-11-14 1994-09-20 Picker International, Inc. Shared excitation phase encode grouping for improved throughput cardiac gated MRI cine imaging
US5253770A (en) 1991-12-26 1993-10-19 Rosenthal Import Ltd. Merchandising unit
US5251165A (en) 1992-04-09 1993-10-05 James Iii J Colin Two phase random number generator
US5603318A (en) 1992-04-21 1997-02-18 University Of Utah Research Foundation Apparatus and method for photogrammetric surgical localization
US5586215A (en) 1992-05-26 1996-12-17 Ricoh Corporation Neural network acoustic and visual speech recognition system
DE69332021T2 (en) 1992-06-08 2003-01-16 Motorola Inc AUTOMATIC GAIN REGULATION FOR A RECEIVER
AT399647B (en) * 1992-07-31 1995-06-26 Truppe Michael ARRANGEMENT FOR DISPLAYING THE INTERIOR OF BODIES
US5526665A (en) 1992-10-09 1996-06-18 United States Surgical Corporation Apparatus for straightening coiled wire
US6335623B1 (en) 1992-12-18 2002-01-01 Fonar Corporation MRI apparatus
US5651047A (en) 1993-01-25 1997-07-22 Cardiac Mariners, Incorporated Maneuverable and locateable catheters
US5799099A (en) 1993-02-12 1998-08-25 George S. Allen Automatic technique for localizing externally attached fiducial markers in volume images of the head
US5787886A (en) 1993-03-19 1998-08-04 Compass International Incorporated Magnetic field digitizer for stereotatic surgery
US5483961A (en) 1993-03-19 1996-01-16 Kelly; Patrick J. Magnetic field digitizer for stereotactic surgery
DE69432834T2 (en) 1993-04-26 2004-05-13 St. Louis University Display of the location of a surgical probe
AU7468494A (en) 1993-07-07 1995-02-06 Cornelius Borst Robotic system for close inspection and remote treatment of moving parts
US5391199A (en) 1993-07-20 1995-02-21 Biosense, Inc. Apparatus and method for treating cardiac arrhythmias
US6285898B1 (en) * 1993-07-20 2001-09-04 Biosense, Inc. Cardiac electromechanics
US5558091A (en) 1993-10-06 1996-09-24 Biosense, Inc. Magnetic determination of position and orientation
US5437292A (en) 1993-11-19 1995-08-01 Bioseal, Llc Method for sealing blood vessel puncture sites
WO1995020343A1 (en) 1994-01-28 1995-08-03 Schneider Medical Technologies, Inc. Imaging device and method
JP2618202B2 (en) 1994-06-23 1997-06-11 株式会社ロッテ Blood lipid lowering agent and food and drink containing it
US6033401A (en) 1997-03-12 2000-03-07 Advanced Closure Systems, Inc. Vascular sealing device with microwave antenna
WO1996008209A2 (en) 1994-09-15 1996-03-21 Visualization Technology, Inc. Position tracking and imaging system for use in medical applications using a reference unit secured to a patient's head
US5829444A (en) 1994-09-15 1998-11-03 Visualization Technology, Inc. Position tracking and imaging system for use in medical applications
US5803089A (en) 1994-09-15 1998-09-08 Visualization Technology, Inc. Position tracking and imaging system for use in medical applications
DE4435183C2 (en) 1994-09-30 2000-04-20 Siemens Ag Method for operating a magnetic resonance device
DE69532829T2 (en) 1994-10-07 2005-01-27 St. Louis University DEVICE FOR USE WITH A SURGICAL NAVIGATION SYSTEM
US6978166B2 (en) 1994-10-07 2005-12-20 Saint Louis University System for use in displaying images of a body part
US5765561A (en) 1994-10-07 1998-06-16 Medical Media Systems Video-based surgical targeting system
US5740808A (en) 1996-10-28 1998-04-21 Ep Technologies, Inc Systems and methods for guilding diagnostic or therapeutic devices in interior tissue regions
US6483948B1 (en) 1994-12-23 2002-11-19 Leica Ag Microscope, in particular a stereomicroscope, and a method of superimposing two images
US5814066A (en) 1994-12-23 1998-09-29 The University Of Virginia Patent Foundation Reduction of femoral arterial bleeding post catheterization using percutaneous application of fibrin sealant
US6019724A (en) 1995-02-22 2000-02-01 Gronningsaeter; Aage Method for ultrasound guidance during clinical procedures
US5715832A (en) 1995-02-28 1998-02-10 Boston Scientific Corporation Deflectable biopsy catheter
US5868673A (en) 1995-03-28 1999-02-09 Sonometrics Corporation System for carrying out surgery, biopsy and ablation of a tumor or other physical anomaly
US6246898B1 (en) 1995-03-28 2001-06-12 Sonometrics Corporation Method for carrying out a medical procedure using a three-dimensional tracking and imaging system
US5730129A (en) 1995-04-03 1998-03-24 General Electric Company Imaging of interventional devices in a non-stationary subject
US5577502A (en) 1995-04-03 1996-11-26 General Electric Company Imaging of interventional devices during medical procedures
US6122541A (en) 1995-05-04 2000-09-19 Radionics, Inc. Head band for frameless stereotactic registration
US5718241A (en) 1995-06-07 1998-02-17 Biosense, Inc. Apparatus and method for treating cardiac arrhythmias with no discrete target
US5649956A (en) 1995-06-07 1997-07-22 Sri International System and method for releasably holding a surgical instrument
US5776050A (en) * 1995-07-24 1998-07-07 Medical Media Systems Anatomical visualization system
US5638819A (en) 1995-08-29 1997-06-17 Manwaring; Kim H. Method and apparatus for guiding an instrument to a target
JP3597918B2 (en) 1995-09-11 2004-12-08 株式会社日立メディコ X-ray CT system
US6351659B1 (en) 1995-09-28 2002-02-26 Brainlab Med. Computersysteme Gmbh Neuro-navigation system
US5769861A (en) 1995-09-28 1998-06-23 Brainlab Med. Computersysteme Gmbh Method and devices for localizing an instrument
US5899672A (en) 1996-01-19 1999-05-04 Salamey; Laurence R. Electromagnetic pump with magnetically separated cylinders
US5814022A (en) 1996-02-06 1998-09-29 Plasmaseal Llc Method and apparatus for applying tissue sealant
ES2251018T3 (en) * 1996-02-15 2006-04-16 Biosense Webster, Inc. CATHETER WITH LUMEN.
CA2246287C (en) 1996-02-15 2006-10-24 Biosense, Inc. Medical procedures and apparatus using intrabody probes
IL119137A0 (en) 1996-02-15 1996-11-14 Biosense Ltd Intrabody energy focusing
JP3546590B2 (en) 1996-04-12 2004-07-28 株式会社デンソー Air-fuel ratio sensor
US6675033B1 (en) 1999-04-15 2004-01-06 Johns Hopkins University School Of Medicine Magnetic resonance imaging guidewire probe
IL126864A (en) 1996-05-06 2003-05-29 Biosense Inc Method and apparatus for calibrating a magnetic field generator
US6167296A (en) 1996-06-28 2000-12-26 The Board Of Trustees Of The Leland Stanford Junior University Method for volumetric image navigation
US6026173A (en) 1997-07-05 2000-02-15 Svenson; Robert H. Electromagnetic imaging and therapeutic (EMIT) systems
US6016439A (en) 1996-10-15 2000-01-18 Biosense, Inc. Method and apparatus for synthetic viewpoint imaging
US5951461A (en) 1996-12-20 1999-09-14 Nyo; Tin Image-guided laryngoscope for tracheal intubation
US6122538A (en) 1997-01-16 2000-09-19 Acuson Corporation Motion--Monitoring method and system for medical devices
US6380732B1 (en) 1997-02-13 2002-04-30 Super Dimension Ltd. Six-degree of freedom tracking system having a passive transponder on the object being tracked
US5928248A (en) 1997-02-14 1999-07-27 Biosense, Inc. Guided deployment of stents
US6314310B1 (en) 1997-02-14 2001-11-06 Biosense, Inc. X-ray guided surgical location system with extended mapping volume
JP2001506163A (en) 1997-02-25 2001-05-15 バイオセンス・インコーポレイテッド Image guided chest treatment method and device
US6580938B1 (en) 1997-02-25 2003-06-17 Biosense, Inc. Image-guided thoracic therapy and apparatus therefor
US20030191496A1 (en) 1997-03-12 2003-10-09 Neomend, Inc. Vascular sealing device with microwave antenna
DE19751761B4 (en) 1997-04-11 2006-06-22 Brainlab Ag System and method for currently accurate detection of treatment targets
US6267769B1 (en) 1997-05-15 2001-07-31 Regents Of The Universitiy Of Minnesota Trajectory guide method and apparatus for use in magnetic resonance and computerized tomographic scanners
FR2763721B1 (en) 1997-05-21 1999-08-06 Inst Nat Rech Inf Automat ELECTRONIC IMAGE PROCESSING DEVICE FOR DETECTING DIMENSIONAL VARIATIONS
DE19725137C2 (en) 1997-06-13 2003-01-23 Siemens Ag Medical examination device with means for recording patient and / or device movements
US6434507B1 (en) 1997-09-05 2002-08-13 Surgical Navigation Technologies, Inc. Medical instrument and method for use with computer-assisted image guided surgery
US6418238B1 (en) 1997-09-22 2002-07-09 Olympus Optical Co., Ltd. Image detection apparatus and image detection method capable of detecting roundish shape
SE9703429L (en) 1997-09-23 1998-11-02 Boliden Ab Method for electromagnetic probing of boreholes, as well as a transmitter and receiver device for the realization of the method
US6226548B1 (en) 1997-09-24 2001-05-01 Surgical Navigation Technologies, Inc. Percutaneous registration apparatus and method for use in computer-assisted surgical navigation
AU9482698A (en) 1997-09-29 1999-04-23 Medsim Advanced Radiology Medical Simulation Ltd. Interventional radiology guidance system
US5978696A (en) 1997-10-06 1999-11-02 General Electric Company Real-time image-guided placement of anchor devices
US6437571B1 (en) 1997-11-21 2002-08-20 Fonar Corporation MRI apparatus
US5938603A (en) 1997-12-01 1999-08-17 Cordis Webster, Inc. Steerable catheter with electromagnetic sensor
US6348058B1 (en) 1997-12-12 2002-02-19 Surgical Navigation Technologies, Inc. Image guided spinal surgery guide, system, and method for use thereof
IL122578A (en) 1997-12-12 2000-08-13 Super Dimension Ltd Wireless six-degree-of-freedom locator
US6200143B1 (en) 1998-01-09 2001-03-13 Tessera, Inc. Low insertion force connector for microelectronic elements
DE19802145C1 (en) 1998-01-22 1999-09-30 Storz Karl Gmbh & Co Medical sliding shaft instrument
US6198959B1 (en) 1998-03-27 2001-03-06 Cornell Research Foundation Inc. Coronary magnetic resonance angiography using motion matched acquisition
DE19819928A1 (en) 1998-05-05 1999-11-11 Philips Patentverwaltung Medical imaging system e.g. for image-assisted surgery
US6361759B1 (en) 1998-05-26 2002-03-26 Wisconsin Alumni Research Foundation MR signal-emitting coatings
US6201987B1 (en) 1998-05-26 2001-03-13 General Electric Company Error compensation for device tracking systems employing electromagnetic fields
US6425865B1 (en) 1998-06-12 2002-07-30 The University Of British Columbia Robotically assisted medical ultrasound
DE19829224B4 (en) 1998-06-30 2005-12-15 Brainlab Ag Method for localizing treatment goals in the area of soft body parts
FR2781906B1 (en) 1998-07-28 2000-09-29 Inst Nat Rech Inf Automat ELECTRONIC DEVICE FOR AUTOMATIC IMAGE RECORDING
JP2003524443A (en) 1998-08-02 2003-08-19 スーパー ディメンション リミテッド Medical guidance device
US6477400B1 (en) 1998-08-20 2002-11-05 Sofamor Danek Holdings, Inc. Fluoroscopic image guided orthopaedic surgery system with intraoperative registration
DE19838590A1 (en) 1998-08-25 2000-03-09 Siemens Ag Magnetic resonance imaging for moving object
DE19841341A1 (en) 1998-09-10 2000-03-16 Bosch Gmbh Robert Downward choke converter for motor vehicle, has controllable switch behind input in series with choke in longitudinal branch, with capacitor in cross branch at output and second controllable switch
US6282442B1 (en) 1998-09-11 2001-08-28 Surgical Laser Technologies, Inc. Multi-fit suction irrigation hand piece
US20040006268A1 (en) 1998-09-24 2004-01-08 Super Dimension Ltd Was Filed In Parent Case System and method of recording and displaying in context of an image a location of at least one point-of-interest in a body during an intra-body medical procedure
WO2000016684A1 (en) 1998-09-24 2000-03-30 Super Dimension Ltd. System and method for determining the location of a catheter during an intra-body medical procedure
US20030074011A1 (en) 1998-09-24 2003-04-17 Super Dimension Ltd. System and method of recording and displaying in context of an image a location of at least one point-of-interest in a body during an intra-body medical procedure
IL126333A0 (en) 1998-09-24 1999-05-09 Super Dimension Ltd System and method of recording and displaying in context of an image a location of at least one point-of-interest in body during an intra-body medical procedure
AU6421599A (en) 1998-10-09 2000-05-01 Surgical Navigation Technologies, Inc. Image guided vertebral distractor
US6298259B1 (en) 1998-10-16 2001-10-02 Univ Minnesota Combined magnetic resonance imaging and magnetic stereotaxis surgical apparatus and processes
US6078175A (en) 1998-10-26 2000-06-20 General Electric Company Acquistion of segmented cardiac gated MRI perfusion images
DE19909816B4 (en) 1998-11-17 2005-02-17 Schaerer Mayfield USA, Inc., Cincinnati Navigation system for carrying out and supporting surgical interventions and marking device or fiducial and pointer for such a navigation system
ATE291383T1 (en) 1998-11-17 2005-04-15 Schaerer Mayfield Usa Inc SURGICAL NAVIGATION SYSTEM WITH A MARKING DEVICE AND A POINTER FOR A TRACKING DEVICE
US6468265B1 (en) 1998-11-20 2002-10-22 Intuitive Surgical, Inc. Performing cardiac surgery without cardioplegia
US6246896B1 (en) 1998-11-24 2001-06-12 General Electric Company MRI guided ablation system
US6538634B1 (en) 1998-12-18 2003-03-25 Kent Ridge Digital Labs Apparatus for the simulation of image-guided surgery
US6275560B1 (en) 1998-12-22 2001-08-14 General Electric Company Cardiac gated computed tomography system
US6826423B1 (en) 1999-01-04 2004-11-30 Midco-Medical Instrumentation And Diagnostics Corporation Whole body stereotactic localization and immobilization system
US6362821B1 (en) 1999-01-06 2002-03-26 Mitsubishi Electric Research Laboratories, Inc. Surface model generation for visualizing three-dimensional objects using multiple elastic surface nets
US6285902B1 (en) 1999-02-10 2001-09-04 Surgical Insights, Inc. Computer assisted targeting device for use in orthopaedic surgery
US6332891B1 (en) 1999-02-16 2001-12-25 Stryker Corporation System and method for performing image guided surgery
US6368331B1 (en) 1999-02-22 2002-04-09 Vtarget Ltd. Method and system for guiding a diagnostic or therapeutic instrument towards a target region inside the patient's body
US6173201B1 (en) 1999-02-22 2001-01-09 V-Target Ltd. Stereotactic diagnosis and treatment with reference to a combined image
US7174201B2 (en) 1999-03-11 2007-02-06 Biosense, Inc. Position sensing system with integral location pad and position display
US7590441B2 (en) 1999-03-11 2009-09-15 Biosense, Inc. Invasive medical device with position sensing and display
US7558616B2 (en) 1999-03-11 2009-07-07 Biosense, Inc. Guidance of invasive medical procedures using implantable tags
US6144875A (en) 1999-03-16 2000-11-07 Accuray Incorporated Apparatus and method for compensating for respiratory and patient motion during treatment
US6501981B1 (en) 1999-03-16 2002-12-31 Accuray, Inc. Apparatus and method for compensating for respiratory and patient motions during treatment
US6470207B1 (en) 1999-03-23 2002-10-22 Surgical Navigation Technologies, Inc. Navigational guidance via computer-assisted fluoroscopic imaging
DE19914455B4 (en) 1999-03-30 2005-07-14 Siemens Ag Method for determining the movement of an organ or therapeutic area of a patient and a system suitable for this purpose
EP1196089A2 (en) 1999-03-31 2002-04-17 Ultraguide Ltd. Apparatus and methods for medical diagnostic and for medical guided interventions and therapy
DE19917867B4 (en) 1999-04-20 2005-04-21 Brainlab Ag Method and device for image support in the treatment of treatment objectives with integration of X-ray detection and navigation system
US6491699B1 (en) 1999-04-20 2002-12-10 Surgical Navigation Technologies, Inc. Instrument guidance method and system for image guided surgery
AU4365600A (en) 1999-04-22 2000-11-10 Medtronic Surgical Navigation Technologies Apparatus and method for image guided surgery
US6430430B1 (en) 1999-04-29 2002-08-06 University Of South Florida Method and system for knowledge guided hyperintensity detection and volumetric measurement
US7343195B2 (en) 1999-05-18 2008-03-11 Mediguide Ltd. Method and apparatus for real time quantitative three-dimensional image reconstruction of a moving organ and intra-body navigation
US7386339B2 (en) 1999-05-18 2008-06-10 Mediguide Ltd. Medical imaging and navigation system
US9572519B2 (en) 1999-05-18 2017-02-21 Mediguide Ltd. Method and apparatus for invasive device tracking using organ timing signal generated from MPS sensors
US6233476B1 (en) 1999-05-18 2001-05-15 Mediguide Ltd. Medical positioning system
US8442618B2 (en) 1999-05-18 2013-05-14 Mediguide Ltd. Method and system for delivering a medical device to a selected position within a lumen
US7778688B2 (en) 1999-05-18 2010-08-17 MediGuide, Ltd. System and method for delivering a stent to a selected position within a lumen
US7840252B2 (en) 1999-05-18 2010-11-23 MediGuide, Ltd. Method and system for determining a three dimensional representation of a tubular organ
US6478793B1 (en) 1999-06-11 2002-11-12 Sherwood Services Ag Ablation treatment of bone metastases
EP1259160A2 (en) 1999-07-02 2002-11-27 Ultraguide Ltd. Apparatus and methods for medical interventions
US6314311B1 (en) 1999-07-28 2001-11-06 Picker International, Inc. Movable mirror laser registration system
US6317619B1 (en) 1999-07-29 2001-11-13 U.S. Philips Corporation Apparatus, methods, and devices for magnetic resonance imaging controlled by the position of a moveable RF coil
AU2344800A (en) 1999-08-16 2001-03-13 Super Dimension Ltd. Method and system for displaying cross-sectional images of body
US6352507B1 (en) 1999-08-23 2002-03-05 G.E. Vingmed Ultrasound As Method and apparatus for providing real-time calculation and display of tissue deformation in ultrasound imaging
US6516213B1 (en) 1999-09-03 2003-02-04 Robin Medical, Inc. Method and apparatus to estimate location and orientation of objects during magnetic resonance imaging
US6702780B1 (en) 1999-09-08 2004-03-09 Super Dimension Ltd. Steering configuration for catheter with rigid distal device
US6317616B1 (en) 1999-09-15 2001-11-13 Neil David Glossop Method and system to facilitate image guided surgery
US6330356B1 (en) 1999-09-29 2001-12-11 Rockwell Science Center Llc Dynamic visual registration of a 3-D object with a graphical model
DE19946948A1 (en) 1999-09-30 2001-04-05 Philips Corp Intellectual Pty Method and arrangement for determining the position of a medical instrument
US6544041B1 (en) 1999-10-06 2003-04-08 Fonar Corporation Simulator for surgical procedures
US8644907B2 (en) 1999-10-28 2014-02-04 Medtronic Navigaton, Inc. Method and apparatus for surgical navigation
US7366562B2 (en) 2003-10-17 2008-04-29 Medtronic Navigation, Inc. Method and apparatus for surgical navigation
US6381485B1 (en) 1999-10-28 2002-04-30 Surgical Navigation Technologies, Inc. Registration of human anatomy integrated for electromagnetic localization
US8239001B2 (en) 2003-10-17 2012-08-07 Medtronic Navigation, Inc. Method and apparatus for surgical navigation
US6379302B1 (en) 1999-10-28 2002-04-30 Surgical Navigation Technologies Inc. Navigation information overlay onto ultrasound imagery
US6235038B1 (en) 1999-10-28 2001-05-22 Medtronic Surgical Navigation Technologies System for translation of electromagnetic and optical localization systems
DE19957082B4 (en) 1999-11-28 2004-08-26 Siemens Ag Method for examining an area of the body performing a periodic movement
US6442417B1 (en) 1999-11-29 2002-08-27 The Board Of Trustees Of The Leland Stanford Junior University Method and apparatus for transforming view orientations in image-guided surgery
SE515683C2 (en) 1999-12-20 2001-09-24 Jan A G Willen Device for compression of the throat pillar for medical image acquisition purposes
DE10000937B4 (en) 2000-01-12 2006-02-23 Brainlab Ag Intraoperative navigation update
US6898303B2 (en) 2000-01-18 2005-05-24 Arch Development Corporation Method, system and computer readable medium for the two-dimensional and three-dimensional detection of lesions in computed tomography scans
CA2398967A1 (en) 2000-02-01 2001-08-09 Albert C. Lardo Magnetic resonance imaging transseptal needle antenna
WO2001064124A1 (en) 2000-03-01 2001-09-07 Surgical Navigation Technologies, Inc. Multiple cannula image guided tool for image guided procedures
US6615155B2 (en) 2000-03-09 2003-09-02 Super Dimension Ltd. Object tracking using a single sensor or a pair of sensors
US6535756B1 (en) 2000-04-07 2003-03-18 Surgical Navigation Technologies, Inc. Trajectory storage apparatus and method for surgical navigation system
AU2001240413A1 (en) 2000-04-10 2001-10-23 2C3D S.A. Medical device for positioning data on intraoperative images
US6519575B1 (en) * 2000-04-24 2003-02-11 General Electric Company System and method for classifying unknown data patterns in multi-variate feature space
US6856826B2 (en) 2000-04-28 2005-02-15 Ge Medical Systems Global Technology Company, Llc Fluoroscopic tracking and visualization system
US6484049B1 (en) 2000-04-28 2002-11-19 Ge Medical Systems Global Technology Company, Llc Fluoroscopic tracking and visualization system
US6856827B2 (en) 2000-04-28 2005-02-15 Ge Medical Systems Global Technology Company, Llc Fluoroscopic tracking and visualization system
DE50000359D1 (en) 2000-05-09 2002-09-12 Brainlab Ag Method for registering a patient data record from an imaging method in navigation-assisted surgical interventions by means of X-ray image assignment
WO2001093745A2 (en) 2000-06-06 2001-12-13 The Research Foundation Of State University Of New York Computer aided visualization, fusion and treatment planning
US6478802B2 (en) 2000-06-09 2002-11-12 Ge Medical Systems Global Technology Company, Llc Method and apparatus for display of an image guided drill bit
US6782287B2 (en) 2000-06-27 2004-08-24 The Board Of Trustees Of The Leland Stanford Junior University Method and apparatus for tracking a medical instrument based on image registration
WO2002000093A2 (en) 2000-06-27 2002-01-03 Insightec-Image Guided Treatment Ltd. Registration of target object images to stored image data
US6717092B2 (en) 2000-08-11 2004-04-06 Pentax Corporation Method of manufacturing treatment instrument of endoscope
CA2420676C (en) 2000-08-23 2010-07-06 Micronix Pty. Ltd. Catheter locator apparatus and method of use
US6823207B1 (en) 2000-08-26 2004-11-23 Ge Medical Systems Global Technology Company, Llc Integrated fluoroscopic surgical navigation and imaging workstation with command protocol
JP4822634B2 (en) 2000-08-31 2011-11-24 シーメンス アクチエンゲゼルシヤフト A method for obtaining coordinate transformation for guidance of an object
US6674833B2 (en) 2000-09-07 2004-01-06 Cbyon, Inc. Virtual fluoroscopic system and method
US6907281B2 (en) 2000-09-07 2005-06-14 Ge Medical Systems Fast mapping of volumetric density data onto a two-dimensional screen
WO2002019936A2 (en) 2000-09-07 2002-03-14 Cbyon, Inc. Virtual fluoroscopic system and method
US6714810B2 (en) 2000-09-07 2004-03-30 Cbyon, Inc. Fluoroscopic registration system and method
US7225012B1 (en) 2000-09-18 2007-05-29 The Johns Hopkins University Methods and systems for image-guided surgical interventions
JP2004513684A (en) 2000-09-23 2004-05-13 ザ ボード オブ トラスティーズ オブ ザ リーランド スタンフォード ジュニア ユニバーシティ Endoscope targeting method and system
US6493574B1 (en) 2000-09-28 2002-12-10 Koninklijke Philips Electronics, N.V. Calibration phantom and recognition algorithm for automatic coordinate transformation in diagnostic imaging
WO2002026135A1 (en) 2000-09-29 2002-04-04 Ge Medical Systems Global Technology Company, Llc Phase-driven multisector reconstruction for multislice helical ct imaging
DE10055564A1 (en) 2000-11-09 2002-06-06 Siemens Ag Device for recognizing a pneumothorax with a thorax MR exposure has an evaluatory device to segment the thorax and its surrounding area with an MR signal matching a noise signal in air and to detect exhaled zones between lungs and thorax.
US6925200B2 (en) 2000-11-22 2005-08-02 R2 Technology, Inc. Graphical user interface for display of anatomical information
US6690960B2 (en) 2000-12-21 2004-02-10 David T. Chen Video-based surgical targeting system
US6666579B2 (en) 2000-12-28 2003-12-23 Ge Medical Systems Global Technology Company, Llc Method and apparatus for obtaining and displaying computed tomography images using a fluoroscopy imaging system
WO2002086797A1 (en) 2001-03-06 2002-10-31 The John Hopkins University School Of Medicine Simulation method for designing customized medical devices
US6473032B1 (en) 2001-03-18 2002-10-29 Trimble Navigation, Ltd Network of non-cooperative integrated pseudolite/satellite base station transmitters
US7605826B2 (en) * 2001-03-27 2009-10-20 Siemens Corporate Research, Inc. Augmented reality guided instrument positioning with depth determining graphics
US6785571B2 (en) 2001-03-30 2004-08-31 Neil David Glossop Device and method for registering a position sensor in an anatomical body
USD466609S1 (en) 2001-03-30 2002-12-03 Neil David Glossop Tracking device
US6807439B2 (en) 2001-04-03 2004-10-19 Medtronic, Inc. System and method for detecting dislodgement of an implantable medical device
AU2002307150A1 (en) 2001-04-06 2002-10-21 Steven Solomon Cardiological mapping and navigation system
US20040152974A1 (en) 2001-04-06 2004-08-05 Stephen Solomon Cardiology mapping and navigation system
US6455182B1 (en) 2001-05-09 2002-09-24 Utc Fuel Cells, Llc Shift converter having an improved catalyst composition, and method for its use
ATE235187T1 (en) 2001-05-22 2003-04-15 Brainlab Ag X-RAY IMAGE REGISTRATION DEVICE WITH A MEDICAL NAVIGATION SYSTEM
US6690386B2 (en) * 2001-05-31 2004-02-10 Dynapel Systems, Inc. Medical image display system
US6636757B1 (en) 2001-06-04 2003-10-21 Surgical Navigation Technologies, Inc. Method and apparatus for electromagnetic navigation of a surgical probe near a metal object
US6992477B2 (en) 2001-06-15 2006-01-31 Biosense, Inc. Medical device with position sensor having core with high permeability material for determining location coordinates of a portion of the medical device
US6584339B2 (en) 2001-06-27 2003-06-24 Vanderbilt University Method and apparatus for collecting and processing physical space data for use while performing image-guided surgery
US7209779B2 (en) 2001-07-17 2007-04-24 Accuimage Diagnostics Corp. Methods and software for retrospectively gating a set of images
DE10136709B4 (en) 2001-07-27 2004-09-02 Siemens Ag Device for performing surgical interventions and method for displaying image information during such an intervention on a patient
DE10137170B4 (en) 2001-07-31 2005-04-28 Siemens Ag Method for triggering respiration in an imaging process
DE10161160A1 (en) 2001-12-13 2003-06-18 Tecmedic Gmbh Method for determining the orientation and relative position of a medical instrument in relation to a structure in the body of a breathing person or animal
EP1321105B1 (en) 2001-12-18 2003-08-20 BrainLAB AG Superposition of patient X-ray or scanning imaging data and superficial video images
USD466610S1 (en) 2002-01-10 2002-12-03 Julia L. Ashton Eye patch for treatment of amblyopia
DE10201644A1 (en) 2002-01-17 2003-08-07 Siemens Ag Registration procedure for projective intraoperative 3D imaging
US20030220557A1 (en) 2002-03-01 2003-11-27 Kevin Cleary Image guided liver interventions based on magnetic tracking of internal organ motion
US7499743B2 (en) 2002-03-15 2009-03-03 General Electric Company Method and system for registration of 3D images within an interventional system
US6774624B2 (en) 2002-03-27 2004-08-10 Ge Medical Systems Global Technology Company, Llc Magnetic tracking system
JP2005521502A (en) 2002-04-03 2005-07-21 セガミ エス.エー.アール.エル. Overlay of chest and abdominal image modalities
US7998062B2 (en) 2004-03-29 2011-08-16 Superdimension, Ltd. Endoscope structures and techniques for navigating to a target in branched structure
AU2003223085A1 (en) 2002-04-17 2003-10-27 Super Dimension Ltd. Endoscope structures and techniques for navigating to a target in branched structure
US7015907B2 (en) 2002-04-18 2006-03-21 Siemens Corporate Research, Inc. Segmentation of 3D medical structures using robust ray propagation
US7826883B2 (en) 2002-04-23 2010-11-02 Devicor Medical Products, Inc. Localization mechanism for an MRI compatible biopsy device
US7011507B2 (en) 2002-06-04 2006-03-14 Seiko Epson Corporation Positive displacement pump with a combined inertance value of the inlet flow path smaller than that of the outlet flow path
US7117026B2 (en) * 2002-06-12 2006-10-03 Koninklijke Philips Electronics N.V. Physiological model based non-rigid image registration
US7769427B2 (en) 2002-07-16 2010-08-03 Magnetics, Inc. Apparatus and method for catheter guidance control and imaging
US7720522B2 (en) 2003-02-25 2010-05-18 Medtronic, Inc. Fiducial marker devices, tools, and methods
CN100364479C (en) 2002-07-31 2008-01-30 奥林巴斯株式会社 Endoscope
US6892090B2 (en) 2002-08-19 2005-05-10 Surgical Navigation Technologies, Inc. Method and apparatus for virtual endoscopy
JP4248822B2 (en) 2002-08-29 2009-04-02 ジーイー・メディカル・システムズ・グローバル・テクノロジー・カンパニー・エルエルシー Fiber rendering method and fiber rendering device
US20040049121A1 (en) 2002-09-06 2004-03-11 Uri Yaron Positioning system for neurological procedures in the brain
US6899672B2 (en) 2002-11-08 2005-05-31 Scimed Life Systems, Inc. Endoscopic imaging system including removable deflection device
US7260426B2 (en) 2002-11-12 2007-08-21 Accuray Incorporated Method and apparatus for tracking an internal target region without an implanted fiducial
AU2003287720A1 (en) 2002-11-14 2004-06-15 General Electric Medical Systems Global Technology Company, Llc Interchangeable localizing devices for use with tracking systems
US7599730B2 (en) 2002-11-19 2009-10-06 Medtronic Navigation, Inc. Navigation system for cardiac therapies
US7697972B2 (en) * 2002-11-19 2010-04-13 Medtronic Navigation, Inc. Navigation system for cardiac therapies
US7729743B2 (en) 2003-01-07 2010-06-01 Koninklijke Philips Electronics N.V. Method and arrangement for tracking a medical instrument
US7505809B2 (en) 2003-01-13 2009-03-17 Mediguide Ltd. Method and system for registering a first image with a second image relative to the body of a patient
US7660623B2 (en) 2003-01-30 2010-02-09 Medtronic Navigation, Inc. Six degree of freedom alignment display for medical procedures
US7270634B2 (en) 2003-03-27 2007-09-18 Koninklijke Philips Electronics N.V. Guidance of invasive medical devices by high resolution three dimensional ultrasonic imaging
US20040199052A1 (en) * 2003-04-01 2004-10-07 Scimed Life Systems, Inc. Endoscopic imaging system
SE526438C2 (en) 2003-04-01 2005-09-13 Sectra Imtec Ab Method and system for measuring in a dynamic sequence of medical images
ATE296577T1 (en) 2003-04-04 2005-06-15 Brainlab Ag PERSPECTIVE REGISTRATION AND VISUALIZATION OF INTERNAL BODY AREAS
US7570987B2 (en) 2003-04-04 2009-08-04 Brainlab Ag Perspective registration and visualization of internal areas of the body
US7171257B2 (en) 2003-06-11 2007-01-30 Accuray Incorporated Apparatus and method for radiosurgery
US7158754B2 (en) 2003-07-01 2007-01-02 Ge Medical Systems Global Technology Company, Llc Electromagnetic tracking system and method using a single-coil transmitter
US7822461B2 (en) * 2003-07-11 2010-10-26 Siemens Medical Solutions Usa, Inc. System and method for endoscopic path planning
US7398116B2 (en) 2003-08-11 2008-07-08 Veran Medical Technologies, Inc. Methods, apparatuses, and systems useful in conducting image guided interventions
EP2316328B1 (en) 2003-09-15 2012-05-09 Super Dimension Ltd. Wrap-around holding device for use with bronchoscopes
WO2005025635A2 (en) 2003-09-15 2005-03-24 Super Dimension Ltd. System of accessories for use with bronchoscopes
US20050187482A1 (en) 2003-09-16 2005-08-25 O'brien David Implantable wireless sensor
US8354837B2 (en) 2003-09-24 2013-01-15 Ge Medical Systems Global Technology Company Llc System and method for electromagnetic tracking operable with multiple coil architectures
US7840253B2 (en) 2003-10-17 2010-11-23 Medtronic Navigation, Inc. Method and apparatus for surgical navigation
EP1680024A2 (en) * 2003-10-21 2006-07-19 The Board Of Trustees Of The Leland Stanford Junior University Systems and methods for intraoperative targetting
US20050085718A1 (en) 2003-10-21 2005-04-21 Ramin Shahidi Systems and methods for intraoperative targetting
JP3820244B2 (en) 2003-10-29 2006-09-13 オリンパス株式会社 Insertion support system
EP2245983A3 (en) 2003-10-31 2013-12-25 Olympus Corporation Insertion support system
US7153297B2 (en) 2003-11-03 2006-12-26 Ge Medical Systems Global Technolgoy Company, Llc Universal attachment mechanism for attaching a tracking device to an instrument
US7015859B2 (en) 2003-11-14 2006-03-21 General Electric Company Electromagnetic tracking system and method using a three-coil wireless transmitter
EP1691666B1 (en) 2003-12-12 2012-05-30 University of Washington Catheterscope 3d guidance and interface system
US8126224B2 (en) 2004-02-03 2012-02-28 Ge Medical Systems Global Technology Company, Llc Method and apparatus for instrument tracking on a scrolling series of 2D fluoroscopic images
US20080125760A1 (en) 2004-02-09 2008-05-29 Super Dimension Ltd. Directional Anchoring Mechanism, Method and Applications Thereof
US8764725B2 (en) 2004-02-09 2014-07-01 Covidien Lp Directional anchoring mechanism, method and applications thereof
US20080021297A1 (en) 2004-02-10 2008-01-24 Koninklijke Philips Electronic, N.V. Method,a System for Generating a Spatial Roadmap for an Interventional Device and Quality Control System for Guarding the Spatial Accuracy Thereof
EP1716538A1 (en) * 2004-02-13 2006-11-02 Philips Intellectual Property & Standards GmbH Apparatus and method for registering images of a structured object
ATE523141T1 (en) 2004-02-17 2011-09-15 Philips Electronics Ltd METHOD AND DEVICE FOR REGISTRATION, VERIFICATION OF AND REFERENCE TO BODY ORGANS
WO2005084571A1 (en) 2004-03-03 2005-09-15 Deutsches Krebsforschungszentrum Stiftung des öffentlichen Rechts Incremental real time recording of tracked instruments in tubular organ structures inside the human body
JP4755638B2 (en) 2004-03-05 2011-08-24 ハンセン メディカル,インク. Robotic guide catheter system
US7657298B2 (en) 2004-03-11 2010-02-02 Stryker Leibinger Gmbh & Co. Kg System, device, and method for determining a position of an object
EP1741042A2 (en) 2004-04-16 2007-01-10 Philips Intellectual Property & Standards GmbH Data set visualization
US9089258B2 (en) 2004-04-21 2015-07-28 Acclarent, Inc. Endoscopic methods and devices for transnasal procedures
US20060063973A1 (en) * 2004-04-21 2006-03-23 Acclarent, Inc. Methods and apparatus for treating disorders of the ear, nose and throat
DE102004022902B4 (en) 2004-05-10 2006-07-06 Siemens Ag Medical imaging and processing method, computed tomography device, workstation and computer program product
EP1761901A1 (en) 2004-05-17 2007-03-14 Koninklijke Philips Electronics N.V. A medical imaging system for mapping a structure in a patient's body
US20060041181A1 (en) * 2004-06-04 2006-02-23 Viswanathan Raju R User interface for remote control of medical devices
US20050288574A1 (en) 2004-06-23 2005-12-29 Thornton Thomas M Wireless (disposable) fiducial based registration and EM distoration based surface registration
WO2006002396A2 (en) 2004-06-24 2006-01-05 Calypso Medical Technologies, Inc. Radiation therapy of the lungs using leadless markers
DE102004030836A1 (en) 2004-06-25 2006-01-26 Siemens Ag Process for the image representation of a medical instrument, in particular a catheter, introduced into a region of examination of a patient that moves rhythmically or arrhythmically
US20060004281A1 (en) 2004-06-30 2006-01-05 Michael Saracen Vest-based respiration monitoring system
CA2573140A1 (en) 2004-07-09 2006-01-26 Advanced Plastics Technologies Luxembourg S.A. Coating process and apparatus for forming coated articles
US7634122B2 (en) 2004-08-25 2009-12-15 Brainlab Ag Registering intraoperative scans
DE502004009087D1 (en) 2004-08-25 2009-04-16 Brainlab Ag Registration of intraoperative scans
US7454048B2 (en) 2004-08-27 2008-11-18 General Electric Company Methods and systems for motion correction in an ultrasound volumetric data set
DE502004003843D1 (en) 2004-08-31 2007-06-28 Brainlab Ag Fluoroscopic verification
US7377083B2 (en) 2004-09-14 2008-05-27 Con-Tie, Inc. Clip connector and method
US20060063998A1 (en) 2004-09-21 2006-03-23 Von Jako Ron Navigation and visualization of an access needle system
US8233681B2 (en) 2004-09-24 2012-07-31 The University Of North Carolina At Chapel Hill Methods, systems, and computer program products for hierarchical registration between a blood vessel and tissue surface model for a subject and a blood vessel and tissue surface image for the subject
US8989349B2 (en) 2004-09-30 2015-03-24 Accuray, Inc. Dynamic tracking of moving targets
US8180432B2 (en) 2004-10-02 2012-05-15 Accuray Incorporated Correlation model selection for internal target movement
US8515527B2 (en) 2004-10-13 2013-08-20 General Electric Company Method and apparatus for registering 3D models of anatomical regions of a heart and a tracking system with projection images of an interventional fluoroscopic system
US7636595B2 (en) 2004-10-28 2009-12-22 Medtronic Navigation, Inc. Method and apparatus for calibrating non-linear instruments
US7751868B2 (en) 2004-11-12 2010-07-06 Philips Electronics Ltd Integrated skin-mounted multifunction device for use in image-guided surgery
US7805269B2 (en) 2004-11-12 2010-09-28 Philips Electronics Ltd Device and method for ensuring the accuracy of a tracking device in a volume
US9002432B2 (en) * 2004-11-15 2015-04-07 Brainlab Ag Method and device for calibrating a medical instrument
US7984467B2 (en) 2004-11-23 2011-07-19 Stmicroelectronics, Inc. Method and system for providing an electronic program guide
DE102004058122A1 (en) 2004-12-02 2006-07-13 Siemens Ag Medical image registration aid for landmarks by computerized and photon emission tomographies, comprises permeable radioactive substance is filled with the emission tomography as radiation permeable containers, a belt and patient body bowl
US20060142798A1 (en) 2004-12-27 2006-06-29 Holman Thomas J Device and method for closing an opening in a body cavity or lumen
CA2588002A1 (en) 2005-01-18 2006-07-27 Traxtal Inc. Method and apparatus for guiding an instrument to a target in the lung
EP1838215B1 (en) 2005-01-18 2012-08-01 Philips Electronics LTD Electromagnetically tracked k-wire device
EP1845835B1 (en) 2005-01-27 2014-11-19 Covidien LP Endoscope with miniature imaging arrangement
GB2423369A (en) 2005-02-22 2006-08-23 Depuy Int Ltd A position sensing probe for computer assisted surgery
US8298224B2 (en) 2005-04-21 2012-10-30 Asthmatx, Inc. Control methods and devices for energy delivery
US7517318B2 (en) * 2005-04-26 2009-04-14 Biosense Webster, Inc. Registration of electro-anatomical map with pre-acquired image using ultrasound
US7831293B2 (en) 2005-05-10 2010-11-09 Advanced Clinical Solutions, Inc. Method of defining a biological target for treatment
US7756563B2 (en) 2005-05-23 2010-07-13 The Penn State Research Foundation Guidance method based on 3D-2D pose estimation and 3D-CT registration with application to live bronchoscopy
US7889905B2 (en) 2005-05-23 2011-02-15 The Penn State Research Foundation Fast 3D-2D image registration method with application to continuously guided endoscopy
WO2007002079A2 (en) 2005-06-21 2007-01-04 Traxtal Inc. System, method and apparatus for navigated therapy and diagnosis
US8406851B2 (en) 2005-08-11 2013-03-26 Accuray Inc. Patient tracking using a virtual image
WO2007025081A2 (en) * 2005-08-24 2007-03-01 Traxtal Inc. System, method and devices for navigated flexible endoscopy
US20070066881A1 (en) * 2005-09-13 2007-03-22 Edwards Jerome R Apparatus and method for image guided accuracy verification
WO2007033206A2 (en) 2005-09-13 2007-03-22 Veran Medical Technologies, Inc. Apparatus and method for image guided accuracy verification
DE102005044033B4 (en) 2005-09-14 2010-11-18 Cas Innovations Gmbh & Co. Kg Positioning system for percutaneous interventions
US7835784B2 (en) 2005-09-21 2010-11-16 Medtronic Navigation, Inc. Method and apparatus for positioning a reference frame
US7684647B2 (en) 2005-11-16 2010-03-23 Accuray Incorporated Rigid body tracking for radiosurgery
US20070129629A1 (en) 2005-11-23 2007-06-07 Beauregard Gerald L System and method for surgical navigation
US20070167744A1 (en) 2005-11-23 2007-07-19 General Electric Company System and method for surgical navigation cross-reference to related applications
US20070167714A1 (en) 2005-12-07 2007-07-19 Siemens Corporate Research, Inc. System and Method For Bronchoscopic Navigational Assistance
US20070167784A1 (en) * 2005-12-13 2007-07-19 Raj Shekhar Real-time Elastic Registration to Determine Temporal Evolution of Internal Tissues for Image-Guided Interventions
US20070159337A1 (en) * 2006-01-12 2007-07-12 Sdgi Holdings, Inc. Modular RFID tag
US20070225595A1 (en) 2006-01-17 2007-09-27 Don Malackowski Hybrid navigation system for tracking the position of body tissue
US8184367B2 (en) * 2006-02-15 2012-05-22 University Of Central Florida Research Foundation Dynamically focused optical instrument
US20070203396A1 (en) * 2006-02-28 2007-08-30 Mccutcheon John G Endoscopic Tool
US8016749B2 (en) 2006-03-21 2011-09-13 Boston Scientific Scimed, Inc. Vision catheter having electromechanical navigation
US8926499B2 (en) 2006-04-17 2015-01-06 Boston Scientific Scimed, Inc. Catheter for use with an endoscope
EP2051631A4 (en) * 2006-06-30 2013-06-05 Broncus Tech Inc Airway bypass site selection and treatment planning
US8248414B2 (en) 2006-09-18 2012-08-21 Stryker Corporation Multi-dimensional navigation of endoscopic video
US8248413B2 (en) 2006-09-18 2012-08-21 Stryker Corporation Visual navigation system for endoscopic surgery
TWI450387B (en) 2006-09-29 2014-08-21 Semiconductor Energy Lab Method for manufacturing semiconductor device
US9129359B2 (en) 2006-11-10 2015-09-08 Covidien Lp Adaptive navigation technique for navigating a catheter through a body channel or cavity
US20080132757A1 (en) * 2006-12-01 2008-06-05 General Electric Company System and Method for Performing Minimally Invasive Surgery Using a Multi-Channel Catheter
WO2008085712A1 (en) * 2007-01-03 2008-07-17 Boston Scientific Limited Method and apparatus for biliary access and stone retrieval
US20080167639A1 (en) 2007-01-08 2008-07-10 Superdimension Ltd. Methods for localized intra-body treatment of tissue
US8374673B2 (en) * 2007-01-25 2013-02-12 Warsaw Orthopedic, Inc. Integrated surgical navigational and neuromonitoring system having automated surgical assistance and control
US20090156895A1 (en) 2007-01-31 2009-06-18 The Penn State Research Foundation Precise endoscopic planning and visualization
US8672836B2 (en) 2007-01-31 2014-03-18 The Penn State Research Foundation Method and apparatus for continuous guidance of endoscopy
WO2008111070A2 (en) * 2007-03-12 2008-09-18 David Tolkowsky Devices and methods for performing medical procedures in tree-like luminal structures
US9278203B2 (en) 2007-03-26 2016-03-08 Covidien Lp CT-enhanced fluoroscopy
EP2486881A3 (en) * 2007-04-18 2012-09-12 Access Scientific, Inc. Access device
US8433159B1 (en) * 2007-05-16 2013-04-30 Varian Medical Systems International Ag Compressed target movement model using interpolation
US8428690B2 (en) 2007-05-16 2013-04-23 General Electric Company Intracardiac echocardiography image reconstruction in combination with position tracking system
WO2008155738A2 (en) * 2007-06-21 2008-12-24 Koninklijke Philips Electronics N.V. Adjusting acquisition protocols for dynamic medical imaging using dynamic models
US10292619B2 (en) * 2007-07-09 2019-05-21 Covidien Lp Patient breathing modeling
US8905920B2 (en) 2007-09-27 2014-12-09 Covidien Lp Bronchoscope adapter and method
US7933380B2 (en) * 2007-09-28 2011-04-26 Varian Medical Systems International Ag Radiation systems and methods using deformable image registration
US7876943B2 (en) * 2007-10-03 2011-01-25 Siemens Medical Solutions Usa, Inc. System and method for lesion detection using locally adjustable priors
US8197464B2 (en) 2007-10-19 2012-06-12 Cordis Corporation Deflecting guide catheter for use in a minimally invasive medical procedure for the treatment of mitral valve regurgitation
US20110093243A1 (en) * 2007-11-14 2011-04-21 Tawhai Merryn H Method for multi-scale meshing of branching biological structures
US8137336B2 (en) 2008-06-27 2012-03-20 Boston Scientific Scimed, Inc. Steerable medical device
WO2009097463A1 (en) 2008-01-29 2009-08-06 Superdimension, Ltd. Target identification tool for intra body localization
US8343041B2 (en) * 2008-05-19 2013-01-01 Boston Scientific Scimed, Inc. Integrated locking device with passive sealing
ES2511033T3 (en) 2008-02-12 2014-10-22 Covidien Lp Controlled Perspective Orientation System
EP2244633A4 (en) * 2008-02-14 2013-10-23 Penn State Res Found Medical image reporting system and method
US8219179B2 (en) * 2008-03-06 2012-07-10 Vida Diagnostics, Inc. Systems and methods for navigation within a branched structure of a body
US9575140B2 (en) 2008-04-03 2017-02-21 Covidien Lp Magnetic interference detection system and method
WO2009132002A1 (en) * 2008-04-21 2009-10-29 University Of South Florida Method and apparatus for pulmonary ventilation imaging using local volume changes
US8218846B2 (en) 2008-05-15 2012-07-10 Superdimension, Ltd. Automatic pathway and waypoint generation and navigation method
JP5372406B2 (en) 2008-05-23 2013-12-18 オリンパスメディカルシステムズ株式会社 Medical equipment
JP5372407B2 (en) * 2008-05-23 2013-12-18 オリンパスメディカルシステムズ株式会社 Medical equipment
US8473032B2 (en) 2008-06-03 2013-06-25 Superdimension, Ltd. Feature-based registration method
US8218847B2 (en) 2008-06-06 2012-07-10 Superdimension, Ltd. Hybrid registration method
US20100030063A1 (en) * 2008-07-31 2010-02-04 Medtronic, Inc. System and method for tracking an instrument
RU2011120186A (en) * 2008-10-20 2012-11-27 Конинклейке Филипс Электроникс, Н.В. METHOD AND SYSTEM OF LOCALIZATION BASED ON IMAGES
US10004387B2 (en) * 2009-03-26 2018-06-26 Intuitive Surgical Operations, Inc. Method and system for assisting an operator in endoscopic navigation
US8611984B2 (en) 2009-04-08 2013-12-17 Covidien Lp Locatable catheter
US9498192B2 (en) 2009-08-03 2016-11-22 Dune Medical Devices Ltd. Surgical tool
JP5457841B2 (en) * 2010-01-07 2014-04-02 株式会社東芝 Medical image processing apparatus and medical image processing program
CN102883651B (en) * 2010-01-28 2016-04-27 宾夕法尼亚州研究基金会 Can be applicable to the global registration system and method based on image that bronchoscope guides
EP3407261A3 (en) 2010-02-01 2019-02-20 Covidien LP Region-growing algorithm
EP2377457B1 (en) 2010-02-22 2016-07-27 Olympus Corporation Medical apparatus
WO2011152094A1 (en) 2010-06-02 2011-12-08 オリンパスメディカルシステムズ株式会社 Medical apparatus and method for controlling the medical apparatus
EP3659490A1 (en) 2010-08-20 2020-06-03 Veran Medical Technologies, Inc. Apparatus and method for four dimensional soft tissue navigation
US8468003B2 (en) 2010-08-23 2013-06-18 Broncus Medical, Inc. Automated fiducial marker planning system and related methods
US9218179B2 (en) 2011-07-15 2015-12-22 Integware, Inc. Software automated data and data model upgrade system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7302295B2 (en) * 2003-09-18 2007-11-27 Cardiac Pacemakers, Inc. Method and apparatus for mimicking respiratory sinus arrhythmia with cardiac pacing controlled via external respiration therapy device
US20070167738A1 (en) * 2004-01-20 2007-07-19 Koninklijke Philips Electronics N.V. Device and method for navigating a catheter
US20110311115A1 (en) * 2010-06-18 2011-12-22 Siemens Corporation Method and system for validating image registration
US20120288173A1 (en) * 2011-05-13 2012-11-15 Broncus Technologies, Inc. Surgical assistance planning method using lung motion analysis

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Torres, "How a CPU works", https://www.hardwaresecrets.com/how-a-cpu-works/2/, Sep. 26, 2005 *

Cited By (157)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11628039B2 (en) 2006-02-16 2023-04-18 Globus Medical Inc. Surgical tool systems and methods
US10893912B2 (en) 2006-02-16 2021-01-19 Globus Medical Inc. Surgical tool systems and methods
US9078685B2 (en) 2007-02-16 2015-07-14 Globus Medical, Inc. Method and system for performing invasive medical procedures using a surgical robot
US9782229B2 (en) 2007-02-16 2017-10-10 Globus Medical, Inc. Surgical robot platform
US10172678B2 (en) 2007-02-16 2019-01-08 Globus Medical, Inc. Method and system for performing invasive medical procedures using a surgical robot
US20140316256A1 (en) * 2011-02-03 2014-10-23 Medtronic, Inc. Display Of An Acquired Cine Loop For Procedure Navigation
US11744648B2 (en) 2011-04-01 2023-09-05 Globus Medicall, Inc. Robotic system and method for spinal and other surgeries
US11202681B2 (en) 2011-04-01 2021-12-21 Globus Medical, Inc. Robotic system and method for spinal and other surgeries
US10660712B2 (en) 2011-04-01 2020-05-26 Globus Medical Inc. Robotic system and method for spinal and other surgeries
US8900131B2 (en) * 2011-05-13 2014-12-02 Intuitive Surgical Operations, Inc. Medical system providing dynamic registration of a model of an anatomical structure for image-guided surgery
US20120289777A1 (en) * 2011-05-13 2012-11-15 Intuitive Surgical Operations, Inc. Medical system providing dynamic registration of a model of an anatomical structure for image-guided surgery
US11819283B2 (en) 2012-06-21 2023-11-21 Globus Medical Inc. Systems and methods related to robotic guidance in surgery
US10835326B2 (en) 2012-06-21 2020-11-17 Globus Medical Inc. Surgical robot platform
US10136954B2 (en) 2012-06-21 2018-11-27 Globus Medical, Inc. Surgical tool systems and method
US11116576B2 (en) 2012-06-21 2021-09-14 Globus Medical Inc. Dynamic reference arrays and methods of use
US10231791B2 (en) 2012-06-21 2019-03-19 Globus Medical, Inc. Infrared signal based position recognition system for use with a robot-assisted surgery
US11109922B2 (en) 2012-06-21 2021-09-07 Globus Medical, Inc. Surgical tool systems and method
US10357184B2 (en) 2012-06-21 2019-07-23 Globus Medical, Inc. Surgical tool systems and method
US11607149B2 (en) 2012-06-21 2023-03-21 Globus Medical Inc. Surgical tool systems and method
US10485617B2 (en) 2012-06-21 2019-11-26 Globus Medical, Inc. Surgical robot platform
US11911225B2 (en) 2012-06-21 2024-02-27 Globus Medical Inc. Method and system for improving 2D-3D registration convergence
US10531927B2 (en) 2012-06-21 2020-01-14 Globus Medical, Inc. Methods for performing invasive medical procedures using a surgical robot
US11793570B2 (en) 2012-06-21 2023-10-24 Globus Medical Inc. Surgical robotic automation with tracking markers
US11819365B2 (en) 2012-06-21 2023-11-21 Globus Medical, Inc. System and method for measuring depth of instrumentation
US11399900B2 (en) 2012-06-21 2022-08-02 Globus Medical, Inc. Robotic systems providing co-registration using natural fiducials and related methods
US10639112B2 (en) 2012-06-21 2020-05-05 Globus Medical, Inc. Infrared signal based position recognition system for use with a robot-assisted surgery
US11395706B2 (en) 2012-06-21 2022-07-26 Globus Medical Inc. Surgical robot platform
US11684433B2 (en) 2012-06-21 2023-06-27 Globus Medical Inc. Surgical tool systems and method
US11135022B2 (en) 2012-06-21 2021-10-05 Globus Medical, Inc. Surgical robot platform
US11103320B2 (en) 2012-06-21 2021-08-31 Globus Medical, Inc. Infrared signal based position recognition system for use with a robot-assisted surgery
US11103317B2 (en) 2012-06-21 2021-08-31 Globus Medical, Inc. Surgical robot platform
US11857266B2 (en) 2012-06-21 2024-01-02 Globus Medical, Inc. System for a surveillance marker in robotic-assisted surgery
US11191598B2 (en) 2012-06-21 2021-12-07 Globus Medical, Inc. Surgical robot platform
US11690687B2 (en) 2012-06-21 2023-07-04 Globus Medical Inc. Methods for performing medical procedures using a surgical robot
US11744657B2 (en) 2012-06-21 2023-09-05 Globus Medical, Inc. Infrared signal based position recognition system for use with a robot-assisted surgery
US10835328B2 (en) 2012-06-21 2020-11-17 Globus Medical, Inc. Surgical robot platform
US11857149B2 (en) 2012-06-21 2024-01-02 Globus Medical, Inc. Surgical robotic systems with target trajectory deviation monitoring and related methods
US11684437B2 (en) 2012-06-21 2023-06-27 Globus Medical Inc. Systems and methods for automatically changing an end-effector on a surgical robot
US11331153B2 (en) 2012-06-21 2022-05-17 Globus Medical, Inc. Surgical robot platform
US11684431B2 (en) 2012-06-21 2023-06-27 Globus Medical, Inc. Surgical robot platform
US11864839B2 (en) 2012-06-21 2024-01-09 Globus Medical Inc. Methods of adjusting a virtual implant and related surgical navigation systems
US10912617B2 (en) 2012-06-21 2021-02-09 Globus Medical, Inc. Surgical robot platform
US11864745B2 (en) 2012-06-21 2024-01-09 Globus Medical, Inc. Surgical robotic system with retractor
US11253327B2 (en) 2012-06-21 2022-02-22 Globus Medical, Inc. Systems and methods for automatically changing an end-effector on a surgical robot
US11317971B2 (en) 2012-06-21 2022-05-03 Globus Medical, Inc. Systems and methods related to robotic guidance in surgery
US11298196B2 (en) 2012-06-21 2022-04-12 Globus Medical Inc. Surgical robotic automation with tracking markers and controlled tool advancement
US11026756B2 (en) 2012-06-21 2021-06-08 Globus Medical, Inc. Surgical robot platform
US11284949B2 (en) 2012-06-21 2022-03-29 Globus Medical, Inc. Surgical robot platform
US11045267B2 (en) 2012-06-21 2021-06-29 Globus Medical, Inc. Surgical robotic automation with tracking markers
US11896363B2 (en) 2013-03-15 2024-02-13 Globus Medical Inc. Surgical robot platform
US10699411B2 (en) * 2013-03-15 2020-06-30 Sunnybrook Research Institute Data display and processing algorithms for 3D imaging systems
US20180158190A1 (en) * 2013-03-15 2018-06-07 Conavi Medical Inc. Data display and processing algorithms for 3d imaging systems
US10813704B2 (en) 2013-10-04 2020-10-27 Kb Medical, Sa Apparatus and systems for precise guidance of surgical tools
US11737766B2 (en) 2014-01-15 2023-08-29 Globus Medical Inc. Notched apparatus for guidance of an insertable instrument along an axis during spinal surgery
US10939968B2 (en) 2014-02-11 2021-03-09 Globus Medical Inc. Sterile handle for controlling a robotic surgical system from a sterile field
US10828116B2 (en) 2014-04-24 2020-11-10 Kb Medical, Sa Surgical instrument holder for use with a robotic surgical system
US11793583B2 (en) 2014-04-24 2023-10-24 Globus Medical Inc. Surgical instrument holder for use with a robotic surgical system
US10292778B2 (en) 2014-04-24 2019-05-21 Globus Medical, Inc. Surgical instrument holder for use with a robotic surgical system
US11844635B2 (en) 2014-07-02 2023-12-19 Covidien Lp Alignment CT
CN106572834A (en) * 2014-07-02 2017-04-19 柯惠有限合伙公司 Alignment CT
WO2016004302A1 (en) * 2014-07-02 2016-01-07 Covidien Lp Alignment ct
WO2016004007A1 (en) * 2014-07-02 2016-01-07 Covidien Lp Intelligent display
US11484276B2 (en) 2014-07-02 2022-11-01 Covidien Lp Alignment CT
US10945742B2 (en) 2014-07-14 2021-03-16 Globus Medical Inc. Anti-skid surgical instrument for use in preparing holes in bone tissue
US10580217B2 (en) 2015-02-03 2020-03-03 Globus Medical, Inc. Surgeon head-mounted display apparatuses
US11062522B2 (en) 2015-02-03 2021-07-13 Global Medical Inc Surgeon head-mounted display apparatuses
US11266470B2 (en) 2015-02-18 2022-03-08 KB Medical SA Systems and methods for performing minimally invasive spinal surgery with a robotic surgical system using a percutaneous technique
CN104939908A (en) * 2015-06-08 2015-09-30 温州医科大学附属第一医院 Guiding assembly for ureteroscope operation
CN104939908B (en) * 2015-06-08 2017-11-10 温州医科大学附属第一医院 A kind of guidance set of Ureteroscopy
US11672622B2 (en) 2015-07-31 2023-06-13 Globus Medical, Inc. Robot arm and methods of use
US11337769B2 (en) 2015-07-31 2022-05-24 Globus Medical, Inc. Robot arm and methods of use
US10925681B2 (en) 2015-07-31 2021-02-23 Globus Medical Inc. Robot arm and methods of use
US10080615B2 (en) 2015-08-12 2018-09-25 Globus Medical, Inc. Devices and methods for temporary mounting of parts to bone
US10786313B2 (en) 2015-08-12 2020-09-29 Globus Medical, Inc. Devices and methods for temporary mounting of parts to bone
US11751950B2 (en) 2015-08-12 2023-09-12 Globus Medical Inc. Devices and methods for temporary mounting of parts to bone
US11872000B2 (en) 2015-08-31 2024-01-16 Globus Medical, Inc Robotic surgical systems and methods
US10973594B2 (en) 2015-09-14 2021-04-13 Globus Medical, Inc. Surgical robotic systems and methods thereof
US11066090B2 (en) 2015-10-13 2021-07-20 Globus Medical, Inc. Stabilizer wheel assembly and methods of use
US10569794B2 (en) 2015-10-13 2020-02-25 Globus Medical, Inc. Stabilizer wheel assembly and methods of use
US10849580B2 (en) 2016-02-03 2020-12-01 Globus Medical Inc. Portable medical imaging system
US10842453B2 (en) 2016-02-03 2020-11-24 Globus Medical, Inc. Portable medical imaging system
US10687779B2 (en) 2016-02-03 2020-06-23 Globus Medical, Inc. Portable medical imaging system with beam scanning collimator
US11883217B2 (en) 2016-02-03 2024-01-30 Globus Medical, Inc. Portable medical imaging system and method
US10117632B2 (en) 2016-02-03 2018-11-06 Globus Medical, Inc. Portable medical imaging system with beam scanning collimator
US11058378B2 (en) 2016-02-03 2021-07-13 Globus Medical, Inc. Portable medical imaging system
US10448910B2 (en) 2016-02-03 2019-10-22 Globus Medical, Inc. Portable medical imaging system
US11801022B2 (en) 2016-02-03 2023-10-31 Globus Medical, Inc. Portable medical imaging system
US11523784B2 (en) 2016-02-03 2022-12-13 Globus Medical, Inc. Portable medical imaging system
US11668588B2 (en) 2016-03-14 2023-06-06 Globus Medical Inc. Metal detector for detecting insertion of a surgical device into a hollow tube
US10866119B2 (en) 2016-03-14 2020-12-15 Globus Medical, Inc. Metal detector for detecting insertion of a surgical device into a hollow tube
US11920957B2 (en) 2016-03-14 2024-03-05 Globus Medical, Inc. Metal detector for detecting insertion of a surgical device into a hollow tube
US11779408B2 (en) 2017-01-18 2023-10-10 Globus Medical, Inc. Robotic navigation of robotic surgical systems
US11529195B2 (en) 2017-01-18 2022-12-20 Globus Medical Inc. Robotic navigation of robotic surgical systems
US11443441B2 (en) * 2017-02-24 2022-09-13 Brainlab Ag Deep inspiration breath-hold setup using x-ray imaging
US20190366124A1 (en) * 2017-02-24 2019-12-05 Brainlab Ag Deep inspiration breath-hold setup using x-ray imaging
US11813030B2 (en) 2017-03-16 2023-11-14 Globus Medical, Inc. Robotic navigation of robotic surgical systems
US11135015B2 (en) 2017-07-21 2021-10-05 Globus Medical, Inc. Robot surgical platform
US11771499B2 (en) 2017-07-21 2023-10-03 Globus Medical Inc. Robot surgical platform
US11253320B2 (en) 2017-07-21 2022-02-22 Globus Medical Inc. Robot surgical platform
US10675094B2 (en) 2017-07-21 2020-06-09 Globus Medical Inc. Robot surgical platform
US11357548B2 (en) 2017-11-09 2022-06-14 Globus Medical, Inc. Robotic rod benders and related mechanical and motor housings
US11794338B2 (en) 2017-11-09 2023-10-24 Globus Medical Inc. Robotic rod benders and related mechanical and motor housings
US10898252B2 (en) 2017-11-09 2021-01-26 Globus Medical, Inc. Surgical robotic systems for bending surgical rods, and related methods and devices
US11382666B2 (en) 2017-11-09 2022-07-12 Globus Medical Inc. Methods providing bend plans for surgical rods and related controllers and computer program products
US11786144B2 (en) 2017-11-10 2023-10-17 Globus Medical, Inc. Methods of selecting surgical implants and related devices
US11134862B2 (en) 2017-11-10 2021-10-05 Globus Medical, Inc. Methods of selecting surgical implants and related devices
US10646283B2 (en) 2018-02-19 2020-05-12 Globus Medical Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
US10573023B2 (en) 2018-04-09 2020-02-25 Globus Medical, Inc. Predictive visualization of medical imaging scanner component movement
US11100668B2 (en) 2018-04-09 2021-08-24 Globus Medical, Inc. Predictive visualization of medical imaging scanner component movement
US11694355B2 (en) 2018-04-09 2023-07-04 Globus Medical, Inc. Predictive visualization of medical imaging scanner component movement
JP2021522918A (en) * 2018-05-07 2021-09-02 ザ クリーヴランド クリニック ファウンデーションThe Cleveland Clinic Foundation Live 3D holographic guidance and navigation for performing interventional surgery
US11337742B2 (en) 2018-11-05 2022-05-24 Globus Medical Inc Compliant orthopedic driver
US11832863B2 (en) 2018-11-05 2023-12-05 Globus Medical, Inc. Compliant orthopedic driver
US11751927B2 (en) 2018-11-05 2023-09-12 Globus Medical Inc. Compliant orthopedic driver
US11278360B2 (en) 2018-11-16 2022-03-22 Globus Medical, Inc. End-effectors for surgical robotic systems having sealed optical components
US11744655B2 (en) 2018-12-04 2023-09-05 Globus Medical, Inc. Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems
US11602402B2 (en) 2018-12-04 2023-03-14 Globus Medical, Inc. Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems
US11806084B2 (en) 2019-03-22 2023-11-07 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, and related methods and devices
US11744598B2 (en) 2019-03-22 2023-09-05 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11317978B2 (en) 2019-03-22 2022-05-03 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11571265B2 (en) 2019-03-22 2023-02-07 Globus Medical Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11850012B2 (en) 2019-03-22 2023-12-26 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11737696B2 (en) 2019-03-22 2023-08-29 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, and related methods and devices
US11382549B2 (en) 2019-03-22 2022-07-12 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, and related methods and devices
US11419616B2 (en) 2019-03-22 2022-08-23 Globus Medical, Inc. System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices
US11045179B2 (en) 2019-05-20 2021-06-29 Global Medical Inc Robot-mounted retractor system
US11628023B2 (en) 2019-07-10 2023-04-18 Globus Medical, Inc. Robotic navigational system for interbody implants
US11571171B2 (en) 2019-09-24 2023-02-07 Globus Medical, Inc. Compound curve cable chain
US11864857B2 (en) 2019-09-27 2024-01-09 Globus Medical, Inc. Surgical robot with passive end effector
US11426178B2 (en) 2019-09-27 2022-08-30 Globus Medical Inc. Systems and methods for navigating a pin guide driver
US11890066B2 (en) 2019-09-30 2024-02-06 Globus Medical, Inc Surgical robot with passive end effector
US11510684B2 (en) 2019-10-14 2022-11-29 Globus Medical, Inc. Rotary motion passive end effector for surgical robots in orthopedic surgeries
US11844532B2 (en) 2019-10-14 2023-12-19 Globus Medical, Inc. Rotary motion passive end effector for surgical robots in orthopedic surgeries
US11382699B2 (en) 2020-02-10 2022-07-12 Globus Medical Inc. Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery
US11690697B2 (en) 2020-02-19 2023-07-04 Globus Medical, Inc. Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment
US11207150B2 (en) 2020-02-19 2021-12-28 Globus Medical, Inc. Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment
US11253216B2 (en) 2020-04-28 2022-02-22 Globus Medical Inc. Fixtures for fluoroscopic imaging systems and related navigation systems and methods
US11838493B2 (en) 2020-05-08 2023-12-05 Globus Medical Inc. Extended reality headset camera system for computer assisted navigation in surgery
US11839435B2 (en) 2020-05-08 2023-12-12 Globus Medical, Inc. Extended reality headset tool tracking and control
US11153555B1 (en) 2020-05-08 2021-10-19 Globus Medical Inc. Extended reality headset camera system for computer assisted navigation in surgery
US11382700B2 (en) 2020-05-08 2022-07-12 Globus Medical Inc. Extended reality headset tool tracking and control
US11510750B2 (en) 2020-05-08 2022-11-29 Globus Medical, Inc. Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications
US11317973B2 (en) 2020-06-09 2022-05-03 Globus Medical, Inc. Camera tracking bar for computer assisted navigation during surgery
US11382713B2 (en) 2020-06-16 2022-07-12 Globus Medical, Inc. Navigated surgical system with eye to XR headset display calibration
US11877807B2 (en) 2020-07-10 2024-01-23 Globus Medical, Inc Instruments for navigated orthopedic surgeries
US11793588B2 (en) 2020-07-23 2023-10-24 Globus Medical, Inc. Sterile draping of robotic arms
US11737831B2 (en) 2020-09-02 2023-08-29 Globus Medical Inc. Surgical object tracking template generation for computer assisted navigation during surgical procedure
US11890122B2 (en) 2020-09-24 2024-02-06 Globus Medical, Inc. Increased cone beam computed tomography volume length without requiring stitching or longitudinal c-arm movement
US11523785B2 (en) 2020-09-24 2022-12-13 Globus Medical, Inc. Increased cone beam computed tomography volume length without requiring stitching or longitudinal C-arm movement
US11911112B2 (en) 2020-10-27 2024-02-27 Globus Medical, Inc. Robotic navigational system
US11717350B2 (en) 2020-11-24 2023-08-08 Globus Medical Inc. Methods for robotic assistance and navigation in spinal surgery and related systems
US11857273B2 (en) 2021-07-06 2024-01-02 Globus Medical, Inc. Ultrasonic robotic surgical navigation
US11850009B2 (en) 2021-07-06 2023-12-26 Globus Medical, Inc. Ultrasonic robotic surgical navigation
US11622794B2 (en) 2021-07-22 2023-04-11 Globus Medical, Inc. Screw tower and rod reduction tool
US11439444B1 (en) 2021-07-22 2022-09-13 Globus Medical, Inc. Screw tower and rod reduction tool
US11911115B2 (en) 2021-12-20 2024-02-27 Globus Medical Inc. Flat panel registration fixture and method of using same
US11918304B2 (en) 2021-12-20 2024-03-05 Globus Medical, Inc Flat panel registration fixture and method of using same

Also Published As

Publication number Publication date
US20210137351A1 (en) 2021-05-13
US20120071753A1 (en) 2012-03-22
US20120059220A1 (en) 2012-03-08
US20190320876A1 (en) 2019-10-24
US20120059248A1 (en) 2012-03-08
US8696549B2 (en) 2014-04-15
US20190231168A1 (en) 2019-08-01
US20220361729A1 (en) 2022-11-17
US20140232840A1 (en) 2014-08-21
US11690527B2 (en) 2023-07-04
US10165928B2 (en) 2019-01-01
US20200060512A1 (en) 2020-02-27
US20220071474A1 (en) 2022-03-10
US10898057B2 (en) 2021-01-26
US20190223689A1 (en) 2019-07-25
US11109740B2 (en) 2021-09-07
EP2605693B1 (en) 2019-11-06
EP3659490A1 (en) 2020-06-03
EP2605693A4 (en) 2014-01-22
US20160354159A1 (en) 2016-12-08
US20120046521A1 (en) 2012-02-23
EP2605693A2 (en) 2013-06-26
WO2012024686A2 (en) 2012-02-23
US10264947B2 (en) 2019-04-23
US20190208987A1 (en) 2019-07-11
WO2012024686A3 (en) 2012-07-19

Similar Documents

Publication Publication Date Title
US20220361729A1 (en) Apparatus and method for four dimensional soft tissue navigation
US11830198B2 (en) Systems, methods and devices for forming respiratory-gated point cloud for four dimensional soft tissue navigation
US11553968B2 (en) Apparatuses and methods for registering a real-time image feed from an imaging device to a steerable catheter
WO2015164587A2 (en) Apparatuses and methods for endobronchial navigation to and confirmation of the location of a target tissue and percutaneous interception of the target tissue

Legal Events

Date Code Title Description
AS Assignment

Owner name: VERAN MEDICAL TECHNOLOGIES, INC., MISSOURI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HOLSING, TROY L.;HUNTER, MARK;LEE, CHRISTOPHER;AND OTHERS;SIGNING DATES FROM 20130226 TO 20130312;REEL/FRAME:030039/0647

AS Assignment

Owner name: PROLOG CAPITAL II, L.P., MISSOURI

Free format text: SECURITY AGREEMENT;ASSIGNOR:VERAN MEDICAL TECHNOLOGIES, INC.;REEL/FRAME:031837/0001

Effective date: 20131127

AS Assignment

Owner name: VERAN MEDICAL TECHNOLOGIES, INC., MISSOURI

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:PROLOG CAPITAL II, L.P.;REEL/FRAME:047493/0705

Effective date: 20181106

AS Assignment

Owner name: MADRYN HEALTH PARTNERS, LP, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNOR:VERAN MEDICAL TECHNOLOGIES, INC.;REEL/FRAME:048147/0992

Effective date: 20181121

Owner name: WESTERN ALLIANCE BANK, CALIFORNIA

Free format text: SECURITY INTEREST;ASSIGNOR:VERAN MEDICAL TECHNOLOGIES, INC.;REEL/FRAME:047561/0866

Effective date: 20181121

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION