US20020168618A1 - Simulation system for image-guided medical procedures - Google Patents

Simulation system for image-guided medical procedures Download PDF

Info

Publication number
US20020168618A1
US20020168618A1 US10/091,742 US9174202A US2002168618A1 US 20020168618 A1 US20020168618 A1 US 20020168618A1 US 9174202 A US9174202 A US 9174202A US 2002168618 A1 US2002168618 A1 US 2002168618A1
Authority
US
United States
Prior art keywords
lumen
user
body cavity
balloon
simulated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/091,742
Inventor
James Anderson
William Brody
Chee-Kong Chui
Xin Ma
Yaoping Wang
Yiyu Cai
Wieslaw Nowinski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
INSTITUTE FOR INFOCOMM RESEARCH
School of Medicine of Johns Hopkins University
Original Assignee
School of Medicine of Johns Hopkins University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by School of Medicine of Johns Hopkins University filed Critical School of Medicine of Johns Hopkins University
Priority to US10/091,742 priority Critical patent/US20020168618A1/en
Assigned to LABORATORIES FOR INFORMATION TECHNOLOGY reassignment LABORATORIES FOR INFORMATION TECHNOLOGY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CAI, YIYU, WANG, YAOPING, NOWINSKI, WIESLAW L., CHUI, CHEE-KONG, MA, XIN
Assigned to JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE, THE reassignment JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE, THE ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ANDERSON, JAMES H., BRODY, WILLIAM R.
Assigned to LABORATORIES FOR INFORMATION TECHNOLOGY reassignment LABORATORIES FOR INFORMATION TECHNOLOGY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CAI, YIYU, WANG, YAOPING, NOWINSKI, WIESLAW L., CHUI, CHEE-KONG
Publication of US20020168618A1 publication Critical patent/US20020168618A1/en
Priority to US10/720,576 priority patent/US20040106167A1/en
Assigned to INSTITUTE FOR INFOCOMM RESEARCH reassignment INSTITUTE FOR INFOCOMM RESEARCH CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: LABORATORIES FOR INFORMATION TECHNOLOGY INCORPORATED
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B23/00Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
    • G09B23/28Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
    • G09B23/285Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/02Prostheses implantable into the body
    • A61F2/04Hollow or tubular parts of organs, e.g. bladders, tracheae, bronchi or bile ducts
    • A61F2/06Blood vessels
    • A61F2/07Stent-grafts
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/02Prostheses implantable into the body
    • A61F2/04Hollow or tubular parts of organs, e.g. bladders, tracheae, bronchi or bile ducts
    • A61F2/06Blood vessels
    • A61F2002/065Y-shaped blood vessels
    • A61F2002/067Y-shaped blood vessels modular
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S623/00Prosthesis, i.e. artificial body members, parts thereof, or aids and accessories therefor
    • Y10S623/901Method of manufacturing prosthetic device

Definitions

  • the invention relates to a system and method for simulating image-guided medical procedures, particularly those relying on interventional and/or diagnostic devices such as catheters.
  • Interventional radiology provides an alternative to open field surgery.
  • Interventional radiology began as a discipline for diagnosing and treating vascular disease (e.g., such as narrowing of the arteries).
  • the interventional radiologist typically uses a catheter inserted into a blood vessel through a puncture in the skin to gain internal access to the vascular system.
  • the catheter is navigated to a target site (e.g., such as the site of a diseased tissue) where it can be used as a conduit through which to pass therapeutic devices.
  • target site e.g., such as the site of a diseased tissue
  • Minimally invasive procedures relying on interventional radiology including lapraroscopic surgery, cardiovascular interventional radiology, and neurointerventional radiology, have tremendous potential to reduce patient discomfort, complications, hospital stays, post-procedural recovery time and total medical costs.
  • Interventional radiologists must perform the delicate eye-hand coordinated movements needed to navigate catheters and therapeutic devices while viewing scanned images of the patient's body cavities or lumens on a flat TV screen.
  • the images are obtained from X-rays, CAT scans, MRI scans, and the like.
  • Depth perception is lacking and it is difficult to learn to control the instruments through the spatially arbitrary linkage. A mistake in this environment can be dangerous. Without performing the procedure often, there is no way for practitioners to maintain the high degree of skill needed to perform these procedures. It is also impractical to implement new methods, operations, and procedures on live individuals.
  • U.S. Pat. No. 6,038,488 discloses a catheter simulation device for surgery and interventional radiology procedures. Translation and rotation of the simulated catheter can be tracked and a computerized control system and recording device are employed to provide a programmed procedure which provides a realistic “feel” to a user of a surgical procedure.
  • WO 99/16352 describes using graphical representations of a surgical instrument and area of the body in which a procedure is being performed to aid an operator using the surgical instrument.
  • WO 99/39315 describes a vascular access simulation system with a tracking system for monitoring the movements of a simulated catheter needle assembly and a skin traction mechanism.
  • the system receives measurements from the tracking system to update simulation and display of representations of the catheter while providing control signals to a force feedback device to enable the application of force to the catheter needle assembly.
  • WO 98/03954 describes a system for simulating operating conditions during minimally invasive surgical procedures. Data regarding the movements of a simulated surgical instrument are interpolated by a computer processor, which utilizes a database of information representing a patient's internal landscape to create a computer model of the internal landscape of the patient.
  • U.S. Pat. No. 6,106,301 describes a radiology interface apparatus and peripherals, such as mock medical instruments, for simulating performance of a medical procedure on a virtual patient.
  • the interface measures manipulations of system peripherals and transfers these measurements via a processor to a medical procedure simulation system.
  • This invention is designed to assist physicians in their training and in preplanning of diagnostic and therapeutic procedures performed in the vascular cardiovascular catheterization laboratory.
  • the simulator also provides active haptic force and tactile feedback components to enhance the total hand-eye coordinated experiences encountered by physicians during actual interventional procedures.
  • the invention also provides a novel solution to easily configure or customize the training or pretreatment planning environment to meet the needs of the user or trainer.
  • the invention provides a system for simulating the movement of a medical device in a body cavity or lumen of a patient.
  • the system comprises a medical device comprising a first end for manipulation by a user and a portion comprising a second end insertable into a simulated body cavity or body lumen in a manikin.
  • the manikin comprises an interface for receiving the portion comprising the second end and for interfacing with the simulated body cavity or lumen.
  • the manikin further comprises a directional force feedback mechanism for exerting a directional force on the medical device in response to a feedback signal.
  • the directional force feedback mechanism provides resistance to forward motion but enables free reverse motion in response to the feedback signal.
  • the directional force feedback mechanism comprises a rolling element coupled to the portion of the medical device comprising the second end.
  • An internal surface of the simulated cavity or lumen in the manikin comprises an oblique slot for receiving the rolling element.
  • a motor such as a servo motor, can be used to control movement of the rolling element.
  • the system further comprises a tactile feedback mechanism which can provide continuous vibrational feedback to a user holding the medical device.
  • Tactile feedback can be provided through a continuously rotating motor in communication with the portion of the medical device comprising the second end.
  • the tactile feedback mechanism can simulate such parameters as blood flow, respiration and the like.
  • the position of at least the second end of the medical device relative the simulated body cavity or lumen is continuously tracked.
  • the medical device comprises an encoder for tracking the translation of the device and an encoder for tracking the rotation of the device.
  • the system comprises a tracking unit comprising a light source, a signal processing circuit, and one or more optical sensors which are placed within the interface. Light from the light source reflects on the device when it is inserted into the interface and reflected light from the device is received by the one or more optical sensors of the tracking system, enabling the movement of the device to be tracked. In response to detection of changes in reflected light, the system will simulate movement of the device in real-time on a user display.
  • two optical sensors are provided which lie in two different planes which are perpendicular to each other.
  • the tracking unit is configured in the form of a rail along which the device can move.
  • More than one medical device can be inserted into the interface and the position of each medical device can be independently monitored.
  • Suitable medical devices for use with the system include, but are not limited to: a catheter, guidewire, endoscope, laparoscope, bronchoscope, stent, coil, balloon, a balloon-inflating device, a surgical tool, a vascular occlusion device, optical probe, a drug delivery device, and combinations thereof.
  • the system comprises a table on which the manikin is placed.
  • the table can comprise a processor connectable to the network.
  • Additional ancillary equipment can include, but are not limited to, foot and hand activation switches, radioopaque contrast dye injectors, hand operated balloon inflation devices, and monitors displaying various simulated electrophysiological parameters.
  • the system comprises at least one first user device connectable to the network which comprises a first display interface for displaying a three-dimensional representation of a simulated body cavity or lumen of a patient.
  • the first display interface further displays a three-dimensional representation of a medical device corresponding to a medical device which is interfaced with the manikin.
  • the system simulates the movement of the medical device within the simulated body cavity or lumen of the manikin in real-time on the display, when a first user manipulates the medical device interfaced with the manikin.
  • the system can be used to simulate the movement of a catheter through a blood vessel (e.g., such as a blood vessel in the heart or brain or another organ).
  • the system further simulates deformation of the body cavity or lumen by the medical device.
  • the system also can comprise a simulated scanning display for displaying a two-dimensional image of the simulated body cavity or lumen.
  • the scanning display is part of a simulated scanning device.
  • the simulated scanning device can simulate an x-ray imaging system. Both the simulated scanning device and scanning display can be coupled to a movable C-arm within scanning distance of the manikin.
  • a re-configurable control panel e.g., a touch screen
  • a re-configurable control panel for performing one or more of: image acquisition selection; image display; manipulating a table on which the manikin is placed; manipulating the position of a simulated scanning device relative to the manikin; and control of one or more shutter devices for limiting a field of view of a scanning device placed within scanning distance of the manikin.
  • the system also can comprise at least one foot-activation switch for activating or collimating the simulated scanning device, image display and/or for controlling table movement.
  • the system can be adapted for use by multiple users, for example, as part of a training environment.
  • the system comprises a monitoring station comprising a second user device connectable to the network and comprising a second display interface for enabling a second user to monitor the movement of the medical device within the simulated body cavity or lumen.
  • the second display interface displays selectable options (e.g., a drop down menu, action buttons, check buttons, radio buttons, dialog boxes, command lines and the like), enabling the second user to select or change one or more anatomical and/or physiological parameters of the simulated body cavity or lumen. Selection of a selectable option causes the three-dimensional image of the simulated body cavity or lumen displayed to the first user to change to reflect the changed anatomical and/or physiological parameters selected by the second user.
  • the first user display interface provides access to a database and in response to this accessing, the system displays an image and/or medical data of a patient on the first user display interface.
  • the second user display interface provides access to the database and the system displays an image and/or medical data on the second user display interface.
  • the second user display interface provides a selectable option enabling a second user to display the image which is displayed on the second user display interface, on the first user's display interface.
  • the invention additionally provides a syringe for simulating fluid delivery, comprising: a housing defining a lumen comprising an opening for delivering a fluid, a pushing element for pushing the fluid through the opening, a friction-producing element in communication with the pushing element, and a motor in communication with the friction-producing element and comprising a signal-receiving element.
  • the friction-producing element will cause friction between the pushing element and a surface of the lumen of the housing when the motor is activated. Activation of the motor is responsive to a signal received by the signal-receiving element.
  • the motor When activated, the motor causes motion of the friction-producing element, causing the friction-producing element to contact the surface of the lumen of the housing. This creates friction between the pushing element and the surface of the lumen and causes resistance to the motion of the pushing element, thus simulating injection of a fluid through a syringe into the body of a patient.
  • the friction-producing element can comprise one or more rubber pads, each rubber pad being coupled to an arm whose movement is controlled by the motor, e.g., such as through a gear attached to the motor.
  • the amount of friction produced by the friction-producing element is adjusted by controlling a rotation angle of the motor.
  • the syringe can be used with the system described above.
  • the opening of the syringe can be connectable to a connecting piece having a first end for receiving fluid from the opening and a second end for delivering fluid to a simulated body cavity or body lumen in the manikin, e.g., via the manikin interface.
  • the invention also provides a method for simulating fluid delivery into a body cavity or lumen of a patient comprising providing a syringe as described above and providing a signal to the syringe, thereby causing friction between the friction producing element and the pushing element. Delivery of fluid to a body cavity or lumen can be viewed in real-time on the screen of a first and/or second user interface.
  • the invention also provides a balloon-inflating device for simulating deployment of a balloon within a body cavity or lumen of a patient.
  • the device comprises a delivery mechanism for controlling delivery of fluid (e.g., such as air) through the balloon-inflating device to the balloon, a pressure sensor for monitoring pressure of fluid delivered, and an electrical pressure meter for reading pressure determined by the pressure sensor.
  • the electrical pressure meter is connectable to a processor and can transmit a signal corresponding to a pressure value to the processor.
  • the balloon inflating device can be used with the system; for example, the system can simulate the deployment of a balloon (e.g., inflation or deflation) within the lumen of a patient; i.e., the system can be used to simulate a balloon angioplasty procedure.
  • a balloon e.g., inflation or deflation
  • the system also can be used to simulate other operations of medical devices, such as a surgical procedure (e.g., such as removal or repair of a tissue structure), injection of a radioopaque isotope and the like.
  • a surgical procedure e.g., such as removal or repair of a tissue structure
  • injection of a radioopaque isotope e.g., injection of a radioopaque isotope and the like.
  • the invention further provides methods for using the system described above.
  • the invention provides a method for simulating the movement of a medical device in the body cavity or lumen of a patient, comprising: providing a medical device comprising a first end for manipulation by a user and a portion comprising a second end inserted into a simulated body cavity or body lumen in a manikin.
  • the simulated body cavity or lumen in the manikin comprises a directional force feedback mechanism and in response to a feedback signal, the directional force feedback mechanism creates resistance to forward motion of the medical device but allows free reverse motion, allowing a first user to experience the sensation of using the device in the body of a patient.
  • the user experiences tactile feedback as well as directional feedback.
  • the first user of the system can access a database of three-dimensional images of body cavities and lumens from a plurality of different patients.
  • the first user can request a representation of a selected image to be displayed on the display interface of his or her user device in response to this accessing.
  • the user can select a suitable hyperlink displayed on the interface, or can input a query into a command line or dialog box, or can select a selectable option provided on the interface in response to the user's accessing the database.
  • the system also superimposes a three-dimensional representation of the medical device on the representation of the body cavity or lumen.
  • the system simulates the movement of the medical device within the body cavity or lumen in real-time on the display interface as the user manipulates the medical device which is interfaced with the manikin.
  • the system also simulates deformation of the body cavity or lumen as the first user simulates navigating and/or deploying the medical device.
  • the user can experience one or more simulated operations of the device, such as a surgical procedure, injection of a radioopaque dye, balloon deployment, and the like.
  • the first user can manipulate a plurality of medical devices using the interface of the manikin.
  • the system will simulate the movement of each of these devices on the first user's display interface.
  • the system can simulate the can simulate navigating a first catheter to a target region of the body, then a balloon catheter, and then positioning a balloon deployment device (e.g., such as the one described above) in proximity to the balloon catheter to inflate or deflate the balloon.
  • a balloon deployment device e.g., such as the one described above
  • the system also simulates inserting a stent catheter, navigating the stent catheter to the target region, and using the balloon deployed by the balloon catheter to deploy the stent.
  • the system simulates coil embolization in a body cavity or lumen of a patient. As a first user interacts with the manikin by inserting a catheter, guidewire, and coil wire into the simulated body cavity or lumen, the system simulates movement of each of these devices in the simulated body cavity or lumen on the first user's display interface.
  • a selectable option on a control interface provided as part of the system provides the user with a selectable option for detaching the coil from the coil wire.
  • the selectable option When the user selects the selectable option, the coil is released from the coil wire in the manikin and on the screen of the first user's display interface.
  • a second user also can interact with the first user by using the monitoring station described above.
  • the second user can display a particular image selected by the second user from the database on the first user's display interface.
  • the second user can alter parameters of the simulation displayed to the first user, for example, as part of a training exercise, to document the progress of one or more first users, and/or to introduce procedural variables that can be used to test or evaluate the response and decision-making abilities of one or more first users.
  • the system is configured to resemble a cardiovascular catheterization laboratory where interventional radiology procedures are performed.
  • a first user can interactively manipulate therapeutic catheters, guidewires and other medical devices in real-time while viewing patient-specific medical image data sets in a manner similar to that encountered in a clinical procedure.
  • FIG. 1 is the block diagram of a simulation system according to one aspect of the invention.
  • FIG. 2 illustrates a perspective view of a system according to the invention.
  • a simulated patient ( 6 ) or manikin houses tracking and force feedback assemblies. Simulated medical devices are introduced into the simulated patient via a user interface box embedded within the patient/manikin (e.g., through the groin or axillary area, in the case of a simulated catheterization lab).
  • a first user ( 1 ) navigating and/or deploying simulated devices can be monitored by a second user ( 19 ) according to one aspect of the invention.
  • FIG. 3 is a block diagram showing various components of a system processor according to one aspect of the invention.
  • FIG. 4 is a block diagram showing various system inputs according one aspect of the invention, such as touch screens, footswitches, syringes, C-arm, hand-operated balloon device, feedback structures, and their connections with the system processor.
  • FIG. 5A illustrates the mechanical structure of a tracking system and active force feedback structure according to one aspect of the invention. More than one set of catheters and guidewires can be used in a given simulation. The translation and rotation of each device are measured using incremental encoders. For example, encoder A and encoder B measure the translation and rotation of a catheter, respectively.
  • FIG. 5B is a block diagram illustrating components of the tracking system and active force feedback system and their interactions with the system processor.
  • FIG. 6A illustrates a different tracking system according to one aspect of the invention comprising one or more optical sensors.
  • FIG. 6B shows a tracking unit and catheter device configured as a loop which can be used to simulate pushing, pulling, or twisting.
  • FIGS. 7A and B show more detailed views of a directional force feedback mechanism according to one aspect of the invention.
  • a wheel coupled to a motor directs forward movement of a simulated catheter through a shutter connected to the simulate catheter.
  • Forward and downward motion of the shutter forces a rolling element coupled to the catheter into an oblique slot which creates resistance to further forward motion.
  • a discontinuously rotating hand provides a sensation of vibration.
  • FIG. 7B shows a close up of the rolling element (e.g., a shaft) and a cross-section through the oblique slot.
  • FIGS. 8 A 1 - 3 and B shows the structure of a simulated syringe with a force feedback mechanism according to one aspect of the invention.
  • FIG. 8A shows a cross-section through the longitudinal axis of the device while
  • FIG. 8B shows a cross-section through the tranverse axis of the device.
  • FIG. 9 shows a simulated hand-operated balloon-inflating device according to one aspect of the invention.
  • a pressure sensor is used to measure the pressure of inflation of a balloon attached to a catheter. The sensor signal is processed and transmitted to the system processor.
  • a user can read the pressure value from a display monitor or from a piezometer as shown in the upper portion of the Figure. A user also can feel pressure transmitted back from a catheter port from the balloon during the inflation process.
  • FIGS. 10 A-D show re-configurable control panels according to different aspects of the invention.
  • FIG. 11 shows a scaled-down simulation system according to one aspect of the invention.
  • FIG. 12 shows a desktop simulation system for pretreatment planning comprising a re-configurable control panel.
  • FIG. 13 is a flow chart showing the steps of a simulation process according to one aspect of the invention.
  • FIG. 14 illustrates the time/realism requirements of a simulation system according to the invention.
  • FIG. 15 shows a physical model of vascular data and device data which can be inputted into a system processor according to the invention.
  • FIG. 16 illustrates creation of a physical model of a body cavity or blood vessel according to one aspect of the invention.
  • the invention provides a system for the simulation of image-guided medical procedures and methods of using the same.
  • the system can be used for training and certification, pre-treatment planning, as well therapeutic device design, development and evaluation.
  • Coupled to refers to direct or indirect coupling of one element of a system to another.
  • An element may be removably coupled or permanently coupled to another element of the system.
  • within scanning distance refers to a distance which is close enough to the manikin to permit display of an image of the simulated body cavity or lumen on the scanning display of the system.
  • a re-configurable control panel refers to a display interface comprising one or more selectable options (e.g., in the form of action buttons, radio buttons, check buttons, drop-down menus, and the like) which can be selected by a user and which can direct the system to perform operation(s).
  • the one or more options can be selected by touch.
  • the control panel can be modified by a user (e.g., by implementing a system program which alters the display, causing it to display different selectable options) thereby “re-configuring” the control panel.
  • providing access to a database refers to providing a selectable option on the display of a user device which, when selected, causes the system to display images or data stored within the database, or causes one or more links to be displayed which, when selected, causes the system to display the images or data.
  • the system displays images or data, or links to images or data, in response to a query of the system by a user.
  • the display interface provides a “query input field” into which the user can input a query and the selectable option is an action button for transmitting the query to the system.
  • the term “in communication with” refers to the ability of a system or component of a system to receive input data from another system or component of a system and to provide an output response in response to the input data.
  • “Output” may be in the form of data or may be in the form of an action taken by the system or component of the system.
  • deployment of a balloon refers to either inflation or deflation of the balloon.
  • a pathology “affecting the structure of the body cavity or lumen” is one which measurably alters at least one physical property of the body cavity or lumen.
  • a physical property refers to a property which relates to the structure or anatomy of a body cavity or lumen which is measurable, generally without the aid of a labeled molecular probe; for example, physical properties of a blood vessel include, but are not limited to: elasticity, thickness, strength of ventricular contractions, vascular resistance, fluid volume, cardiac output, myocardial contractility, and other related parameters.
  • a volume image is a stack of two-dimensional (2D) images (e.g., of a body cavity or lumen) oriented in an axial direction.
  • a device for “accessing a body cavity or lumen” refers to a device which can be maneuvered in the body cavity or lumen. “Maneuvering” refers to the ability of at least about 50% of the external surface of the device to fit within a cavity or lumen while retaining rotational or forward translational freedom of movement.
  • an “interventional medical device” includes a device for treatment (e.g., stents, stent-grafts, balloons, coils, drug delivery devices), for diagnosis (e.g., imaging probes), and for placement of other medical devices (e.g., guidewires).
  • a device for treatment e.g., stents, stent-grafts, balloons, coils, drug delivery devices
  • diagnosis e.g., imaging probes
  • other medical devices e.g., guidewires.
  • Some devices, such as catheters can have multiple functions.
  • the terms “an interventional medical device” and “device for accessing a body cavity or lumen” are used interchangeably.
  • a “knowledge base” is a data structure comprising facts and rules relating to a subject; for example, a “vascular properties knowledge base” is a data structure comprising facts relating to properties of blood vessels, such as elasticity, deformation, tissue and cellular properties, blood flow, and the like and rules for correlating facts relating to vascular properties to interactions with one or medical devices.
  • a “rule” in a knowledge base refers to a statement associated with a certainty factor. Rules are generally established by interviewing human experts or by obtaining data from databases or other knowledge bases.
  • an “expert system” comprises a program for applying the rules of one or more knowledge bases to data provided to, or stored within the knowledge base(s), thereby enabling the knowledge base(s) to be queried and to grow.
  • an expert system comprises an inference engine which enables the system to manipulate input data from a user to arrive at one or more possible answers to a question by a user.
  • an expert system also comprises a cache or dynamic memory for storing the current state of any active rule along with facts relating to premises on which the rule is based.
  • a system which “simulates a path representing at least a portion of a body cavity or lumen” is a system which displays a three-dimensional representation of the internal surface of the at least a portion of the body cavity or lumen on the interface of a user device in communication with the system.
  • to “determine the best fit between the geometry of the device and the geometry of the path” refers to displaying a representation of at least a portion of the device and simulating its placement within at least a portion of the body cavity or lumen.
  • a “device parameter” refers to a physical property of a device, e.g., such as flexibility, memory, material, shape, and the like.
  • a physical model of a device is a combination of a recommended geometrical model, topology, and material. It is also the basis for making the first design of a medical device based on patient-specific data.
  • a “software suite” refers to a plurality of interacting programs for communicating with an operating system.
  • clinical data refers to physical, anatomical, and/or physiological data acquired by medical image modalities such as X-ray, MRI, CT, US, angiography, video camera, or by direct physical and/or electronic measurements.
  • a best fit between a simulated path for a simulated body cavity or lumen and a simulated medical device refers to one which requires the minimum amount of deformation in the simulated surgical process that takes into consideration the patient-specific vasculature and composite materials of the device.
  • an “FEM engine” refers to a program or set of programs for performing finite element analysis focusing on vasculature finite element models and analysis of the interaction between vasculature models and devices.
  • FIG. 1 is a block diagram of a simulation system according to one aspect of the invention.
  • Input into the system executes a particular simulation to be enacted.
  • a simulation includes images of a patient and also can include a display of patient-specific information (e.g., such as clinical information and medical history).
  • the patient images can be obtained from a database of patient-specific images or images relating to a population of demographically similar patients (e.g., such as patients sharing a pathology).
  • the system also accesses data relating to various interventional devices.
  • the system can include data files relating to the shape and physical properties of one or more medical devices.
  • the simulation system also includes a manikin ( 6 ) (i.e., representing a patient) for interfacing with one or more simulated medical devices (see, e.g., as shown in FIG. 2).
  • Users interact with the simulation system by observing various rendered displays ( 2 ), such as fluoroscopic images of blood vessels, and manipulate the one or more simulated devices in response to data received by these display ( 2 ).
  • the invention can simulate the anatomy of a specific patient on which the one or more devices will be used.
  • the intervention simulation system comprises a medical device with a first end for manipulation by a user and a portion comprising a second end which is insertable into a simulated body cavity or body lumen in a simulated patient interface.
  • the simulated patient interface is part of a manikin ( 6 ) which simulates the physical features of a human patient.
  • the manikin ( 6 ) comprises an interface ( 5 ) for receiving the portion comprising the second end and for interfacing with a simulated body cavity or lumen within the manikin.
  • the interface also comprises a directional force feedback mechanism for exerting a directional force on the candidate medical device in response to a feedback signal received by the force feedback mechanism.
  • a directional force feedback mechanism for exerting a directional force on the candidate medical device in response to a feedback signal received by the force feedback mechanism.
  • the directional force feedback mechanism provides resistance to forward motion but enables reverse motion in response to the feedback signal.
  • the medical device can be one which is commercially available, a device being tested for use or not otherwise commercially available, or can be a candidate device based on a simulated design selected to suit the characteristics of a particular patient. Methods and systems for designing customized medical devices are disclosed in U.S. Provisional Application Serial No. 60/273,734, filed Mar. 6, 2001.
  • the directional force feedback mechanism comprises a rolling element (e.g., such as a shaft) coupled to the portion of the candidate device comprising the second end.
  • An internal surface of the simulated cavity or lumen in the manikin in turn comprises an oblique slot for receiving the rolling element.
  • forward movement of the second end causes the rolling element to be received by the slot, causing resistance to further forward motion.
  • a motor such as a servo motor, controls movement of the rolling element. This embodiment is shown in more detail in FIG. 7A.
  • the servo motor rotates clockwise, causing a wheel to rotate, pushing a shutter forward and downward.
  • the forward and downward movement of the shutter pushes the rolling element down into the slot.
  • the rolling element moves upward along the slot, and any further forward movement is resisted. If the user wishes to pull back the device, the rolling element will move downward and can be released from the slot.
  • the interface comprises both a directional force feedback mechanism and a tactile feedback mechanism.
  • the tactile feedback mechanism provides vibrational feedback to a user holding the candidate medical device.
  • continuous vibrational feedback is provided through a continuously rotating motor (e.g., such as the servo motor) in communication with the portion of the device comprising the second end.
  • a discontinuously rotating motor controlling the movement of a hand also can be used to simulate intermittent forces experienced by a body cavity or lumen. For example, in a clinical situation, when a catheter is inserted into the cardiovascular system, cardiovascular function and activity may cause the catheter to vibrate.
  • the servo motor and the rotating hand are designed to simulate this kind of vibration.
  • the servo motor rotates continuously and but has an adjustable rotating frequency. .
  • the rotating hand pushes the catheter discontinuously, i.e., simulating blood flow and respiration.
  • Haptic “display” serves at least two purposes in the intervention simulator: kinesthetic and cognitive. First, it provides the sensation of movement to the user and therefore it greatly enhances surgical performance. Second, it is used to enable a user to learn to distinguish between tissues by testing their mechanical properties. Deformation models are used to compute the effect of force on the biomechanics of an interventional device and on the deformation of a cavity or lumen through which the device is navigating and/or being deployed, and feedback signals to the force feedback and tactile feedback mechanisms can be used to mimic actual forces that might be experienced during an interventional procedure.
  • the system is capable of providing physically meaningful forces that realistically mimic those encountered during an interventional procedure, there may be instances where a less realistic simulation is satisfactory.
  • a user may want to feel that he or she has reached an obstruction during catheterization.
  • the user may not need to experience all the various contacts he or she could feel while maneuvering a catheter prior to experiencing a single large resistance.
  • the present invention provides a mechanism to stop a user from advancing past an obstruction and yet permits the user to pull back a simulated device.
  • the manikin interface can be encased in a housing comprising one or more openings for receiving medical devices, and means for interfacing with tracking unit(s), feedback mechanism(s) and a system processor (described further below). Additional devices such as syringes and balloon inflating devices can be provided as part of the interface, e.g., simulating balloon angioplasty proceedings).
  • the interface housing can be displaceable for some distance from the manikin itself or can project from the manikin (e.g., being an integral part of the manikin). To further enhance realism, only the opening(s) of the housing may visible from the manikin (e.g., the interface “housing” can be part of the manikin).
  • the interface is an embedded system as shown in FIG. 2, with openings into areas of the manikin simulating areas of medical intervention.
  • the simulation system can obtain input of various types to more closely mimic an intervention procedure.
  • input to the simulator can consist of patient medical history and diagnostic data including, but not limited to, data obtained from X-ray, MRI, MRA, CT or ultrasound images.
  • Data can relate to a specific patient, e.g., where a user is training to perform a procedure on a specific patient using a customized device.
  • data can relate to a “symbolic patient”, for example, representing a particular demographic group of closely related patients, such as patients having a type of pathology.
  • FIG. 2 shows an example of various system inputs that can be provided.
  • the simulated patient ( 6 ) in the Figure is a manikin that also houses the tracking and force feedback assemblies.
  • a physician ( 1 ) simulates navigation of a catheter by manipulating catheters and guidewires ( 5 ). These catheters and guidewires are inserted into the manikin at the manikin interface.
  • One or more monitors ( 2 ) can be used to display simulated fluoroscopic and vascular images simulating the internal anatomy of a patient represented by the manikin.
  • 2-D fluoroscopic views are displayed at the same time that 3D geometric models are displayed by system user interfaces.
  • the user has the option to adjust fluoroscopic images by one or more of zooming, collimation, rotation, and the like.
  • a user can view the vasculature from various positions or angles along x-, y-, and x-axes. This option can be of major value in pre-treatment planning, since a physician can use the system to evaluate different treatment approaches prior to performing actual intervention in a patient.
  • a simulated scanning device ( 4 ) additionally can be provided, e.g., in the form of a mock C-arm equipped with an x-ray emitter.
  • the mock C-arm can move along the long side of an operating table ( 8 ) on which the patient/manikin is placed and can rotate around the table to simulate capturing a patient's images at various lateral and angular positions.
  • two footswitches ( 7 ) can be used to simulate activation of a simulated x-ray device as well as vascular image acquisition and storage.
  • one or more monitors ( 2 ) simulate fluoroscopic images obtained.
  • a footswitch is preferred for scanning and image processing, since user(s) generally have their hands occupied with other equipment, in actual practice
  • the system provides a re-configurable control panel ( 9 ) (e.g., a touch screen) to enable a user to simulate patient table manipulation, vascular image acquisition selection and display, and the use of shutter devices to limit the extent of the field of view provided by a scanning device ( 4 ).
  • the panel also can be used to implement functions such as machine-activated radioopaque dye injection (e.g., activating the simulated syringe) and/or deployment of a balloon via a balloon-inflating device ( 18 ) interfaced with the manikin.
  • FIGS. 10 A-D show re-configurable control panels according to different aspects of the invention.
  • the display is programmable and has a large storage area for bitmaps, display lists, and screens. Users can easily set up complex image control panels according to their own requirements.
  • FIG. 10A shows the typical controls associated with patient table manipulation. Manipulating these controls result in a corresponding motion of a C-arm that carries a simulated X-ray emitter.
  • FIG. 10B shows controls associated with image acquisition for manipulating the sharpness and clarity of the rendered images.
  • FIG. 19C shows controls for machine activated balloon inflation and deflation, and shuttering.
  • FIG. 10D shows controls for collecting images for creating a roadmap.
  • the invention additionally provides one or more interventional devices interfaced with the manikin for simulating common procedures such as an injection, balloon deployment, and/or stent deployment.
  • the system comprises a syringe for simulating fluid delivery.
  • the simulation syringe comprises a housing defining a lumen comprising an opening for delivering a fluid, a pushing element for pushing the fluid through the opening, a friction-producing element in communication with the pushing element, and a motor in communication with the friction-producing element which further comprises signal receiving element.
  • the simulation syringe can be interfaced with the manikin and the signal-receiving element preferably receives signals from the system processor, e.g., to execute contrast injection at a particular flow rate and volume.
  • the friction-producing element will cause friction between the pushing element and a surface of the lumen of the housing when the motor is activated in response to a signal received by the signal-receiving element.
  • the motor When activated, the motor causes motion of the friction-producing element, causing the friction-producing element to contact the surface of the lumen of the housing. This creates friction between the pushing element and the surface of the lumen and causes resistance to the motion of the pushing element, thus simulating injection of a fluid through a syringe into the body of a patient.
  • the friction-producing element can comprise one or more rubber pads, each rubber pad being coupled to an arm whose movement is controlled by the motor, e.g., such as through a gear attached to the motor.
  • the amount of friction produced by the friction-producing element is adjusted by controlling a rotation angle of the motor.
  • FIGS. 8 A 1 - 3 and B show the structure of a simulated syringe ( 3 ) with force feedback structure according to one aspect of the invention.
  • a servo motor and two arms are installed in front of the pushing element (e.g., a handspike). These two arms are connected through two meshed gears.
  • Gear 1 is installed on the servo motor as is the driver of the motor. When a force feedback signal is communicated to the servo motor, the Gear 1 will contrarotate and Gear 2 will rotate clockwise. Arm 1 and Arm 2 splay and the rubber pads on the two arms will touch the wall of the syringe.
  • the value of the friction can be adjusted by controlling the rotation angle of the servo motor. When the servo motor rotates clockwise, the two arms will close and the user can move the handspike freely again.
  • the simulated syringe ( 3 ) can be used to simulate the injection of radioopaque dye, to simulate fluoroscopic imaging, or the delivery of a therapeutic agent or drug.
  • Control parameters such as contrast injection volume and rate can be controlled by a user through a control interface such as a touch screen, enabling a user to choose the rate and total volume of injection.
  • the injection process can be captured, and selected images of the process saved, to provide a roadmap image on a separate monitor.
  • FIG. 9 shows a simulated hand-operated balloon-inflating device.
  • a pressure sensor is used to measure the pressure of a fluid, such as air, being delivered to a balloon catheter, which has been navigated to a target site.
  • the signal of the sensor is processed and transmitted to the system processor through the microprocessor M 1 .
  • a user is able to read pressure values from a display monitor or from an electrical pressure sensor, such as the piezometer shown in the upper portion of FIG. 9. Additionally, the user is able to feel pressure delivered by the balloon-inflating device.
  • the inflating device can provide up to about at least 20 Bar of compressed liquid to a balloon.
  • compressed liquid is provided within a compressed liquid generator in communication with a piston.
  • a user can trigger delivery of compressed fluid from the generator by imparting linear force on the piston, thereby triggering inflation of a balloon.
  • the compression stroke is approximately 2 inches and can be delivered when a user twists a handle of the balloon-inflating device, causing a screw bar to force the piston forward.
  • a release button or switch is provided enable rapid release of compressed fluid, thereby triggering deflation of the balloon.
  • an automatic control system inside the device is used to control the forward or backward movement of a handwheel for controlling the amount of pressure actually delivered to the balloon, in steps of a minimum of 0.01 Bar. Pressure values can be read from a screen of the pressure meter (e.g., such as an LCD screen) or can be displayed on the display of a user device.
  • the system enables a user to program parameters such as maximum pressure delivered to the balloon.
  • the user starts to increase pressure delivered to the balloon by means of a button on a handheld remote control and monitors pressure values on a pressure display.
  • the system may trigger an alarm when balloon pressure increases past a selected threshold.
  • the system analyzes pressure data automatically to automatically adjust pressure and increase/decrease speed of inflation or deflation as appropriate.
  • Signals from simulated devices such as the simulated syringe and/or hand operated balloon inflation device generally are processed by an A/D converter first and then inputted to the system processor.
  • signals from footswitches are digital and inputted directly to the microprocessor and then to the system processor.
  • the system can include additional input devices to simulate an interventional procedure.
  • one or more monitors can be included to simulate display of electrophysiological signals such as ECG and blood pressure.
  • the system is designed to allow use by multiple users (see, e.g., FIG. 2).
  • a second user ( 19 ) can be introduced to alter the simulation parameters that a first user ( 1 ) is experiencing.
  • the system further comprises one or more monitors ( 13 - 17 ) comprising one or more second user display interfaces for a enabling a second user (e.g., a trainer) ( 19 ) to monitor a simulation that a first user ( 1 ) is experiencing.
  • the second user/trainer ( 19 ) is provided with selectable options on the display of his or her user interface to enable the second user ( 19 ) to alter or introduce variables (e.g., anatomical or physiological variables) in order to test or evaluate the responses or decision-making abilities of one or more first users ( 1 ).
  • variables e.g., anatomical or physiological variables
  • processor interface ( 13 ) is used to connect a monitor ( 15 ), keyboard ( 16 ) and mouse ( 17 ) of a first user device to a system processor connectable to the network.
  • the system processor communicates with a microprocessor (M 1 ) which resides inside an operating table which receives the manikin.
  • M 1 microprocessor
  • a floppy disk driver ( 10 ) and/or CD-ROM drive ( 12 ), and/or other memory devices new patient cases can be loaded into the simulation system.
  • a user ( 1 or 19 ) can upload relevant patient images or other medical data or can upgrade software using the monitor ( 15 ), keyboard ( 16 ) and mouse ( 17 ).
  • FIG. 3 is a block diagram highlighting the features of the system processor, according to one aspect of the invention.
  • the processor is a CPU installed inside a patient table ( 8 ) which controls data and control flow among various system components such as a hard drive, memory, display monitors, manikin interface, and one or more simulated medical devices.
  • FIG. 4 is a block diagram showing interactions between the system processor and various system inputs according to one aspect of the invention.
  • a microprocessor (M 1 ) is used for data acquisition. Tracking information from an optical tracking unit in optical communication with one or more simulated medical devices is provided to the M 1 through a signal processing circuit.
  • a mock C-Arm moves in response to a control signal from a touch screen connected to the microprocessor through a serial port. Preferably, the control signal is processed by the microprocessor prior to being received by the C-arm.
  • manipulations of a device by a user in an interface provided in the manikin are coordinated with a simulation of the device on the user display, such that motion of the device in the manikin is simulated on the user display in real-time.
  • the simulation device provides a mechanism to continuously track a position of at least the second end of the medical device relative to the manikin.
  • the system can comprise one or more encoders for tracking translation and/or rotation of the device (see, e.g., FIGS. 5A and B).
  • FIG. 5B is a block diagram illustrating the components of the tracking system and the active force feedback mechanism. Using rolling spherical objects coupled to a simulated catheter and guidewire, respectively, four incremental encoders can pick up the motions of the simulated devices. The rolling elements also serve as part of the directional force feedback mechanism described above.
  • the system comprises a tracking unit which tracks the movement of the candidate medical device.
  • the tracking system comprises a light source (e.g., a point light source), a signal processing circuit, and one or more optical sensors, and is placed within the interface in optical communication with the device and the simulated cavity or lumen through which the device is being navigated.
  • the candidate device will reflect light to it from the light source and reflected light will be received by the optical sensor(s). Changes in reflected light picked up from the sensor(s) indicate movement of the candidate device as a result of manipulation.
  • two optical sensors are provided within the tracking unit, each perpendicular to the other.
  • the tracking unit can be in the form of a rail along which the device can move.
  • the simulated interventional device can be looped around the tracking device and can be manipulated by pushing, pulling, and/or twisting the loop.
  • tracking systems enable the intervention system to independently track the movement of two or more medical devices, for example, a catheter and guidewire.
  • FIG. 11 shows a possible configuration that reduces the size of simulation system to one which can be placed on a normal desktop.
  • FIG. 12 is a desktop system intended for pretreatment planning by interventional radiologists.
  • the intervention simulation system further comprises at least one first user device (e.g., a computer or wireless device connectable to the network) comprising a graphical user interface and connectable to a system processor and/or the network.
  • the processor comprises one or more programs for generating a geometric model of a body cavity or lumen of a patient from stored or collected volume-rendered images obtained from one or more patients.
  • the user can access a database of such images using the user interface, either by inputting text into a command box or dialog box and implementing a search function of the system or by selecting one or more selectable options reflecting files and/or images stored in the database (e.g., a hyperlink designated by the name of the file).
  • the system generally operates by means of a software suite that operates on a general purpose computer such as a PC or IBM-compatible device.
  • the system comprises a processor (e.g., as CPU), memory, graphics adaptor, printer controller, hard disk and controller, mouse controller, and the like.
  • the processor should comprise a minimum of about 8 MB of RAM.
  • the first user display interface is part of a monitor which is connected to a keyboard, mouse, and, optionally, printer and/or scanning device.
  • the software suite of the system comprises a program (e.g., a C language program) that controls the system's user interface and data files, e.g., providing one or more of search functions, computation functions, and relationship-determining functions.
  • the system comprises a geometric modeling system for modeling a three-dimensional representation of a body lumen or cavity; a device modeling system for modeling a three-dimensional representation of one or more medical devices, and at least one knowledge base for modeling interactions between a simulated body cavity or lumen and a simulated medical device.
  • optical data relating to the internal contours of a body cavity or lumen are obtained and provided to the intervention simulation system.
  • the optical data can be displayed directly on one or more user interfaces or can be stored in a system database as described above. Because the system user devices and processors are connectable to the network, patient data also can be accessed from remote databases.
  • a stack of two-dimensional (2D) images is collected by a scanning device in an axial direction and is used to form a three-dimensional (3D) structure (see, e.g., as shown in FIGS. 3A and 3B).
  • Suitable scanning devices include, but are not limited to, x-ray devices, magnetic resonance imaging (MRI) devices, ultrasound (US) devices, computerized tomography (CT) devices, rotational angiography devices, gadolinium-enhanced MR angiograph devices, or other imaging modalities.
  • MRI magnetic resonance imaging
  • US ultrasound
  • CT computerized tomography
  • rotational angiography devices rotational angiography devices
  • gadolinium-enhanced MR angiograph devices gadolinium-enhanced MR angiograph devices
  • volumetric images can be constructed.
  • the system may be directly connected to the output of one or more scanning devices, e.g., collecting optical data from such devices as these are acquired.
  • the system may include a means for extracting features from individual scanned images (e.g., communicated to the system through a scanner or provided as a pdf file) to construct a 3D volume image.
  • the geometric modeling arm of the system can be implemented remotely by a user to determine one or more of: the geometry/topology of the body cavity or lumen, measurements relating to any pathological features of the body cavity or lumen, and such parameters as tissue wall thickness, elasticity and the like.
  • a user of the system e.g., a biomedical professional with knowledge of human anatomy and pathology
  • image processing tasks on a plurality of scanned images to create geometrical structures and a topology which corresponds to the contours of a body cavity or lumen belonging to a patient being analyzed.
  • Volume rendering techniques such as ray casting and projection techniques have traditionally been used in the visualization of volume images.
  • Ray casting methods shoot rays through a volume object from each pixel in an image and employ algorithms that trilinearly interpolates samples along each ray, providing complex shading calculations and color assignments at the sample points which are then accumulated into final pixel colors (see, e.g., Kaufman, In Volume Rendering, IEEE Computer Science Press, Las Alamitos, Calif., 1990).
  • Real-time volume rendering with hardware texture mapping e.g., SGI
  • board card e.g., Mitsubishi VolumePro
  • Projection-originated methods reconstruct 3D geometries from two or more images (See, e.g., Solbach, et al., Computer Biomedical Research 27(3): 178-198, 1994; Nguyen and Sklansky, IEEE Transactions on Medical Imaging 13(3): 178-198, 1994; Longuet-Higgens, Nature 293(10): 133-135, 1981).
  • Thinning methods such as “active-contour”, “medial axis transformation”, and “simulated annealing”, and the like, can be employed to determine information in projection planes (see, e.g., Kass, et al., International Journal of Computer Vision 1: 321-331, 1987; Lee, et al., CVGIP: Graphical Models and Image Processing 56(6): 462-478, 1994; Arcelli and di Baja, Image and Vision Computing 11(2): 163-173, 1993; Pellot, et al., IEEE Transactions Medical Imaging 13(1): 48-60, 1994; Brandt and Algazi, CVGIP: Image Understanding 55(3): 329-337, 1992).
  • the advantage of projective reconstruction lies in its capability to handle tiny tube-like systems such as vascular, neural and lymphatic vessels that could be lost with iso-surfacing algorithms.
  • “Piece-by-piece cylinder representation” or “generalized cylinder representation” is widely used in vascular modeling (see, e.g., Brown et al., Proceedings of EUROGRAPHY ' 87, pp 113-124; Barillot et al., IEEE Transactions on Computer Graphics and Applications, December 1985, pp 13-19).
  • Polygonal tessellation e.g., triangulation, also can be applied to model 3D tube-like shapes as is known in the art (see, e.g., Sederberg, et al., International Journal on Computational Geometry and Applications 8(4): 389-406; Choi and Park, Visual Computer 10: 372-387, 1994).
  • Ferley, et al., Computer Graphics Forum 165(5): 283-293, 1997 additionally describes an implicit surface method for reconstruction of branching shapes.
  • vascular segments are modeled using sweeping operations while vascular bifurcations can be modeled using blending operations (i.e., sweeping plus hole-filling operations) (Gregory and Zhou, Computer Aided Geometric Design 11: 391-410, 1994; Ye, et al., Computer Aided Geometric Design 27: 875-885, 1995).
  • blending operations i.e., sweeping plus hole-filling operations
  • volumetric meshing is the technique of volumetric meshing.
  • Meshes which represent a 3D or volumetric form can be generated from scanned images using a standard Windows operating system such as NT.
  • Software for generating 3D mesh images are commercially and publicly available. Sources for such software are described at http://www-users.informatik.rwth-aachen.de/ ⁇ roberts/software.html#Commercial, and include, for example, Altair®HyperMesh®5.0 (available from Altair Engineering, Inc., Maplelawn, Troy, Mich. 48084).
  • a volume image of a blood vessel is obtained to construct a physical or geometric model which comprises information relating to both shape and material of tissue forming the blood vessel.
  • construction of geometric models entail dividing a 3D modeling process into a series of 2D cross-sectional segmentation operations from which the 3D surface of the structure is reconstructed.
  • An image processor is used to draw out the shape of the desired vascular structure from each image. Segmentation methods relying on intensity thresholding or region-growing can be used, as are known in the art, to facilitate the process (see, e.g., Wang, et al., IEEE Engineering in Medicine and Biology, November/December 1999, pp 33-39; Moore, et al., J.
  • Finite element modeling also can be used for blood flow modeling, as described in, for example, Taylor, et al., Computer Methods in Applied Mechanics and Engineering 158: 155-196; Hughes et al., Computer Methods in Applied Mechanics and Engineering 73(2): 173-189, 1989; Shephard and Georges, Int. J Numerical Methods in Engineering 32: 709-749, 1991.
  • a bifurcation is first generated by sweeping three semi-tubular surfaces in bi-cubic Bézier form.
  • a central line model of a vasculature can be constructed.
  • This model is represented in hierarchical structure consisting of vessel topology (using a parent-child relationship to represent the topological connectivity among a list of a vascular segments), vessel geometry (coordinates and radii), and vessel material property.
  • the 3D model of the vessels is then reconstructed based on the central line geometry. Visual smoothness is achieved by employing operations like sweeping and blending.
  • a variational modeling approach is implemented for vasculature segments. An advantage of such method is that it provides flexibility in changing 3D structure. Where a pathology is identified and measured, a vascular model can be modified to account for the pathology.
  • deformable models are used to detect structures in images.
  • Such models can be used to define a geometry which minimizes the energy of a simulated structure to account for topological change, e.g., due to factors such as blood flow dynamics and even interactions between the device and the body lumen or cavity.
  • catheter tip shape deforms in a predictable manner when straightened with a guide wire, when advancing through tortuous vessels, and when encountering vascular constraints such as lumen narrowing, branch point bifurcations, and the like. These events can be modeled using the simulation system.
  • a deformation law is applied to a geometric model obtained from a hierarchical central line model to construct a 3D model.
  • This 3D model can be used to model linear deformation, linear forces, non-linear deformation, and non-linear forces.
  • the application of deformation laws to a geometric model is described in, for example, Wang, et al., 1999, supra, Mallaldi, et al., J. Mathematical Imaging and Vision 6(2-3): 269-289, 1996; Caselles et al., Numehariwitz mathematik 66: 1-31, 1993; Osher and Sethian, J.
  • the system comprises a knowledge base, relating to the physical and/or biological properties of a patient(s)' body cavity or lumens.
  • Facts within this “vascular material knowledge base” can be derived in part from the geometric modeling arm of the simulation system as well as from public databases (e.g., such as PubMed®) (see, as shown in FIG. 1).
  • the property of elasticity can be established from the relationship between image density (determined from a volume image) of a portion of a body cavity or lumen and the stiffness of a particular tissue.
  • the diameter of a cavity/lumen can be determined.
  • plaque can be distinguished from vessel walls by evaluating the image intensity of a volume image.
  • data relating to these images are provided to one or more of the knowledge base systems described above.
  • the knowledge base system(s) include data from images are obtained from patients having atherosclerosis, coronary vascular lesions, carotid bifurcation stenosis, carotid bifurcation stenosis, abdominal aortic aneurysms, peripheral vascular disease, cerebrovascular disease, cancer, trauma, and congenital malformations that may cause or display vascular manifestations, and the like.
  • Quantitative measures of a pathology can be obtained.
  • a quantity module which is part of the system can be used to measure the size of a blockage (e.g., a plaque).
  • At least one knowledge base comprises clinical information related to a specific patient for which a device is being designed.
  • This database can include such demographic information as age, sex, drug history, medical history, medical billing information, and the like.
  • This portion of the system can be encrypted so that while information can be continually added to other knowledge bases (e.g., by remote system users), information within the patient-specific knowledge base cannot be tampered with. However, preferably, even information provided by remote system users will be stored in temporary data files until a system operator enables the system to accept the information. Information relating to populations of patients also can be stored for comparison with information relating to the specific patient.
  • the first display interface also displays a three-dimensional representation of the medical device which is interfaced with the manikin.
  • a simulation of the device can be obtained from a database of images of stored devices (e.g., where these are known and/or commercially available) or from a simulation of a device, for example, as described in U.S. Provisional Application Serial No. 60/273,734, filed Mar. 6, 2001.
  • a volume scanned image of the device also can be generated using techniques similar to those described above.
  • a physical model is used to simulate a device based on the quantitative analysis of volume-rendered images, followed by a derivation of the geometry, topology, and physical properties of the device.
  • Suitable medical devices which can be simulated include, but are not limited to: a catheter, guidewire, endoscope, laparoscope, bronchoscope, stent, coil, balloon, a balloon-inflating device, a surgical tool, a vascular occlusion device, optical probe, a drug delivery device, and combinations thereof.
  • the system is able to model the interactions of multiple devices with each other. For example, the system can model the simultaneous movements of a catheter, guidewire, therapeutic device and the like.
  • the system simulates the movement of the simulated device within the simulated body cavity or lumen in real-time when a first user manipulates the medical device interfaced with the manikin.
  • This can be realized by performing virtual device navigation inside a simulated body cavity or lumen using an incremental FEM engine.
  • an incremental FEM engine Such a simulation system is described in U.S. Provisional Application 60/273,733, filed Mar. 6, 2001, the entirety of which is incorporated by reference.
  • the embedded FEM engine of the system can provide a real-time simulation of catheter/guide-wire interactions with blood vessels. This enables the first user to develop the eye-hand coordination necessary to implement a particular interventional procedure.
  • the underlying assumption of physical modeling is adapted to simulate navigation and/or deployment of a particular medical device in a body cavity or lumen.
  • the system simulates a path which represents at least a portion of a patient's body cavity or lumen and determines fit between the geometry of the device (with or without functional and information attribute layers) and the geometry of the path.
  • the system simulates the design of the device in stages; first providing a simulation based on optimal shape (e.g., using the device shape database), then optimal function, then optimal information parameters.
  • an incremental Finite Element Method is applied to the analysis of catheter navigation.
  • FEM Finite Element Method
  • blood vessels are assumed to be rigid circular tube-structures with varying radii, or with arbitrary cross-sections and deformabilities.
  • the vasculature network is only minimally deformed by catheter navigation.
  • the tip of a guidewire or navigating catheter is very soft in order to prevent damage to a blood vessel when in contact.
  • the vessel wall is therefore relatively stiffer than the catheter itself and therefore, it is quite reasonable to simulate a rigid blood vessel wall when simulating navigation and/or deployment of a catheter.
  • Typical catheters/guidewires are generally cylindrical in shape, with curved or uncurved geometries (e.g., the cross-sections of catheters/guidewires are generally circular or ring-shaped).
  • a catheter/guidewire can be conceptualized as comprising a plurality of discrete 3D beam elements or segments. Thus, they can be represented as an aggregate of multiple, flexible bodies connected to each other at nodes capable of simulating extension, compression, bending and torsion (i.e., modes of deformation).
  • catheter navigation can be considered as a sequence of movements of flexible multibody systems comprising a plurality of segments inside the rigid tube-structures (e.g., corresponding to blood vessels).
  • a simulated catheter is subjected to a simulated force such as pushing, pulling, twisting, or combinations thereof.
  • the movement of the catheter is represented as the sum of rigid-body displacements and deformations at each step with the deformations being relatively small compared to displacements.
  • the elements of the catheter system are treated as rigid bodies first and then deformations are calculated for individual nodes of elements at their equilibrium position.
  • a different principle can be employed which is based on a virtual work method or multibody dynamics method (MDM).
  • MDM models the kinematics (rigid body displacements) of a multibody system.
  • FEM models the deformations of flexible bodies to analyze catheter navigation.
  • a medical device such as a catheter
  • the rigidity of a lumen such as a blood vessel and Hooke's law is applied.
  • nonlinear FEM should be applied.
  • the coordinate system XYZ is the inertial (global) reference frame and xyz is the body (local) reference frame at time t.
  • V denotes the volume of the catheter
  • ⁇ overscore (u) ⁇ denotes the displacement vector of a catheter point at time t
  • ⁇ overscore ( ⁇ ) ⁇ and ⁇ overscore ( ⁇ ) ⁇ denote the strain vector and stress vector, respectively.
  • ⁇ overscore ( ⁇ ) ⁇ 0 denotes the residual stress vector due to the accumulation of the previous deformations which can be reduced through a process of energy release (shape recover),
  • ⁇ overscore (u) ⁇ denotes the virtual displacement vector that is consistent with the constrain conditions
  • denotes the mass density of the catheter
  • ⁇ overscore (ü) ⁇ denotes the acceleration vector (second order differentiation of variables with respect to time t), and
  • T is the traction vector and can be expressed in terms of the external force applied at the boundary S and the contact force between the catheter and the walls of the vessels.
  • the displacement vector can be defined as a summation of two terms, a term representing rigid body displacement and a deformation term, in order to derive an explicit equation which can be solved to simulate catheter movement. Because rigid displacement of the catheter results in no strain or stress, the final two variational equations from (1) can be formulated as
  • ⁇ overscore (u) ⁇ r denotes the rigid displacement
  • ⁇ overscore (u) ⁇ f represents the deformation
  • ⁇ overscore (T) ⁇ a and ⁇ overscore (T) ⁇ c represent the external force and contact force, respectively
  • ⁇ overscore ( ⁇ ) ⁇ f and ⁇ overscore ( ⁇ ) ⁇ f represent the strain and stress corresponding to the deformation. It is assumed here that deformations are generally smaller than the rigid displacements. The deformation can then be assumed to be time independent during navigation. Because of this, the acceleration of deformation is not taken into consideration in this formula.
  • [0189] represents the deformations of the elements.
  • S n and V n denote the boundary and volume of the nth element, respectively.
  • Equations (4) and (5) can be solved using routine FEM methods to derive the matrix equations:
  • the rigid body displacement vector ⁇ overscore (u) ⁇ is represented by three translations and three rotations at each FEM node, while the deformation vector ⁇ overscore (U) ⁇ is also expressed in the same way, with a total of six degrees of freedom at an FEM node.
  • Matrices ⁇ overscore (M) ⁇ and ⁇ overscore (K) ⁇ denote the global mass matrix and the global stiffness matrix, respectively.
  • equations (6) and (7) are coupled to each other and can be solved using a semi-implicit iteration method (see, e.g., Rao, In The Finite Element Method in Engineering, 2 nd Edition, New York: Pergamon Press, 1989).
  • vessels are not treated as rigid cylindrical structures but as deformable structures. This is particularly useful when modeling the interaction of catheterization devices, such as balloon and stents, with diseased arteries. These vessels vary in cross-sectional diameter due to the presence of a pathology, such as stenosis. Further, the deformation properties of diseased vessels are different from the deformation properties of normal vessels. Additionally, it may be desirable to model one or more physiological parameters such as the effect of blood flow on navigation of a medical device such as a catheter. Therefore, in one aspect, the simulation process uses a hemodynamic model describing the blood flow phenomenon. Preferably, the hemodynamic model accounts for the affects of such variables, as disease, age, obesity, and the like.
  • the device materials and vessels are treated as nonlinear. Blood flowing through the vessels is modeled by treating the blood as a homogeneous incompressible Newtonian fluid.
  • the vessels and associated stenosis are modeled as layered structures, using a 3D space FEM model.
  • Physiological influences on a body cavity or lumen also can be considered in particular anatomic locations in which these influences may be important concerns. For example, when modeling coil deployment in the head, the system can take blood flow dynamics into account, since a coil may be swept away if incorrectly placed.
  • FEM analysis occurs in real-time, in order to simulate real-time movement of a representation of a device while a user is manipulating a model device in the manikin.
  • Such training is important to developing eye-hand coordination.
  • this is implemented using a fully nonlinear 3D finite element model combined with hemodynamic analysis. This requires extensive computer power.
  • a multiprocessor system with at least about four processors, with each processor having computing power equal to a 2 GHz Intel Pentium 4 CPU is one example of a system that might be used.
  • the system models interactions between the physiology and anatomy of a patient and one or more medical devices using physical modeling.
  • FIG. 16 is a block diagram illustrating the various steps in such a simulation process and how these interact with each other.
  • the system accounts for physiological responses to an intervention procedure. For example, in simulating damage to a vessel wall through excessive pushing of a device against the wall, the system also can simulate the effect such an action will have on blood pressure.
  • a simulation of a tumorous lesion in a blood vessel include modeling the effects of such a lesion on local mechanical properties of tissues.
  • the system includes a patient database comprising stored volume images and files relating to optical data obtained from body cavities and lumens of one or more patients.
  • the database comprises data from a population of patients, such as a population of normal patients, a population of patients with coronary artery disease, peripheral vascular disease, stenosis, and the like.
  • the database comprises vascular data from patients obtained through one or more of a 3D Rotational XR scanner, an MRI scanner, an MRA scanner, or any scanning device suitable for collecting scanned images for generating volume images. Data so obtained generally is segmented. By having two rounds of scanning using the same scanning, but with only one round revealing the vasculature, segmented vessels can be obtained by subtracting images of the former scan from the corresponding images in the latter scan.
  • FIG. 15 illustrates the creation of a physical model for a patient's vasculature. Based upon segmented volume images, nodes are extracted, along with position and contour information. This data defines the central line of a vessel. Preferably, nodes are labeled according to the direction of blood flow as this aids in the deformation analysis process. After a 3D geometric model is reconstructed from the medical images, using the geometric modeling system as described above, a deformation law is implemented using FEM.
  • the system models one or more operations of the device.
  • operations include, but are not limited to: a surgical procedure (e.g., such as removing, cutting, or repairing a tissue), inflation or deflation of a balloon, injection of a radioopaque material into the body cavity or lumen, and the like.
  • the system models interactions between an angioplasty device and a blood vessel having one or more lesions.
  • the system can model the deployment of a balloon angioplasty device at a lesion site and can model inflation and deflation of the balloon at the site.
  • a visual simulation is implemented at the same time that a user manipulates a balloon-inflating device.
  • the balloon-inflating device comprises a delivery mechanism for controlling delivery of fluid (e.g., such as air) to a balloon, a pressure sensor for monitoring pressure of a fluid delivered to the balloon, and an electrical pressure meter for reading pressure determined by the pressure sensor.
  • the electrical pressure meter transmits a signal corresponding to a pressure value to the system processor and, in response, the system simulates deployment of the balloon both on the screen of the first user device and within the manikin.
  • Injection of contrast medium also can be simulated.
  • the first user or a second user training the first user
  • injection can be triggered using a simulated syringe or button on the control panel.
  • the appearance of contrast filling the vessels is modeled to reflect the rate of injection relative to the blood flow rate in the vessel. This provides a realistic impression of the injection.
  • diastolic and systolic flow pattern and washout of contrast through the vasculature also are modeled using the contrast injection function. Roadmapping capabilities additionally can be made available. The value of roadmapping is enhanced when it is combined with simultaneous 3D display of the vasculature.
  • the system provides a haptic interface for providing an interventional radiologist with the sense of touch during pretreatment planning and training.
  • the system can be used in preparation for catheterization procedures with cerebral vascular pathologies such as intracranial aneurisms, stenosis, arteriovenous malformations, and the like.
  • Other simulations which can be performed using the system include, but are not limited to, angioplasty, catheter navigation in the abdominal aorta, peripheral intravenous catheterization, venipuncture, interventional cardiology, and the like.
  • FIG. 13 is a flow diagram illustrating a simulation according to one aspect of the invention.
  • the simulation is event driven, i.e., responding to discrete actions from one or more users.
  • Computation of interactions between the body cavity or lumen and one or more medical devices is implemented by the FEM engine described above.
  • FEM has been used widely to compute deformations under mechanical constraints in engineering; however, the instant invention applies FEM analysis to various physical models of blood vessels, blood flow dynamics and medical devices.
  • Any input from users comes in the form of device manipulations, such as pushing, pulling, twisting a catheter; deploying a coil; inflating a balloon with a balloon catheter.
  • Each of these inputs affects the finite element structure modeled by the system.
  • an equilibrium state representing the interaction between the device and cavity/lumen can be obtained.
  • the interacting devices and vessels are at their final deformable forms.
  • the forces computed at each node of the interaction between a medical device/body cavity or lumen are then fed back to one or more users using simulated instruments interfacing with the system.
  • System outputs include real-time representations of medical devices as they navigate and/or deploy in simulated body cavities or lumens.
  • Real-time interaction is an important feature of the instant invention.
  • the immersion of a user, and therefore, his or her ability to learn from the simulation system, is directly linked to the bandwidth of various components of the simulation system.
  • An acceptable bandwidth for visual display is in the range of about 20-60 Hz while an acceptable bandwidth for haptic display is in the range of about 300-1000 Hz (where 300 Hz is the free hand gesture frequency).
  • Latency measures the time between sensor acquisition (e.g., acquiring the position of a simulated medical device relative to a simulated body cavity/lumen) and system action (e.g., haptic rendering or force feedback).
  • Computation time is that amount of time needed to determine the equilibrium state of a structure (e.g., a representation of a device and cavity/lumen) and to update the resulting models.
  • Latency There are several contributing causes of latency, including, but not limited to: time required for communication between input devices and the system processor, time for communication between the haptic display and the system processor, time for communication between the visual display (e.g., the 2D display) and the processor, time to compute collision detection, time for force feedback, and time for computing deformation models. Latency depends greatly on hardware and preferably the system comprises an at least about 16-bits bus for internal transmission within the embedded system (e.g., manikin interface), and a combination of serial and USB transmissions to create external links between simulated devices and the system processor.
  • FIG. 14 shows the relationship between response time and realism.
  • the simulation system according to the invention provides a visual feedback of 12-15 frames per second.
  • the system provides a library of 3D representations of medical devices and a library of 3D representations of normal or pathological patient anatomy.
  • the user can select an entry point for insertion of a medical device into a simulated patient (e.g., at either a radial or femoral site) and in response to the user's manipulation, a haptic display will display the navigation of the device through a selected body cavity or lumen.
  • the system can be used to direct the navigation of the device towards or away from the heart, allowing a user to choose where navigation will begin to be tracked.
  • the user interface can comprise direction buttons, enabling a user to maneuver the device in particular directions.
  • a current position of a navigating catheter within a body cavity/lumen is overlaid on a fluoroscopic view.
  • a user has the option to adjust a fluoroscopic image in a manner similar to that employed in a CathLab.
  • the user can zoom in/out of a particular view of a catheter-guidewire entry site for a closer look of the position and orientation of the catheter and guidewire.
  • the user also can improve image quality by collimating the field of view using the shutter function of a simulated scanning device.
  • the shutter function provides both lateral and vertical collimation to recreate a clinical setting.
  • the contrast of the fluoroscopic image also can be modified.
  • moving patient table control levers can change the position of the fluoroscopic field of view. These levers control the movement of the image in the X and Y-axes as well as rotation and skew. They correspond to patient table control levers used in the clinical setting.
  • the motion of one or more medical devices relative to a body cavity or lumen is tracked and updated simultaneously in fluoroscopic and 3D displays.
  • the user can change the transparency of 3D rendered vessels to better compliment the geometry presented in the fluoroscopic view.
  • the user also has the option of overlapping a representation of the device with a representation of a surface-rendered vasculature.
  • 3D-rendered vessels can be rotated in the x-, y-, and z-axis to better appreciate the position of the catheter/guidewire tip relative to the vascular anatomy. This feature is very useful in teaching selective vessel catheterization techniques.
  • a fluoroscopic image can be viewed in stereo mode with the stereo image projected onto a split screen alongside the 2D image of a vessel.
  • Users see the stereo virtual image on the screen of their user devices wearing a pair of stereo glasses (e.g., such as StereoGraphic Crystal Eyes).
  • the stereo virtual objects consist of vessels, associated volume data, and the one or more interventional devices being navigated and/or deployed through the vessels.
  • the simulator has the capability of locating catheter tip position within multi-planar images of a body region.
  • the system will highlight tip position relative to anatomical structures on the display of one or more user devices.
  • images of the tip are viewable in any of an axial, coronal, sagittal or combined mode, representing images of scanned anatomical structures (e.g., such as obtained from CT, MRI or actual cross-anatomical color images).
  • images of the tip are viewable in any of an axial, coronal, sagittal or combined mode, representing images of scanned anatomical structures (e.g., such as obtained from CT, MRI or actual cross-anatomical color images).
  • an endoscopic view is provided of the tip of the catheter within the enclosing vessels of the cardiovascular system.
  • the system provides a haptic system for providing a neuroradiologist with the sense of touch during pretreatment planning and training.
  • the system comprises a database of angiographic information and a vascular model can be extracted from a database comprising data relating to geometry and topology of the cerebral vasculature (e.g., using a knowledge base). Physical properties of vessels can be obtained from outside sources such as the literature or from various experts.
  • a library of devices suitable for use with vessels in the brain is included in the system.
  • the library comprises data files relating to the geometry and/or physical properties of interventional devices, such as catheters, guidewires, stents, and coils.
  • a device shape and material knowledge base can be provided as described in U.S. Provisional Application Serial No. 60/273,734, filed Mar. 6, 2001.
  • the system simulates an intracranial blood vessel with an aneurysm.
  • Intracranial aneurysms are berry-like blisters in cerebral arteries that are caused by a weakness of all vessel wall layers. If rupture of an aneurysm occurs, hemorrhage can cause serious damage to the brain.
  • a clear understanding of the anatomy surrounding an aneurysm is critical, such as the location and size of the neck, or connection between the aneurysm and vessel which feeds into it.
  • An aneurysm is usually clearly visible in volume and surface-rendered images.
  • the system displays a representation of the aneurysm and surrounding blood vessels and models the interactions of a simulated device being maneuvered in proximity to the aneurysm.
  • the system is used to simulated the placement of one or more coils to treat the aneurysm.
  • aneurysm coiling is simulated by navigating a medical device such as a coilwire to the aneurysm and replacing the wire with a coil. The coil is deployed by detaching the coil from the wire. Multiple coils can be deployed by repeating the detachment process with new coil wires. Each of these actions can be simulated on the haptic display using the system according to the invention.
  • a user can simulate other interventional procedures such as contrast fluid injection, inflation or deflation of a balloon, stent deployment, injection of a drug or therapeutic -agent.
  • interventional procedures such as contrast fluid injection, inflation or deflation of a balloon, stent deployment, injection of a drug or therapeutic -agent.
  • the system provides both haptic and visual feedback to the user to enable the user to develop the eye-hand coordination necessary to become skilled in these procedures.
  • the invention produces a highly realistic simulation environment for preplanning image-guided medical device delivery procedures and for training individuals who perform such procedures.
  • component parts of this invention may be applied to many other fields, for example, such as the field of 3D computer games. It should be apparent to those of ordinary skill in the art that variations, modifications, and other implementations of what is described herein will occur to those of ordinary skill in the art without departing from the spirit and scope of the invention and the claims.

Abstract

This invention provides a system and method for computer simulation of image-guided diagnostic and therapeutic procedures such as vascular catheterization, angioplasty, stent, coil and graft placement, embolotherapy and drug infusion therapy. In a particularly preferred aspect, the system is configured to resemble a cardiovascular catheterization laboratory where interventional radiology procedures are performed. A first user can interactively manipulate therapeutic catheters, guidewires and other medical devices in real-time while viewing patient-specific medical image data sets in a manner similar to that encountered in a clinical procedure.

Description

    RELATED APPLICATIONS
  • This application claims priority under 35 U.S.C. § 119(e) to U.S. Provisional Application 60/273,733, and to U.S. Provisional Application Serial No. 60/273,734, both filed Mar. 6, 2001, the entireties of which are incorporated by reference herein.[0001]
  • FIELD OF THE INVENTION
  • The invention relates to a system and method for simulating image-guided medical procedures, particularly those relying on interventional and/or diagnostic devices such as catheters. [0002]
  • BACKGROUND OF THE INVENTION
  • Interventional radiology provides an alternative to open field surgery. Interventional radiology began as a discipline for diagnosing and treating vascular disease (e.g., such as narrowing of the arteries). The interventional radiologist typically uses a catheter inserted into a blood vessel through a puncture in the skin to gain internal access to the vascular system. Using medical imaging guidance, the catheter is navigated to a target site (e.g., such as the site of a diseased tissue) where it can be used as a conduit through which to pass therapeutic devices. Minimally invasive procedures relying on interventional radiology, including lapraroscopic surgery, cardiovascular interventional radiology, and neurointerventional radiology, have tremendous potential to reduce patient discomfort, complications, hospital stays, post-procedural recovery time and total medical costs. [0003]
  • However, despite the advantages described above, minimally invasive procedures also pose risks. Failure to properly navigate, orient or position catheters and/or other devices within a patient, or failure to properly recognize an anatomic area or pathology to be treated may result in serious injury to a vein, artery, organ, or other internal tissue structure. [0004]
  • Interventional radiologists must perform the delicate eye-hand coordinated movements needed to navigate catheters and therapeutic devices while viewing scanned images of the patient's body cavities or lumens on a flat TV screen. The images are obtained from X-rays, CAT scans, MRI scans, and the like. Depth perception is lacking and it is difficult to learn to control the instruments through the spatially arbitrary linkage. A mistake in this environment can be dangerous. Without performing the procedure often, there is no way for practitioners to maintain the high degree of skill needed to perform these procedures. It is also impractical to implement new methods, operations, and procedures on live individuals. [0005]
  • U.S. Pat. No. 6,038,488 discloses a catheter simulation device for surgery and interventional radiology procedures. Translation and rotation of the simulated catheter can be tracked and a computerized control system and recording device are employed to provide a programmed procedure which provides a realistic “feel” to a user of a surgical procedure. [0006]
  • WO 99/16352 describes using graphical representations of a surgical instrument and area of the body in which a procedure is being performed to aid an operator using the surgical instrument. [0007]
  • WO 99/39315 describes a vascular access simulation system with a tracking system for monitoring the movements of a simulated catheter needle assembly and a skin traction mechanism. The system receives measurements from the tracking system to update simulation and display of representations of the catheter while providing control signals to a force feedback device to enable the application of force to the catheter needle assembly. [0008]
  • WO 98/03954 describes a system for simulating operating conditions during minimally invasive surgical procedures. Data regarding the movements of a simulated surgical instrument are interpolated by a computer processor, which utilizes a database of information representing a patient's internal landscape to create a computer model of the internal landscape of the patient. [0009]
  • U.S. Pat. No. 6,106,301 describes a radiology interface apparatus and peripherals, such as mock medical instruments, for simulating performance of a medical procedure on a virtual patient. The interface measures manipulations of system peripherals and transfers these measurements via a processor to a medical procedure simulation system. [0010]
  • SUMMARY OF THE INVENTION
  • There is a need to have a highly realistic simulation environment for training and pretreatment planning of image-guided, medical procedures such as vascular catheterization, angioplasty, embolotherapy, drug infusion therapy and stent and coil deployment. [0011]
  • This invention is designed to assist physicians in their training and in preplanning of diagnostic and therapeutic procedures performed in the vascular cardiovascular catheterization laboratory. In addition to providing realistic visual feedback and interacting with essential devices, such as are found in a cardiovascular catheterization laboratory, the simulator also provides active haptic force and tactile feedback components to enhance the total hand-eye coordinated experiences encountered by physicians during actual interventional procedures. To simulate various types of procedures, the invention also provides a novel solution to easily configure or customize the training or pretreatment planning environment to meet the needs of the user or trainer. [0012]
  • In one aspect, the invention provides a system for simulating the movement of a medical device in a body cavity or lumen of a patient. The system comprises a medical device comprising a first end for manipulation by a user and a portion comprising a second end insertable into a simulated body cavity or body lumen in a manikin. The manikin comprises an interface for receiving the portion comprising the second end and for interfacing with the simulated body cavity or lumen. The manikin further comprises a directional force feedback mechanism for exerting a directional force on the medical device in response to a feedback signal. [0013]
  • Preferably, the directional force feedback mechanism provides resistance to forward motion but enables free reverse motion in response to the feedback signal. In one aspect, the directional force feedback mechanism comprises a rolling element coupled to the portion of the medical device comprising the second end. An internal surface of the simulated cavity or lumen in the manikin comprises an oblique slot for receiving the rolling element. In response to a feedback signal, forward movement of the second end will cause the rolling element to be received by the slot, thereby causing resistance to further forward motion. A motor, such as a servo motor, can be used to control movement of the rolling element. [0014]
  • In another aspect, the system further comprises a tactile feedback mechanism which can provide continuous vibrational feedback to a user holding the medical device. Tactile feedback can be provided through a continuously rotating motor in communication with the portion of the medical device comprising the second end. The tactile feedback mechanism can simulate such parameters as blood flow, respiration and the like. [0015]
  • Preferably, the position of at least the second end of the medical device relative the simulated body cavity or lumen is continuously tracked. In one aspect, the medical device comprises an encoder for tracking the translation of the device and an encoder for tracking the rotation of the device. In another aspect, the system comprises a tracking unit comprising a light source, a signal processing circuit, and one or more optical sensors which are placed within the interface. Light from the light source reflects on the device when it is inserted into the interface and reflected light from the device is received by the one or more optical sensors of the tracking system, enabling the movement of the device to be tracked. In response to detection of changes in reflected light, the system will simulate movement of the device in real-time on a user display. [0016]
  • In one aspect, two optical sensors are provided which lie in two different planes which are perpendicular to each other. In another aspect, the tracking unit is configured in the form of a rail along which the device can move. [0017]
  • More than one medical device can be inserted into the interface and the position of each medical device can be independently monitored. Suitable medical devices for use with the system include, but are not limited to: a catheter, guidewire, endoscope, laparoscope, bronchoscope, stent, coil, balloon, a balloon-inflating device, a surgical tool, a vascular occlusion device, optical probe, a drug delivery device, and combinations thereof. [0018]
  • In one aspect, the system comprises a table on which the manikin is placed. The table can comprise a processor connectable to the network. Additional ancillary equipment can include, but are not limited to, foot and hand activation switches, radioopaque contrast dye injectors, hand operated balloon inflation devices, and monitors displaying various simulated electrophysiological parameters. [0019]
  • The system comprises at least one first user device connectable to the network which comprises a first display interface for displaying a three-dimensional representation of a simulated body cavity or lumen of a patient. Preferably, the first display interface further displays a three-dimensional representation of a medical device corresponding to a medical device which is interfaced with the manikin. The system simulates the movement of the medical device within the simulated body cavity or lumen of the manikin in real-time on the display, when a first user manipulates the medical device interfaced with the manikin. For example, the system can be used to simulate the movement of a catheter through a blood vessel (e.g., such as a blood vessel in the heart or brain or another organ). In one aspect, the system further simulates deformation of the body cavity or lumen by the medical device. [0020]
  • The system also can comprise a simulated scanning display for displaying a two-dimensional image of the simulated body cavity or lumen. In one aspect, the scanning display is part of a simulated scanning device. For example, the simulated scanning device can simulate an x-ray imaging system. Both the simulated scanning device and scanning display can be coupled to a movable C-arm within scanning distance of the manikin. [0021]
  • To enhance the realism of the simulation, a re-configurable control panel (e.g., a touch screen) can be provided for performing one or more of: image acquisition selection; image display; manipulating a table on which the manikin is placed; manipulating the position of a simulated scanning device relative to the manikin; and control of one or more shutter devices for limiting a field of view of a scanning device placed within scanning distance of the manikin. The system also can comprise at least one foot-activation switch for activating or collimating the simulated scanning device, image display and/or for controlling table movement. [0022]
  • The system can be adapted for use by multiple users, for example, as part of a training environment. In one aspect, the system comprises a monitoring station comprising a second user device connectable to the network and comprising a second display interface for enabling a second user to monitor the movement of the medical device within the simulated body cavity or lumen. Preferably, the second display interface displays selectable options (e.g., a drop down menu, action buttons, check buttons, radio buttons, dialog boxes, command lines and the like), enabling the second user to select or change one or more anatomical and/or physiological parameters of the simulated body cavity or lumen. Selection of a selectable option causes the three-dimensional image of the simulated body cavity or lumen displayed to the first user to change to reflect the changed anatomical and/or physiological parameters selected by the second user. [0023]
  • In one aspect, the first user display interface provides access to a database and in response to this accessing, the system displays an image and/or medical data of a patient on the first user display interface. In another aspect, the second user display interface provides access to the database and the system displays an image and/or medical data on the second user display interface. In a further aspect, the second user display interface provides a selectable option enabling a second user to display the image which is displayed on the second user display interface, on the first user's display interface. [0024]
  • The invention additionally provides a syringe for simulating fluid delivery, comprising: a housing defining a lumen comprising an opening for delivering a fluid, a pushing element for pushing the fluid through the opening, a friction-producing element in communication with the pushing element, and a motor in communication with the friction-producing element and comprising a signal-receiving element. The friction-producing element will cause friction between the pushing element and a surface of the lumen of the housing when the motor is activated. Activation of the motor is responsive to a signal received by the signal-receiving element. [0025]
  • When activated, the motor causes motion of the friction-producing element, causing the friction-producing element to contact the surface of the lumen of the housing. This creates friction between the pushing element and the surface of the lumen and causes resistance to the motion of the pushing element, thus simulating injection of a fluid through a syringe into the body of a patient. [0026]
  • The friction-producing element can comprise one or more rubber pads, each rubber pad being coupled to an arm whose movement is controlled by the motor, e.g., such as through a gear attached to the motor. In one aspect, the amount of friction produced by the friction-producing element is adjusted by controlling a rotation angle of the motor. [0027]
  • The syringe can be used with the system described above. For example, the opening of the syringe can be connectable to a connecting piece having a first end for receiving fluid from the opening and a second end for delivering fluid to a simulated body cavity or body lumen in the manikin, e.g., via the manikin interface. [0028]
  • The invention also provides a method for simulating fluid delivery into a body cavity or lumen of a patient comprising providing a syringe as described above and providing a signal to the syringe, thereby causing friction between the friction producing element and the pushing element. Delivery of fluid to a body cavity or lumen can be viewed in real-time on the screen of a first and/or second user interface. [0029]
  • The invention also provides a balloon-inflating device for simulating deployment of a balloon within a body cavity or lumen of a patient. In one aspect, the device comprises a delivery mechanism for controlling delivery of fluid (e.g., such as air) through the balloon-inflating device to the balloon, a pressure sensor for monitoring pressure of fluid delivered, and an electrical pressure meter for reading pressure determined by the pressure sensor. Preferably, the electrical pressure meter is connectable to a processor and can transmit a signal corresponding to a pressure value to the processor. The balloon inflating device can be used with the system; for example, the system can simulate the deployment of a balloon (e.g., inflation or deflation) within the lumen of a patient; i.e., the system can be used to simulate a balloon angioplasty procedure. [0030]
  • The system also can be used to simulate other operations of medical devices, such as a surgical procedure (e.g., such as removal or repair of a tissue structure), injection of a radioopaque isotope and the like. [0031]
  • The invention further provides methods for using the system described above. In one aspect, the invention provides a method for simulating the movement of a medical device in the body cavity or lumen of a patient, comprising: providing a medical device comprising a first end for manipulation by a user and a portion comprising a second end inserted into a simulated body cavity or body lumen in a manikin. The simulated body cavity or lumen in the manikin comprises a directional force feedback mechanism and in response to a feedback signal, the directional force feedback mechanism creates resistance to forward motion of the medical device but allows free reverse motion, allowing a first user to experience the sensation of using the device in the body of a patient. In a preferred aspect, the user experiences tactile feedback as well as directional feedback. [0032]
  • The first user of the system can access a database of three-dimensional images of body cavities and lumens from a plurality of different patients. For example, the first user can request a representation of a selected image to be displayed on the display interface of his or her user device in response to this accessing. For example, the user can select a suitable hyperlink displayed on the interface, or can input a query into a command line or dialog box, or can select a selectable option provided on the interface in response to the user's accessing the database. [0033]
  • In one aspect, the system also superimposes a three-dimensional representation of the medical device on the representation of the body cavity or lumen. Preferably, the system simulates the movement of the medical device within the body cavity or lumen in real-time on the display interface as the user manipulates the medical device which is interfaced with the manikin. More preferably, the system also simulates deformation of the body cavity or lumen as the first user simulates navigating and/or deploying the medical device. The user can experience one or more simulated operations of the device, such as a surgical procedure, injection of a radioopaque dye, balloon deployment, and the like. [0034]
  • The first user can manipulate a plurality of medical devices using the interface of the manikin. In response, the system will simulate the movement of each of these devices on the first user's display interface. For example, the system can simulate the can simulate navigating a first catheter to a target region of the body, then a balloon catheter, and then positioning a balloon deployment device (e.g., such as the one described above) in proximity to the balloon catheter to inflate or deflate the balloon. [0035]
  • In another aspect, the system also simulates inserting a stent catheter, navigating the stent catheter to the target region, and using the balloon deployed by the balloon catheter to deploy the stent. In a further aspect, the system simulates coil embolization in a body cavity or lumen of a patient. As a first user interacts with the manikin by inserting a catheter, guidewire, and coil wire into the simulated body cavity or lumen, the system simulates movement of each of these devices in the simulated body cavity or lumen on the first user's display interface. A selectable option on a control interface provided as part of the system (e.g., a re-configurable control panel or touch screen) provides the user with a selectable option for detaching the coil from the coil wire. When the user selects the selectable option, the coil is released from the coil wire in the manikin and on the screen of the first user's display interface. [0036]
  • A second user also can interact with the first user by using the monitoring station described above. For example, the second user can display a particular image selected by the second user from the database on the first user's display interface. The second user can alter parameters of the simulation displayed to the first user, for example, as part of a training exercise, to document the progress of one or more first users, and/or to introduce procedural variables that can be used to test or evaluate the response and decision-making abilities of one or more first users. [0037]
  • In a particularly preferred aspect, the system is configured to resemble a cardiovascular catheterization laboratory where interventional radiology procedures are performed. A first user can interactively manipulate therapeutic catheters, guidewires and other medical devices in real-time while viewing patient-specific medical image data sets in a manner similar to that encountered in a clinical procedure.[0038]
  • BRIEF DESCRIPTION OF THE FIGURES
  • The objects and features of the invention can be better understood with reference to the following detailed description and accompanying drawings. [0039]
  • FIG. 1 is the block diagram of a simulation system according to one aspect of the invention. [0040]
  • FIG. 2 illustrates a perspective view of a system according to the invention. A simulated patient ([0041] 6) or manikin houses tracking and force feedback assemblies. Simulated medical devices are introduced into the simulated patient via a user interface box embedded within the patient/manikin (e.g., through the groin or axillary area, in the case of a simulated catheterization lab). A first user (1) navigating and/or deploying simulated devices can be monitored by a second user (19) according to one aspect of the invention.
  • FIG. 3 is a block diagram showing various components of a system processor according to one aspect of the invention. [0042]
  • FIG. 4 is a block diagram showing various system inputs according one aspect of the invention, such as touch screens, footswitches, syringes, C-arm, hand-operated balloon device, feedback structures, and their connections with the system processor. [0043]
  • FIG. 5A illustrates the mechanical structure of a tracking system and active force feedback structure according to one aspect of the invention. More than one set of catheters and guidewires can be used in a given simulation. The translation and rotation of each device are measured using incremental encoders. For example, encoder A and encoder B measure the translation and rotation of a catheter, respectively. [0044]
  • FIG. 5B is a block diagram illustrating components of the tracking system and active force feedback system and their interactions with the system processor. [0045]
  • FIG. 6A illustrates a different tracking system according to one aspect of the invention comprising one or more optical sensors. [0046]
  • FIG. 6B shows a tracking unit and catheter device configured as a loop which can be used to simulate pushing, pulling, or twisting. [0047]
  • FIGS. 7A and B show more detailed views of a directional force feedback mechanism according to one aspect of the invention. As shown in FIG. 7A, a wheel coupled to a motor directs forward movement of a simulated catheter through a shutter connected to the simulate catheter. Forward and downward motion of the shutter, forces a rolling element coupled to the catheter into an oblique slot which creates resistance to further forward motion. A discontinuously rotating hand provides a sensation of vibration. FIG. 7B shows a close up of the rolling element (e.g., a shaft) and a cross-section through the oblique slot. [0048]
  • FIGS. [0049] 8A1-3 and B shows the structure of a simulated syringe with a force feedback mechanism according to one aspect of the invention. FIG. 8A shows a cross-section through the longitudinal axis of the device while FIG. 8B shows a cross-section through the tranverse axis of the device.
  • FIG. 9 shows a simulated hand-operated balloon-inflating device according to one aspect of the invention. A pressure sensor is used to measure the pressure of inflation of a balloon attached to a catheter. The sensor signal is processed and transmitted to the system processor. A user can read the pressure value from a display monitor or from a piezometer as shown in the upper portion of the Figure. A user also can feel pressure transmitted back from a catheter port from the balloon during the inflation process. [0050]
  • FIGS. [0051] 10A-D show re-configurable control panels according to different aspects of the invention.
  • FIG. 11 shows a scaled-down simulation system according to one aspect of the invention. [0052]
  • FIG. 12 shows a desktop simulation system for pretreatment planning comprising a re-configurable control panel. [0053]
  • FIG. 13 is a flow chart showing the steps of a simulation process according to one aspect of the invention. [0054]
  • FIG. 14 illustrates the time/realism requirements of a simulation system according to the invention. [0055]
  • FIG. 15 shows a physical model of vascular data and device data which can be inputted into a system processor according to the invention. [0056]
  • FIG. 16 illustrates creation of a physical model of a body cavity or blood vessel according to one aspect of the invention.[0057]
  • DETAILED DESCRIPTION
  • The invention provides a system for the simulation of image-guided medical procedures and methods of using the same. The system can be used for training and certification, pre-treatment planning, as well therapeutic device design, development and evaluation. [0058]
  • Definitions [0059]
  • The following definitions are provided for specific terms which are used in the following written description. [0060]
  • As used herein, “coupled to” refers to direct or indirect coupling of one element of a system to another. An element may be removably coupled or permanently coupled to another element of the system. [0061]
  • As used herein, “within scanning distance” refers to a distance which is close enough to the manikin to permit display of an image of the simulated body cavity or lumen on the scanning display of the system. [0062]
  • As used herein, “a re-configurable control panel” refers to a display interface comprising one or more selectable options (e.g., in the form of action buttons, radio buttons, check buttons, drop-down menus, and the like) which can be selected by a user and which can direct the system to perform operation(s). Preferably, the one or more options can be selected by touch. The control panel can be modified by a user (e.g., by implementing a system program which alters the display, causing it to display different selectable options) thereby “re-configuring” the control panel. [0063]
  • As used herein, “providing access to a database” refers to providing a selectable option on the display of a user device which, when selected, causes the system to display images or data stored within the database, or causes one or more links to be displayed which, when selected, causes the system to display the images or data. In one aspect, the system displays images or data, or links to images or data, in response to a query of the system by a user. In one aspect, the display interface provides a “query input field” into which the user can input a query and the selectable option is an action button for transmitting the query to the system. [0064]
  • As used herein, the term “in communication with” refers to the ability of a system or component of a system to receive input data from another system or component of a system and to provide an output response in response to the input data. “Output” may be in the form of data or may be in the form of an action taken by the system or component of the system. [0065]
  • As used herein, “deployment of a balloon” refers to either inflation or deflation of the balloon. [0066]
  • As used herein, a pathology “affecting the structure of the body cavity or lumen” is one which measurably alters at least one physical property of the body cavity or lumen.. [0067]
  • As used herein, “a physical property” refers to a property which relates to the structure or anatomy of a body cavity or lumen which is measurable, generally without the aid of a labeled molecular probe; for example, physical properties of a blood vessel include, but are not limited to: elasticity, thickness, strength of ventricular contractions, vascular resistance, fluid volume, cardiac output, myocardial contractility, and other related parameters. [0068]
  • As used herein, “a volume image” is a stack of two-dimensional (2D) images (e.g., of a body cavity or lumen) oriented in an axial direction. [0069]
  • As used herein, a device for “accessing a body cavity or lumen” refers to a device which can be maneuvered in the body cavity or lumen. “Maneuvering” refers to the ability of at least about 50% of the external surface of the device to fit within a cavity or lumen while retaining rotational or forward translational freedom of movement. [0070]
  • As used herein, an “interventional medical device” includes a device for treatment (e.g., stents, stent-grafts, balloons, coils, drug delivery devices), for diagnosis (e.g., imaging probes), and for placement of other medical devices (e.g., guidewires). Some devices, such as catheters, can have multiple functions. In general, the terms “an interventional medical device” and “device for accessing a body cavity or lumen” are used interchangeably. [0071]
  • As used herein, a “knowledge base” is a data structure comprising facts and rules relating to a subject; for example, a “vascular properties knowledge base” is a data structure comprising facts relating to properties of blood vessels, such as elasticity, deformation, tissue and cellular properties, blood flow, and the like and rules for correlating facts relating to vascular properties to interactions with one or medical devices. [0072]
  • As used herein, a “rule” in a knowledge base refers to a statement associated with a certainty factor. Rules are generally established by interviewing human experts or by obtaining data from databases or other knowledge bases. [0073]
  • As used herein, an “expert system” comprises a program for applying the rules of one or more knowledge bases to data provided to, or stored within the knowledge base(s), thereby enabling the knowledge base(s) to be queried and to grow. Preferably, an expert system comprises an inference engine which enables the system to manipulate input data from a user to arrive at one or more possible answers to a question by a user. More preferably, an expert system also comprises a cache or dynamic memory for storing the current state of any active rule along with facts relating to premises on which the rule is based. [0074]
  • As used herein, a system which “simulates a path representing at least a portion of a body cavity or lumen” is a system which displays a three-dimensional representation of the internal surface of the at least a portion of the body cavity or lumen on the interface of a user device in communication with the system. [0075]
  • As used herein, to “determine the best fit between the geometry of the device and the geometry of the path” refers to displaying a representation of at least a portion of the device and simulating its placement within at least a portion of the body cavity or lumen. [0076]
  • As used herein, a “device parameter” refers to a physical property of a device, e.g., such as flexibility, memory, material, shape, and the like. [0077]
  • As used herein, “a physical model of a device” is a combination of a recommended geometrical model, topology, and material. It is also the basis for making the first design of a medical device based on patient-specific data. [0078]
  • As used herein, a “software suite” refers to a plurality of interacting programs for communicating with an operating system. [0079]
  • As used herein, “clinical data” refers to physical, anatomical, and/or physiological data acquired by medical image modalities such as X-ray, MRI, CT, US, angiography, video camera, or by direct physical and/or electronic measurements. [0080]
  • As used herein, “a best fit” between a simulated path for a simulated body cavity or lumen and a simulated medical device refers to one which requires the minimum amount of deformation in the simulated surgical process that takes into consideration the patient-specific vasculature and composite materials of the device. [0081]
  • As used herein, an “FEM engine” refers to a program or set of programs for performing finite element analysis focusing on vasculature finite element models and analysis of the interaction between vasculature models and devices. [0082]
  • Intervention Simulation System [0083]
  • FIG. 1 is a block diagram of a simulation system according to one aspect of the invention. Input into the system executes a particular simulation to be enacted. Generally, a simulation includes images of a patient and also can include a display of patient-specific information (e.g., such as clinical information and medical history). The patient images can be obtained from a database of patient-specific images or images relating to a population of demographically similar patients (e.g., such as patients sharing a pathology). Preferably, the system also accesses data relating to various interventional devices. For example, the system can include data files relating to the shape and physical properties of one or more medical devices. Preferably, the simulation system also includes a manikin ([0084] 6) (i.e., representing a patient) for interfacing with one or more simulated medical devices (see, e.g., as shown in FIG. 2).
  • Users interact with the simulation system by observing various rendered displays ([0085] 2), such as fluoroscopic images of blood vessels, and manipulate the one or more simulated devices in response to data received by these display (2). The invention can simulate the anatomy of a specific patient on which the one or more devices will be used.
  • Simulated Patient Interface [0086]
  • In one aspect, the intervention simulation system comprises a medical device with a first end for manipulation by a user and a portion comprising a second end which is insertable into a simulated body cavity or body lumen in a simulated patient interface. Preferably, the simulated patient interface is part of a manikin ([0087] 6) which simulates the physical features of a human patient. The manikin (6) comprises an interface (5) for receiving the portion comprising the second end and for interfacing with a simulated body cavity or lumen within the manikin.
  • The interface also comprises a directional force feedback mechanism for exerting a directional force on the candidate medical device in response to a feedback signal received by the force feedback mechanism. This provides a user with a feeling that he/she is interacting with a real patient. Preferably, the directional force feedback mechanism provides resistance to forward motion but enables reverse motion in response to the feedback signal. The medical device can be one which is commercially available, a device being tested for use or not otherwise commercially available, or can be a candidate device based on a simulated design selected to suit the characteristics of a particular patient. Methods and systems for designing customized medical devices are disclosed in U.S. Provisional Application Serial No. 60/273,734, filed Mar. 6, 2001. [0088]
  • As shown in FIGS. 7A and B, in one aspect, the directional force feedback mechanism comprises a rolling element (e.g., such as a shaft) coupled to the portion of the candidate device comprising the second end. An internal surface of the simulated cavity or lumen in the manikin in turn comprises an oblique slot for receiving the rolling element. In response to a feedback signal, forward movement of the second end causes the rolling element to be received by the slot, causing resistance to further forward motion. Preferably, a motor, such as a servo motor, controls movement of the rolling element. This embodiment is shown in more detail in FIG. 7A. When a force feedback control signal is generated, the servo motor rotates clockwise, causing a wheel to rotate, pushing a shutter forward and downward. The forward and downward movement of the shutter pushes the rolling element down into the slot. Because of friction between the slot and the rolling element, the rolling element moves upward along the slot, and any further forward movement is resisted. If the user wishes to pull back the device, the rolling element will move downward and can be released from the slot. [0089]
  • In a most preferred embodiment, the interface comprises both a directional force feedback mechanism and a tactile feedback mechanism. The tactile feedback mechanism provides vibrational feedback to a user holding the candidate medical device. In one aspect, continuous vibrational feedback is provided through a continuously rotating motor (e.g., such as the servo motor) in communication with the portion of the device comprising the second end. A discontinuously rotating motor controlling the movement of a hand (see, e.g., FIG. 7A) also can be used to simulate intermittent forces experienced by a body cavity or lumen. For example, in a clinical situation, when a catheter is inserted into the cardiovascular system, cardiovascular function and activity may cause the catheter to vibrate. The servo motor and the rotating hand are designed to simulate this kind of vibration. The servo motor rotates continuously and but has an adjustable rotating frequency. . The rotating hand pushes the catheter discontinuously, i.e., simulating blood flow and respiration. [0090]
  • Haptic “display” serves at least two purposes in the intervention simulator: kinesthetic and cognitive. First, it provides the sensation of movement to the user and therefore it greatly enhances surgical performance. Second, it is used to enable a user to learn to distinguish between tissues by testing their mechanical properties. Deformation models are used to compute the effect of force on the biomechanics of an interventional device and on the deformation of a cavity or lumen through which the device is navigating and/or being deployed, and feedback signals to the force feedback and tactile feedback mechanisms can be used to mimic actual forces that might be experienced during an interventional procedure. [0091]
  • However, although the system is capable of providing physically meaningful forces that realistically mimic those encountered during an interventional procedure, there may be instances where a less realistic simulation is satisfactory. For example, a user may want to feel that he or she has reached an obstruction during catheterization. However, the user may not need to experience all the various contacts he or she could feel while maneuvering a catheter prior to experiencing a single large resistance. The present invention provides a mechanism to stop a user from advancing past an obstruction and yet permits the user to pull back a simulated device. [0092]
  • The manikin interface can be encased in a housing comprising one or more openings for receiving medical devices, and means for interfacing with tracking unit(s), feedback mechanism(s) and a system processor (described further below). Additional devices such as syringes and balloon inflating devices can be provided as part of the interface, e.g., simulating balloon angioplasty proceedings). [0093]
  • The interface housing can be displaceable for some distance from the manikin itself or can project from the manikin (e.g., being an integral part of the manikin). To further enhance realism, only the opening(s) of the housing may visible from the manikin (e.g., the interface “housing” can be part of the manikin). Preferably, the interface is an embedded system as shown in FIG. 2, with openings into areas of the manikin simulating areas of medical intervention. [0094]
  • System Input Devices [0095]
  • The simulation system can obtain input of various types to more closely mimic an intervention procedure. For example, as shown in FIG. 1, input to the simulator can consist of patient medical history and diagnostic data including, but not limited to, data obtained from X-ray, MRI, MRA, CT or ultrasound images. Data can relate to a specific patient, e.g., where a user is training to perform a procedure on a specific patient using a customized device. Alternatively, data can relate to a “symbolic patient”, for example, representing a particular demographic group of closely related patients, such as patients having a type of pathology. [0096]
  • FIG. 2 shows an example of various system inputs that can be provided. The simulated patient ([0097] 6) in the Figure is a manikin that also houses the tracking and force feedback assemblies. A physician (1) simulates navigation of a catheter by manipulating catheters and guidewires (5). These catheters and guidewires are inserted into the manikin at the manikin interface. One or more monitors (2) can be used to display simulated fluoroscopic and vascular images simulating the internal anatomy of a patient represented by the manikin. In one aspect, 2-D fluoroscopic views are displayed at the same time that 3D geometric models are displayed by system user interfaces. Preferably, the user has the option to adjust fluoroscopic images by one or more of zooming, collimation, rotation, and the like. In combination with 3D volume-rendered images generated using display interfaces described further below, a user can view the vasculature from various positions or angles along x-, y-, and x-axes. This option can be of major value in pre-treatment planning, since a physician can use the system to evaluate different treatment approaches prior to performing actual intervention in a patient.
  • A simulated scanning device ([0098] 4) additionally can be provided, e.g., in the form of a mock C-arm equipped with an x-ray emitter. Preferably, the mock C-arm can move along the long side of an operating table (8) on which the patient/manikin is placed and can rotate around the table to simulate capturing a patient's images at various lateral and angular positions.
  • For example, as shown in FIG. 2, two footswitches ([0099] 7) can be used to simulate activation of a simulated x-ray device as well as vascular image acquisition and storage. In response to this activation, one or more monitors (2) simulate fluoroscopic images obtained. A footswitch is preferred for scanning and image processing, since user(s) generally have their hands occupied with other equipment, in actual practice
  • Preferably, the system provides a re-configurable control panel ([0100] 9) (e.g., a touch screen) to enable a user to simulate patient table manipulation, vascular image acquisition selection and display, and the use of shutter devices to limit the extent of the field of view provided by a scanning device (4). The panel also can be used to implement functions such as machine-activated radioopaque dye injection (e.g., activating the simulated syringe) and/or deployment of a balloon via a balloon-inflating device (18) interfaced with the manikin.
  • FIGS. [0101] 10A-D show re-configurable control panels according to different aspects of the invention. Preferably, the display is programmable and has a large storage area for bitmaps, display lists, and screens. Users can easily set up complex image control panels according to their own requirements. FIG. 10A shows the typical controls associated with patient table manipulation. Manipulating these controls result in a corresponding motion of a C-arm that carries a simulated X-ray emitter. FIG. 10B shows controls associated with image acquisition for manipulating the sharpness and clarity of the rendered images. FIG. 19C shows controls for machine activated balloon inflation and deflation, and shuttering. FIG. 10D shows controls for collecting images for creating a roadmap.
  • In a preferred aspect, the invention additionally provides one or more interventional devices interfaced with the manikin for simulating common procedures such as an injection, balloon deployment, and/or stent deployment. [0102]
  • In one aspect, therefore, the system comprises a syringe for simulating fluid delivery. The simulation syringe comprises a housing defining a lumen comprising an opening for delivering a fluid, a pushing element for pushing the fluid through the opening, a friction-producing element in communication with the pushing element, and a motor in communication with the friction-producing element which further comprises signal receiving element. The simulation syringe can be interfaced with the manikin and the signal-receiving element preferably receives signals from the system processor, e.g., to execute contrast injection at a particular flow rate and volume. [0103]
  • The friction-producing element will cause friction between the pushing element and a surface of the lumen of the housing when the motor is activated in response to a signal received by the signal-receiving element. When activated, the motor causes motion of the friction-producing element, causing the friction-producing element to contact the surface of the lumen of the housing. This creates friction between the pushing element and the surface of the lumen and causes resistance to the motion of the pushing element, thus simulating injection of a fluid through a syringe into the body of a patient. [0104]
  • The friction-producing element can comprise one or more rubber pads, each rubber pad being coupled to an arm whose movement is controlled by the motor, e.g., such as through a gear attached to the motor. In one aspect, the amount of friction produced by the friction-producing element is adjusted by controlling a rotation angle of the motor. [0105]
  • FIGS. [0106] 8A1-3 and B show the structure of a simulated syringe (3) with force feedback structure according to one aspect of the invention. In the embodiment shown in FIGS. 8A-B, a servo motor and two arms are installed in front of the pushing element (e.g., a handspike). These two arms are connected through two meshed gears. Gear 1 is installed on the servo motor as is the driver of the motor. When a force feedback signal is communicated to the servo motor, the Gear 1 will contrarotate and Gear2 will rotate clockwise. Arm 1 and Arm 2 splay and the rubber pads on the two arms will touch the wall of the syringe. Because of the friction, the surgeon will feel resistance when he or she tries to push or pull the pushing element. The value of the friction can be adjusted by controlling the rotation angle of the servo motor. When the servo motor rotates clockwise, the two arms will close and the user can move the handspike freely again.
  • The simulated syringe ([0107] 3) can be used to simulate the injection of radioopaque dye, to simulate fluoroscopic imaging, or the delivery of a therapeutic agent or drug. Control parameters such as contrast injection volume and rate can be controlled by a user through a control interface such as a touch screen, enabling a user to choose the rate and total volume of injection. The injection process can be captured, and selected images of the process saved, to provide a roadmap image on a separate monitor.
  • As discussed above, the manikin also can be interfaced with a balloon-inflating device for simulating such operations as balloon and stent deployment. FIG. 9 shows a simulated hand-operated balloon-inflating device. A pressure sensor is used to measure the pressure of a fluid, such as air, being delivered to a balloon catheter, which has been navigated to a target site. The signal of the sensor is processed and transmitted to the system processor through the microprocessor M[0108] 1. A user is able to read pressure values from a display monitor or from an electrical pressure sensor, such as the piezometer shown in the upper portion of FIG. 9. Additionally, the user is able to feel pressure delivered by the balloon-inflating device. Preferably, the inflating device can provide up to about at least 20 Bar of compressed liquid to a balloon.
  • In one aspect, compressed liquid is provided within a compressed liquid generator in communication with a piston. A user can trigger delivery of compressed fluid from the generator by imparting linear force on the piston, thereby triggering inflation of a balloon. Preferably, the compression stroke is approximately 2 inches and can be delivered when a user twists a handle of the balloon-inflating device, causing a screw bar to force the piston forward. A release button or switch is provided enable rapid release of compressed fluid, thereby triggering deflation of the balloon. In a further aspect, an automatic control system inside the device is used to control the forward or backward movement of a handwheel for controlling the amount of pressure actually delivered to the balloon, in steps of a minimum of 0.01 Bar. Pressure values can be read from a screen of the pressure meter (e.g., such as an LCD screen) or can be displayed on the display of a user device. [0109]
  • Preferably, the system enables a user to program parameters such as maximum pressure delivered to the balloon. In one aspect, the user starts to increase pressure delivered to the balloon by means of a button on a handheld remote control and monitors pressure values on a pressure display. The system may trigger an alarm when balloon pressure increases past a selected threshold. In an “auto mode” the system analyzes pressure data automatically to automatically adjust pressure and increase/decrease speed of inflation or deflation as appropriate. [0110]
  • Signals from simulated devices such as the simulated syringe and/or hand operated balloon inflation device generally are processed by an A/D converter first and then inputted to the system processor. Preferably, signals from footswitches are digital and inputted directly to the microprocessor and then to the system processor. [0111]
  • The system can include additional input devices to simulate an interventional procedure. For example, one or more monitors can be included to simulate display of electrophysiological signals such as ECG and blood pressure. [0112]
  • The system is designed to allow use by multiple users (see, e.g., FIG. 2). For example, a second user ([0113] 19) can be introduced to alter the simulation parameters that a first user (1) is experiencing. In one aspect, therefore, the system further comprises one or more monitors (13-17) comprising one or more second user display interfaces for a enabling a second user (e.g., a trainer) (19) to monitor a simulation that a first user (1) is experiencing. The second user/trainer (19) is provided with selectable options on the display of his or her user interface to enable the second user (19) to alter or introduce variables (e.g., anatomical or physiological variables) in order to test or evaluate the responses or decision-making abilities of one or more first users (1).
  • In one aspect, processor interface ([0114] 13) is used to connect a monitor (15), keyboard (16) and mouse (17) of a first user device to a system processor connectable to the network. In one aspect, the system processor communicates with a microprocessor (M1) which resides inside an operating table which receives the manikin. Using a floppy disk driver (10) and/or CD-ROM drive (12), and/or other memory devices, new patient cases can be loaded into the simulation system. Because the processor is connectable to the internet or intranet, remote observation or training is possible. A user (1 or 19) can upload relevant patient images or other medical data or can upgrade software using the monitor (15), keyboard (16) and mouse (17).
  • FIG. 3 is a block diagram highlighting the features of the system processor, according to one aspect of the invention. In the aspect shown in FIG. 2, the processor is a CPU installed inside a patient table ([0115] 8) which controls data and control flow among various system components such as a hard drive, memory, display monitors, manikin interface, and one or more simulated medical devices.
  • FIG. 4 is a block diagram showing interactions between the system processor and various system inputs according to one aspect of the invention. A microprocessor (M[0116] 1) is used for data acquisition. Tracking information from an optical tracking unit in optical communication with one or more simulated medical devices is provided to the M1 through a signal processing circuit. A mock C-Arm moves in response to a control signal from a touch screen connected to the microprocessor through a serial port. Preferably, the control signal is processed by the microprocessor prior to being received by the C-arm.
  • Preferably, manipulations of a device by a user in an interface provided in the manikin are coordinated with a simulation of the device on the user display, such that motion of the device in the manikin is simulated on the user display in real-time. [0117]
  • Therefore, in one aspect, the simulation device provides a mechanism to continuously track a position of at least the second end of the medical device relative to the manikin. For example, the system can comprise one or more encoders for tracking translation and/or rotation of the device (see, e.g., FIGS. 5A and B). FIG. 5B is a block diagram illustrating the components of the tracking system and the active force feedback mechanism. Using rolling spherical objects coupled to a simulated catheter and guidewire, respectively, four incremental encoders can pick up the motions of the simulated devices. The rolling elements also serve as part of the directional force feedback mechanism described above. [0118]
  • In a currently preferred aspect, as shown in FIGS. 6A and B, the system comprises a tracking unit which tracks the movement of the candidate medical device. The tracking system comprises a light source (e.g., a point light source), a signal processing circuit, and one or more optical sensors, and is placed within the interface in optical communication with the device and the simulated cavity or lumen through which the device is being navigated. The candidate device will reflect light to it from the light source and reflected light will be received by the optical sensor(s). Changes in reflected light picked up from the sensor(s) indicate movement of the candidate device as a result of manipulation. [0119]
  • In one aspect, two optical sensors are provided within the tracking unit, each perpendicular to the other. [0120]
  • As shown in FIG. 6A, the tracking unit can be in the form of a rail along which the device can move. Alternatively, the simulated interventional device can be looped around the tracking device and can be manipulated by pushing, pulling, and/or twisting the loop. Preferably, tracking systems enable the intervention system to independently track the movement of two or more medical devices, for example, a catheter and guidewire. [0121]
  • Being an embedded system with detachable components, the simulation system is flexible and can be easily configured to suit the customized needs of its users. FIG. 11 shows a possible configuration that reduces the size of simulation system to one which can be placed on a normal desktop. FIG. 12 is a desktop system intended for pretreatment planning by interventional radiologists. [0122]
  • System Processor [0123]
  • The intervention simulation system further comprises at least one first user device (e.g., a computer or wireless device connectable to the network) comprising a graphical user interface and connectable to a system processor and/or the network. Preferably, the processor comprises one or more programs for generating a geometric model of a body cavity or lumen of a patient from stored or collected volume-rendered images obtained from one or more patients. In one aspect, the user can access a database of such images using the user interface, either by inputting text into a command box or dialog box and implementing a search function of the system or by selecting one or more selectable options reflecting files and/or images stored in the database (e.g., a hyperlink designated by the name of the file). [0124]
  • The system generally operates by means of a software suite that operates on a general purpose computer such as a PC or IBM-compatible device. Preferably, the system comprises a processor (e.g., as CPU), memory, graphics adaptor, printer controller, hard disk and controller, mouse controller, and the like. The processor should comprise a minimum of about 8 MB of RAM. Preferably, the first user display interface is part of a monitor which is connected to a keyboard, mouse, and, optionally, printer and/or scanning device. The software suite of the system comprises a program (e.g., a C language program) that controls the system's user interface and data files, e.g., providing one or more of search functions, computation functions, and relationship-determining functions. In a preferred aspect, the system comprises a geometric modeling system for modeling a three-dimensional representation of a body lumen or cavity; a device modeling system for modeling a three-dimensional representation of one or more medical devices, and at least one knowledge base for modeling interactions between a simulated body cavity or lumen and a simulated medical device. [0125]
  • Geometric Modeling System [0126]
  • In one aspect, optical data relating to the internal contours of a body cavity or lumen are obtained and provided to the intervention simulation system. The optical data can be displayed directly on one or more user interfaces or can be stored in a system database as described above. Because the system user devices and processors are connectable to the network, patient data also can be accessed from remote databases. [0127]
  • To generate a volume-image, a stack of two-dimensional (2D) images is collected by a scanning device in an axial direction and is used to form a three-dimensional (3D) structure (see, e.g., as shown in FIGS. 3A and 3B). Almost all medical scanners can produce these axial images or can produce images that can be converted easily to axial images. Suitable scanning devices include, but are not limited to, x-ray devices, magnetic resonance imaging (MRI) devices, ultrasound (US) devices, computerized tomography (CT) devices, rotational angiography devices, gadolinium-enhanced MR angiograph devices, or other imaging modalities. For example, rotational CT scanners capture patient data in the form of projection images. By using a Filtered Back Projection technique or Arithmetic Reconstruction Technique (ART), volumetric images can be constructed. [0128]
  • The system may be directly connected to the output of one or more scanning devices, e.g., collecting optical data from such devices as these are acquired. However, in another aspect, the system may include a means for extracting features from individual scanned images (e.g., communicated to the system through a scanner or provided as a pdf file) to construct a 3D volume image. The geometric modeling arm of the system can be implemented remotely by a user to determine one or more of: the geometry/topology of the body cavity or lumen, measurements relating to any pathological features of the body cavity or lumen, and such parameters as tissue wall thickness, elasticity and the like. [0129]
  • In creating a geometric model of a body cavity or lumen (e.g., such as a blood vessel), a user of the system (e.g., a biomedical professional with knowledge of human anatomy and pathology) performs image processing tasks on a plurality of scanned images to create geometrical structures and a topology which corresponds to the contours of a body cavity or lumen belonging to a patient being analyzed. [0130]
  • Volume rendering techniques such as ray casting and projection techniques have traditionally been used in the visualization of volume images. Ray casting methods shoot rays through a volume object from each pixel in an image and employ algorithms that trilinearly interpolates samples along each ray, providing complex shading calculations and color assignments at the sample points which are then accumulated into final pixel colors (see, e.g., Kaufman, In [0131] Volume Rendering, IEEE Computer Science Press, Las Alamitos, Calif., 1990). Real-time volume rendering with hardware texture mapping (e.g., SGI) for UNIX platform or with board card (e.g., Mitsubishi VolumePro) for PC platforms are commercially available.
  • Commercially available image processing tools, such as Photoshop™ can be used to manually draw out the shape of the structure from each scanned image. Various imaging-processing tasks, as are known in the art, can be performed by the system; for example, segmentation can be used. Several improved algorithms using iso-surfacing or volume-rendering techniques to visualize vascular trees also can be used and have been described in Ehricke, et al., [0132] Computer & Graphics 18(3): 395-406, 1994; Cline, et al., In Magnetic Resonance Imaging (Pergamon Press) 7: 45-54, 1989; and Puig, et al., Proc. Of Visualization '97, pp 443-446, for example.
  • Projection-originated methods reconstruct 3D geometries from two or more images (See, e.g., Solbach, et al., [0133] Computer Biomedical Research 27(3): 178-198, 1994; Nguyen and Sklansky, IEEE Transactions on Medical Imaging 13(3): 178-198, 1994; Longuet-Higgens, Nature 293(10): 133-135, 1981). Thinning methods such as “active-contour”, “medial axis transformation”, and “simulated annealing”, and the like, can be employed to determine information in projection planes (see, e.g., Kass, et al., International Journal of Computer Vision 1: 321-331, 1987; Lee, et al., CVGIP: Graphical Models and Image Processing 56(6): 462-478, 1994; Arcelli and di Baja, Image and Vision Computing 11(2): 163-173, 1993; Pellot, et al., IEEE Transactions Medical Imaging 13(1): 48-60, 1994; Brandt and Algazi, CVGIP: Image Understanding 55(3): 329-337, 1992). The advantage of projective reconstruction lies in its capability to handle tiny tube-like systems such as vascular, neural and lymphatic vessels that could be lost with iso-surfacing algorithms.
  • “Piece-by-piece cylinder representation” or “generalized cylinder representation” is widely used in vascular modeling (see, e.g., Brown et al., [0134] Proceedings of EUROGRAPHY '87, pp 113-124; Barillot et al., IEEE Transactions on Computer Graphics and Applications, December 1985, pp 13-19). Polygonal tessellation, e.g., triangulation, also can be applied to model 3D tube-like shapes as is known in the art (see, e.g., Sederberg, et al., International Journal on Computational Geometry and Applications 8(4): 389-406; Choi and Park, Visual Computer 10: 372-387, 1994). Ferley, et al., Computer Graphics Forum 165(5): 283-293, 1997, additionally describes an implicit surface method for reconstruction of branching shapes.
  • Accurate modeling of a 3D vascular network relies on good representations of vascular segments and bifurcations. Ideally, a vascular model should be visually smooth and the detail of the display should be adaptable to fit application requirements. In one aspect, a constructive approach is used to model visually smooth vascular networks. In this approach, vascular segments are modeled using sweeping operations while vascular bifurcations can be modeled using blending operations (i.e., sweeping plus hole-filling operations) (Gregory and Zhou, [0135] Computer Aided Geometric Design 11: 391-410, 1994; Ye, et al., Computer Aided Geometric Design 27: 875-885, 1995). Based on GC conditions for boundaries and cross-boundary derivatives (see, e.g., Schreiner and Buxbaum, IEEE Transactions on Biomedical Engineering 40(5): 482-491, 1993), constructive algorithms for segmental sweeping and bifurcation blending can be designed as described in Cai et al., “Constructive Algorithms for GC1 Generation of Vascular Network,” Submitted to IEEE Biomedical Engineering, March 2001. See, as shown in FIGS. 5 and 6.
  • Yet another method of obtaining a volume model or a geometric model of a body cavity or lumen is the technique of volumetric meshing. Meshes which represent a 3D or volumetric form can be generated from scanned images using a standard Windows operating system such as NT. Software for generating 3D mesh images are commercially and publicly available. Sources for such software are described at http://www-users.informatik.rwth-aachen.de/˜roberts/software.html#Commercial, and include, for example, Altair®HyperMesh®5.0 (available from Altair Engineering, Inc., Maplelawn, Troy, Mich. 48084). [0136]
  • In a preferred aspect, a volume image of a blood vessel is obtained to construct a physical or geometric model which comprises information relating to both shape and material of tissue forming the blood vessel. Generally, construction of geometric models entail dividing a 3D modeling process into a series of 2D cross-sectional segmentation operations from which the 3D surface of the structure is reconstructed. An image processor is used to draw out the shape of the desired vascular structure from each image. Segmentation methods relying on intensity thresholding or region-growing can be used, as are known in the art, to facilitate the process (see, e.g., Wang, et al., [0137] IEEE Engineering in Medicine and Biology, November/December 1999, pp 33-39; Moore, et al., J. Biomechanics 31: 179-184, 1998). Finite element modeling also can be used for blood flow modeling, as described in, for example, Taylor, et al., Computer Methods in Applied Mechanics and Engineering 158: 155-196; Hughes et al., Computer Methods in Applied Mechanics and Engineering 73(2): 173-189, 1989; Shephard and Georges, Int. J Numerical Methods in Engineering 32: 709-749, 1991.
  • Surface sweeping is a powerful tool for creating tube-like shapes, i.e., simulating blood vessels. The sweeping operation requires a smooth trajectory and cross-sectional shapes. To form a tube-like surface, a closed cross-sectional contour must be used. A cubic Bézier curve is used to represent the central trajectory or path. With γ (t) representing any of G[0138] J paths, a local coordinate system (T (t), N(t), B(t)) can be defined along the curve (see, e.g., FIG. 5). This triplet (T (t), N(t), B(t)), also known as a “Frenet frame”, is the tangent, normal and bi-normal defined along the trajectory of the curve. Assuming r(t) is a contour function defined in the cross-sectional plane perpendicular to the curve at a given point along the trajectory, the sweeping surface can be represented as
  • Γ(t, θ)=γ(t)+r(t) (cos θ N(t)+sin θ B(t)),
  • as described by Piegl and Tiller, In The [0139] NURBS Book, Springer, Berlin, 1995, where θ is the cross-sectional angle and tε[0, 1] is a parameter defined along the curve. A bi-cubic Bézier form for the sweeping tube can therefore be developed using a tensor-product operation (see, e.g., Piegl and Tiller, 1995, supra).
  • To model bifurcation, the same sweeping operation can be applied. In order to avoid self-intersection, only half of the tubular surface can be used (FIG. 6). This, however, leads to missing two triangular patches (front and back) at the joint. Bifurcation modeling therefore requires triangular hole filling. An analytic approach described in Gregory and Zhou, [0140] Computer Aided Geometric Design 11: 391-410, 1994, can be used to fill triangular holes with given neighboring surfaces. To generate GJ smooth bifurcations, however, additional modifications of hole boundaries and hence the surrounding surfaces are desirable. The procedures for bifurcation modeling are summarized as follows:
  • (i) A bifurcation is first generated by sweeping three semi-tubular surfaces in bi-cubic Bézier form. [0141]
  • (ii) Two triangular holes are formed by three surrounding semi-tubular surfaces. Each hole is initially “filled” with three bi-cubic Bézier patches using the method described in Gregory and Zhou, 1994, supra. [0142]
  • (iii) The boundaries of the semi-tubular surfaces are changed to quintic Bézier form. The modifications are determined from the cross-boundary tangential continuity, twist-compatibility and unique existence of tangent planes at hole comers. [0143]
  • (iv) Three semi-tubular surfaces are then degree-elevated into quintic Bézier patches and modified based on the new hole boundaries. The next row of control points of the hole boundaries are modified accordingly to ensure that the semi-tubular surfaces having cubic cross-boundary derivatives along the hole boundaries. [0144]
  • (v) The vector-valued cross-boundary derivative in a quintic form along the hole boundaries is generated for the filling hole patches. [0145]
  • (vi) The hole boundaries are split into two at the middle point of the parameter, so are the associated vector-valued cross-boundary derivatives. The star-lines and their associated vector-valued cross-boundary derivatives are degree-elevated to quintic as well. [0146]
  • (vii) Three final filling rectangular patches are generated based on the updated starlines, split hole boundaries, and the vector-valued cross-boundary derivatives along the star-lines and the split hole boundaries. The remaining 3×3 interior control points are determined by taking a Coons-Boolean sum approach as described in Ye, [0147] Computer Aided Design 27: 875-885; 1995.
  • From the segmented medical images, a central line model of a vasculature can be constructed. This model is represented in hierarchical structure consisting of vessel topology (using a parent-child relationship to represent the topological connectivity among a list of a vascular segments), vessel geometry (coordinates and radii), and vessel material property. The 3D model of the vessels is then reconstructed based on the central line geometry. Visual smoothness is achieved by employing operations like sweeping and blending. A variational modeling approach is implemented for vasculature segments. An advantage of such method is that it provides flexibility in changing 3D structure. Where a pathology is identified and measured, a vascular model can be modified to account for the pathology. [0148]
  • Preferably, deformable models are used to detect structures in images. Such models can be used to define a geometry which minimizes the energy of a simulated structure to account for topological change, e.g., due to factors such as blood flow dynamics and even interactions between the device and the body lumen or cavity. For example, catheter tip shape deforms in a predictable manner when straightened with a guide wire, when advancing through tortuous vessels, and when encountering vascular constraints such as lumen narrowing, branch point bifurcations, and the like. These events can be modeled using the simulation system. [0149]
  • In one aspect, a deformation law is applied to a geometric model obtained from a hierarchical central line model to construct a 3D model. This 3D model can be used to model linear deformation, linear forces, non-linear deformation, and non-linear forces. The application of deformation laws to a geometric model is described in, for example, Wang, et al., 1999, supra, Mallaldi, et al., [0150] J. Mathematical Imaging and Vision 6(2-3): 269-289, 1996; Caselles et al., Numerische mathematik 66: 1-31, 1993; Osher and Sethian, J. Computational Physics 79: 12-49, 1988; Sethian, In Level Set Methods, Cambridge University Press, Cambridge, England, 1996, Caselles et al., Int. J. Vis. 22(1): 61-79; Kichenassamy et al, Proc. 5th Int. Conf. Computer Vision, pp. 810-815, 1995).
  • In a further aspect, the system comprises a knowledge base, relating to the physical and/or biological properties of a patient(s)' body cavity or lumens. Facts within this “vascular material knowledge base” can be derived in part from the geometric modeling arm of the simulation system as well as from public databases (e.g., such as PubMed®) (see, as shown in FIG. 1). In one aspect, the property of elasticity can be established from the relationship between image density (determined from a volume image) of a portion of a body cavity or lumen and the stiffness of a particular tissue. In another aspect, the diameter of a cavity/lumen can be determined. [0151]
  • For example, plaque can be distinguished from vessel walls by evaluating the image intensity of a volume image. Preferably, as volume images of body cavities or lumens are acquired from patients having a disease, data relating to these images are provided to one or more of the knowledge base systems described above. Preferably, the knowledge base system(s) include data from images are obtained from patients having atherosclerosis, coronary vascular lesions, carotid bifurcation stenosis, carotid bifurcation stenosis, abdominal aortic aneurysms, peripheral vascular disease, cerebrovascular disease, cancer, trauma, and congenital malformations that may cause or display vascular manifestations, and the like. [0152]
  • Quantitative measures of a pathology can be obtained. For example, a quantity module which is part of the system can be used to measure the size of a blockage (e.g., a plaque). [0153]
  • In yet another aspect, at least one knowledge base comprises clinical information related to a specific patient for which a device is being designed. This database can include such demographic information as age, sex, drug history, medical history, medical billing information, and the like. This portion of the system can be encrypted so that while information can be continually added to other knowledge bases (e.g., by remote system users), information within the patient-specific knowledge base cannot be tampered with. However, preferably, even information provided by remote system users will be stored in temporary data files until a system operator enables the system to accept the information. Information relating to populations of patients also can be stored for comparison with information relating to the specific patient. [0154]
  • Device Modeling System [0155]
  • Preferably, the first display interface also displays a three-dimensional representation of the medical device which is interfaced with the manikin. A simulation of the device can be obtained from a database of images of stored devices (e.g., where these are known and/or commercially available) or from a simulation of a device, for example, as described in U.S. Provisional Application Serial No. 60/273,734, filed Mar. 6, 2001. A volume scanned image of the device also can be generated using techniques similar to those described above. [0156]
  • Preferably, a physical model is used to simulate a device based on the quantitative analysis of volume-rendered images, followed by a derivation of the geometry, topology, and physical properties of the device. Suitable medical devices which can be simulated include, but are not limited to: a catheter, guidewire, endoscope, laparoscope, bronchoscope, stent, coil, balloon, a balloon-inflating device, a surgical tool, a vascular occlusion device, optical probe, a drug delivery device, and combinations thereof. The system is able to model the interactions of multiple devices with each other. For example, the system can model the simultaneous movements of a catheter, guidewire, therapeutic device and the like. [0157]
  • Navigation Modeling System [0158]
  • Preferably, the system simulates the movement of the simulated device within the simulated body cavity or lumen in real-time when a first user manipulates the medical device interfaced with the manikin. This can be realized by performing virtual device navigation inside a simulated body cavity or lumen using an incremental FEM engine. Such a simulation system is described in U.S. Provisional Application 60/273,733, filed Mar. 6, 2001, the entirety of which is incorporated by reference. For example, the embedded FEM engine of the system can provide a real-time simulation of catheter/guide-wire interactions with blood vessels. This enables the first user to develop the eye-hand coordination necessary to implement a particular interventional procedure. [0159]
  • Depending on the realism or deformation accuracy required, the underlying assumption of physical modeling is adapted to simulate navigation and/or deployment of a particular medical device in a body cavity or lumen. [0160]
  • In a preferred aspect of the invention, the system simulates a path which represents at least a portion of a patient's body cavity or lumen and determines fit between the geometry of the device (with or without functional and information attribute layers) and the geometry of the path. The system simulates the design of the device in stages; first providing a simulation based on optimal shape (e.g., using the device shape database), then optimal function, then optimal information parameters. [0161]
  • Basic Models for Catheter Navigation [0162]
  • In a preferred aspect, an incremental Finite Element Method (FEM) is applied to the analysis of catheter navigation. In this basic FEM analysis, blood vessels are assumed to be rigid circular tube-structures with varying radii, or with arbitrary cross-sections and deformabilities. However, it is commonly accepted that because most of the blood vessels within the human body are well stretched by surrounding muscles, the vasculature network is only minimally deformed by catheter navigation. Generally, also the tip of a guidewire or navigating catheter is very soft in order to prevent damage to a blood vessel when in contact. The vessel wall is therefore relatively stiffer than the catheter itself and therefore, it is quite reasonable to simulate a rigid blood vessel wall when simulating navigation and/or deployment of a catheter. [0163]
  • Typical catheters/guidewires are generally cylindrical in shape, with curved or uncurved geometries (e.g., the cross-sections of catheters/guidewires are generally circular or ring-shaped). A catheter/guidewire can be conceptualized as comprising a plurality of discrete 3D beam elements or segments. Thus, they can be represented as an aggregate of multiple, flexible bodies connected to each other at nodes capable of simulating extension, compression, bending and torsion (i.e., modes of deformation). Thus, catheter navigation can be considered as a sequence of movements of flexible multibody systems comprising a plurality of segments inside the rigid tube-structures (e.g., corresponding to blood vessels). [0164]
  • In one aspect, a simulated catheter is subjected to a simulated force such as pushing, pulling, twisting, or combinations thereof. The movement of the catheter is represented as the sum of rigid-body displacements and deformations at each step with the deformations being relatively small compared to displacements. Generally, the elements of the catheter system are treated as rigid bodies first and then deformations are calculated for individual nodes of elements at their equilibrium position. [0165]
  • A different principle can be employed which is based on a virtual work method or multibody dynamics method (MDM). The MDM models the kinematics (rigid body displacements) of a multibody system. In contrast, the FEM models the deformations of flexible bodies to analyze catheter navigation. Generally, the deformation of a medical device such as a catheter is relatively small relative to the rigidity of a lumen, such as a blood vessel and Hooke's law is applied. However, where the deformation of a lumen is large (for example, when biomaterials fail), nonlinear FEM should be applied. [0166]
  • The Governing Equation [0167]
  • Consider a catheter represented by multiple, discrete elements, each with a deformed configuration. This flexible multibody system is in dynamic equilibrium with applied forces (e.g., contact traction and internal forces) at time t. An example of an internal force is a hyper-viscoelastic force in an isotropic constitution model (see, e.g., [0168] The Biomedical Engineering Handbook, Editor-In Chief, Joseph D. Bronzino, CRC Press+IEEE Press, 1995).
  • Two coordinate systems can be used to describe the movement and the deformations of the catheter system. The coordinate system XYZ is the inertial (global) reference frame and xyz is the body (local) reference frame at time t. [0169]
  • The variational equations of motion of the catheter system are given as [0170]
  • S δ{overscore (u)} T {overscore (T)}dS−∫ V δ{overscore (u)} T{overscore (ü)}−{overscore (f)})dV=∫ Vδ{overscore (ε)}({overscore (σ)}−{overscore (σ)}0)dV  (1)
  • where [0171]
  • S denotes the boundary surface, [0172]
  • V denotes the volume of the catheter, [0173]
  • {overscore (u)} denotes the displacement vector of a catheter point at time t, [0174]
  • {overscore (ε)} and {overscore (σ)} denote the strain vector and stress vector, respectively, [0175]
  • {overscore (σ)}[0176] 0 denotes the residual stress vector due to the accumulation of the previous deformations which can be reduced through a process of energy release (shape recover),
  • δ{overscore (u)} denotes the virtual displacement vector that is consistent with the constrain conditions, [0177]
  • δ{overscore (ε)} denotes the corresponding virtual strain vector, [0178]
  • ρ denotes the mass density of the catheter, [0179]
  • {overscore (f)} denotes the body force vector, [0180]
  • {overscore (ü)} denotes the acceleration vector (second order differentiation of variables with respect to time t), and [0181]
  • T is the traction vector and can be expressed in terms of the external force applied at the boundary S and the contact force between the catheter and the walls of the vessels. [0182]
  • The displacement vector can be defined as a summation of two terms, a term representing rigid body displacement and a deformation term, in order to derive an explicit equation which can be solved to simulate catheter movement. Because rigid displacement of the catheter results in no strain or stress, the final two variational equations from (1) can be formulated as [0183]
  • S δ{overscore (u)} r T({overscore (T)} a +{overscore (T)} c)dS−∫ V δ{overscore (u)} r T{overscore (ü)} r −{overscore (f)}(dV=0  (2)
  • representing the movement of catheter/multibody system, with each element moving as a rigid object and [0184]
  • S δ{overscore (u)} f T({overscore (T)} a +{overscore (T)} c)dS−∫ V δ{overscore (u)} f T{overscore (ü)} r −{overscore (f)})dV=∫ Vδ{overscore (ε)}f({overscore (σ)}f −{overscore (σ)} 0)dV  (3)
  • where {overscore (u)}[0185] r, , denotes the rigid displacement; {overscore (u)}f represents the deformation, {overscore (T)}a and {overscore (T)}c represent the external force and contact force, respectively; and {overscore (ε)}f and {overscore (σ)}f represent the strain and stress corresponding to the deformation. It is assumed here that deformations are generally smaller than the rigid displacements. The deformation can then be assumed to be time independent during navigation. Because of this, the acceleration of deformation is not taken into consideration in this formula.
  • FEM Analysis [0186]
  • Three-dimensional (3D) beam elements can be used to derive equations for FEM analysis of catheter movement. Equations (2) and (3), above, can be rewritten for a catheter with N elements, where [0187] n = 1 N S n δ u r T ( T a + T c ) S - n = 1 N V n δ u r T ( ρ u - ¨ r f ) V = 0 ( 4 )
    Figure US20020168618A1-20021114-M00001
  • represents the rigid body displacement of the beam elements and [0188] n = 1 N S n δ u f T ( T a + T c ) S - n = 1 N V n δ u f T ( ρ u - ¨ r f ) V = n = t N V n δ ɛ f T ( σ f - σ 0 ) V ( 5 )
    Figure US20020168618A1-20021114-M00002
  • represents the deformations of the elements. S[0189] n and Vn denote the boundary and volume of the nth element, respectively.
  • Equations (4) and (5) can be solved using routine FEM methods to derive the matrix equations: [0190]
  • {overscore (M)}{overscore (Ü)}={overscore (T)} a +{overscore (T)} c +{overscore (f)}  (6)
  • {overscore (K)}{overscore (u)}={overscore (T)} a +{overscore (T)} c −{overscore (M)}{overscore (Ü)}+{overscore (f)}+{overscore (δ)} 0  (7)
  • providing a multidynamic analysis of rigid body displacements and for an FEM analysis of deformations for a simulated catheter. The rigid body displacement vector {overscore (u)} is represented by three translations and three rotations at each FEM node, while the deformation vector {overscore (U)} is also expressed in the same way, with a total of six degrees of freedom at an FEM node. Matrices {overscore (M)} and {overscore (K)} denote the global mass matrix and the global stiffness matrix, respectively. Note that equations (6) and (7) are coupled to each other and can be solved using a semi-implicit iteration method (see, e.g., Rao, In [0191] The Finite Element Method in Engineering, 2nd Edition, New York: Pergamon Press, 1989).
  • Advanced Models [0192]
  • In one aspect, vessels are not treated as rigid cylindrical structures but as deformable structures. This is particularly useful when modeling the interaction of catheterization devices, such as balloon and stents, with diseased arteries. These vessels vary in cross-sectional diameter due to the presence of a pathology, such as stenosis. Further, the deformation properties of diseased vessels are different from the deformation properties of normal vessels. Additionally, it may be desirable to model one or more physiological parameters such as the effect of blood flow on navigation of a medical device such as a catheter. Therefore, in one aspect, the simulation process uses a hemodynamic model describing the blood flow phenomenon. Preferably, the hemodynamic model accounts for the affects of such variables, as disease, age, obesity, and the like. [0193]
  • For a more realistic and accurate analysis of the interaction between a device and a pathology such as coronary stenosis, the device materials and vessels are treated as nonlinear. Blood flowing through the vessels is modeled by treating the blood as a homogeneous incompressible Newtonian fluid. The vessels and associated stenosis are modeled as layered structures, using a 3D space FEM model. Physiological influences on a body cavity or lumen also can be considered in particular anatomic locations in which these influences may be important concerns. For example, when modeling coil deployment in the head, the system can take blood flow dynamics into account, since a coil may be swept away if incorrectly placed. [0194]
  • Preferably, FEM analysis occurs in real-time, in order to simulate real-time movement of a representation of a device while a user is manipulating a model device in the manikin. Such training is important to developing eye-hand coordination. Preferably, this is implemented using a fully nonlinear 3D finite element model combined with hemodynamic analysis. This requires extensive computer power. A multiprocessor system with at least about four processors, with each processor having computing power equal to a 2 GHz Intel Pentium 4 CPU is one example of a system that might be used. [0195]
  • Preferably, the system models interactions between the physiology and anatomy of a patient and one or more medical devices using physical modeling. FIG. 16 is a block diagram illustrating the various steps in such a simulation process and how these interact with each other. Preferably, the system accounts for physiological responses to an intervention procedure. For example, in simulating damage to a vessel wall through excessive pushing of a device against the wall, the system also can simulate the effect such an action will have on blood pressure. Similarly, a simulation of a tumorous lesion in a blood vessel include modeling the effects of such a lesion on local mechanical properties of tissues. [0196]
  • In a preferred aspect, the system includes a patient database comprising stored volume images and files relating to optical data obtained from body cavities and lumens of one or more patients. Preferably, the database comprises data from a population of patients, such as a population of normal patients, a population of patients with coronary artery disease, peripheral vascular disease, stenosis, and the like. In one aspect, the database comprises vascular data from patients obtained through one or more of a 3D Rotational XR scanner, an MRI scanner, an MRA scanner, or any scanning device suitable for collecting scanned images for generating volume images. Data so obtained generally is segmented. By having two rounds of scanning using the same scanning, but with only one round revealing the vasculature, segmented vessels can be obtained by subtracting images of the former scan from the corresponding images in the latter scan. [0197]
  • FIG. 15 illustrates the creation of a physical model for a patient's vasculature. Based upon segmented volume images, nodes are extracted, along with position and contour information. This data defines the central line of a vessel. Preferably, nodes are labeled according to the direction of blood flow as this aids in the deformation analysis process. After a 3D geometric model is reconstructed from the medical images, using the geometric modeling system as described above, a deformation law is implemented using FEM. [0198]
  • Deployment Models [0199]
  • In one aspect, in addition to modeling movement of a device through a body cavity or lumen, the system models one or more operations of the device. Such operations include, but are not limited to: a surgical procedure (e.g., such as removing, cutting, or repairing a tissue), inflation or deflation of a balloon, injection of a radioopaque material into the body cavity or lumen, and the like. [0200]
  • In one aspect, the system models interactions between an angioplasty device and a blood vessel having one or more lesions. For example, the system can model the deployment of a balloon angioplasty device at a lesion site and can model inflation and deflation of the balloon at the site. Preferably, a visual simulation is implemented at the same time that a user manipulates a balloon-inflating device. In one aspect, the balloon-inflating device comprises a delivery mechanism for controlling delivery of fluid (e.g., such as air) to a balloon, a pressure sensor for monitoring pressure of a fluid delivered to the balloon, and an electrical pressure meter for reading pressure determined by the pressure sensor. The electrical pressure meter transmits a signal corresponding to a pressure value to the system processor and, in response, the system simulates deployment of the balloon both on the screen of the first user device and within the manikin. [0201]
  • Injection of contrast medium also can be simulated. In one aspect, the first user (or a second user training the first user) can select an injection volume and rate from selectable options displayed on the first user interface (or second user interface). When these injection parameters are set, injection can be triggered using a simulated syringe or button on the control panel. The appearance of contrast filling the vessels (opacity) is modeled to reflect the rate of injection relative to the blood flow rate in the vessel. This provides a realistic impression of the injection. Preferably, diastolic and systolic flow pattern and washout of contrast through the vasculature also are modeled using the contrast injection function. Roadmapping capabilities additionally can be made available. The value of roadmapping is enhanced when it is combined with simultaneous 3D display of the vasculature. [0202]
  • Simulation Methods [0203]
  • In one aspect, the system provides a haptic interface for providing an interventional radiologist with the sense of touch during pretreatment planning and training. The system can be used in preparation for catheterization procedures with cerebral vascular pathologies such as intracranial aneurisms, stenosis, arteriovenous malformations, and the like. Other simulations which can be performed using the system include, but are not limited to, angioplasty, catheter navigation in the abdominal aorta, peripheral intravenous catheterization, venipuncture, interventional cardiology, and the like. [0204]
  • FIG. 13 is a flow diagram illustrating a simulation according to one aspect of the invention. Preferably, the simulation is event driven, i.e., responding to discrete actions from one or more users. Computation of interactions between the body cavity or lumen and one or more medical devices is implemented by the FEM engine described above. FEM has been used widely to compute deformations under mechanical constraints in engineering; however, the instant invention applies FEM analysis to various physical models of blood vessels, blood flow dynamics and medical devices. [0205]
  • Any input from users comes in the form of device manipulations, such as pushing, pulling, twisting a catheter; deploying a coil; inflating a balloon with a balloon catheter. Each of these inputs affects the finite element structure modeled by the system. By solving equations representing this structure through an iterative process as described above, an equilibrium state representing the interaction between the device and cavity/lumen can be obtained. At the equilibrium state, the interacting devices and vessels are at their final deformable forms. The forces computed at each node of the interaction between a medical device/body cavity or lumen are then fed back to one or more users using simulated instruments interfacing with the system. System outputs include real-time representations of medical devices as they navigate and/or deploy in simulated body cavities or lumens. [0206]
  • Real-time interaction is an important feature of the instant invention. The immersion of a user, and therefore, his or her ability to learn from the simulation system, is directly linked to the bandwidth of various components of the simulation system. An acceptable bandwidth for visual display is in the range of about 20-60 Hz while an acceptable bandwidth for haptic display is in the range of about 300-1000 Hz (where 300 Hz is the free hand gesture frequency). [0207]
  • Two parameters that are particularly important for accurate perception by a user are latency and computation time. Latency measures the time between sensor acquisition (e.g., acquiring the position of a simulated medical device relative to a simulated body cavity/lumen) and system action (e.g., haptic rendering or force feedback). Computation time is that amount of time needed to determine the equilibrium state of a structure (e.g., a representation of a device and cavity/lumen) and to update the resulting models. [0208]
  • There are several contributing causes of latency, including, but not limited to: time required for communication between input devices and the system processor, time for communication between the haptic display and the system processor, time for communication between the visual display (e.g., the 2D display) and the processor, time to compute collision detection, time for force feedback, and time for computing deformation models. Latency depends greatly on hardware and preferably the system comprises an at least about 16-bits bus for internal transmission within the embedded system (e.g., manikin interface), and a combination of serial and USB transmissions to create external links between simulated devices and the system processor. [0209]
  • Realism is also important. Very often, real-time interaction and realism are correlated. For example, FIG. 14 shows the relationship between response time and realism. Preferably, the simulation system according to the invention provides a visual feedback of 12-15 frames per second. [0210]
  • Visual feedback is the most powerful perception channel. The quality of visual rendering greatly influences user immersion and therefore the effectiveness of the simulation system. The system provides a library of 3D representations of medical devices and a library of 3D representations of normal or pathological patient anatomy. In one aspect, the user can select an entry point for insertion of a medical device into a simulated patient (e.g., at either a radial or femoral site) and in response to the user's manipulation, a haptic display will display the navigation of the device through a selected body cavity or lumen. The system can be used to direct the navigation of the device towards or away from the heart, allowing a user to choose where navigation will begin to be tracked. The user interface can comprise direction buttons, enabling a user to maneuver the device in particular directions. [0211]
  • Preferably, a current position of a navigating catheter within a body cavity/lumen is overlaid on a fluoroscopic view. When required, especially, during a course of training, a user has the option to adjust a fluoroscopic image in a manner similar to that employed in a CathLab. For example, the user can zoom in/out of a particular view of a catheter-guidewire entry site for a closer look of the position and orientation of the catheter and guidewire. The user also can improve image quality by collimating the field of view using the shutter function of a simulated scanning device. The shutter function provides both lateral and vertical collimation to recreate a clinical setting. The contrast of the fluoroscopic image also can be modified. In addition, moving patient table control levers can change the position of the fluoroscopic field of view. These levers control the movement of the image in the X and Y-axes as well as rotation and skew. They correspond to patient table control levers used in the clinical setting. [0212]
  • As discussed above, the motion of one or more medical devices relative to a body cavity or lumen is tracked and updated simultaneously in fluoroscopic and 3D displays. The user can change the transparency of 3D rendered vessels to better compliment the geometry presented in the fluoroscopic view. The user also has the option of overlapping a representation of the device with a representation of a surface-rendered vasculature. 3D-rendered vessels can be rotated in the x-, y-, and z-axis to better appreciate the position of the catheter/guidewire tip relative to the vascular anatomy. This feature is very useful in teaching selective vessel catheterization techniques. Besides 3D views, a fluoroscopic image can be viewed in stereo mode with the stereo image projected onto a split screen alongside the 2D image of a vessel. Users see the stereo virtual image on the screen of their user devices wearing a pair of stereo glasses (e.g., such as StereoGraphic Crystal Eyes). The stereo virtual objects consist of vessels, associated volume data, and the one or more interventional devices being navigated and/or deployed through the vessels. [0213]
  • Besides providing stereo and 3D views of the catheterization process, the simulator has the capability of locating catheter tip position within multi-planar images of a body region. The system will highlight tip position relative to anatomical structures on the display of one or more user devices. Preferably, images of the tip are viewable in any of an axial, coronal, sagittal or combined mode, representing images of scanned anatomical structures (e.g., such as obtained from CT, MRI or actual cross-anatomical color images). It is an important aspect of the system to provide multi-functional views for teaching complex techniques, such as those used in interventional procedures. In one aspect, an endoscopic view is provided of the tip of the catheter within the enclosing vessels of the cardiovascular system. [0214]
  • In another aspect, the system provides a haptic system for providing a neuroradiologist with the sense of touch during pretreatment planning and training. Preferably, the system comprises a database of angiographic information and a vascular model can be extracted from a database comprising data relating to geometry and topology of the cerebral vasculature (e.g., using a knowledge base). Physical properties of vessels can be obtained from outside sources such as the literature or from various experts. A library of devices suitable for use with vessels in the brain is included in the system. In one aspect, the library comprises data files relating to the geometry and/or physical properties of interventional devices, such as catheters, guidewires, stents, and coils. A device shape and material knowledge base can be provided as described in U.S. Provisional Application Serial No. 60/273,734, filed Mar. 6, 2001. [0215]
  • In one aspect, the system simulates an intracranial blood vessel with an aneurysm. Intracranial aneurysms are berry-like blisters in cerebral arteries that are caused by a weakness of all vessel wall layers. If rupture of an aneurysm occurs, hemorrhage can cause serious damage to the brain. To prepare for an interventional proceeding, a clear understanding of the anatomy surrounding an aneurysm is critical, such as the location and size of the neck, or connection between the aneurysm and vessel which feeds into it. An aneurysm is usually clearly visible in volume and surface-rendered images. [0216]
  • Preferably, the system displays a representation of the aneurysm and surrounding blood vessels and models the interactions of a simulated device being maneuvered in proximity to the aneurysm. In one aspect, the system is used to simulated the placement of one or more coils to treat the aneurysm. In one aspect, aneurysm coiling is simulated by navigating a medical device such as a coilwire to the aneurysm and replacing the wire with a coil. The coil is deployed by detaching the coil from the wire. Multiple coils can be deployed by repeating the detachment process with new coil wires. Each of these actions can be simulated on the haptic display using the system according to the invention. [0217]
  • In other aspect, a user can simulate other interventional procedures such as contrast fluid injection, inflation or deflation of a balloon, stent deployment, injection of a drug or therapeutic -agent. The system provides both haptic and visual feedback to the user to enable the user to develop the eye-hand coordination necessary to become skilled in these procedures. [0218]
  • As described above, the invention produces a highly realistic simulation environment for preplanning image-guided medical device delivery procedures and for training individuals who perform such procedures. In addition to its application in biomedical engineering, component parts of this invention may be applied to many other fields, for example, such as the field of 3D computer games. It should be apparent to those of ordinary skill in the art that variations, modifications, and other implementations of what is described herein will occur to those of ordinary skill in the art without departing from the spirit and scope of the invention and the claims. [0219]
  • All of the references, patents, and applications identified above, are expressly incorporated herein in their entireties. [0220]

Claims (73)

What is claimed is:
1. A system for simulating movement of a medical device in a body cavity or lumen of a patient, comprising:
(a) a medical device comprising a first end for manipulation by a user and a portion comprising a second end insertable into a simulated body cavity or body lumen in a manikin;
(b) a manikin comprising an interface for receiving the portion comprising the second end and for interfacing with a simulated body cavity or lumen within the manikin, wherein the interface comprises a directional force feedback mechanism for exerting a directional force on the medical device in response to a feedback signal received by the force feedback mechanism.
2. The system according to claim 1, wherein the directional force feedback mechanism provides resistance to forward motion but enables free reverse motion in response to the feedback signal.
3. The system according to claim 1, wherein the directional force feedback mechanism comprises a rolling element coupled to the portion of the device comprising the second end and wherein an internal surface of the simulated cavity or lumen in the manikin comprises an oblique slot for receiving the rolling element.
4. The system according to claim 3, wherein, in response to a feedback signal, forward movement of the second end causes the rolling element to be received by the slot, thereby causing resistance to further forward motion.
5. The system according to claim 4, wherein a motor controls movement of the rolling element.
6. The system according to claim 1, further comprising a tactile feedback mechanism.
7. The system according to claim 6, wherein the tactile feedback mechanism provides continuous vibrational feedback to a user holding the medical device.
8. The system according to claim 8, wherein continuous vibrational feedback is provided through a continuously rotating motor in communication with the portion of the device comprising the second end.
9. The system according to claim 1, wherein a position of at least the second end of the medical device relative to the manikin is continuously tracked.
10. The system according to claim 9, wherein the medical device comprises an encoder for tracking the translation of the device and an encoder for tracking the rotation of the device.
11. The system according to claim 9, wherein the system further comprises a tracking unit comprising a light source, a signal processing circuit, and one or more optical sensors, wherein the tracking unit is placed within the interface in optical communication with the device when it is inserted into the cavity or lumen.
12. The system according to claim 11, wherein light from the light source reflects on the device when inserted and wherein the reflected light is received by the one or more optical sensors.
13. The system according to claim 12, wherein changes in reflected light received by the one or more sensors is detected by the system, and wherein, in response to this detection, the system simulates movement of the device in real-time on the user display.
14. The system according to claim 12, wherein two optical sensors are provided which are perpendicular to one another.
15. The system according to claim 12, wherein the tracking unit is configured in the form of a rail along which the device can move.
16. The system according to claim 10, wherein one or more additional medical devices comprising a first end for manipulation by a user and a portion comprising a second end for insertion into the simulated body cavity or body lumen, are inserted into the interface and wherein the position of each medical device is independently monitored.
17. The system according to claim 16, wherein the one or more medical devices are selected from the group consisting of a catheter, guidewire, endoscope, laparoscope, bronchoscope, stent, coil, balloon, a balloon-inflating device, a surgical tool, a vascular occlusion device, optical probe, a drug delivery device, and combinations thereof.
18. The system according to claim 1, further comprising a table for placing the manikin thereon, wherein the table comprises a processor connectable to the network.
19. The system according to claim 18, wherein the system further comprises at least one first user device connectable to the network, the first user device comprising a first display interface for displaying a three-dimensional representation of a simulated body cavity or lumen of a patient.
20. The system according to claim 19, wherein the first display interface further displays a three-dimensional representation of a medical device corresponding to a medical device which is interfaced with the manikin and wherein the system simulates on the display the movement of the medical device within the simulated body cavity or lumen of the manikin in real-time when a first user manipulates the medical device interfaced with the manikin.
20. The system according to claim 19, further comprising a simulated scanning display for displaying a two-dimensional image of the simulated body cavity or lumen.
21. The system according to claim 20, wherein the simulated scanning display is part of a simulated scanning device.
22. The system according to claim 21, wherein the simulated scanning device is simulating an x-ray imaging system.
23. The system according to claim 21, wherein the simulated scanning device and scanning display are coupled to a movable C-arm within scanning distance of the manikin.
24. The system according to claim 1, further comprising a re-configurable control panel for performing one or more of: image acquisition selection; image display; manipulating a table on which the manikin is placed; manipulating the position of a simulated scanning device relative to the manikin; and control of one or more shutter devices for limiting a field of view of a scanning device placed within scanning distance of the manikin.
25. The system according to claim 1 or 20, further comprising a monitoring station, the monitoring station comprising a second user device connectable to the network and comprising a second display interface for enabling a second user to monitor the movement of the medical device within the simulated body cavity or lumen.
26. The system according to claim 25, wherein the second display interface of the monitoring station displays selectable options enabling the second user to select or change one or more anatomical and/or physiological parameters of the simulated body cavity or lumen, and wherein the selection causes the three-dimensional image of the simulated body cavity or lumen displayed to the first user to change to reflect the changed anatomical and/or physiological parameters.
27. The system according to claim 20, wherein the system is connectable to a database of patient images and/or medical data.
28. The system according to claim 25, wherein the system is connectable to a database of patient images and/or medical data.
29. The system according to claim 27, wherein the patient images comprise images of a body cavity or lumen from a patient affected by a pathology.
30. The system according to claim 28, wherein the patient images comprise images of a body cavity or lumen from a patient affected by a pathology.
31. The system according to claim 21, further comprising at least one foot-activation switch for activating or collimating the simulated scanning device, image display or table movement
33. The system according to claim 27, wherein the first user display interface provides access to the database and wherein, in response to accessing, the system displays an image and/or medical data on the first user display interface.
34. The system according to claim 27, wherein the second user display interface provides access to the database and wherein, in response to accessing, the system displays an image and/or medical data on the second user display interface.
35. The system according to claim 33, wherein the second user display interface provides access to the database and wherein, in response to accessing, the system displays an image and/or medical data on the second user display interface.
36. The system according to claim 35, wherein the second user display interface provides a selectable option enabling a second user to display the image displayed on the second user display interface, on the first user's display interface.
37. The system according to claim 1, wherein the device is selected from the group consisting of a catheter, guidewire, endoscope, laparoscope, bronchoscope, stent, coil, balloon, a balloon-inflating device, a surgical tool, a vascular occlusion device, optical probe, a drug delivery device, and combinations thereof.
38. A syringe for simulating fluid delivery, comprising:
a housing defining a lumen comprising an opening for delivering a fluid;
a pushing element for pushing the fluid through the opening;
a friction-producing element in communication with the pushing element; and
a motor in communication with the friction-producing element and comprising a signal-receiving element,
wherein the friction-producing element causes friction between the pushing element and a surface of the lumen of the housing upon activation by the motor in response to a signal received by the signal-receiving element.
39. The syringe according to claim 38, wherein the motor, when activated, causes motion of the friction-producing element, thereby causing the friction-producing element to contact the surface of the lumen of the housing, creating friction between the pushing element and the surface of the lumen and resistance to the motion of the pushing element.
40. The syringe according to claim 38, wherein the friction-producing element comprises one or more rubber pads.
41. The syringe according to claim 40, wherein each rubber pad is coupled to an arm whose movement is controlled by the motor.
42. The syringe according to claim 41, wherein each arm is coupled to the motor through a gear attached to the motor.
43. The syringe according to claim 38, wherein the amount of friction produced by the friction-producing element is adjusted by controlling a rotation angle of the motor.
44. The system according to claim 1, further comprising the syringe of claim 38, wherein opening of the syringe is connectable to a connecting piece having a first end for receiving fluid from the opening and a second end for delivering fluid to a simulated body cavity or body lumen in the manikin.
45. A balloon-inflating device for simulating deployment of a balloon within a body cavity or lumen of a patient, comprising:
a delivery mechanism for controlling delivery of fluid through the balloon-inflating device to the balloon;
a pressure sensor for monitoring pressure of a fluid delivered to the balloon by the balloon-inflating device;
an electrical pressure meter for reading pressure determined by the pressure sensor, the electrical pressure meter being connectable to a processor and for transmitting a signal corresponding to a pressure value to the processor.
46. The system according to claim 1, further comprising the balloon-inflating device of claim 45.
47. The system according to claim 20, wherein the system simulates deformation of the body cavity or lumen by the medical device.
48. The system according to claim 20, wherein the system simulates an operation of a medical device selected from the group consisting of: a surgical procedure, inflation or deflation of a balloon, injection of a radioopaque material into the body cavity or lumen, and combinations thereof.
49. The system according to claim 20, wherein the system simulates the movement of the device within a blood vessel.
50. The system according to claim 49, wherein the blood vessel is in the brain.
51. The system according to claim 50, wherein the blood vessel is in the heart.
52. A method for simulating the movement of a medical device in the body cavity or lumen of a patient, comprising:
providing a medical device comprising a first end for manipulation by a user and a portion comprising a second end inserted into a simulated body cavity or body lumen in a manikin, wherein the simulated body cavity or lumen in the manikin comprises a directional force feedback mechanism, and
wherein, in response to a feedback signal, the directional force feedback mechanism creates resistance to forward motion of the medical device but allows free reverse motion.
53. The method according to claim 52, further comprising:
providing a system comprising:
a processor in communication with the directional force feedback mechanism, the processor connectable to the network; and
a first user device in communication with the processor, the first user device comprising a first display interface for displaying a representation of a body cavity or lumen; and for providing access to a database of three-dimensional images of body cavities and lumens from a plurality of different patients; and
enabling a user to select from the database a representation, wherein in response to the selection, the representation is displayed on the first display interface.
54. The method according to claim 52, wherein the first display interface a displays a three-dimensional representation of the medical device and wherein the system simulates the movement of the medical device within the body cavity or lumen in real-time as a first user manipulates the medical device which is interfaced with the manikin.
55. The method according to claim 52 or 53, further comprising providing a monitoring station comprising a second display interface in communication with the processor and the first display interface, and wherein the second display interface provides a second user with access to the database.
56. The method according to claim 54, wherein when a second user selects a representation from the database, the representation is displayed on both the first and second display interface.
57. The method according to claim 53, wherein the system simulates the deformation of a body cavity or lumen in response to movement of the medical device by the first user and displays the representation of the deformation on the first display interface.
58. The method according to claim 53, wherein the medical device performs an operation on the simulated body cavity or lumen and the first display interface displays a simulation of the operation.
59. The method according to claim 58, wherein the operation is inflation or deflation of a balloon within the simulated body cavity or lumen.
60. The method according to claim 58, wherein the operation is injection of a radioopaque fluid within the body cavity or lumen.
61. The method according to claim 52, wherein the device is selected from the group consisting of a catheter, guidewire, endoscope, laparoscope, bronchoscope, stent, coil, balloon, a balloon-inflating device, a surgical tool, a vascular occlusion device, an optical probe, a drug delivery device, and combinations thereof.
62. The method according to claim 54, wherein a first user inserts one or more additional medical devices into the simulated body cavity or lumen, and the movement of each medical device is independently monitored.
63. The method according to claim 52, wherein the simulated body cavity or lumen in the manikin further comprises a tactile feedback mechanism, providing continuous vibrational feedback to a first user manipulating the device.
64. A method for simulating fluid delivery into a body cavity or lumen of a patient comprising:
(a) providing a syringe for simulating fluid delivery, the syringe comprising:
a housing defining a lumen comprising an opening for delivering a fluid;
a pushing element for pushing the fluid through the opening;
a friction-producing element in communication with the pushing element; and
a motor in communication with the friction-producing element and comprising a signal-receiving element,
wherein the friction-producing element causes friction between the pushing element and a surface of the lumen in response to a signal received by the signal receiving element; and
(b) providing a signal, thereby causing friction between the pushing element and the lumen.
65. A method for simulating deployment of a balloon within a body cavity or lumen of a patient, comprising:
(a) providing a balloon-inflating device, comprising:
a delivery mechanism for controlling delivery of a fluid through the balloon-inflating device to the balloon;
a pressure sensor for monitoring pressure of a fluid delivered to the balloon by the balloon-inflating device;
an electrical pressure meter for reading pressure determined by the pressure sensor and for transmitting a signal corresponding to a pressure value to a processor;
(b) providing a system comprising:
a processor for receiving the signal, the processor connectable to the network; and
a user device comprising an interface displaying a representation of the balloon within a simulated body cavity or lumen; and
(c) delivering the fluid to the balloon; wherein deployment of the balloon in response to the delivering is displayed on the user device.
66. The method according to claim 65, wherein the fluid is air.
67. The method according to claim 65, wherein the method is used to simulate balloon angioplasty.
68. The method according to claim 65, further comprising providing the system according to claim 1, inserting a balloon catheter into the simulated body cavity or lumen to simulate navigating to a target region of the body, and simulating positioning the balloon deployment device in proximity to the balloon catheter to inflate or deflate the balloon.
69. The method according to claim 67, further comprising inserting a catheter and guidewire into the body cavity or lumen to navigate the balloon cavity to the target region.
70. The method according to claim 67, further comprising inserting a stent catheter to navigate to a target region and using the balloon to deploy the stent, thereby simulating stent deployment in the body cavity or lumen.
71. The method according to claim 68, further comprising inserting a catheter or guidewire into the body cavity or lumen to navigate the stent catheter to the target region.
72. A method for simulating coil embolization in a body cavity or lumen of a patient, comprising:
providing a catheter, guidewire and coil wire comprising a coil to navigate to a target region of the body;
providing the system according to claim 19, wherein the re-configurable control panel provides a selectable option for detaching the coil from the coil wire, and wherein selecting the selectable option triggers the release of the coil from the coil wire.
73. The method according to claim 72, wherein an electrical current triggers release of the coil from the coil wire.
US10/091,742 1999-05-03 2002-03-05 Simulation system for image-guided medical procedures Abandoned US20020168618A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US10/091,742 US20020168618A1 (en) 2001-03-06 2002-03-05 Simulation system for image-guided medical procedures
US10/720,576 US20040106167A1 (en) 1999-05-03 2003-11-24 Methods for evaluating sterilization procedures using a biological indicator

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US27373301P 2001-03-06 2001-03-06
US27373401P 2001-03-06 2001-03-06
US10/091,742 US20020168618A1 (en) 2001-03-06 2002-03-05 Simulation system for image-guided medical procedures

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US56370700A Continuation-In-Part 1999-05-03 2000-05-02

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/720,576 Continuation US20040106167A1 (en) 1999-05-03 2003-11-24 Methods for evaluating sterilization procedures using a biological indicator

Publications (1)

Publication Number Publication Date
US20020168618A1 true US20020168618A1 (en) 2002-11-14

Family

ID=26956404

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/091,742 Abandoned US20020168618A1 (en) 1999-05-03 2002-03-05 Simulation system for image-guided medical procedures
US10/091,745 Expired - Fee Related US7371067B2 (en) 2001-03-06 2002-03-05 Simulation method for designing customized medical devices

Family Applications After (1)

Application Number Title Priority Date Filing Date
US10/091,745 Expired - Fee Related US7371067B2 (en) 2001-03-06 2002-03-05 Simulation method for designing customized medical devices

Country Status (3)

Country Link
US (2) US20020168618A1 (en)
SG (1) SG142164A1 (en)
WO (2) WO2002086797A1 (en)

Cited By (161)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020016923A1 (en) * 2000-07-03 2002-02-07 Knaus William A. Broadband computer-based networked systems for control and management of medical records
US20030040669A1 (en) * 2001-01-09 2003-02-27 Michael Grass Method of imaging the blood flow in a vascular tree
US20030061070A1 (en) * 2001-09-25 2003-03-27 Kelly Gina E. Interactive medical training system
US20030114751A1 (en) * 2001-11-30 2003-06-19 Christoph Pedain Device and method for administering a substance
US20030186199A1 (en) * 2002-01-23 2003-10-02 Melior-Delaware System and method for interactive online training
US20030212707A1 (en) * 2002-05-10 2003-11-13 Uber Arthur E. System and method for automated benchmarking for the recognition of best medical practices and products and for establishing standards for medical procedures
US20030211451A1 (en) * 2002-05-07 2003-11-13 Cae Inc. System and method for distance learning of systems knowledge and integrated procedures using a real-time, full-scope simulation
US20030230313A1 (en) * 2002-03-13 2003-12-18 Ehsan Alipour Imaging of the vasa vasorum to navigate through an occlusion
US20040010221A1 (en) * 2002-06-20 2004-01-15 Christoph Pedain Method and device for preparing a drainage
US20040043368A1 (en) * 2002-08-30 2004-03-04 Ming-Shium Hsieh Three-dimensional surgery simulation system
US20040126746A1 (en) * 2000-10-23 2004-07-01 Toly Christopher C. Medical physiological simulator including a conductive elastomer layer
US20040138551A1 (en) * 2002-09-12 2004-07-15 Andreas Hartlep Determining distribution for planning an infusion
US20040253572A1 (en) * 2001-05-20 2004-12-16 Edna Chosack Endoscopic ultrasonography simulation
US20050033561A1 (en) * 2003-08-07 2005-02-10 The Math Works, Inc. Synchronization and data review system
US20050118557A1 (en) * 2003-11-29 2005-06-02 American Board Of Family Medicine, Inc. Computer architecture and process of user evaluation
US20050181343A1 (en) * 2004-02-02 2005-08-18 Ault Mark J. Ultrasound guided vascular access training device
US20050214724A1 (en) * 2004-03-23 2005-09-29 David Feygin Vascular-access simulation system with ergonomic features
US20050220264A1 (en) * 2004-03-31 2005-10-06 Siemens Aktiengesellschaft Method and device for medical image reconstruction
US20050277096A1 (en) * 2004-06-14 2005-12-15 Hendrickson Daniel L Medical simulation system and method
US20060073455A1 (en) * 2004-09-30 2006-04-06 Cardiac Pacemakers, Inc. Virtual reality based prototyping system for medical devices
US20060094953A1 (en) * 2004-10-15 2006-05-04 Andreas Hartlep Targeted infusion of agents for treatment of ALS
US20060093583A1 (en) * 2004-10-15 2006-05-04 Andreas Hartlep Targeted infusion of agents against Parkinson's disease
US20060121036A1 (en) * 2004-10-15 2006-06-08 Andreas Hartlep Targeted immunization and plaque destruction against Alzheimer's disease
US20060127867A1 (en) * 2002-12-03 2006-06-15 Jan Grund-Pedersen Interventional simulator system
US20060171574A1 (en) * 2004-11-12 2006-08-03 Delmonego Brian Graphical healthcare order processing system and method
US20070016035A1 (en) * 2005-05-17 2007-01-18 Ge Medical Systems Global Technology Company, Llc Ultrasonic diagnostic apparatus and ultrasonic image generating method
US20070016072A1 (en) * 2005-05-06 2007-01-18 Sorin Grunwald Endovenous access and guidance system utilizing non-image based ultrasound
US20070016391A1 (en) * 2005-07-14 2007-01-18 Ryo Minoguchi Reverse finite element analysis and modeling of biomechanical properties of internal tissues
US20070020605A1 (en) * 2005-06-17 2007-01-25 Fei Company Combined hardware and software instrument simulator for use as a teaching aid
US20070027667A1 (en) * 2005-07-14 2007-02-01 Osborn Thomas W Iii Computational model of the internal human pelvic environment
US20070032826A1 (en) * 2005-08-02 2007-02-08 Yitzhack Schwartz Standardization of catheter-based treatment for atrial fibrillation
US20070043292A1 (en) * 2005-08-08 2007-02-22 Siemens Aktiengesellschaft Method for acquiring and evaluating vascular examination data
US20070043285A1 (en) * 2005-08-02 2007-02-22 Yitzhack Schwartz Simulation of invasive procedures
US20070134637A1 (en) * 2005-12-08 2007-06-14 Simbionix Ltd. Medical simulation device with motion detector
US20070141543A1 (en) * 2002-12-03 2007-06-21 Jan Grund-Pedersen Interventional simulator system
US20070276216A1 (en) * 2004-08-16 2007-11-29 Refael Beyar Image-Guided Navigation for Catheter-Based Interventions
US20080020362A1 (en) * 2004-08-10 2008-01-24 Cotin Stephane M Methods and Apparatus for Simulaton of Endovascular and Endoluminal Procedures
US20080027574A1 (en) * 2006-07-25 2008-01-31 Thomas Roger D Surgical console operable to playback multimedia content
US20080082110A1 (en) * 2006-09-28 2008-04-03 Rodriguez Ponce Maria Inmacula Planning movement trajectories of medical instruments into heterogeneous body structures
US20080085499A1 (en) * 2006-10-05 2008-04-10 Christopher Horvath Surgical console operable to simulate surgical procedures
US20080139895A1 (en) * 2006-10-13 2008-06-12 Siemens Medical Solutions Usa, Inc. System and Method for Selection of Points of Interest During Quantitative Analysis Using a Touch Screen Display
US20080183059A1 (en) * 2003-09-23 2008-07-31 Optical Sensors Incorporated System and method for assessing capillary vitality
US20080187896A1 (en) * 2004-11-30 2008-08-07 Regents Of The University Of California, The Multimodal Medical Procedure Training System
US20080200843A1 (en) * 2005-08-09 2008-08-21 Ohio Universtiy Method and Apparatus for Measurement of Human Tissue Properties in Vivo
US20080221438A1 (en) * 2007-03-09 2008-09-11 Chen Luke Y Automated catalog and system for correction of inhomogeneous fields
DE102007021717A1 (en) * 2007-05-09 2008-10-02 Siemens Ag Broncho-pulmonal diagnose and therapy system for treating diseases in vascular and lymphatic system, has X-ray imaging arrangement arranged for three-dimensional movement within diagnostic-and therapy areas at multi-axial support system
US20080240548A1 (en) * 2007-03-28 2008-10-02 Terence Sern-Wei Yeoh Isosurfacial three-dimensional imaging system and method
US20080286735A1 (en) * 2005-07-20 2008-11-20 Dies Srl System and a Method for Simulating a Manual Interventional Operation by a User in a Medical Procedure
US20080312884A1 (en) * 2005-01-24 2008-12-18 Institut De Recherche Sur Les Cancers De L'appareil Digestifircad Process and System for Simulation or Digital Synthesis of Sonographic Images
US20090046912A1 (en) * 2005-01-24 2009-02-19 Institut De Recherche Sur Les Cancers De L'appareil Digestif-Irca Process and System for Simulation or Digital Synthesis of Sonographic Images
WO2009049282A2 (en) * 2007-10-11 2009-04-16 University Of Florida Research Foundation, Inc. Mixed simulator and uses thereof
US20090118714A1 (en) * 2007-11-07 2009-05-07 Dan Teodorescu Surgical console information display system and method
US20090123053A1 (en) * 2003-06-17 2009-05-14 Brown University Methods and apparatus for model-based detection of structure in view data
US20090131955A1 (en) * 2005-09-29 2009-05-21 Corindus Ltd. Methods and apparatuses for treatment of hollow organs
US20090130643A1 (en) * 2005-07-20 2009-05-21 Corrado Cusano Method for simulating a manual interventional operation by a user in a medical procedure
US20090171212A1 (en) * 2007-10-09 2009-07-02 Howard Mark Garon Interactive Virtual Visualization System For Training And Assistance In the Use of Ultrasound Handheld Transducers
US20090177090A1 (en) * 2005-05-06 2009-07-09 Sorin Grunwald Endovascular devices and methods of use
US20090177454A1 (en) * 2007-01-16 2009-07-09 Ran Bronstein System and method for performing computerized simulations for image-guided procedures using a patient specific model
US20090270712A1 (en) * 2007-04-13 2009-10-29 Brainlab Ag Margin determination/tumor cell migration
US20090310835A1 (en) * 2006-07-17 2009-12-17 Koninklijke Philips Electronics N. V. Efficient user interaction with polygonal meshes for medical image segmentation
US7665995B2 (en) 2000-10-23 2010-02-23 Toly Christopher C Medical training simulator including contact-less sensors
US20100055657A1 (en) * 2008-08-27 2010-03-04 Warren Goble Radiographic and ultrasound simulators
WO2010025336A1 (en) * 2008-08-29 2010-03-04 Corindus Ltd. Catheter simulation and assistance system
US20100099981A1 (en) * 2008-10-21 2010-04-22 Fishel Robert S Trans-Septal Catheterization Device And Method
US20100109713A1 (en) * 2008-11-05 2010-05-06 Harriman Paul J Current balancing circuit and method
KR100957470B1 (en) 2009-08-28 2010-05-17 주식회사 래보 Surgical robot system using augmented reality and control method thereof
WO2010056538A1 (en) * 2008-10-29 2010-05-20 Tim Maguire An automated vessel puncture device using three-dimensional(3d) near infrared (nir) imaging and a robotically driven needle
WO2010110560A2 (en) * 2009-03-24 2010-09-30 주식회사 래보 Surgical robot system using augmented reality, and method for controlling same
US7848543B2 (en) 2004-02-05 2010-12-07 Brainlab Ag Method and system for prediction and management of material and information transport in an organism
US20110002517A1 (en) * 2008-03-06 2011-01-06 Koninklijke Philips Electronics N.V. Method for analyzing a tube system
US20110010155A1 (en) * 2008-03-12 2011-01-13 Waseda University Tracheal intubation training apparatus
US20110060579A1 (en) * 2004-09-28 2011-03-10 Anton Butsev Ultrasound Simulation Apparatus and Method
US20110091853A1 (en) * 2009-10-20 2011-04-21 Magnetecs, Inc. Method for simulating a catheter guidance system for control, development and training applications
US20110218774A1 (en) * 2010-03-03 2011-09-08 Milan Ikits Systems and Methods for Simulations Utilizing a Virtual Coupling
US20110238082A1 (en) * 2008-12-12 2011-09-29 Corindus Inc. Remote catheter procedure system
WO2011151304A1 (en) * 2010-05-31 2011-12-08 Laerdal Medical As Iv training system
US20120004668A1 (en) * 2004-03-05 2012-01-05 Hansen Medical, Inc. Robotic catheter system
KR101108927B1 (en) 2009-03-24 2012-02-09 주식회사 이턴 Surgical robot system using augmented reality and control method thereof
EP2439719A1 (en) * 2010-10-05 2012-04-11 Biosense Webster (Israel), Ltd. Simulation of an invasive procedure
US20120122062A1 (en) * 2010-11-16 2012-05-17 Electronics And Telecommunications Research Institute Reconfigurable platform management apparatus for virtual reality-based training simulator
WO2012076494A1 (en) * 2010-12-06 2012-06-14 Sanofi-Aventis Deutschland Gmbh Training mechanism for drug delivery device
US20120178069A1 (en) * 2010-06-15 2012-07-12 Mckenzie Frederic D Surgical Procedure Planning and Training Tool
US8257302B2 (en) 2005-05-10 2012-09-04 Corindus, Inc. User interface for remote control catheterization
US20120238875A1 (en) * 2004-11-30 2012-09-20 Eric Savitsky Embedded Motion Sensing Technology for Integration within Commercial Ultrasound Probes
ES2387785A1 (en) * 2012-05-14 2012-10-01 Universitat Politècnica De Catalunya Method for generating a path for a virtual bronchoscopy
US8297983B2 (en) 2004-11-30 2012-10-30 The Regents Of The University Of California Multimodal ultrasound training system
US20120278711A1 (en) * 2003-09-16 2012-11-01 Labtest International, Inc. D/B/A Intertek Consumer Goods North America Haptic response system and method of use
US20120280988A1 (en) * 2010-04-09 2012-11-08 University Of Florida Research Foundation, Inc. Interactive mixed reality system and uses thereof
US8395626B2 (en) * 2006-04-08 2013-03-12 Alan Millman Method and system for interactive simulation of materials
US8457714B2 (en) 2008-11-25 2013-06-04 Magnetecs, Inc. System and method for a catheter impedance seeking device
US8480618B2 (en) 2008-05-06 2013-07-09 Corindus Inc. Catheter system
US8480404B2 (en) * 2004-11-30 2013-07-09 Eric A. Savitsky Multimodal ultrasound training system
US8491307B2 (en) * 2002-12-03 2013-07-23 Mentice Ab Interventional simulator control system
US8500451B2 (en) * 2007-01-16 2013-08-06 Simbionix Ltd. Preoperative surgical simulation
US8556635B2 (en) 2000-10-23 2013-10-15 Christopher C. Toly Physiological simulator for use as a brachial plexus nerve block trainer
US20130329982A1 (en) * 2010-11-18 2013-12-12 Masar Scientific Uk Limited Radiological Simulation
WO2013192234A1 (en) * 2012-06-18 2013-12-27 The Research Foundation For The State University Of New York Systems and methods for identifying historical vasculature cases
US8694157B2 (en) 2008-08-29 2014-04-08 Corindus, Inc. Catheter control system and graphical user interface
US20140193788A1 (en) * 2011-01-10 2014-07-10 Alk Ag Method, a device and a computer program product for training the use of an auto-injector
US8786613B2 (en) 2006-04-08 2014-07-22 Alan Millman Method and system for interactive simulation of materials and models
US8790297B2 (en) 2009-03-18 2014-07-29 Corindus, Inc. Remote catheter system with steerable catheter
US20140212864A1 (en) * 2012-10-30 2014-07-31 Truinject Medical Corp. Injection training apparatus using 3d position sensor
US20140298270A1 (en) * 2011-10-11 2014-10-02 Koninklijke Philips N.V. Workflow for ambiguity guided interactive segmentation of lung lobes
US20150018675A1 (en) * 2006-03-14 2015-01-15 Nemoto Kyorindo Co., Ltd. Medical image system
US8965490B2 (en) 2012-05-07 2015-02-24 Vasonova, Inc. Systems and methods for detection of the superior vena cava area
WO2015073357A1 (en) * 2013-11-13 2015-05-21 Volcano Corporation Visually optimized intravascular imaging and associated devices, systems, and methods
EP2269693A4 (en) * 2008-04-14 2015-07-08 Gmv Aerospace And Defence S A Planning system for intraoperative radiation therapy and method for carrying out said planning
US9105200B2 (en) 2011-10-04 2015-08-11 Quantant Technology, Inc. Semi-automated or fully automated, network and/or web-based, 3D and/or 4D imaging of anatomy for training, rehearsing and/or conducting medical procedures, using multiple standard X-ray and/or other imaging projections, without a need for special hardware and/or systems and/or pre-processing/analysis of a captured image data
US9119551B2 (en) 2010-11-08 2015-09-01 Vasonova, Inc. Endovascular navigation system and method
US9171484B2 (en) 2008-03-06 2015-10-27 Immersion Corporation Determining location and orientation of an object positioned on a surface
US9220568B2 (en) 2009-10-12 2015-12-29 Corindus Inc. Catheter system with percutaneous device movement algorithm
US9254220B1 (en) 2006-08-29 2016-02-09 Vasamed, Inc. Method and system for assessing severity and stage of peripheral arterial disease and lower extremity wounds using angiosome mapping
US9265577B2 (en) 2007-05-18 2016-02-23 The Johns Hopkins University Methods and systems for providing planning and dispensation of research and/or treatment for brain disease
US20160232667A1 (en) * 2010-08-12 2016-08-11 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US20160324407A1 (en) * 2013-10-31 2016-11-10 Optimede Inc. Test system having laser treatment function
US20170004732A1 (en) * 2013-11-29 2017-01-05 "Eidos-Medicine", Ltd, Drive for generating force-related tactile feedback on an instrument
US20170035514A1 (en) * 2015-08-07 2017-02-09 Abbott Cardiovascular System Inc. System and method for supporting decisions during a catheterization procedure
US9655539B2 (en) 2009-11-09 2017-05-23 Magnetecs, Inc. System and method for targeting catheter electrodes
US9679499B2 (en) 2008-09-15 2017-06-13 Immersion Medical, Inc. Systems and methods for sensing hand motion by measuring remote displacement
US20170243522A1 (en) * 2014-09-10 2017-08-24 The University Of North Carolina At Chapel Hill Radiation-free simulator systems and methods for simulating fluoroscopic or other procedures
CN107411819A (en) * 2017-04-12 2017-12-01 上海大学 Balloon angioplasty process real time simulation method
US9833293B2 (en) 2010-09-17 2017-12-05 Corindus, Inc. Robotic catheter system
US9836895B1 (en) * 2015-06-19 2017-12-05 Waymo Llc Simulating virtual objects
US9875339B2 (en) 2011-01-27 2018-01-23 Simbionix Ltd. System and method for generating a patient-specific digital image-based model of an anatomical structure
US9922578B2 (en) 2014-01-17 2018-03-20 Truinject Corp. Injection site training system
US9962229B2 (en) 2009-10-12 2018-05-08 Corindus, Inc. System and method for navigating a guide wire
WO2018089413A1 (en) * 2016-11-08 2018-05-17 President And Fellows Of Harvard College Methodology and apparatus for simulation of medical devices
US10037715B2 (en) 2013-10-16 2018-07-31 Simulab Corporation Detecting insertion of needle into simulated vessel using a conductive fluid
US20180264236A1 (en) * 2017-03-15 2018-09-20 Radux Devices, LLC Interventional tool delivery devices, systems and methods
US10235904B2 (en) 2014-12-01 2019-03-19 Truinject Corp. Injection training tool emitting omnidirectional light
US10269266B2 (en) 2017-01-23 2019-04-23 Truinject Corp. Syringe dose and position measuring apparatus
US10290232B2 (en) 2014-03-13 2019-05-14 Truinject Corp. Automated detection of performance characteristics in an injection training system
US10354050B2 (en) 2009-03-17 2019-07-16 The Board Of Trustees Of Leland Stanford Junior University Image processing method for determining patient-specific cardiovascular information
US10360810B1 (en) * 2011-09-28 2019-07-23 Sproutel Inc. Educational doll for children with chronic illness
US10368837B2 (en) 2005-05-06 2019-08-06 Arrow International, Inc. Apparatus and method for vascular access
US10395446B2 (en) * 2016-05-04 2019-08-27 Tecat Performance Systems, Llc Integrated wireless data system for avionics performance indication
US10433929B2 (en) 2007-03-09 2019-10-08 St. Jude Medical, Atrial Fibrillation Division, Inc. System and method for local deformable registration of a catheter navigation system to image data or a model
US10440246B2 (en) * 2014-11-19 2019-10-08 Kiran K. Bhat System for enabling remote annotation of media data captured using endoscopic instruments and the creation of targeted digital advertising in a documentation environment using diagnosis and procedure code entries
US20190340956A1 (en) * 2018-05-05 2019-11-07 Mentice Inc. Simulation-based training and assessment systems and methods
US10500340B2 (en) 2015-10-20 2019-12-10 Truinject Corp. Injection system
US10650703B2 (en) 2017-01-10 2020-05-12 Truinject Corp. Suture technique training system
US10648790B2 (en) 2016-03-02 2020-05-12 Truinject Corp. System for determining a three-dimensional position of a testing tool
WO2020095078A1 (en) 2018-11-09 2020-05-14 Semmelweis Egyetem Exoskeleton for assisting surgical positioning, method for producing the exoskeleton
US10726741B2 (en) 2004-11-30 2020-07-28 The Regents Of The University Of California System and method for converting handheld diagnostic ultrasound systems into ultrasound training systems
US10734116B2 (en) 2011-10-04 2020-08-04 Quantant Technology, Inc. Remote cloud based medical image sharing and rendering semi-automated or fully automated network and/or web-based, 3D and/or 4D imaging of anatomy for training, rehearsing and/or conducting medical procedures, using multiple standard X-ray and/or other imaging projections, without a need for special hardware and/or systems and/or pre-processing/analysis of a captured image data
US10743942B2 (en) 2016-02-29 2020-08-18 Truinject Corp. Cosmetic and therapeutic injection safety systems, methods, and devices
US10849688B2 (en) 2016-03-02 2020-12-01 Truinject Corp. Sensory enhanced environments for injection aid and social training
US10902746B2 (en) 2012-10-30 2021-01-26 Truinject Corp. System for cosmetic and therapeutic training
US11094223B2 (en) 2015-01-10 2021-08-17 University Of Florida Research Foundation, Incorporated Simulation features combining mixed reality and modular tracking
US11107587B2 (en) 2008-07-21 2021-08-31 The Board Of Trustees Of The Leland Stanford Junior University Method for tuning patient-specific cardiovascular simulations
US11164483B2 (en) * 2015-12-28 2021-11-02 Pontificia Universidad Católica De Chile Medical simulator for the simulation of puncture operations
US20210378747A1 (en) * 2018-03-28 2021-12-09 Insilicotrials Technologies S.R.L. Method and system for computational modeling and simulation of the operation and/or behavior of medical devices which are implantable or usable on patients
US11315439B2 (en) 2013-11-21 2022-04-26 SonoSim, Inc. System and method for extended spectrum ultrasound training using animate and inanimate training objects
US11495142B2 (en) 2019-01-30 2022-11-08 The Regents Of The University Of California Ultrasound trainer with internal optical tracking
US11600201B1 (en) 2015-06-30 2023-03-07 The Regents Of The University Of California System and method for converting handheld diagnostic ultrasound systems into ultrasound training systems
US11631342B1 (en) 2012-05-25 2023-04-18 The Regents Of University Of California Embedded motion sensing technology for integration within commercial ultrasound probes
US11627944B2 (en) 2004-11-30 2023-04-18 The Regents Of The University Of California Ultrasound case builder system and method
US11749137B2 (en) 2017-01-26 2023-09-05 The Regents Of The University Of California System and method for multisensory psychomotor skill training
US11810473B2 (en) 2019-01-29 2023-11-07 The Regents Of The University Of California Optical surface tracking for medical simulation
JP7439106B2 (en) 2019-01-18 2024-02-27 ベクトン・ディキンソン・アンド・カンパニー Intravenous treatment selection system
US11918314B2 (en) 2009-10-12 2024-03-05 Corindus, Inc. System and method for navigating a guide wire

Families Citing this family (122)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MXPA02005861A (en) 1999-12-14 2003-01-28 Icu Medical Inc Method of manufacturing a multiple component device.
US7526112B2 (en) * 2001-04-30 2009-04-28 Chase Medical, L.P. System and method for facilitating cardiac intervention
DE10162272A1 (en) * 2001-12-19 2003-07-10 Philips Intellectual Property Procedure to support orientation in the vascular system
AU2003223085A1 (en) * 2002-04-17 2003-10-27 Super Dimension Ltd. Endoscope structures and techniques for navigating to a target in branched structure
US20040064295A1 (en) * 2002-09-26 2004-04-01 Jiping Zhang Methods for modular-parametric-finite-element modeling
DE10247299A1 (en) * 2002-10-10 2004-04-22 Philips Intellectual Property & Standards Gmbh Image processing unit for medical X-ray apparatus comparing actual image of body volume with preceding image for adjacent movement phase of imaged body volume
WO2004051601A1 (en) * 2002-12-03 2004-06-17 Mentice Ab An interventional simulator control system
WO2005025635A2 (en) 2003-09-15 2005-03-24 Super Dimension Ltd. System of accessories for use with bronchoscopes
EP2316328B1 (en) 2003-09-15 2012-05-09 Super Dimension Ltd. Wrap-around holding device for use with bronchoscopes
GB2409326B (en) * 2003-12-19 2005-12-07 Keymed A dummy medical instrument for use in a simulator
US8764725B2 (en) 2004-02-09 2014-07-01 Covidien Lp Directional anchoring mechanism, method and applications thereof
US20050288808A1 (en) * 2004-06-14 2005-12-29 Lopez George A Computer system for efficient design and manufacture of multiple-component devices
US20060040245A1 (en) * 2004-08-20 2006-02-23 Airola Christopher A Interactive medical procedure training
US7322826B2 (en) * 2004-09-08 2008-01-29 Medical Accessories And Research Corp. Soft tissue model
US20080220039A1 (en) * 2004-09-17 2008-09-11 Sherman Darren R Thin Film Medical Devices Manufactured on Application Specific Core Shapes
DE102004046038B4 (en) * 2004-09-21 2010-07-15 Karl Storz Gmbh & Co. Kg Virtual surgery simulator
CN101084528B (en) * 2004-12-20 2011-09-14 皇家飞利浦电子股份有限公司 A method and a system for integration of medical diagnostic information and a geometric model of a movable body
WO2006067534A1 (en) * 2004-12-22 2006-06-29 Euromed Consult Bt. Prosthesis for the non-invasive treatment of aneurysms
US8066759B2 (en) 2005-02-04 2011-11-29 Boston Scientific Scimed, Inc. Resonator for medical device
CN101128829B (en) * 2005-02-23 2010-05-19 皇家飞利浦电子股份有限公司 Method and device for the prediction of the course of a catheter, method for manufacturing catheter
US20060199159A1 (en) * 2005-03-01 2006-09-07 Neuronetics, Inc. Head phantom for simulating the patient response to magnetic stimulation
CN101160602A (en) * 2005-04-12 2008-04-09 皇家飞利浦电子股份有限公司 A method, an apparatus and a computer program for segmenting an anatomic structure in a multi-dimensional dataset.
US20060257835A1 (en) * 2005-05-13 2006-11-16 Wallaker Daniel M Endoscopy simulation system
US7595469B2 (en) * 2005-05-24 2009-09-29 Boston Scientific Scimed, Inc. Resonator for medical device
US7279664B2 (en) 2005-07-26 2007-10-09 Boston Scientific Scimed, Inc. Resonator for medical device
US7304277B2 (en) 2005-08-23 2007-12-04 Boston Scientific Scimed, Inc Resonator with adjustable capacitor for medical device
US7524282B2 (en) 2005-08-29 2009-04-28 Boston Scientific Scimed, Inc. Cardiac sleeve apparatus, system and method of use
US20070066881A1 (en) 2005-09-13 2007-03-22 Edwards Jerome R Apparatus and method for image guided accuracy verification
WO2007033206A2 (en) 2005-09-13 2007-03-22 Veran Medical Technologies, Inc. Apparatus and method for image guided accuracy verification
WO2007046777A1 (en) * 2005-10-21 2007-04-26 Agency For Science, Technology And Research Encoding, storing and decoding data for teaching radiology diagnosis
US7423496B2 (en) 2005-11-09 2008-09-09 Boston Scientific Scimed, Inc. Resonator with adjustable capacitance for medical device
US7711148B2 (en) * 2005-12-07 2010-05-04 Siemens Medical Solutions Usa, Inc. Systems and methods for guidewire tracking using phase congruency
US7383734B2 (en) * 2006-01-31 2008-06-10 Medtronic, Inc. Simulation of magnetic field induced vibrations in implantable medical devices
US20070207448A1 (en) * 2006-03-03 2007-09-06 The National Retina Institute Method and system for using simulation techniques in ophthalmic surgery training
US8095382B2 (en) * 2006-06-16 2012-01-10 The Invention Science Fund I, Llc Methods and systems for specifying a blood vessel sleeve
US8147537B2 (en) * 2006-06-16 2012-04-03 The Invention Science Fund I, Llc Rapid-prototyped custom-fitted blood vessel sleeve
US8478437B2 (en) * 2006-06-16 2013-07-02 The Invention Science Fund I, Llc Methods and systems for making a blood vessel sleeve
US7818084B2 (en) * 2006-06-16 2010-10-19 The Invention Science Fund, I, LLC Methods and systems for making a blood vessel sleeve
US8550344B2 (en) * 2006-06-16 2013-10-08 The Invention Science Fund I, Llc Specialty stents with flow control features or the like
US8551155B2 (en) * 2006-06-16 2013-10-08 The Invention Science Fund I, Llc Stent customization system and method
US8163003B2 (en) * 2006-06-16 2012-04-24 The Invention Science Fund I, Llc Active blood vessel sleeve methods and systems
US20080133040A1 (en) * 2006-06-16 2008-06-05 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Methods and systems for specifying a blood vessel sleeve
US20080172073A1 (en) * 2006-06-16 2008-07-17 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Active blood vessel sleeve
DE102006051447A1 (en) * 2006-10-31 2008-05-08 Siemens Ag Method and system for generating a user interface
MX2009010000A (en) 2007-03-19 2010-03-17 Insuline Medical Ltd Drug delivery device.
WO2009081262A1 (en) 2007-12-18 2009-07-02 Insuline Medical Ltd. Drug delivery device with sensor for closed-loop operation
US9220837B2 (en) 2007-03-19 2015-12-29 Insuline Medical Ltd. Method and device for drug delivery
US8622991B2 (en) 2007-03-19 2014-01-07 Insuline Medical Ltd. Method and device for drug delivery
US8382706B2 (en) * 2007-04-13 2013-02-26 General Electric Company User interface for configuring an invasive cardiology digital signal amplifier and method of use
US20080275467A1 (en) * 2007-05-02 2008-11-06 Siemens Corporate Research, Inc. Intraoperative guidance for endovascular interventions via three-dimensional path planning, x-ray fluoroscopy, and image overlay
US8905920B2 (en) 2007-09-27 2014-12-09 Covidien Lp Bronchoscope adapter and method
US9881520B2 (en) * 2008-01-08 2018-01-30 Immersion Medical, Inc. Virtual tool manipulation system
US20090202899A1 (en) * 2008-02-11 2009-08-13 Pyszczek Michael F Electrical apparatus with integral thin film solid state battery and methods of manufacture
US9575140B2 (en) 2008-04-03 2017-02-21 Covidien Lp Magnetic interference detection system and method
US8327519B2 (en) * 2008-04-14 2012-12-11 Linares Medical Devices, Llc Multi-level machine for duplicating a sectioned and scanned bone end and for producing a fitting implant replacement
JP5140857B2 (en) * 2008-05-12 2013-02-13 株式会社大野興業 Method for producing soft blood vessel model for surgical simulation
US8473032B2 (en) 2008-06-03 2013-06-25 Superdimension, Ltd. Feature-based registration method
US8218847B2 (en) 2008-06-06 2012-07-10 Superdimension, Ltd. Hybrid registration method
US8932207B2 (en) 2008-07-10 2015-01-13 Covidien Lp Integrated multi-functional endoscopic tool
MX2011004817A (en) 2008-11-07 2011-07-28 Insuline Medical Ltd Device and method for drug delivery.
EP3427687A1 (en) * 2009-05-14 2019-01-16 Covidien LP Automatic registration technique
US20110137155A1 (en) * 2009-12-09 2011-06-09 Boston Scientific Scimed, Inc. Delivery device for localized delivery of a therapeutic agent
DE102009060522A1 (en) 2009-12-23 2011-06-30 Karl Storz GmbH & Co. KG, 78532 Simulation system for the training of endoscopic operations
EP2524279A1 (en) * 2010-01-14 2012-11-21 BrainLAB AG Gesture support for controlling and/or operating a medical device
US10582834B2 (en) 2010-06-15 2020-03-10 Covidien Lp Locatable expandable working channel and method
US8157742B2 (en) 2010-08-12 2012-04-17 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
EP3659490A1 (en) 2010-08-20 2020-06-03 Veran Medical Technologies, Inc. Apparatus and method for four dimensional soft tissue navigation
CN102760370A (en) * 2011-04-26 2012-10-31 天津市医学堂科技有限公司 Three-dimensional positioning human simulator
DE102011076188B4 (en) * 2011-05-20 2013-03-21 Siemens Aktiengesellschaft Apparatus and method for planning an endovascular procedure with a medical instrument
US9504588B2 (en) 2011-06-05 2016-11-29 The Research Foundation For The State University Of New York System and method for simulating deployment configuration of an expandable device
JP6034374B2 (en) 2011-06-07 2016-11-30 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Rotational position determination device
US8577693B2 (en) 2011-07-13 2013-11-05 The Invention Science Fund I, Llc Specialty stents with flow control features or the like
US9972082B2 (en) 2012-02-22 2018-05-15 Veran Medical Technologies, Inc. Steerable surgical catheter having biopsy devices and related systems and methods for four dimensional soft tissue navigation
US8548778B1 (en) 2012-05-14 2013-10-01 Heartflow, Inc. Method and system for providing information from a patient-specific model of blood flow
WO2014025791A1 (en) * 2012-08-06 2014-02-13 The University Of North Carolina At Chapel Hill Simulation-based estimation of elasticity parameters and use of same for non-invasive cancer detection and cancer staging
WO2014100311A1 (en) * 2012-12-21 2014-06-26 Volcano Corporation Adaptive interface for a medical imaging system
US9734638B2 (en) * 2013-02-11 2017-08-15 Ramot At Tel-Aviv University Ltd. Three-dimensional modeling from single photographs
US10452238B2 (en) 2013-03-15 2019-10-22 Blue Belt Technologies, Inc. Systems and methods for determining a position for placing of a joint prosthesis
WO2014142770A1 (en) * 2013-03-15 2014-09-18 Altun Adnan A method for creating surgery simulation for surgical planning and providing surgical consultation services over the web and/or network
DE102013103176A1 (en) * 2013-03-28 2014-10-02 Acandis Gmbh & Co. Kg Method for producing a patient-specific implant
EP2991587A4 (en) 2013-05-01 2016-05-18 Aneumed Inc Personalized aortic valve prosthesis
US9043191B2 (en) 2013-08-16 2015-05-26 Heartflow, Inc. Systems and methods for identifying personalized vascular implants from patient-specific anatomic data
US9364635B2 (en) * 2013-09-20 2016-06-14 Covidien Lp Computer controlled steerable tip guide catheter
CN103631225B (en) * 2013-11-26 2017-06-13 广东威创视讯科技股份有限公司 A kind of scene device long-range control method and device
US9931490B2 (en) 2013-12-17 2018-04-03 Zoll Circulation, Incorporated Control system for arterial catheter
US9737693B2 (en) * 2013-12-17 2017-08-22 Zoll Circulation, Inc. Control system for arterial catheter
CN103761916A (en) * 2014-01-24 2014-04-30 成都万先自动化科技有限责任公司 Dummy for viscera operation exercise service
US10290230B2 (en) 2014-01-27 2019-05-14 Arizona Board Of Regents On Behalf Of Arizona State University Device specific finite element models for simulating endovascular treatment
US20150305612A1 (en) 2014-04-23 2015-10-29 Mark Hunter Apparatuses and methods for registering a real-time image feed from an imaging device to a steerable catheter
US20150305650A1 (en) 2014-04-23 2015-10-29 Mark Hunter Apparatuses and methods for endobronchial navigation to and confirmation of the location of a target tissue and percutaneous interception of the target tissue
US10952593B2 (en) 2014-06-10 2021-03-23 Covidien Lp Bronchoscope adapter
AU2015284085B2 (en) 2014-07-02 2019-07-18 Covidien Lp System and method of providing distance and orientation feedback while navigating in 3D
DE102014113836B4 (en) * 2014-09-24 2021-05-06 Acandis Gmbh Method for producing a patient-specific, endovascular implant
EP3002580B1 (en) 2014-09-30 2019-09-11 Sofradim Production Assessment of shear forces distribution at fixation points of textile-based implants
US10278616B2 (en) 2015-05-12 2019-05-07 Navix International Limited Systems and methods for tracking an intrabody catheter
US10426555B2 (en) 2015-06-03 2019-10-01 Covidien Lp Medical instrument with sensor for use in a system and method for electromagnetic navigation
US10398509B2 (en) 2015-09-18 2019-09-03 General Electric Company System and method for optimal catheter selection for individual patient anatomy
JP7267743B2 (en) * 2016-02-16 2023-05-02 メンティス アー・ベー Systems and methods for routing conduit lines, such as catheters, within a vessel
US11607316B2 (en) * 2016-02-17 2023-03-21 Koninklijke Philips N.V. Physical 3D anatomical structure model fabrication
CA2958802C (en) * 2016-04-05 2018-03-27 Timotheus Anton GMEINER Multi-metric surgery simulator and methods
EP3252737A1 (en) 2016-06-03 2017-12-06 Sofradim Production Abdominal model for laparoscopic abdominal wall repair/reconstruction simulation
WO2018011757A1 (en) * 2016-07-14 2018-01-18 Navix International Limited Characteristic track catheter navigation
US10638952B2 (en) 2016-10-28 2020-05-05 Covidien Lp Methods, systems, and computer-readable media for calibrating an electromagnetic navigation system
US10751126B2 (en) 2016-10-28 2020-08-25 Covidien Lp System and method for generating a map for electromagnetic navigation
US10517505B2 (en) 2016-10-28 2019-12-31 Covidien Lp Systems, methods, and computer-readable media for optimizing an electromagnetic navigation system
US10722311B2 (en) 2016-10-28 2020-07-28 Covidien Lp System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map
US10792106B2 (en) 2016-10-28 2020-10-06 Covidien Lp System for calibrating an electromagnetic navigation system
US10418705B2 (en) 2016-10-28 2019-09-17 Covidien Lp Electromagnetic navigation antenna assembly and electromagnetic navigation system including the same
US10446931B2 (en) 2016-10-28 2019-10-15 Covidien Lp Electromagnetic navigation antenna assembly and electromagnetic navigation system including the same
US10615500B2 (en) 2016-10-28 2020-04-07 Covidien Lp System and method for designing electromagnetic navigation antenna assemblies
US10792104B2 (en) 2016-11-08 2020-10-06 Henry Ford Health System Selecting a medical device for use in a medical procedure
US11006852B2 (en) 2017-12-11 2021-05-18 Covidien Lp Systems, methods, and computer-readable media of estimating thoracic cavity movement during respiration
US10893842B2 (en) 2018-02-08 2021-01-19 Covidien Lp System and method for pose estimation of an imaging device and for determining the location of a medical device with respect to a target
JP7165936B2 (en) * 2018-04-13 2022-11-07 国立研究開発法人理化学研究所 TRAINING DEVICE, IMAGE PROCESSING METHOD, PROGRAM, AND INFORMATION RECORDING MEDIUM
CN109199587A (en) * 2018-10-16 2019-01-15 强联智创(北京)科技有限公司 Travelling route analogy method, device and the equipment of a kind of conduit in the blood vessels
US10943410B2 (en) * 2018-11-19 2021-03-09 Medtronic, Inc. Extended reality assembly modeling
WO2021076575A1 (en) * 2019-10-15 2021-04-22 University Of Pittsburgh - Of The Commonwealth System Of Higher Education Stress prediction based on neural network
EP3843103A1 (en) * 2019-12-25 2021-06-30 Softimize Ltd. Systems and methods for increasing adherence for medical devices
KR102384079B1 (en) * 2020-07-01 2022-04-06 고려대학교 산학협력단 Apparatus and method for patients customized stent procedure simulation
US20220181024A1 (en) * 2020-12-04 2022-06-09 Biosense Webster (Israel) Ltd. Catheter structure examination and optimization using medical procedure information
KR102563710B1 (en) * 2021-01-28 2023-08-04 이화여자대학교 산학협력단 Mandrel wire shaping system and method for coil embolization
CN115281584B (en) * 2022-06-30 2023-08-15 中国科学院自动化研究所 Flexible endoscope robot control system and flexible endoscope robot simulation method

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4642055A (en) * 1985-06-24 1987-02-10 Saliterman Steven S Hemodynamic monitoring trainer
US4907973A (en) * 1988-11-14 1990-03-13 Hon David C Expert system simulator for modeling realistic internal environments and performance
US5155435A (en) * 1991-08-08 1992-10-13 The Regents Of The University Of California Method and apparatus for performing interventional medical procedures using MR imaging of interventional device superimposed with ghost patient image
US5289373A (en) * 1991-11-29 1994-02-22 General Electric Company Method and apparatus for real-time tracking of catheter guide wires in fluoroscopic images during interventional radiological procedures
US5704791A (en) * 1995-03-29 1998-01-06 Gillio; Robert G. Virtual surgery system instrument
US5771181A (en) * 1994-12-14 1998-06-23 Moore; Robert S. Generation for virtual reality simulator systems
US5800179A (en) * 1996-07-23 1998-09-01 Medical Simulation Corporation System for training persons to perform minimally invasive surgical procedures
US5871018A (en) * 1995-12-26 1999-02-16 Delp; Scott L. Computer-assisted surgical method
US5959613A (en) * 1995-12-01 1999-09-28 Immersion Corporation Method and apparatus for shaping force signals for a force feedback device
US6038488A (en) * 1997-02-27 2000-03-14 Bertec Corporation Catheter simulation device
US6074213A (en) * 1998-08-17 2000-06-13 Hon; David C. Fractional process simulator with remote apparatus for multi-locational training of medical teams
US6104780A (en) * 1997-11-24 2000-08-15 Oec Medical Systems, Inc. Mobile bi-planar fluoroscopic imaging apparatus
US6106297A (en) * 1996-11-12 2000-08-22 Lockheed Martin Corporation Distributed interactive simulation exercise manager system and method
US6106301A (en) * 1996-09-04 2000-08-22 Ht Medical Systems, Inc. Interventional radiology interface apparatus and method
US6470207B1 (en) * 1999-03-23 2002-10-22 Surgical Navigation Technologies, Inc. Navigational guidance via computer-assisted fluoroscopic imaging
US6572376B1 (en) * 2000-11-22 2003-06-03 Lockheed Martin Corporation Avionics maintenance training device
US6610007B2 (en) * 2000-04-03 2003-08-26 Neoguide Systems, Inc. Steerable segmented endoscope and method of insertion
US20040076940A1 (en) * 1998-01-28 2004-04-22 Immersion Medical, Inc. Interface device and method for interfacing instruments to medical procedure simulation systems

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4918620A (en) * 1988-06-16 1990-04-17 General Electric Company Expert system method and architecture
GB8815065D0 (en) * 1988-06-24 1988-08-03 Ici Plc Prosthetic devices
US5208768A (en) * 1988-11-14 1993-05-04 Digital Equipment Corporation Expert system including arrangement for acquiring redesign knowledge
US5099846A (en) 1988-12-23 1992-03-31 Hardy Tyrone L Method and apparatus for video presentation from a variety of scanner imaging sources
GB8925380D0 (en) * 1989-11-09 1989-12-28 Leonard Ian Producing prostheses
US5487012A (en) * 1990-12-21 1996-01-23 Topholm & Westermann Aps Method of preparing an otoplasty or adaptive earpiece individually matched to the shape of an auditory canal
US5297054A (en) * 1992-04-03 1994-03-22 General Motors Corporation Expert system for automically generating gear designs
JP3380553B2 (en) * 1992-11-09 2003-02-24 オルムコ コーポレイション Custom orthodontic appliance forming method and apparatus
DE69432023T2 (en) * 1993-09-10 2003-10-23 Univ Queensland Santa Lucia STEREOLITHOGRAPHIC ANATOMIC MODELING PROCESS
US5552995A (en) * 1993-11-24 1996-09-03 The Trustees Of The Stevens Institute Of Technology Concurrent engineering design tool and method
BE1008372A3 (en) * 1994-04-19 1996-04-02 Materialise Nv METHOD FOR MANUFACTURING A perfected MEDICAL MODEL BASED ON DIGITAL IMAGE INFORMATION OF A BODY.
GB9407936D0 (en) * 1994-04-21 1994-06-15 Univ Bristol Training device
US5522402A (en) 1994-05-13 1996-06-04 Cooley; Robert A. Three-dimensional scanning method for design of protheses
CA2144505A1 (en) 1995-03-10 1996-09-11 Jonathan R. Merril Computer based medical procedure simulation system
US5797849A (en) * 1995-03-28 1998-08-25 Sonometrics Corporation Method for carrying out a medical procedure using a three-dimensional tracking and imaging system
US5771310A (en) * 1996-12-30 1998-06-23 Shriners Hospitals For Children Method and apparatus for recording three-dimensional topographies
US5754738A (en) * 1996-06-07 1998-05-19 Camc Corporation Computerized prototyping system employing virtual system design enviroment
GB2318058B (en) * 1996-09-25 2001-03-21 Ninian Spenceley Peckitt Improvements relating to prosthetic implants
US5824085A (en) * 1996-09-30 1998-10-20 Integrated Surgical Systems, Inc. System and method for cavity generation for surgical planning and initial placement of a bone prosthesis
AU729042B2 (en) * 1997-01-08 2001-01-25 Clynch Technologies, Inc. Method for producing custom fitted medical devices
US6205411B1 (en) * 1997-02-21 2001-03-20 Carnegie Mellon University Computer-assisted surgery planner and intra-operative guidance system
GB2324470A (en) * 1997-04-24 1998-10-28 Customflex Limited Prosthetic implants
AU9482698A (en) 1997-09-29 1999-04-23 Medsim Advanced Radiology Medical Simulation Ltd. Interventional radiology guidance system
EP1051698B1 (en) 1998-01-28 2018-01-17 Immersion Medical, Inc. Interface device and method for interfacing instruments to vascular access simulation systems
WO1999042978A1 (en) * 1998-02-19 1999-08-26 Boston Dynamics, Inc. Method and apparatus for surgical training and simulating surgery
US6327491B1 (en) 1998-07-06 2001-12-04 Neutar, Llc Customized surgical fixture
US6315553B1 (en) 1999-11-30 2001-11-13 Orametrix, Inc. Method and apparatus for site treatment of an orthodontic patient
US20010047251A1 (en) * 2000-03-03 2001-11-29 Kemp William H. CAD system which designs 3-D models

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4642055A (en) * 1985-06-24 1987-02-10 Saliterman Steven S Hemodynamic monitoring trainer
US4907973A (en) * 1988-11-14 1990-03-13 Hon David C Expert system simulator for modeling realistic internal environments and performance
US5155435A (en) * 1991-08-08 1992-10-13 The Regents Of The University Of California Method and apparatus for performing interventional medical procedures using MR imaging of interventional device superimposed with ghost patient image
US5289373A (en) * 1991-11-29 1994-02-22 General Electric Company Method and apparatus for real-time tracking of catheter guide wires in fluoroscopic images during interventional radiological procedures
US5771181A (en) * 1994-12-14 1998-06-23 Moore; Robert S. Generation for virtual reality simulator systems
US5704791A (en) * 1995-03-29 1998-01-06 Gillio; Robert G. Virtual surgery system instrument
US5800177A (en) * 1995-03-29 1998-09-01 Gillio; Robert G. Surgical simulator user input device
US5959613A (en) * 1995-12-01 1999-09-28 Immersion Corporation Method and apparatus for shaping force signals for a force feedback device
US5871018A (en) * 1995-12-26 1999-02-16 Delp; Scott L. Computer-assisted surgical method
US5800179A (en) * 1996-07-23 1998-09-01 Medical Simulation Corporation System for training persons to perform minimally invasive surgical procedures
US6106301A (en) * 1996-09-04 2000-08-22 Ht Medical Systems, Inc. Interventional radiology interface apparatus and method
US6106297A (en) * 1996-11-12 2000-08-22 Lockheed Martin Corporation Distributed interactive simulation exercise manager system and method
US6038488A (en) * 1997-02-27 2000-03-14 Bertec Corporation Catheter simulation device
US6104780A (en) * 1997-11-24 2000-08-15 Oec Medical Systems, Inc. Mobile bi-planar fluoroscopic imaging apparatus
US20040076940A1 (en) * 1998-01-28 2004-04-22 Immersion Medical, Inc. Interface device and method for interfacing instruments to medical procedure simulation systems
US6074213A (en) * 1998-08-17 2000-06-13 Hon; David C. Fractional process simulator with remote apparatus for multi-locational training of medical teams
US6470207B1 (en) * 1999-03-23 2002-10-22 Surgical Navigation Technologies, Inc. Navigational guidance via computer-assisted fluoroscopic imaging
US6610007B2 (en) * 2000-04-03 2003-08-26 Neoguide Systems, Inc. Steerable segmented endoscope and method of insertion
US6572376B1 (en) * 2000-11-22 2003-06-03 Lockheed Martin Corporation Avionics maintenance training device

Cited By (307)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020016923A1 (en) * 2000-07-03 2002-02-07 Knaus William A. Broadband computer-based networked systems for control and management of medical records
US20040126746A1 (en) * 2000-10-23 2004-07-01 Toly Christopher C. Medical physiological simulator including a conductive elastomer layer
US20090068627A1 (en) * 2000-10-23 2009-03-12 Toly Christopher C Medical physiological simulator including a conductive elastomer layer
US7665995B2 (en) 2000-10-23 2010-02-23 Toly Christopher C Medical training simulator including contact-less sensors
US8556635B2 (en) 2000-10-23 2013-10-15 Christopher C. Toly Physiological simulator for use as a brachial plexus nerve block trainer
US8323029B2 (en) 2000-10-23 2012-12-04 Toly Christopher C Medical physiological simulator including a conductive elastomer layer
US8162668B2 (en) 2000-10-23 2012-04-24 Simulab Corporation Medical training simulator including contact-less sensors
US7857626B2 (en) * 2000-10-23 2010-12-28 Toly Christopher C Medical physiological simulator including a conductive elastomer layer
US6823204B2 (en) * 2001-01-09 2004-11-23 Koninklijke Philips Electronics N.V. Method of imaging the blood flow in a vascular tree
US20030040669A1 (en) * 2001-01-09 2003-02-27 Michael Grass Method of imaging the blood flow in a vascular tree
US9501955B2 (en) * 2001-05-20 2016-11-22 Simbionix Ltd. Endoscopic ultrasonography simulation
US20040253572A1 (en) * 2001-05-20 2004-12-16 Edna Chosack Endoscopic ultrasonography simulation
US20030061070A1 (en) * 2001-09-25 2003-03-27 Kelly Gina E. Interactive medical training system
US7266227B2 (en) * 2001-11-30 2007-09-04 Brainlab Ag Device and method for administering a substance
US20030114751A1 (en) * 2001-11-30 2003-06-19 Christoph Pedain Device and method for administering a substance
US20030186199A1 (en) * 2002-01-23 2003-10-02 Melior-Delaware System and method for interactive online training
US20030230313A1 (en) * 2002-03-13 2003-12-18 Ehsan Alipour Imaging of the vasa vasorum to navigate through an occlusion
US20030211451A1 (en) * 2002-05-07 2003-11-13 Cae Inc. System and method for distance learning of systems knowledge and integrated procedures using a real-time, full-scope simulation
US20030212707A1 (en) * 2002-05-10 2003-11-13 Uber Arthur E. System and method for automated benchmarking for the recognition of best medical practices and products and for establishing standards for medical procedures
US7457804B2 (en) * 2002-05-10 2008-11-25 Medrad, Inc. System and method for automated benchmarking for the recognition of best medical practices and products and for establishing standards for medical procedures
US7734326B2 (en) * 2002-06-20 2010-06-08 Brainlab Ag Method and device for preparing a drainage
US20040010221A1 (en) * 2002-06-20 2004-01-15 Christoph Pedain Method and device for preparing a drainage
US20040043368A1 (en) * 2002-08-30 2004-03-04 Ming-Shium Hsieh Three-dimensional surgery simulation system
US7121832B2 (en) * 2002-08-30 2006-10-17 Taipei Medical University Three-dimensional surgery simulation system
US20040138551A1 (en) * 2002-09-12 2004-07-15 Andreas Hartlep Determining distribution for planning an infusion
US7993141B2 (en) 2002-12-03 2011-08-09 Mentice Ab Interventional simulator system
US20060127867A1 (en) * 2002-12-03 2006-06-15 Jan Grund-Pedersen Interventional simulator system
EP1576566B1 (en) * 2002-12-03 2018-06-13 Mentice AB An interventional simulator system
US20070141543A1 (en) * 2002-12-03 2007-06-21 Jan Grund-Pedersen Interventional simulator system
US8491307B2 (en) * 2002-12-03 2013-07-23 Mentice Ab Interventional simulator control system
US8083524B2 (en) 2002-12-03 2011-12-27 Mentice Ab Interventional simulator system
US20150139525A1 (en) * 2003-06-17 2015-05-21 Brown University Methods and apparatus for model-based detection of structure in view data
US20090123053A1 (en) * 2003-06-17 2009-05-14 Brown University Methods and apparatus for model-based detection of structure in view data
US7584082B2 (en) * 2003-08-07 2009-09-01 The Mathworks, Inc. Synchronization and data review system
US20090319578A1 (en) * 2003-08-07 2009-12-24 The Mathworks, Inc. Synchronization and data review system
US20050033561A1 (en) * 2003-08-07 2005-02-10 The Math Works, Inc. Synchronization and data review system
US20120278711A1 (en) * 2003-09-16 2012-11-01 Labtest International, Inc. D/B/A Intertek Consumer Goods North America Haptic response system and method of use
US20080183059A1 (en) * 2003-09-23 2008-07-31 Optical Sensors Incorporated System and method for assessing capillary vitality
US8133177B2 (en) 2003-09-23 2012-03-13 Vasamed, Inc. System and method for assessing capillary vitality
US20050118557A1 (en) * 2003-11-29 2005-06-02 American Board Of Family Medicine, Inc. Computer architecture and process of user evaluation
US8096811B2 (en) * 2003-11-29 2012-01-17 American Board Of Family Medicine, Inc. Computer architecture and process of user evaluation
US20050181343A1 (en) * 2004-02-02 2005-08-18 Ault Mark J. Ultrasound guided vascular access training device
US7848543B2 (en) 2004-02-05 2010-12-07 Brainlab Ag Method and system for prediction and management of material and information transport in an organism
US8409136B2 (en) * 2004-03-05 2013-04-02 Hansen Medical, Inc. Robotic catheter system
US20120004668A1 (en) * 2004-03-05 2012-01-05 Hansen Medical, Inc. Robotic catheter system
US20050214724A1 (en) * 2004-03-23 2005-09-29 David Feygin Vascular-access simulation system with ergonomic features
US8403674B2 (en) * 2004-03-23 2013-03-26 Laerdal Medical As Vascular-access simulation system with ergonomic features
US20050220264A1 (en) * 2004-03-31 2005-10-06 Siemens Aktiengesellschaft Method and device for medical image reconstruction
US7862340B2 (en) 2004-06-14 2011-01-04 Medical Simulation Corporation Medical simulation system and method
US20100021875A1 (en) * 2004-06-14 2010-01-28 Medical Simulation Corporation Medical Simulation System and Method
US20080076100A1 (en) * 2004-06-14 2008-03-27 Medical Simulation Corporation Medical Simulation System and Method
US20050277096A1 (en) * 2004-06-14 2005-12-15 Hendrickson Daniel L Medical simulation system and method
US20090111080A1 (en) * 2004-06-14 2009-04-30 Medical Simulation Corporation Medical simulation system and method
US7455523B2 (en) 2004-06-14 2008-11-25 Medical Simulation Corporation Medical simulation system and method
WO2005124723A3 (en) * 2004-06-14 2007-05-18 Medical Simulation Corp Medical simulation system and method
US8062038B2 (en) 2004-06-14 2011-11-22 Medical Simulation Corporation Medical simulation system and method
US20080020362A1 (en) * 2004-08-10 2008-01-24 Cotin Stephane M Methods and Apparatus for Simulaton of Endovascular and Endoluminal Procedures
US20070276216A1 (en) * 2004-08-16 2007-11-29 Refael Beyar Image-Guided Navigation for Catheter-Based Interventions
US8600477B2 (en) 2004-08-16 2013-12-03 Corinduc, Inc. Image-guided navigation for catheter-based interventions
US20110060579A1 (en) * 2004-09-28 2011-03-10 Anton Butsev Ultrasound Simulation Apparatus and Method
US8244506B2 (en) * 2004-09-28 2012-08-14 Immersion Medical Inc. Ultrasound simulation apparatus and method
US20060073455A1 (en) * 2004-09-30 2006-04-06 Cardiac Pacemakers, Inc. Virtual reality based prototyping system for medical devices
US9901413B2 (en) 2004-10-15 2018-02-27 Brainlab Ag Targeted infusion of agents for treatment of ALS
US20060121036A1 (en) * 2004-10-15 2006-06-08 Andreas Hartlep Targeted immunization and plaque destruction against Alzheimer's disease
US20060093583A1 (en) * 2004-10-15 2006-05-04 Andreas Hartlep Targeted infusion of agents against Parkinson's disease
US20060094953A1 (en) * 2004-10-15 2006-05-04 Andreas Hartlep Targeted infusion of agents for treatment of ALS
US9924888B2 (en) 2004-10-15 2018-03-27 Brainlab Ag Targeted infusion of agents against parkinson's disease
US9907485B2 (en) 2004-10-15 2018-03-06 Brainlab Ag Targeted immunization and plaque destruction against Alzheimer's disease
US20060171574A1 (en) * 2004-11-12 2006-08-03 Delmonego Brian Graphical healthcare order processing system and method
US11062624B2 (en) 2004-11-30 2021-07-13 The Regents Of University Of California Embedded motion sensing technology for integration within commercial ultrasound probes
US8297983B2 (en) 2004-11-30 2012-10-30 The Regents Of The University Of California Multimodal ultrasound training system
US10726741B2 (en) 2004-11-30 2020-07-28 The Regents Of The University Of California System and method for converting handheld diagnostic ultrasound systems into ultrasound training systems
US10026338B2 (en) * 2004-11-30 2018-07-17 The Regents Of The University Of California Embedded motion sensing technology for integration within commercial ultrasound probes
US20080187896A1 (en) * 2004-11-30 2008-08-07 Regents Of The University Of California, The Multimodal Medical Procedure Training System
US11627944B2 (en) 2004-11-30 2023-04-18 The Regents Of The University Of California Ultrasound case builder system and method
US8480404B2 (en) * 2004-11-30 2013-07-09 Eric A. Savitsky Multimodal ultrasound training system
US20120238875A1 (en) * 2004-11-30 2012-09-20 Eric Savitsky Embedded Motion Sensing Technology for Integration within Commercial Ultrasound Probes
US20090046912A1 (en) * 2005-01-24 2009-02-19 Institut De Recherche Sur Les Cancers De L'appareil Digestif-Irca Process and System for Simulation or Digital Synthesis of Sonographic Images
US8235726B2 (en) * 2005-01-24 2012-08-07 Institut De Recherche Sur Les Cancers De L'appareil Digestif (Ircad) Process and system for simulation or digital synthesis of sonographic images
US20080312884A1 (en) * 2005-01-24 2008-12-18 Institut De Recherche Sur Les Cancers De L'appareil Digestifircad Process and System for Simulation or Digital Synthesis of Sonographic Images
US8241041B2 (en) * 2005-01-24 2012-08-14 Institut de Recherche sur les Cancers de l'Appareil Degestif (IRCAD) Process and system for simulation or digital synthesis of sonographic images
US20070016072A1 (en) * 2005-05-06 2007-01-18 Sorin Grunwald Endovenous access and guidance system utilizing non-image based ultrasound
US8409103B2 (en) 2005-05-06 2013-04-02 Vasonova, Inc. Ultrasound methods of positioning guided vascular access devices in the venous system
US8597193B2 (en) 2005-05-06 2013-12-03 Vasonova, Inc. Apparatus and method for endovascular device guiding and positioning using physiological parameters
US9339207B2 (en) * 2005-05-06 2016-05-17 Vasonova, Inc. Endovascular devices and methods of use
US20090177090A1 (en) * 2005-05-06 2009-07-09 Sorin Grunwald Endovascular devices and methods of use
US9204819B2 (en) * 2005-05-06 2015-12-08 Vasonova, Inc. Endovenous access and guidance system utilizing non-image based ultrasound
US10321890B2 (en) 2005-05-06 2019-06-18 Arrow International, Inc. Apparatus and method for endovascular device guiding and positioning using physiological parameters
US10335240B2 (en) 2005-05-06 2019-07-02 Arrow International, Inc. Endovascular navigation system and method
US9198600B2 (en) 2005-05-06 2015-12-01 Vasonova, Inc. Endovascular access and guidance system utilizing divergent beam ultrasound
US10368837B2 (en) 2005-05-06 2019-08-06 Arrow International, Inc. Apparatus and method for vascular access
US10470743B2 (en) 2005-05-06 2019-11-12 Arrow International, Inc. Apparatus and method for endovascular device guiding and positioning using physiological parameters
US8257302B2 (en) 2005-05-10 2012-09-04 Corindus, Inc. User interface for remote control catheterization
US20070016035A1 (en) * 2005-05-17 2007-01-18 Ge Medical Systems Global Technology Company, Llc Ultrasonic diagnostic apparatus and ultrasonic image generating method
US7917349B2 (en) * 2005-06-17 2011-03-29 Fei Company Combined hardware and software instrument simulator for use as a teaching aid
US20070020605A1 (en) * 2005-06-17 2007-01-25 Fei Company Combined hardware and software instrument simulator for use as a teaching aid
US20070016391A1 (en) * 2005-07-14 2007-01-18 Ryo Minoguchi Reverse finite element analysis and modeling of biomechanical properties of internal tissues
US20070027667A1 (en) * 2005-07-14 2007-02-01 Osborn Thomas W Iii Computational model of the internal human pelvic environment
US8392159B2 (en) 2005-07-14 2013-03-05 The Procter And Gamble Company Computational model of the internal human pelvic environment
US20110172978A1 (en) * 2005-07-14 2011-07-14 Osborn Iii Thomas Ward Computational Model of the Internal Human Pelvic Environment
US7937249B2 (en) * 2005-07-14 2011-05-03 The Procter & Gamble Company Computational model of the internal human pelvic environment
US20080286735A1 (en) * 2005-07-20 2008-11-20 Dies Srl System and a Method for Simulating a Manual Interventional Operation by a User in a Medical Procedure
US8485829B2 (en) * 2005-07-20 2013-07-16 DIES S.r.l. System and a method for simulating a manual interventional operation by a user in a medical procedure
US20090130643A1 (en) * 2005-07-20 2009-05-21 Corrado Cusano Method for simulating a manual interventional operation by a user in a medical procedure
US20070043285A1 (en) * 2005-08-02 2007-02-22 Yitzhack Schwartz Simulation of invasive procedures
US8583220B2 (en) 2005-08-02 2013-11-12 Biosense Webster, Inc. Standardization of catheter-based treatment for atrial fibrillation
US7877128B2 (en) * 2005-08-02 2011-01-25 Biosense Webster, Inc. Simulation of invasive procedures
US20070032826A1 (en) * 2005-08-02 2007-02-08 Yitzhack Schwartz Standardization of catheter-based treatment for atrial fibrillation
US20070043292A1 (en) * 2005-08-08 2007-02-22 Siemens Aktiengesellschaft Method for acquiring and evaluating vascular examination data
US20080200843A1 (en) * 2005-08-09 2008-08-21 Ohio Universtiy Method and Apparatus for Measurement of Human Tissue Properties in Vivo
US20090131955A1 (en) * 2005-09-29 2009-05-21 Corindus Ltd. Methods and apparatuses for treatment of hollow organs
US20070134637A1 (en) * 2005-12-08 2007-06-14 Simbionix Ltd. Medical simulation device with motion detector
US20150018675A1 (en) * 2006-03-14 2015-01-15 Nemoto Kyorindo Co., Ltd. Medical image system
US8786613B2 (en) 2006-04-08 2014-07-22 Alan Millman Method and system for interactive simulation of materials and models
US8395626B2 (en) * 2006-04-08 2013-03-12 Alan Millman Method and system for interactive simulation of materials
US9014446B2 (en) 2006-07-17 2015-04-21 Koninklijke Philips N.V. Efficient user interaction with polygonal meshes for medical image segmentation
US8660325B2 (en) * 2006-07-17 2014-02-25 Koninklijke Philips N.V. Efficient user interaction with polygonal meshes for medical image segmentation
US20090310835A1 (en) * 2006-07-17 2009-12-17 Koninklijke Philips Electronics N. V. Efficient user interaction with polygonal meshes for medical image segmentation
US8396232B2 (en) 2006-07-25 2013-03-12 Novartis Ag Surgical console operable to playback multimedia content
US20080027574A1 (en) * 2006-07-25 2008-01-31 Thomas Roger D Surgical console operable to playback multimedia content
US9254220B1 (en) 2006-08-29 2016-02-09 Vasamed, Inc. Method and system for assessing severity and stage of peripheral arterial disease and lower extremity wounds using angiosome mapping
US9283052B2 (en) * 2006-09-28 2016-03-15 Brainlab Ag Planning movement trajectories of medical instruments into heterogeneous body structures
US20080082110A1 (en) * 2006-09-28 2008-04-03 Rodriguez Ponce Maria Inmacula Planning movement trajectories of medical instruments into heterogeneous body structures
US20080085499A1 (en) * 2006-10-05 2008-04-10 Christopher Horvath Surgical console operable to simulate surgical procedures
US7777731B2 (en) * 2006-10-13 2010-08-17 Siemens Medical Solutions Usa, Inc. System and method for selection of points of interest during quantitative analysis using a touch screen display
US20080139895A1 (en) * 2006-10-13 2008-06-12 Siemens Medical Solutions Usa, Inc. System and Method for Selection of Points of Interest During Quantitative Analysis Using a Touch Screen Display
US20090177454A1 (en) * 2007-01-16 2009-07-09 Ran Bronstein System and method for performing computerized simulations for image-guided procedures using a patient specific model
US8543338B2 (en) 2007-01-16 2013-09-24 Simbionix Ltd. System and method for performing computerized simulations for image-guided procedures using a patient specific model
US8500451B2 (en) * 2007-01-16 2013-08-06 Simbionix Ltd. Preoperative surgical simulation
US10945633B2 (en) 2007-03-09 2021-03-16 St. Jude Medical, Atrial Fibrillation Division, Inc. Automated catalog and system for correction of inhomogeneous fields
US10433929B2 (en) 2007-03-09 2019-10-08 St. Jude Medical, Atrial Fibrillation Division, Inc. System and method for local deformable registration of a catheter navigation system to image data or a model
US9591990B2 (en) * 2007-03-09 2017-03-14 St. Jude Medical, Atrial Fibrillation Division, Inc. Automated catalog and system for correction of inhomogeneous fields
US9549689B2 (en) 2007-03-09 2017-01-24 St. Jude Medical, Atrial Fibrillation Division, Inc. System and method for correction of inhomogeneous fields
US20080221438A1 (en) * 2007-03-09 2008-09-11 Chen Luke Y Automated catalog and system for correction of inhomogeneous fields
US20080240548A1 (en) * 2007-03-28 2008-10-02 Terence Sern-Wei Yeoh Isosurfacial three-dimensional imaging system and method
US8217937B2 (en) * 2007-03-28 2012-07-10 The Aerospace Corporation Isosurfacial three-dimensional imaging system and method
US10124114B2 (en) * 2007-04-13 2018-11-13 Brainlab Ag Margin determination
US20090270712A1 (en) * 2007-04-13 2009-10-29 Brainlab Ag Margin determination/tumor cell migration
US20080292046A1 (en) * 2007-05-09 2008-11-27 Estelle Camus Bronchopulmonary medical services system and imaging method
DE102007021717A1 (en) * 2007-05-09 2008-10-02 Siemens Ag Broncho-pulmonal diagnose and therapy system for treating diseases in vascular and lymphatic system, has X-ray imaging arrangement arranged for three-dimensional movement within diagnostic-and therapy areas at multi-axial support system
US9265577B2 (en) 2007-05-18 2016-02-23 The Johns Hopkins University Methods and systems for providing planning and dispensation of research and/or treatment for brain disease
US20090171212A1 (en) * 2007-10-09 2009-07-02 Howard Mark Garon Interactive Virtual Visualization System For Training And Assistance In the Use of Ultrasound Handheld Transducers
WO2009049282A3 (en) * 2007-10-11 2009-07-23 Univ Florida Mixed simulator and uses thereof
WO2009049282A2 (en) * 2007-10-11 2009-04-16 University Of Florida Research Foundation, Inc. Mixed simulator and uses thereof
US20090118714A1 (en) * 2007-11-07 2009-05-07 Dan Teodorescu Surgical console information display system and method
US9171484B2 (en) 2008-03-06 2015-10-27 Immersion Corporation Determining location and orientation of an object positioned on a surface
US10719980B2 (en) * 2008-03-06 2020-07-21 Koninklijke Philips N.V. Method for analyzing a tube system
US20110002517A1 (en) * 2008-03-06 2011-01-06 Koninklijke Philips Electronics N.V. Method for analyzing a tube system
US20110010155A1 (en) * 2008-03-12 2011-01-13 Waseda University Tracheal intubation training apparatus
EP2269693A4 (en) * 2008-04-14 2015-07-08 Gmv Aerospace And Defence S A Planning system for intraoperative radiation therapy and method for carrying out said planning
US11717645B2 (en) 2008-05-06 2023-08-08 Corindus, Inc. Robotic catheter system
US10342953B2 (en) 2008-05-06 2019-07-09 Corindus, Inc. Robotic catheter system
US9402977B2 (en) 2008-05-06 2016-08-02 Corindus Inc. Catheter system
US8828021B2 (en) 2008-05-06 2014-09-09 Corindus, Inc. Catheter system
US9168356B2 (en) 2008-05-06 2015-10-27 Corindus Inc. Robotic catheter system
US10987491B2 (en) 2008-05-06 2021-04-27 Corindus, Inc. Robotic catheter system
US9095681B2 (en) 2008-05-06 2015-08-04 Corindus Inc. Catheter system
US9623209B2 (en) 2008-05-06 2017-04-18 Corindus, Inc. Robotic catheter system
US8480618B2 (en) 2008-05-06 2013-07-09 Corindus Inc. Catheter system
US11107587B2 (en) 2008-07-21 2021-08-31 The Board Of Trustees Of The Leland Stanford Junior University Method for tuning patient-specific cardiovascular simulations
US20100055657A1 (en) * 2008-08-27 2010-03-04 Warren Goble Radiographic and ultrasound simulators
WO2010025336A1 (en) * 2008-08-29 2010-03-04 Corindus Ltd. Catheter simulation and assistance system
US8694157B2 (en) 2008-08-29 2014-04-08 Corindus, Inc. Catheter control system and graphical user interface
US20110144658A1 (en) * 2008-08-29 2011-06-16 Corindus Inc. Catheter simulation and assistance system
US9679499B2 (en) 2008-09-15 2017-06-13 Immersion Medical, Inc. Systems and methods for sensing hand motion by measuring remote displacement
US20100099981A1 (en) * 2008-10-21 2010-04-22 Fishel Robert S Trans-Septal Catheterization Device And Method
WO2010056538A1 (en) * 2008-10-29 2010-05-20 Tim Maguire An automated vessel puncture device using three-dimensional(3d) near infrared (nir) imaging and a robotically driven needle
US9743875B2 (en) 2008-10-29 2017-08-29 Vasculogic, Llc Automated vessel puncture device using three-dimensional(3D) near infrared (NIR) imaging and a robotically driven needle
US20100109713A1 (en) * 2008-11-05 2010-05-06 Harriman Paul J Current balancing circuit and method
US8457714B2 (en) 2008-11-25 2013-06-04 Magnetecs, Inc. System and method for a catheter impedance seeking device
US9545497B2 (en) 2008-12-12 2017-01-17 Corindus, Inc. Remote catheter procedure system
US20110238082A1 (en) * 2008-12-12 2011-09-29 Corindus Inc. Remote catheter procedure system
US10561821B2 (en) 2008-12-12 2020-02-18 Corindus, Inc. Remote catheter procedure system
US10354050B2 (en) 2009-03-17 2019-07-16 The Board Of Trustees Of Leland Stanford Junior University Image processing method for determining patient-specific cardiovascular information
US8790297B2 (en) 2009-03-18 2014-07-29 Corindus, Inc. Remote catheter system with steerable catheter
KR101108927B1 (en) 2009-03-24 2012-02-09 주식회사 이턴 Surgical robot system using augmented reality and control method thereof
WO2010110560A2 (en) * 2009-03-24 2010-09-30 주식회사 래보 Surgical robot system using augmented reality, and method for controlling same
WO2010110560A3 (en) * 2009-03-24 2011-03-17 주식회사 이턴 Surgical robot system using augmented reality, and method for controlling same
KR100957470B1 (en) 2009-08-28 2010-05-17 주식회사 래보 Surgical robot system using augmented reality and control method thereof
US9962229B2 (en) 2009-10-12 2018-05-08 Corindus, Inc. System and method for navigating a guide wire
US10881474B2 (en) 2009-10-12 2021-01-05 Corindus, Inc. System and method for navigating a guide wire
US11918314B2 (en) 2009-10-12 2024-03-05 Corindus, Inc. System and method for navigating a guide wire
US11696808B2 (en) 2009-10-12 2023-07-11 Corindus, Inc. System and method for navigating a guide wire
US9220568B2 (en) 2009-10-12 2015-12-29 Corindus Inc. Catheter system with percutaneous device movement algorithm
US20110091853A1 (en) * 2009-10-20 2011-04-21 Magnetecs, Inc. Method for simulating a catheter guidance system for control, development and training applications
US9655539B2 (en) 2009-11-09 2017-05-23 Magnetecs, Inc. System and method for targeting catheter electrodes
US20110218774A1 (en) * 2010-03-03 2011-09-08 Milan Ikits Systems and Methods for Simulations Utilizing a Virtual Coupling
US8442806B2 (en) 2010-03-03 2013-05-14 Immersion Medical, Inc. Systems and methods for simulations utilizing a virtual coupling
US11361516B2 (en) 2010-04-09 2022-06-14 University Of Florida Research Foundation, Incorporated Interactive mixed reality system and uses thereof
US9626805B2 (en) 2010-04-09 2017-04-18 University Of Florida Research Foundation, Incorporated Interactive mixed reality system and uses thereof
US9251721B2 (en) * 2010-04-09 2016-02-02 University Of Florida Research Foundation, Inc. Interactive mixed reality system and uses thereof
US10902677B2 (en) 2010-04-09 2021-01-26 University Of Florida Research Foundation, Incorporated Interactive mixed reality system and uses thereof
US20120280988A1 (en) * 2010-04-09 2012-11-08 University Of Florida Research Foundation, Inc. Interactive mixed reality system and uses thereof
CN102906802A (en) * 2010-05-31 2013-01-30 挪度医疗器械有限公司 Iv training system
WO2011151304A1 (en) * 2010-05-31 2011-12-08 Laerdal Medical As Iv training system
US20120178069A1 (en) * 2010-06-15 2012-07-12 Mckenzie Frederic D Surgical Procedure Planning and Training Tool
US11033332B2 (en) 2010-08-12 2021-06-15 Heartflow, Inc. Method and system for image processing to determine blood flow
US11154361B2 (en) 2010-08-12 2021-10-26 Heartflow, Inc. Method and system for image processing to determine blood flow
US11083524B2 (en) 2010-08-12 2021-08-10 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
US11090118B2 (en) 2010-08-12 2021-08-17 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US10702340B2 (en) 2010-08-12 2020-07-07 Heartflow, Inc. Image processing and patient-specific modeling of blood flow
US10702339B2 (en) 2010-08-12 2020-07-07 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
US10682180B2 (en) 2010-08-12 2020-06-16 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
US11116575B2 (en) 2010-08-12 2021-09-14 Heartflow, Inc. Method and system for image processing to determine blood flow
US11135012B2 (en) 2010-08-12 2021-10-05 Heartflow, Inc. Method and system for image processing to determine patient-specific blood flow characteristics
US11298187B2 (en) 2010-08-12 2022-04-12 Heartflow, Inc. Method and system for image processing to determine patient-specific blood flow characteristics
US11793575B2 (en) 2010-08-12 2023-10-24 Heartflow, Inc. Method and system for image processing to determine blood flow
US10531923B2 (en) 2010-08-12 2020-01-14 Heartflow, Inc. Method and system for image processing to determine blood flow
US10492866B2 (en) 2010-08-12 2019-12-03 Heartflow, Inc. Method and system for image processing to determine blood flow
US10478252B2 (en) 2010-08-12 2019-11-19 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
US20160232667A1 (en) * 2010-08-12 2016-08-11 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US10052158B2 (en) 2010-08-12 2018-08-21 Heartflow, Inc. Method and system for image processing to determine patient-specific blood flow characteristics
US10441361B2 (en) 2010-08-12 2019-10-15 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US10080614B2 (en) 2010-08-12 2018-09-25 Heartflow, Inc. Method and system for image processing to determine patient-specific blood flow characteristics
US10080613B2 (en) 2010-08-12 2018-09-25 Heartflow, Inc. Systems and methods for determining and visualizing perfusion of myocardial muscle
US10092360B2 (en) * 2010-08-12 2018-10-09 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US11583340B2 (en) 2010-08-12 2023-02-21 Heartflow, Inc. Method and system for image processing to determine blood flow
US10149723B2 (en) 2010-08-12 2018-12-11 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US10154883B2 (en) 2010-08-12 2018-12-18 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US10159529B2 (en) 2010-08-12 2018-12-25 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
US10166077B2 (en) 2010-08-12 2019-01-01 Heartflow, Inc. Method and system for image processing to determine patient-specific blood flow characteristics
US10179030B2 (en) 2010-08-12 2019-01-15 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
US10376317B2 (en) 2010-08-12 2019-08-13 Heartflow, Inc. Method and system for image processing and patient-specific modeling of blood flow
US10327847B2 (en) 2010-08-12 2019-06-25 Heartflow, Inc. Method and system for patient-specific modeling of blood flow
US10321958B2 (en) 2010-08-12 2019-06-18 Heartflow, Inc. Method and system for image processing to determine patient-specific blood flow characteristics
US9833293B2 (en) 2010-09-17 2017-12-05 Corindus, Inc. Robotic catheter system
US8636519B2 (en) 2010-10-05 2014-01-28 Biosense Webster (Israel) Ltd. Simulation of an invasive procedure
AU2011226872B2 (en) * 2010-10-05 2014-09-11 Biosense Webster (Israel), Ltd. Simulation of an invasive procedure
JP2012075909A (en) * 2010-10-05 2012-04-19 Biosense Webster (Israel) Ltd Simulation of invasive procedure
EP2439719A1 (en) * 2010-10-05 2012-04-11 Biosense Webster (Israel), Ltd. Simulation of an invasive procedure
US11445996B2 (en) 2010-11-08 2022-09-20 Teleflex Life Sciences Limited Endovascular navigation system and method
US10368830B2 (en) 2010-11-08 2019-08-06 Arrow International Inc. Endovascular navigation system and method
US9119551B2 (en) 2010-11-08 2015-09-01 Vasonova, Inc. Endovascular navigation system and method
CN102592484A (en) * 2010-11-16 2012-07-18 韩国电子通信研究院 Reconfigurable platform management apparatus for virtual reality-based training simulator
US20120122062A1 (en) * 2010-11-16 2012-05-17 Electronics And Telecommunications Research Institute Reconfigurable platform management apparatus for virtual reality-based training simulator
US9192301B2 (en) * 2010-11-18 2015-11-24 Masar Scientific Uk Limited Radiological simulation
US20130329982A1 (en) * 2010-11-18 2013-12-12 Masar Scientific Uk Limited Radiological Simulation
JP2014505503A (en) * 2010-12-06 2014-03-06 サノフィ−アベンティス・ドイチュラント・ゲゼルシャフト・ミット・ベシュレンクテル・ハフツング Training mechanism for drug delivery devices
US9336690B2 (en) 2010-12-06 2016-05-10 Sanofi-Aventis Deutschland Gmbh Training mechanism for drug delivery device
WO2012076494A1 (en) * 2010-12-06 2012-06-14 Sanofi-Aventis Deutschland Gmbh Training mechanism for drug delivery device
US20140193788A1 (en) * 2011-01-10 2014-07-10 Alk Ag Method, a device and a computer program product for training the use of an auto-injector
US9875339B2 (en) 2011-01-27 2018-01-23 Simbionix Ltd. System and method for generating a patient-specific digital image-based model of an anatomical structure
US10360810B1 (en) * 2011-09-28 2019-07-23 Sproutel Inc. Educational doll for children with chronic illness
US10734116B2 (en) 2011-10-04 2020-08-04 Quantant Technology, Inc. Remote cloud based medical image sharing and rendering semi-automated or fully automated network and/or web-based, 3D and/or 4D imaging of anatomy for training, rehearsing and/or conducting medical procedures, using multiple standard X-ray and/or other imaging projections, without a need for special hardware and/or systems and/or pre-processing/analysis of a captured image data
US9105200B2 (en) 2011-10-04 2015-08-11 Quantant Technology, Inc. Semi-automated or fully automated, network and/or web-based, 3D and/or 4D imaging of anatomy for training, rehearsing and/or conducting medical procedures, using multiple standard X-ray and/or other imaging projections, without a need for special hardware and/or systems and/or pre-processing/analysis of a captured image data
US20140298270A1 (en) * 2011-10-11 2014-10-02 Koninklijke Philips N.V. Workflow for ambiguity guided interactive segmentation of lung lobes
US9678620B2 (en) * 2011-10-11 2017-06-13 Koninklijke Philips N.V. Workflow for ambiguity guided interactive segmentation of lung lobes
US9345447B2 (en) 2012-05-07 2016-05-24 Vasonova, Inc. Right atrium indicator
US8965490B2 (en) 2012-05-07 2015-02-24 Vasonova, Inc. Systems and methods for detection of the superior vena cava area
US9743994B2 (en) 2012-05-07 2017-08-29 Vasonova, Inc. Right atrium indicator
ES2387785A1 (en) * 2012-05-14 2012-10-01 Universitat Politècnica De Catalunya Method for generating a path for a virtual bronchoscopy
US11631342B1 (en) 2012-05-25 2023-04-18 The Regents Of University Of California Embedded motion sensing technology for integration within commercial ultrasound probes
WO2013192234A1 (en) * 2012-06-18 2013-12-27 The Research Foundation For The State University Of New York Systems and methods for identifying historical vasculature cases
US9792836B2 (en) * 2012-10-30 2017-10-17 Truinject Corp. Injection training apparatus using 3D position sensor
US11854426B2 (en) 2012-10-30 2023-12-26 Truinject Corp. System for cosmetic and therapeutic training
US20140212864A1 (en) * 2012-10-30 2014-07-31 Truinject Medical Corp. Injection training apparatus using 3d position sensor
US10902746B2 (en) 2012-10-30 2021-01-26 Truinject Corp. System for cosmetic and therapeutic training
US11403964B2 (en) 2012-10-30 2022-08-02 Truinject Corp. System for cosmetic and therapeutic training
US20220309954A1 (en) * 2012-10-30 2022-09-29 Truinject Corp. Injection training apparatus using 3d position sensor
US10037715B2 (en) 2013-10-16 2018-07-31 Simulab Corporation Detecting insertion of needle into simulated vessel using a conductive fluid
US20160324407A1 (en) * 2013-10-31 2016-11-10 Optimede Inc. Test system having laser treatment function
WO2015073357A1 (en) * 2013-11-13 2015-05-21 Volcano Corporation Visually optimized intravascular imaging and associated devices, systems, and methods
US11696741B2 (en) 2013-11-13 2023-07-11 Philips Image Guided Therapy Corporation Visually optimized intravascular imaging and associated devices, systems, and methods
CN105722464A (en) * 2013-11-13 2016-06-29 火山公司 Visually optimized intravascular imaging and associated devices, systems, and methods
US11020087B2 (en) 2013-11-13 2021-06-01 Philips Image Guided Therapy Corporation Visually optimized intravascular imaging and associated devices, systems, and methods
US11594150B1 (en) 2013-11-21 2023-02-28 The Regents Of The University Of California System and method for extended spectrum ultrasound training using animate and inanimate training objects
US11315439B2 (en) 2013-11-21 2022-04-26 SonoSim, Inc. System and method for extended spectrum ultrasound training using animate and inanimate training objects
US20170004732A1 (en) * 2013-11-29 2017-01-05 "Eidos-Medicine", Ltd, Drive for generating force-related tactile feedback on an instrument
US10559226B2 (en) * 2013-11-29 2020-02-11 Eidos-Medicine Llc Drive for generating force-related tactile feedback on an instrument
US9922578B2 (en) 2014-01-17 2018-03-20 Truinject Corp. Injection site training system
US10896627B2 (en) 2014-01-17 2021-01-19 Truinjet Corp. Injection site training system
US10290231B2 (en) 2014-03-13 2019-05-14 Truinject Corp. Automated detection of performance characteristics in an injection training system
US10290232B2 (en) 2014-03-13 2019-05-14 Truinject Corp. Automated detection of performance characteristics in an injection training system
US20170243522A1 (en) * 2014-09-10 2017-08-24 The University Of North Carolina At Chapel Hill Radiation-free simulator systems and methods for simulating fluoroscopic or other procedures
US10440246B2 (en) * 2014-11-19 2019-10-08 Kiran K. Bhat System for enabling remote annotation of media data captured using endoscopic instruments and the creation of targeted digital advertising in a documentation environment using diagnosis and procedure code entries
US10235904B2 (en) 2014-12-01 2019-03-19 Truinject Corp. Injection training tool emitting omnidirectional light
US11094223B2 (en) 2015-01-10 2021-08-17 University Of Florida Research Foundation, Incorporated Simulation features combining mixed reality and modular tracking
US9836895B1 (en) * 2015-06-19 2017-12-05 Waymo Llc Simulating virtual objects
US10943414B1 (en) 2015-06-19 2021-03-09 Waymo Llc Simulating virtual objects
US11600201B1 (en) 2015-06-30 2023-03-07 The Regents Of The University Of California System and method for converting handheld diagnostic ultrasound systems into ultrasound training systems
US20170035514A1 (en) * 2015-08-07 2017-02-09 Abbott Cardiovascular System Inc. System and method for supporting decisions during a catheterization procedure
US10679758B2 (en) * 2015-08-07 2020-06-09 Abbott Cardiovascular Systems Inc. System and method for supporting decisions during a catheterization procedure
US10500340B2 (en) 2015-10-20 2019-12-10 Truinject Corp. Injection system
US11164483B2 (en) * 2015-12-28 2021-11-02 Pontificia Universidad Católica De Chile Medical simulator for the simulation of puncture operations
US10743942B2 (en) 2016-02-29 2020-08-18 Truinject Corp. Cosmetic and therapeutic injection safety systems, methods, and devices
US10849688B2 (en) 2016-03-02 2020-12-01 Truinject Corp. Sensory enhanced environments for injection aid and social training
US10648790B2 (en) 2016-03-02 2020-05-12 Truinject Corp. System for determining a three-dimensional position of a testing tool
US11730543B2 (en) 2016-03-02 2023-08-22 Truinject Corp. Sensory enhanced environments for injection aid and social training
US10748358B2 (en) * 2016-05-04 2020-08-18 Tecat Performance Systems, Llc Integrated wireless data system for avionics performance indication
US20190333299A1 (en) * 2016-05-04 2019-10-31 Tecat Performance Systems, Llc Integrated wireless data system for avionics performance indication
US10395446B2 (en) * 2016-05-04 2019-08-27 Tecat Performance Systems, Llc Integrated wireless data system for avionics performance indication
WO2018089413A1 (en) * 2016-11-08 2018-05-17 President And Fellows Of Harvard College Methodology and apparatus for simulation of medical devices
US10650703B2 (en) 2017-01-10 2020-05-12 Truinject Corp. Suture technique training system
US10269266B2 (en) 2017-01-23 2019-04-23 Truinject Corp. Syringe dose and position measuring apparatus
US11710424B2 (en) 2017-01-23 2023-07-25 Truinject Corp. Syringe dose and position measuring apparatus
US11749137B2 (en) 2017-01-26 2023-09-05 The Regents Of The University Of California System and method for multisensory psychomotor skill training
US11517721B2 (en) 2017-03-15 2022-12-06 Radux Devices, LLC Interventional tool delivery devices, systems and MElHODS
US20180264236A1 (en) * 2017-03-15 2018-09-20 Radux Devices, LLC Interventional tool delivery devices, systems and methods
US10556094B2 (en) * 2017-03-15 2020-02-11 Radux Devices, LLC Interventional tool delivery devices, systems and methods
CN107411819A (en) * 2017-04-12 2017-12-01 上海大学 Balloon angioplasty process real time simulation method
US20210378747A1 (en) * 2018-03-28 2021-12-09 Insilicotrials Technologies S.R.L. Method and system for computational modeling and simulation of the operation and/or behavior of medical devices which are implantable or usable on patients
US20190340956A1 (en) * 2018-05-05 2019-11-07 Mentice Inc. Simulation-based training and assessment systems and methods
WO2020095078A1 (en) 2018-11-09 2020-05-14 Semmelweis Egyetem Exoskeleton for assisting surgical positioning, method for producing the exoskeleton
DE112019005588T5 (en) 2018-11-09 2021-11-11 Semmelweis Egyetem Exoskeleton for assisting surgical positioning, methods of manufacturing the exoskeleton and a surgical method for using such an exoskeleton
JP7439106B2 (en) 2019-01-18 2024-02-27 ベクトン・ディキンソン・アンド・カンパニー Intravenous treatment selection system
US11810473B2 (en) 2019-01-29 2023-11-07 The Regents Of The University Of California Optical surface tracking for medical simulation
US11495142B2 (en) 2019-01-30 2022-11-08 The Regents Of The University Of California Ultrasound trainer with internal optical tracking

Also Published As

Publication number Publication date
WO2002070980A1 (en) 2002-09-12
US20020137014A1 (en) 2002-09-26
SG142164A1 (en) 2008-05-28
WO2002086797A1 (en) 2002-10-31
US7371067B2 (en) 2008-05-13

Similar Documents

Publication Publication Date Title
US20020168618A1 (en) Simulation system for image-guided medical procedures
US6236878B1 (en) Method for predictive modeling for planning medical interventions and simulating physiological conditions
US20040009459A1 (en) Simulation system for medical procedures
US6538634B1 (en) Apparatus for the simulation of image-guided surgery
Sutherland et al. An augmented reality haptic training simulator for spinal needle procedures
JP4436966B2 (en) Endoscope tutorial system
US7261565B2 (en) Endoscopic tutorial system for the pancreatic system
US8500451B2 (en) Preoperative surgical simulation
US8639485B2 (en) Systems and methods for editing a model of a physical system for a simulation
Wang et al. Real-time interactive simulator for percutaneous coronary revascularization procedures
RU2642913C2 (en) System and method for establishment of individual model of patient's anatomical structure based on digital image
US5755577A (en) Apparatus and method for recording data of a surgical procedure
Alderliesten et al. Simulation of minimally invasive vascular interventions for training purposes
CN105264459A (en) Haptic augmented and virtual reality system for simulation of surgical procedures
CN107847277A (en) Aid in guiding the method and system of intra-vascular tools in blood vessel structure
US8491307B2 (en) Interventional simulator control system
Chui et al. Training and pretreatment planning of interventional neuroradiology procedures–initial clinical validation
Villard et al. A prototype percutaneous transhepatic cholangiography training simulator with real-time breathing motion
Kwon et al. Realistic force reflection in a spine biopsy simulator
Meglan Making surgical simulation real
Nakao et al. Haptic reproduction and interactive visualization of a beating heart for cardiovascular surgery simulation
Abolmaesumi et al. A haptic-based system for medical image examination
EP1576564B1 (en) An interventional simulator control system
Troccaz et al. Simulators for medical training: application to vascular ultrasound imaging
Sutherland et al. Towards an augmented ultrasound guided spinal needle insertion system

Legal Events

Date Code Title Description
AS Assignment

Owner name: LABORATORIES FOR INFORMATION TECHNOLOGY, SINGAPORE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHUI, CHEE-KONG;MA, XIN;CAI, YIYU;AND OTHERS;REEL/FRAME:013276/0410;SIGNING DATES FROM 20020507 TO 20020513

AS Assignment

Owner name: JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE, THE,

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ANDERSON, JAMES H.;BRODY, WILLIAM R.;REEL/FRAME:012993/0607;SIGNING DATES FROM 20020510 TO 20020514

Owner name: LABORATORIES FOR INFORMATION TECHNOLOGY, SINGAPORE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHUI, CHEE-KONG;CAI, YIYU;WANG, YAOPING;AND OTHERS;REEL/FRAME:012993/0603;SIGNING DATES FROM 20020507 TO 20020513

AS Assignment

Owner name: INSTITUTE FOR INFOCOMM RESEARCH, SINGAPORE

Free format text: CHANGE OF NAME;ASSIGNOR:LABORATORIES FOR INFORMATION TECHNOLOGY INCORPORATED;REEL/FRAME:020689/0521

Effective date: 20020711

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION