CN103371870A - Multimode image based surgical operation navigation system - Google Patents

Multimode image based surgical operation navigation system Download PDF

Info

Publication number
CN103371870A
CN103371870A CN2013102981426A CN201310298142A CN103371870A CN 103371870 A CN103371870 A CN 103371870A CN 2013102981426 A CN2013102981426 A CN 2013102981426A CN 201310298142 A CN201310298142 A CN 201310298142A CN 103371870 A CN103371870 A CN 103371870A
Authority
CN
China
Prior art keywords
image
multimode
registration
ultrasonic
navigation systems
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013102981426A
Other languages
Chinese (zh)
Other versions
CN103371870B (en
Inventor
秦文健
辜嘉
温铁祥
李志成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Zhongkehuaying Health Technology Co ltd
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN201310298142.6A priority Critical patent/CN103371870B/en
Publication of CN103371870A publication Critical patent/CN103371870A/en
Application granted granted Critical
Publication of CN103371870B publication Critical patent/CN103371870B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention relates to a multimode image based surgical operation navigation system which comprises a preoperative image acquisition device, an ultrasonic scanning device, a multimode image registration device, an integrated endoscopic device and a postoperative evaluation device. The preoperative image acquisition device acquires a three-dimensional image, the ultrasonic scanning device acquires an ultrasonic image in real time, the multimode image registration device registers the three-dimensional image with the ultrasonic image to obtain a registered image, the integrated endoscopic device acquires current image information of an operational position during operation, and the multimode image registration device fuses the registered image and the current image information to obtain a fused image. The preoperative three-dimensional image, the intraoperative ultrasonic image and the intraoperative current image are fused, therefore, real-time image information which is accurate, reliable and rich in information content can be provided for doctors; meanwhile, by the aid of the postoperative evaluation device, bases are provided for subsequent disease diagnosis, tracking or operation implementation.

Description

A kind of surgical navigation systems based on multimode images
[technical field]
The present invention relates to medical instruments field, relate in particular to a kind of surgical navigation systems based on multimode images.
[background technology]
Computed tomography (Computed Tomography, CT), nuclear magnetic resonance (Magnetic Resonance Imaging, MRI) and ultra sonic imaging (Ultrasound, US) be widely used in computer-aided diagnosis and Technology of surgery navigation with its characteristic and advantage separately.In traditional micro-wound surgical operation process, lack the accurate description to the focus three dimensional structure before the art, directly affected the levels of precision of planning before the art, viewing area in the art only limits to the human body exposed surface, can only rely on doctor's experience and Space Idea and supposition to go synthetic determination to judge the focus particular location, its safety and accuracy can be subject to subjective impact, and severe patient causes operative failure.
The surgical navigation instrument is under area of computer aided, view data is processed such as image segmentation, image registration fusion and three-dimensional reconstruction etc., again according to before doctor's clinical experience and the art to focal zone ill pathological characters and disease sites structural analysis, the planning operation pathway, formulate the operation plan of reasonable, quantitative and Wicresoft and assist the doctor to carry out operation technique in conjunction with stereotactic system, thereby effectively reduce wound, the raising treatment precision of operation, make early rehabilitation of patient, reduce the probability that other sequela of postoperative occur.
Surgical navigation systems of the prior art lacks a cover in conjunction with imaging compound detection navigation scheme in imaging before the art and the art, thereby can not provide accurately reliable, the abundant real-time imaging information of quantity of information for the doctor, and the quality of operation can't further promote.In addition, surgical navigator of the prior art is not open platform, software system and interface can only operate according to each producer's instrument Application standard, can not upgrade, and basically do not possess postoperative trace analysis evaluation function, therefore being necessary to set up one sets up image-guided opening and postoperative evaluation system, not only can be for medical personnel provide a postoperative historical data with reference to platform, can also provide one based on historical surgical data, be used to follow-up medical diagnosis on disease, tracking or operation to implement to provide the platform of foundation.
[summary of the invention]
The present invention is intended to solve above-mentioned problems of the prior art, proposes a kind of surgical navigation systems based on multimode images.
Described surgical navigation systems based on multimode images comprises: video capturing device, ultrasonic scanning device, multimode images registration apparatus, endoscope's integrating device, postoperative evaluation device before the art.Wherein, the front video capturing device of described art obtains the 3-dimensional image of the front diseased region of patient's art; The ultrasonic image of diseased region in the described ultrasonic scanning device Real-time Obtaining patient art; Described multimode images registration apparatus carries out the multimode registration with described 3-dimensional image and ultrasonic image, obtains the registration image; Described endoscope integrating device obtains the current image information of surgery location in the art, and described multimode images registration apparatus merges described registration image and current image information, obtains merging image; Described postoperative evaluation device carries out machine learning according to described registration image and fusion image information, sets up the disease forecasting model.
The surgical navigation systems based on multimode images that the present invention proposes has merged before the art the current image of surgery location in MRI/CT 3-dimensional image, intraoperative ultrasound image and the art, can be that the doctor provide more accurately reliable, the abundant real-time imaging information of quantity of information; Simultaneously the present invention also is provided for storing and analyzing the postoperative evaluation device of surgical data, and this apparatus for evaluating can carry out machine learning according to surgical data, thereby implements to provide foundation for follow-up medical diagnosis on disease, tracking or operation.
[description of drawings]
Fig. 1 is the surgical navigation systems structure chart based on multimode images of one embodiment of the invention.
Fig. 2 is the multimode images registration apparatus fundamental diagram of one embodiment of the invention.
[specific embodiment]
In order to make purpose of the present invention, technical scheme and advantage more clear, below in conjunction with specific embodiment and accompanying drawing, the present invention is described in further detail.Should be appreciated that specific embodiment described in the literary composition only in order to explaining technical scheme of the present invention, and not should be understood to limitation of the present invention.
The invention provides a kind of surgical navigation systems based on multimode images, be used to that the doctor provides in real time in the art, accurate diseased region image as a reference, thereby the guiding doctor implements operation.
As shown in Figure 1, in an embodiment of the present invention, described surgical navigation systems based on multimode images comprises video capturing device 100 before the art, ultrasonic scanning device 200, multimode images registration apparatus 300, endoscope's integrating device 400 and postoperative evaluation device 500.
Hereinafter will each ingredient and the operation principle thereof of described surgical navigation systems based on multimode images be described in further detail.
Video capturing device 100 usefulness Rhizoma Atractylodis Macrocephalae are front before the described art scans patient's diseased region, thereby obtains the 3-dimensional image of patient's diseased region.Wherein, video capturing device 100 includes but not limited to the medical scanning imaging devices such as MRI scanner, CT scanner before the described art.Preferably, video capturing device 100 carries out pretreatment based on the related algorithm of Digital Image Processing to the primary data that scanning obtains before the described art, then adopt the tissue/organ shape based on statistics, patient's diseased region tissue/organ is carried out three-dimensional reconstruction, the final accurately described 3-dimensional image that obtains.Described 3-dimensional image can be used for planning operation pathway, for example, can calculate optimum surgical safe zone by collision algorithm, realize deathtrap active dodge technology, in order to retrain the displacement of operating theater instruments in the art, avoid maloperation and injure normal structure organ or hyperamization tracheal rupture.
Described ultrasonic scanning device 200 is used for obtaining in real time the ultrasonic image of patient's art diseased region.Described multimode images registration apparatus 300 carries out the multimode registration with described 3-dimensional image and ultrasonic image, obtains the registration image.
Described 3-dimensional image and ultrasonic image are the medical image of different modalities, do not have association between the gray value of the corresponding voxel of the medical image of different modalities.Therefore, as shown in Figure 2, preferably, described multimode images registration apparatus 300 further comprises MODAL TRANSFORMATION OF A module 301 and registration module 302, described MODAL TRANSFORMATION OF A module 301 is converted to virtual ultrasonic image with described 3-dimensional image, 302 pairs of described virtual ultrasonic images of described registration module and described ultrasonic image carry out registration, obtain described registration image.Particularly, can be according to the Imaging physics characteristic attribute of two kinds of different modalities, employing is derived and modeling based on the mathematical theory of perceptron kernel function, draw the physical features attribute of two kinds of inherences between the modal data, and further derive transforming relationship between described 3-dimensional image and the ultrasonic image bimodal data, described 3-dimensional image is converted to virtual ultrasonic image, and then described virtual ultrasonic image and described ultrasonic image are carried out registration, obtain described registration image.
Described registration image combines the characteristics of described 3-dimensional image and ultrasonic image, and the advantage that has 3 D stereo and present has in real time reflected patient's diseased region situation more true and reliablely.
Preferably, described ultrasonic scanning device 200 comprises based on the mechanical arm of spinor theory and the ultrasound probe that is arranged at described mechanical arm tail end.Described mechanical arm based on spinor theory is the legerity type multi-joint mechanical arm, and it has movable advantage freely; Described mechanical arm is used for gripping described ultrasound probe.In operation, described ultrasound probe is pressed close to patient's diseased region, in order to obtain the ultrasonoscopy of patient's diseased region.
In operation, patient tends to cause organizing deformation or the skew of organ trace because of breathing, therefore in a preferred embodiment, described ultrasonic scanning device 200 can be adjusted itself and patient's relative position adaptively, in case because of press close to patient and maintenance fixedly pose dampen tissue of patient.Particularly, described ultrasonic scanning device 200 further comprises sensing module, command control module and mechanical arm control chamber.Described sensing module obtains the force data between described ultrasonic scanning device and the patient, when described force data during greater than a certain predetermined threshold value T, described command control module is sent control command to described mechanical arm control chamber, described mechanical arm control chamber is controlled described mechanical arm away from patient, prevents from dampening patient.The auxiliary doctor of mechanical arm among the present invention grips ultrasonic probe, also can adopt the direct kinematics matrix to extrapolate terminal ultrasonic probe location parameter, and by the demarcation of self-control nylon plane grid body Model realization probe, obtain the ultrasonoscopy space to the transformation relation of the front image data locus of art, so not only can obtain the accurate spatial positional information of ultrasonic probe according to known spatial alternation relation, also reduce working doctor intensity.
Except the ultrasonic image that uses described ultrasonic scanning device 200 Real-time Obtaining patient diseased regions, the doctor also need use endoscope's integrating device 400 to obtain the current image information of surgery location in the art in operation.In the prior art, that fujinon electronic video endoscope has is real-time, the characteristic of high imaging true to nature, it is widely used in micro-wound surgical operation, for the doctor provides the visual operation visual field, has simultaneously that wound is little, few intercurrent disease, recovery is fast and the lower operation of direct-view and the advantage such as safe and effective.But the medical image that endoscopic surgery obtains lacks stereovision, and the visual area is narrow and small.In the present invention, described endoscope integrating device 400 obtains after the current image information of surgery location in the art, and 300 pairs of described registration images of described multimode images registration apparatus and current image information further merge, and obtain merging image.Described fusion visual fusion the current image of surgery location in 3-dimensional image, intraoperative ultrasound image and the art before the art, can implement reference for the doctor provide more accurately reliably image information to be used for operation.
Preferably, described endoscope integrating device 400 also comprises localizer, described endoscope integrating device 400 and ultrasonic scanning device 200 are equipped with the optical markings thing, and described localizer obtains the position of described endoscope integrating device 400 in described ultrasonic image according to described optical markings thing.Particularly, described localizer is fixed as object of reference, and its coordinate position is known.In operation, real-time displacement all may occur in described endoscope integrating device 400 and ultrasonic scanning device 200, by described localizer obtain respectively described endoscope integrating device 400 with respect to the positional information of described localizer and described ultrasonic scanning device 200 with respect to the positional information of described localizer, obtain described endoscope integrating device 400 positions with respect to described ultrasonic scanning device 200 thereby convert.The described fusion image that comprises described endoscope integrating device 400 images may further be the doctor provides more accurate reliably image information to be used for operation enforcement reference.
Preferably, described endoscope integrating device 400 is the narrow-band spectrum imaging endoscope integrating device based on CMOS.Adopt this endoscope integrating device except can obtaining the lesions position accurate information, also can by remove in conjunction with healthy and strong method for adaptive image enhancement in the image fuzzy, correct illumination information and improve image resolution ratio, solve noise in the optical imagery, fuzzy, reflective, the problem such as illumination is not enough.For example utilize this texture of the resident criterion in edge and anisotropy broadcast algorithm Recovery image, and introduce Smoothing Constraint and solve total variance problem in the image repair, finally can obtain 3 D anatomy structure is corresponding in the true visual field Overlapping display and fuse information.
Preferably, described postoperative evaluation device 500 can be based on the data inventory analysis platform of cloud computing.Described postoperative evaluation device 500 comprises memorizer and data processor, the described registration image of described memory stores and fusion image, described data processor is set up described disease forecasting model by machine learning, for follow-up medical diagnosis on disease or operation implement to provide foundation.Further preferably, described data processor carries out machine learning based on support vector machine principle or neural network theory.Postoperative evaluation device among the present invention is distributed in a large amount of image datas and surgical parameters in the virtual cloud, realizes the highly effective and safe storage of image data and at a high speed dynamically read-write.Employing can be by setting up the Based on Probability Statistic analysis models based on the data analysis statistics of cloud platform, image to operation process on the image data of postoperative and the cloud platform is analyzed, for the doctor follows the tracks of assessment to patient's rear situation of performing the operation comprehensively, simultaneously also for providing reference data and teaching resource for image-guided operation clinically.Also can develop a cover entire run in the Web client software based on above-mentioned principle, the service of enjoying the cloud platform resource is provided for non-programming user.
The surgical navigation systems based on multimode images that the present invention proposes combines the separately advantage of the current image of surgery location in MRI/CT 3-dimensional image before the art, intraoperative ultrasound image and the art, and its fusion obtained merging image, for being used for operation, the real-time imaging information that the doctor provides more accurately reliably, quantity of information is abundant implements reference, can realize: in piercing process, in conjunction with locating and tracking system, employing guarantees to realize best operation pathway based on feature point tracking in the body of two ultrasonic orthogonal images in the art and puncture needle location; In process of expansion, in conjunction with the method for visualizing of augmented reality, research convergent divergent channel real-time positioning and early warning; In operative process, take endoscope's localization method and augmented reality based on optics and electromagnetism hybrid location determination technology, finally realize the complete three-dimensional real-time navigation of operation process.
In addition, the present invention also is provided for storing and analyzing the postoperative evaluation device of surgical data, and this apparatus for evaluating can carry out machine learning according to surgical data, thereby implements to provide foundation for follow-up medical diagnosis on disease, tracking or operation.
Although the present invention is described with reference to current preferred embodiments; but those skilled in the art will be understood that; above-mentioned preferred embodiments only is used for explaining and illustrating technical scheme of the present invention; and be not to limit protection scope of the present invention; any within the spirit and principles in the present invention scope; any modification of doing, equivalent replacement, distortion, improvement etc. all should be included within the claim protection domain of the present invention.

Claims (10)

1. surgical navigation systems based on multimode images comprises: video capturing device, ultrasonic scanning device, multimode images registration apparatus, endoscope's integrating device, postoperative evaluation device before the art, wherein,
Video capturing device obtains the 3-dimensional image of the front diseased region of patient's art before the described art;
The ultrasonic image of diseased region in the described ultrasonic scanning device Real-time Obtaining patient art;
Described multimode images registration apparatus carries out the multimode registration with described 3-dimensional image and ultrasonic image, obtains the registration image;
Described endoscope integrating device obtains the current image information of surgery location in the art, and described multimode images registration apparatus merges described registration image and current image information, obtains merging image;
Described postoperative evaluation device carries out machine learning according to described registration image and fusion image information, sets up the disease forecasting model.
2. the surgical navigation systems based on multimode images according to claim 1 is characterized in that, video capturing device is MRI scanner or CT scanner before the described art.
3. the surgical navigation systems based on multimode images according to claim 1, it is characterized in that, described multimode images registration apparatus comprises MODAL TRANSFORMATION OF A module and registration module, described MODAL TRANSFORMATION OF A module is converted to virtual ultrasonic image with described 3-dimensional image, described registration module is carried out registration to described virtual ultrasonic image and described ultrasonic image, obtains described registration image.
4. the surgical navigation systems based on multimode images according to claim 1 is characterized in that, described postoperative evaluation device is the data inventory analysis platform based on cloud computing.
5. the surgical navigation systems based on multimode images according to claim 4, it is characterized in that, described postoperative evaluation device comprises memorizer and data processor, the described registration image of described memory stores and fusion image, described data processor is set up described disease forecasting model by machine learning.
6. the surgical navigation systems based on multimode images according to claim 5 is characterized in that, described data processor carries out machine learning based on support vector machine principle or neural network theory.
7. the surgical navigation systems based on multimode images according to claim 1 is characterized in that, described ultrasonic scanning device comprises based on the mechanical arm of spinor theory and the ultrasound probe that is positioned at described mechanical arm tail end.
8. the surgical navigation systems based on multimode images according to claim 7, it is characterized in that, described ultrasonic scanning device further comprises sensing module, command control module and mechanical arm control chamber, described sensing module obtains the force data between described ultrasonic scanning device and the patient, when described force data during greater than predetermined threshold value T, described command control module is sent control command to described mechanical arm control chamber, and described mechanical arm control chamber is controlled described mechanical arm away from patient.
9. the surgical navigation systems based on multimode images according to claim 1 is characterized in that, described endoscope integrating device is the narrow-band spectrum imaging endoscope integrating device based on CMOS.
10. the surgical navigation systems based on multimode images according to claim 9, it is characterized in that, described endoscope integrating device also comprises localizer, described endoscope integrating device and ultrasonic scanning device are equipped with the optical markings thing, and described localizer obtains the described endoscope position of integrating device in described ultrasonic image according to described optical markings thing.
CN201310298142.6A 2013-07-16 2013-07-16 A kind of surgical navigation systems based on multimode images Active CN103371870B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310298142.6A CN103371870B (en) 2013-07-16 2013-07-16 A kind of surgical navigation systems based on multimode images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310298142.6A CN103371870B (en) 2013-07-16 2013-07-16 A kind of surgical navigation systems based on multimode images

Publications (2)

Publication Number Publication Date
CN103371870A true CN103371870A (en) 2013-10-30
CN103371870B CN103371870B (en) 2015-07-29

Family

ID=49458131

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310298142.6A Active CN103371870B (en) 2013-07-16 2013-07-16 A kind of surgical navigation systems based on multimode images

Country Status (1)

Country Link
CN (1) CN103371870B (en)

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103793915A (en) * 2014-02-18 2014-05-14 上海交通大学 Low-cost mark-free registration system and method in neurosurgery navigation
CN104881568A (en) * 2015-04-27 2015-09-02 苏州敏宇医疗科技有限公司 Cloud computation based early oncotherapy efficacy evaluation system and method
CN105213032A (en) * 2015-09-06 2016-01-06 北京医千创科技有限公司 Location of operation system
CN105303496A (en) * 2015-11-19 2016-02-03 李涛 Information management system of intelligent surgical operation based on mobile Internet
CN105615831A (en) * 2015-12-18 2016-06-01 李占和 Medical image holographic AR (augmented reality) display system
CN106063726A (en) * 2016-05-24 2016-11-02 中国科学院苏州生物医学工程技术研究所 Puncture navigation system and air navigation aid thereof in real time
CN106073898A (en) * 2016-08-17 2016-11-09 北京柏惠维康医疗机器人科技有限公司 Abdominal cavity interventional operation system and method
CN106236264A (en) * 2016-08-24 2016-12-21 李国新 The gastrointestinal procedures air navigation aid of optically-based tracking and images match and system
CN106236263A (en) * 2016-08-24 2016-12-21 李国新 The gastrointestinal procedures air navigation aid decomposed based on scene and system
CN106327479A (en) * 2016-09-23 2017-01-11 西安电子科技大学 Apparatus and method for identifying blood vessels in angiography-assisted congenital heart disease operation
CN106725852A (en) * 2016-12-02 2017-05-31 上海精劢医疗科技有限公司 The operation guiding system of lung puncture
WO2017101248A1 (en) * 2015-12-14 2017-06-22 北京医千创科技有限公司 Device and method for surgery image processing
CN106890025A (en) * 2017-03-03 2017-06-27 浙江大学 A kind of minimally invasive operation navigating system and air navigation aid
CN107049475A (en) * 2017-04-19 2017-08-18 纪建松 Liver cancer local ablation method and system
CN107233132A (en) * 2017-07-03 2017-10-10 南京觅踪电子科技有限公司 A kind of multi-modal visual fusion surgery systems and air navigation aid
WO2017211087A1 (en) * 2016-06-06 2017-12-14 北京理工大学 Endoscopic surgery navigation method and system
CN107854177A (en) * 2017-11-18 2018-03-30 上海交通大学医学院附属第九人民医院 A kind of ultrasound and CT/MR image co-registrations operation guiding system and its method based on optical alignment registration
CN108324246A (en) * 2018-01-19 2018-07-27 上海联影医疗科技有限公司 Medical diagnosis auxiliary system and method
CN108629845A (en) * 2018-03-30 2018-10-09 湖南沛健医疗科技有限责任公司 Operation piloting method, device, equipment, system and readable storage medium storing program for executing
CN108766504A (en) * 2018-06-15 2018-11-06 上海理工大学 A kind of people of operation guiding system is because of evaluation method
CN108814717A (en) * 2018-06-29 2018-11-16 微创(上海)医疗机器人有限公司 surgical robot system
CN108837283A (en) * 2018-04-12 2018-11-20 上海市东方医院 Stem bronchi cell precise positioning slow-released system
WO2019000732A1 (en) * 2017-06-29 2019-01-03 江苏奥康尼医疗科技发展有限公司 Supplementary apparatus for cartilage repair surgery
CN110025379A (en) * 2019-05-07 2019-07-19 新博医疗技术有限公司 A kind of ultrasound image and CT image co-registration real-time navigation system and method
CN110557623A (en) * 2019-08-05 2019-12-10 常州锦瑟医疗信息科技有限公司 Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system
CN110584775A (en) * 2018-06-13 2019-12-20 凯勋国际股份有限公司 Airway model generation system and intubation assistance system
CN111260786A (en) * 2020-01-06 2020-06-09 南京航空航天大学 Intelligent ultrasonic multi-mode navigation system and method
CN111508057A (en) * 2019-01-31 2020-08-07 许斐凯 Trachea model reconstruction method and system by using computer vision and deep learning technology
CN112002018A (en) * 2020-08-18 2020-11-27 云南省第一人民医院 Intraoperative position navigation system, device and method based on mixed reality
CN112004478A (en) * 2018-01-19 2020-11-27 皇家飞利浦有限公司 Automatic path correction during multi-modal fusion targeted biopsy
CN112215843A (en) * 2019-12-31 2021-01-12 无锡祥生医疗科技股份有限公司 Ultrasonic intelligent imaging navigation method and device, ultrasonic equipment and storage medium
CN112348858A (en) * 2019-08-07 2021-02-09 通用电气公司 Deformable registration of multi-modality images
CN113052864A (en) * 2021-03-02 2021-06-29 四川大学 Method for predicting body appearance after plastic surgery based on machine learning
CN113143217A (en) * 2021-05-07 2021-07-23 张育青 Method and system for predicting human body sound production effect
CN113856067A (en) * 2021-09-08 2021-12-31 中山大学 Multi-mode data fusion radiotherapy position determination method and auxiliary robot system
CN114206251A (en) * 2019-05-31 2022-03-18 直观外科手术操作公司 System and method for integrating images captured by different imaging modalities into a composite image of a surgical space
CN114305684A (en) * 2021-12-06 2022-04-12 南京航空航天大学 Autonomous multi-degree-of-freedom scanning type endoscope minimally invasive surgery navigation device and system thereof
CN114391918A (en) * 2022-01-19 2022-04-26 南华大学附属第一医院 Hepatobiliary surgery calculus removing equipment with scene construction effect and imaging system
US11564768B2 (en) 2017-03-31 2023-01-31 Koninklijke Philips N.V. Force sensed surface scanning systems, devices, controllers and method
CN114305684B (en) * 2021-12-06 2024-04-12 南京航空航天大学 Autonomous multi-degree-of-freedom scanning type endoscope minimally invasive surgery navigation device and system thereof

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050080328A1 (en) * 2002-06-04 2005-04-14 General Electric Company Method and apparatus for medical intervention procedure planning and location and navigation of an intervention tool
CN101681504A (en) * 2006-11-27 2010-03-24 皇家飞利浦电子股份有限公司 System and method for fusing real-time ultrasound images with pre-acquired medical images
WO2012065058A2 (en) * 2010-11-11 2012-05-18 The Johns Hopkins University Remote center of motion robot for medical image scanning and image-guided targeting
CN102512246A (en) * 2011-12-22 2012-06-27 中国科学院深圳先进技术研究院 Surgery guiding system and method
CN102711650A (en) * 2010-01-13 2012-10-03 皇家飞利浦电子股份有限公司 Image integration based registration and navigation for endoscopic surgery
CN102999902A (en) * 2012-11-13 2013-03-27 上海交通大学医学院附属瑞金医院 Optical navigation positioning system based on CT (computed tomography) registration results and navigation method thereby
CN103040525A (en) * 2012-12-27 2013-04-17 深圳先进技术研究院 Multimode medical imaging surgery navigation method and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050080328A1 (en) * 2002-06-04 2005-04-14 General Electric Company Method and apparatus for medical intervention procedure planning and location and navigation of an intervention tool
CN101681504A (en) * 2006-11-27 2010-03-24 皇家飞利浦电子股份有限公司 System and method for fusing real-time ultrasound images with pre-acquired medical images
CN102711650A (en) * 2010-01-13 2012-10-03 皇家飞利浦电子股份有限公司 Image integration based registration and navigation for endoscopic surgery
WO2012065058A2 (en) * 2010-11-11 2012-05-18 The Johns Hopkins University Remote center of motion robot for medical image scanning and image-guided targeting
CN102512246A (en) * 2011-12-22 2012-06-27 中国科学院深圳先进技术研究院 Surgery guiding system and method
CN102999902A (en) * 2012-11-13 2013-03-27 上海交通大学医学院附属瑞金医院 Optical navigation positioning system based on CT (computed tomography) registration results and navigation method thereby
CN103040525A (en) * 2012-12-27 2013-04-17 深圳先进技术研究院 Multimode medical imaging surgery navigation method and system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
秦文健等: "3维建模中视频图像与磁跟踪器的多模态标定在微创手术中的应用", 《中国图象图形学报》 *
罗哲: "计算机辅助微创心脏外科手术导航系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103793915B (en) * 2014-02-18 2017-03-15 上海交通大学 Inexpensive unmarked registration arrangement and method for registering in neurosurgery navigation
CN103793915A (en) * 2014-02-18 2014-05-14 上海交通大学 Low-cost mark-free registration system and method in neurosurgery navigation
CN104881568A (en) * 2015-04-27 2015-09-02 苏州敏宇医疗科技有限公司 Cloud computation based early oncotherapy efficacy evaluation system and method
CN105213032A (en) * 2015-09-06 2016-01-06 北京医千创科技有限公司 Location of operation system
CN105303496A (en) * 2015-11-19 2016-02-03 李涛 Information management system of intelligent surgical operation based on mobile Internet
WO2017101248A1 (en) * 2015-12-14 2017-06-22 北京医千创科技有限公司 Device and method for surgery image processing
CN105615831A (en) * 2015-12-18 2016-06-01 李占和 Medical image holographic AR (augmented reality) display system
CN106063726A (en) * 2016-05-24 2016-11-02 中国科学院苏州生物医学工程技术研究所 Puncture navigation system and air navigation aid thereof in real time
CN106063726B (en) * 2016-05-24 2019-05-28 中国科学院苏州生物医学工程技术研究所 Navigation system and its air navigation aid are punctured in real time
WO2017211087A1 (en) * 2016-06-06 2017-12-14 北京理工大学 Endoscopic surgery navigation method and system
CN106073898A (en) * 2016-08-17 2016-11-09 北京柏惠维康医疗机器人科技有限公司 Abdominal cavity interventional operation system and method
CN106073898B (en) * 2016-08-17 2019-06-14 北京柏惠维康医疗机器人科技有限公司 Abdominal cavity interventional operation system
CN106236264A (en) * 2016-08-24 2016-12-21 李国新 The gastrointestinal procedures air navigation aid of optically-based tracking and images match and system
CN106236263A (en) * 2016-08-24 2016-12-21 李国新 The gastrointestinal procedures air navigation aid decomposed based on scene and system
CN106327479A (en) * 2016-09-23 2017-01-11 西安电子科技大学 Apparatus and method for identifying blood vessels in angiography-assisted congenital heart disease operation
CN106327479B (en) * 2016-09-23 2018-11-20 西安电子科技大学 The device and method that congenital heart disease art medium vessels recognize under angiography intermediary
CN106725852A (en) * 2016-12-02 2017-05-31 上海精劢医疗科技有限公司 The operation guiding system of lung puncture
CN106890025B (en) * 2017-03-03 2020-02-28 浙江大学 Minimally invasive surgery navigation system and navigation method
CN106890025A (en) * 2017-03-03 2017-06-27 浙江大学 A kind of minimally invasive operation navigating system and air navigation aid
US11857379B2 (en) 2017-03-31 2024-01-02 Koninklijke Philips N.V. Force sensed surface scanning systems, devices, controllers and methods
US11564768B2 (en) 2017-03-31 2023-01-31 Koninklijke Philips N.V. Force sensed surface scanning systems, devices, controllers and method
CN107049475A (en) * 2017-04-19 2017-08-18 纪建松 Liver cancer local ablation method and system
WO2019000732A1 (en) * 2017-06-29 2019-01-03 江苏奥康尼医疗科技发展有限公司 Supplementary apparatus for cartilage repair surgery
CN107233132A (en) * 2017-07-03 2017-10-10 南京觅踪电子科技有限公司 A kind of multi-modal visual fusion surgery systems and air navigation aid
CN107854177A (en) * 2017-11-18 2018-03-30 上海交通大学医学院附属第九人民医院 A kind of ultrasound and CT/MR image co-registrations operation guiding system and its method based on optical alignment registration
CN112004478A (en) * 2018-01-19 2020-11-27 皇家飞利浦有限公司 Automatic path correction during multi-modal fusion targeted biopsy
CN108324246A (en) * 2018-01-19 2018-07-27 上海联影医疗科技有限公司 Medical diagnosis auxiliary system and method
CN108629845B (en) * 2018-03-30 2022-07-12 湖南沛健医疗科技有限责任公司 Surgical navigation device, apparatus, system, and readable storage medium
CN108629845A (en) * 2018-03-30 2018-10-09 湖南沛健医疗科技有限责任公司 Operation piloting method, device, equipment, system and readable storage medium storing program for executing
CN108837283A (en) * 2018-04-12 2018-11-20 上海市东方医院 Stem bronchi cell precise positioning slow-released system
CN110584775A (en) * 2018-06-13 2019-12-20 凯勋国际股份有限公司 Airway model generation system and intubation assistance system
CN108766504A (en) * 2018-06-15 2018-11-06 上海理工大学 A kind of people of operation guiding system is because of evaluation method
CN108814717A (en) * 2018-06-29 2018-11-16 微创(上海)医疗机器人有限公司 surgical robot system
CN111508057A (en) * 2019-01-31 2020-08-07 许斐凯 Trachea model reconstruction method and system by using computer vision and deep learning technology
CN110025379A (en) * 2019-05-07 2019-07-19 新博医疗技术有限公司 A kind of ultrasound image and CT image co-registration real-time navigation system and method
CN114206251A (en) * 2019-05-31 2022-03-18 直观外科手术操作公司 System and method for integrating images captured by different imaging modalities into a composite image of a surgical space
CN110557623A (en) * 2019-08-05 2019-12-10 常州锦瑟医疗信息科技有限公司 Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system
CN112348858A (en) * 2019-08-07 2021-02-09 通用电气公司 Deformable registration of multi-modality images
CN112215843B (en) * 2019-12-31 2021-06-11 无锡祥生医疗科技股份有限公司 Ultrasonic intelligent imaging navigation method and device, ultrasonic equipment and storage medium
CN112215843A (en) * 2019-12-31 2021-01-12 无锡祥生医疗科技股份有限公司 Ultrasonic intelligent imaging navigation method and device, ultrasonic equipment and storage medium
CN111260786B (en) * 2020-01-06 2023-05-23 南京航空航天大学 Intelligent ultrasonic multi-mode navigation system and method
CN111260786A (en) * 2020-01-06 2020-06-09 南京航空航天大学 Intelligent ultrasonic multi-mode navigation system and method
CN112002018A (en) * 2020-08-18 2020-11-27 云南省第一人民医院 Intraoperative position navigation system, device and method based on mixed reality
CN113052864A (en) * 2021-03-02 2021-06-29 四川大学 Method for predicting body appearance after plastic surgery based on machine learning
CN113143217A (en) * 2021-05-07 2021-07-23 张育青 Method and system for predicting human body sound production effect
CN113143217B (en) * 2021-05-07 2024-01-26 张育青 Method and system for predicting sounding effect of human body
CN113856067A (en) * 2021-09-08 2021-12-31 中山大学 Multi-mode data fusion radiotherapy position determination method and auxiliary robot system
CN114305684A (en) * 2021-12-06 2022-04-12 南京航空航天大学 Autonomous multi-degree-of-freedom scanning type endoscope minimally invasive surgery navigation device and system thereof
CN114305684B (en) * 2021-12-06 2024-04-12 南京航空航天大学 Autonomous multi-degree-of-freedom scanning type endoscope minimally invasive surgery navigation device and system thereof
CN114391918A (en) * 2022-01-19 2022-04-26 南华大学附属第一医院 Hepatobiliary surgery calculus removing equipment with scene construction effect and imaging system

Also Published As

Publication number Publication date
CN103371870B (en) 2015-07-29

Similar Documents

Publication Publication Date Title
CN103371870B (en) A kind of surgical navigation systems based on multimode images
US10055848B2 (en) Three-dimensional image segmentation based on a two-dimensional image information
US20160163105A1 (en) Method of operating a surgical navigation system and a system using the same
EP2950735B1 (en) Registration correction based on shift detection in image data
CN107067398B (en) Completion method and device for missing blood vessels in three-dimensional medical model
JPH09508994A (en) Image forming apparatus and method
JP2011212301A (en) Projection image generation apparatus and method, and program
JP2021510107A (en) Three-dimensional imaging and modeling of ultrasound image data
Pandey et al. Fast and automatic bone segmentation and registration of 3D ultrasound to CT for the full pelvic anatomy: a comparative study
CN115105207A (en) Operation holographic navigation method and system based on mixed reality
EP3328305B1 (en) Microscope tracking based on video analysis
CN109350059B (en) Combined steering engine and landmark engine for elbow auto-alignment
EP3110335B1 (en) Zone visualization for ultrasound-guided procedures
US20240104733A1 (en) Systems and methods to process electronic medical images for diagnostic or interventional use
CN114283179A (en) Real-time fracture far-near end space pose acquisition and registration system based on ultrasonic images
US11869216B2 (en) Registration of an anatomical body part by detecting a finger pose
US11430203B2 (en) Computer-implemented method for registering low dimensional images with a high dimensional image, a method for training an aritificial neural network useful in finding landmarks in low dimensional images, a computer program and a system for registering low dimensional images with a high dimensional image
US20230149092A1 (en) Systems and methods for compensating for obstructions in medical images
US20230016429A1 (en) Using a current workflow step for control of medical data processing
Hao et al. Development and preliminary testing of a prior knowledge-based visual navigation system for cardiac ultrasound scanning
Manning et al. Surgical navigation
CN116966450A (en) Focusing ultrasonic noninvasive ablation device, and ablation preoperative planning method and system
WO2023110134A1 (en) Detection of positional deviations in patient registration
JP2021045341A (en) Arthroscopic surgery support device, arthroscopic surgery support method, and program
De Paolis et al. Human anatomy visualization and navigation system for image-guided surgery

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20170912

Address after: 215028, room 20, 523, Northwest District, nano City, 99 Jinji Lake Road, Suzhou Industrial Park, Jiangsu, China

Patentee after: SUZHOU ZHONGKE ADVANCED TECHNOLOGY RESEARCH INSTITUTE Co.,Ltd.

Address before: Room office building No. 1068 Shenzhen Institute of advanced technology A-301 518000 in Guangdong city of Shenzhen province Nanshan District Shenzhen University city academy Avenue

Patentee before: Shenzhen shen-tech advanced Cci Capital Ltd.

Effective date of registration: 20170912

Address after: Room office building No. 1068 Shenzhen Institute of advanced technology A-301 518000 in Guangdong city of Shenzhen province Nanshan District Shenzhen University city academy Avenue

Patentee after: Shenzhen shen-tech advanced Cci Capital Ltd.

Address before: 1068 No. 518055 Guangdong city in Shenzhen Province, Nanshan District City Xili University School Avenue

Patentee before: SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210617

Address after: 215123 Room 201, building 1, 333 Xingpu Road, Suzhou Industrial Park, Jiangsu Province

Patentee after: Suzhou zhongkehuaying Health Technology Co.,Ltd.

Address before: Room 523, building 20, northwest of nano City, 99 Jinjihu Avenue, Suzhou Industrial Park, Jiangsu Province, 215028

Patentee before: SUZHOU ZHONGKE ADVANCED TECHNOLOGY RESEARCH INSTITUTE Co.,Ltd.