[en] Current neuronavigation systems cannot adapt to changing intraoperative conditions over time. To overcome this limitation, we present an experimental end-to-end system capable of updating 3D preoperative images in the presence of brain shift and successive resections. The heart of our system is a nonrigid registration technique using a biomechanical model, driven by the deformations of key surfaces tracked in successive intraoperative images. The biomechanical model is deformed using FEM or XFEM, depending on the type of deformation under consideration, namely brain shift or resection. We describe the operation of our system on two patient cases, each comprising ¯ve intraoperative MR images, and demonstrate that our approach significantly improves the alignment of nonrigidly registered images.
Disciplines :
Laboratory medicine & medical technology Engineering, computing & technology: Multidisciplinary, general & others Mechanical engineering
Author, co-author :
Vigneron, Lara
Noels, Ludovic ; Université de Liège - ULiège > Département d'aérospatiale et mécanique > Computational & Multiscale Mechanics of Materials (CM3)
Warfield, Simon; Harvard Medical School, Harvard Medical School > Computational Radiology Laboratory
Verly, Jacques ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Exploitation des signaux et images
Robe, Pierre ; Université de Liège - ULiège > Département des sciences biomédicales et précliniques > Département des sciences biomédicales et précliniques
Language :
English
Title :
Serial FEM/XFEM-Based Update of Preoperative Brain Images Using Intraoperative MRI
Comeau R. M., Sadikot A. F., Fenster A., Peters T. M., Intraoperative ultrasound for guidance and tissue shift correction in image-guided neurosurgery Medical Physics 2000 27 4 787 800 (Pubitemid 30227057)
Hastreiter P., Rezk-Salama C., Soza G., Bauer M., Greiner G., Fahlbusch R., Ganslandt O., Nimsky C., Strategies for brain shift evaluation Medical Image Analysis 2004 8 4 447 464 (Pubitemid 39625027)
Dickhaus H., Ganser K. A., Staubert A., Bonsanto M. M., Wirtz C. R., Tronnier V. M., Kunze S., Quantification of brain shift effects by MR-imaging Proceedings of the 1997 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society November 1997 491 494
Hartkens T., Hill D. L. G., Castellano-Smith A. D., Hawkes D. J., Maurer C. R., Martin A. J., Hall W. A., Liu H., Truwit C. L., Measurement and analysis of brain deformation during neurosurgery IEEE Transactions on Medical Imaging 2003 22 1 82 92
Nabavi A., McL B. P., Gering D. T., Westin C. F., Mehta V., Pergolizzi R. S., Ferrant M., Warfield S. K., Hata N., Schwartz R. B., Wells W. M., Kikinis R., Jolesz F. A., Serial intraoperative magnetic resonance imaging of brain shift Neurosurgery 2001 48 4 787 798 (Pubitemid 32268088)
Audette M. A., Siddiqi K., Ferrie F. P., Peters T. M., An integrated range-sensing, segmentation and registration framework for the characterization of intra-surgical brain deformations in image-guided surgery Computer Vision and Image Understanding 2003 89 2-3 226 251
Archip N., Clatz O., Whalen S., Kacher D., Fedorov A., Kot A., Chrisochoides N., Jolesz F., Golby A., Black P. M., Warfield S. K., Non-rigid alignment of pre-operative MRI, fMRI, and DT-MRI with intra-operative MRI for enhanced visualization and navigation in image-guided neurosurgery NeuroImage 2007 35 2 609 624 (Pubitemid 46400543)
Jannin P., Morandi X., Fleig O. J., Le Rumeur E., Toulouse P., Gibaud B., Scarabin J. M., Integration of sulcal and functional information for multimodal neuronavigation Journal of Neurosurgery 2002 96 4 713 723 (Pubitemid 34245627)
Tei A., Talos F., Bharatha A., Tracking volumetric brain deformations during image guided neurosurgery VISIM: Information Retrieval and Exploration in Large Medical Image Collections, in Conjunction with (MICCAI '01) 2001
Warfield S. K., Talos F., Kemper C., Cosman E., Tei A., Ferrant M., Macq B., Wells W. M., Black P. M., Jolesz F. A., Kikinis R., Augmenting intraoperative MRI with preoperative fMRI and DTI by biomechanical simulation of brain deformation 5029 Medical Imaging 2003: Visualization, Image-Guided Procedures, and Display February 2003 San Diego, Calif, USA Proceedings of SPIE
Bucki M., Payan Y., Framework and bio-mechanical model for a per-operative imageguided neuronavigator including brain-shift compensation Proceedings of the 2nd Workshop on Computer Assisted Diagnosis and Surgery March 2006
Clatz O., Delingette H., Talos I. F., Golby A. J., Kikinis R., Jolesz F. A., Ayache N., Warfield S. K., Robust nonrigid registration to capture brain shift from intraoperative MRI IEEE Transactions on Medical Imaging 2005 24 11 1417 1427 (Pubitemid 41619219)
Ferrant M., Nabavi A., Macq B., Black P. M., Jolesz F. A., Kikinis R., Warfield S. K., Serial registration of intraoperative MR images of the brain Medical Image Analysis 2002 6 4 337 359 (Pubitemid 35363944)
Hagemann A., Rohr K., Stiehl H. S., Coupling of fluid and elastic models for biomechanical simulations of brain deformations using FEM Medical Image Analysis 2002 6 4 375 388 (Pubitemid 35363946)
Kemper C. A., Talos I.-F., Golby A., Black P. M., Kikinis R., Grimson W. E. L., Warfield S. K., An anisotropic material model for image guided neurosurgery 3217 Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '04) 2004 267 275 (Pubitemid 40787235)
Lunn K. E., Paulsen K. D., Roberts D. W., Kennedy F. E., Hartov A., West J. D., Displacement estimation with co-registered ultrasound for image guided neurosurgery: a quantitative in vivo porcine study IEEE Transactions on Medical Imaging 2003 22 11 1358 1368
Miga M. I., Paulsen K. D., Hoopes P. J., Kennedy F. E., Hartov A., Roberts D. W., In vivo quantification of a homogeneous brain deformation model for updating preoperative images during surgery IEEE Transactions on Biomedical Engineering 2000 47 2 266 273 (Pubitemid 30091554)
Paulsen K. D., Miga M. I., Kennedy F. E., Jack Hoopes P., Hartov A., Roberts D. W., A computational model for tracking subsurface tissue deformation during stereotactic neurosurgery IEEE Transactions on Biomedical Engineering 1999 46 2 213 225 (Pubitemid 29058927)
Rexilius J., Warfield S. K., Guttmann C. R. G., A novel nonrigid registration algorithm and applications Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '01) 2001 923 931 (Pubitemid 33352499)
Roberts D. W., Miga M. I., Hartov A., Eisner S., Lemery J. M., Kennedy F. E., Paulsen K. D., Intraoperatively updated neuroimaging using brain modeling and sparse data Neurosurgery 1999 45 5 1199 1207 (Pubitemid 29517526)
krinjar O., Nabavi A., Duncan J., Model-driven brain shift compensation Medical Image Analysis 2002 6 4 361 373 (Pubitemid 35363945)
Ji S., Hartov A., Roberts D., Paulsen K., Data assimilation using a gradient descent method for estimation of intraoperative brain deformation Medical Image Analysis 2009 13 5 744 756
Sun H., Lunn K. E., Farid H., Wu Z., Roberts D. W., Hartov A., Paulsen K. D., Stereopsis-guided brain shift compensation IEEE Transactions on Medical Imaging 2005 24 8 1039 1052 (Pubitemid 41178503)
Warfield S. K., Haker S. J., Talos I. F., Kemper C. A., Weisenfeld N., Mewes A. U. J., Goldberg-Zimring D., Zou K. H., Westin C. F., Wells W. M., Tempany C. M. C., Golby A., Black P. M., Jolesz F. A., Kikinis R., Capturing intraoperative deformations: research experience at Brigham and Women's hospital Medical Image Analysis 2005 9 2 145 162 (Pubitemid 40268394)
Wittek A., Miller K., Kikinis R., Warfield S. K., Patient-specific model of brain deformation: application to medical image registration Journal of Biomechanics 2007 40 4 919 929 (Pubitemid 46273452)
Cohen-Adad J., Paul P., Morandi X., Jannin P., Knowledge modeling in image-guided neurosurgery: application in understanding intraoperative brain shift 6141 Proceedings of the Medical Imaging: Visualization, Image-Guided Procedures and Display 2006 Proceedings of SPIE
Kyriacou S. K., Mohamed A., Miller K., Neff S., Brain mechanics for neurosurgery: modeling issues Biomechanics and Modeling in Mechanobiology 2002 1 2 151 164
Miller K., Wittek A., Joldes G., Horton A., Dutta-Roy T., Berger J., Morriss L., Modelling brain deformations for computer-integrated neurosurgery International Journal for Numerical Methods in Biomedical Engineering 2010 26 1 117 138
Nienhuys H.-W., van der Stappen F. A., A surgery simulation supporting cuts and finite element deformation 2208 Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '01) 2001 153 160
Serby D., Harders M., Székely G., A new approach to cutting into finite element models 2208 Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '01) 2001 425 433 (Pubitemid 33352440)
Steinemann D., Harders M. A., Gross M., Székely G., Hybrid cutting of deformable solids Proceedings of the IEEE Computer Society Conference on Virtual Reality 2006 35 42
Bielser D., Glardon P., Teschner M., Gross M., A state machine for real-time cutting of tetrahedral meshes Graphical Models 2004 66 6 398 417 (Pubitemid 39591349)
Ganovelli F., Cignoni P., Montani C., Scopigno R., Multiresolution model for soft objects supporting interactive cuts and lacerations Computer Graphics Forum 2000 19 3 271 281
Mor A., Kanade T., Modifying soft tissue models: progressive cutting with minimal new element creation 1935 Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '00) 2000 598 607
Nienhuys H.-W., Cutting in Deformable Objects, Ph.D. thesis 2003 Institute for Information and Computing Sciences, Utrecht University
Duflot M., Nguyen-Dang H., A meshless method with enriched weight functions for fatigue crack growth International Journal for Numerical Methods in Engineering 2004 59 14 1945 1961 (Pubitemid 38462358)
Mos N., Dolbow J., Belytschko T., A finite element method for crack growth without remeshing International Journal for Numerical Methods in Engineering 1999 46 1 131 150 (Pubitemid 30508928)
Abdelaziz Y., Hamouine A., A survey of the extended finite element Computers and Structures 2008 86 11-12 1141 1151
Vigneron L. M., Duflot M. P., Robe P. A., Warfield S. K., Verly J. G., 2D XFEM-based modeling of retraction and successive resections for preoperative image update Computer Aided Surgery 2009 14 13 1 20
Vigneron L. M., Boman R. C., Ponthot J. P., Robe P. A., Warfield S. K., Verly J. G., Enhanced FEM-based modeling of brain shift deformation in image-guided neurosurgery Journal of Computational and Applied Mathematics 2010 234 7 2046 2053
Vigneron L. M., Boman R. C., Ponthot J.-P., Robe P. A., Warfield S. K., Verly J. G., 3D FEM/XFEM-based biomechanical brain modeling for preoperative image update Workshop Computational Biomechanics for Medicine II, at the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '07) 2007
Hagemann A., Rohr K., Stiehl H. S., Spetzger U., Gilsbach J. M., Biomechanical modeling of the human head for physically based, nonrigid image registration IEEE Transactions on Medical Imaging 1999 18 10 875 884 (Pubitemid 32211103)
Dubuisson M.-P., Jain A. K., A modified Hausdorff distance for object matching Proceedings of the 12th International Conference on Pattern Recognition (IAPR '94) 1994 566 568
Miga M. I., Roberts D. W., Kennedy F. E., Platenik L. A., Hartov A., Lunn K. E., Paulsen K. D., Modeling of retraction and resection for intraoperative updating of images Neurosurgery 2001 49 1 75 85 (Pubitemid 32552585)
Forest C., Delingette H., Ayache N., Cutting simulation of manifold volumetric meshes 2488 Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '02) 2002 235 244
Forest C., Delingette H., Ayache N., Removing tetrahedra from manifold tetrahedralisation: application to real-time surgical simulation Medical Image Analysis 2005 9 2 113 122 (Pubitemid 40268391)
Ferrant M., Physics-based deformable modeling of volumes and surfaces for medical image registration, segmentation and visualization, Ph.D. thesis 2001 Louvain-la-Neuve, Belgium Université Catholique de Louvain, Telecommunications Laboratory
Ferrant M., Nabavi A., Macq B., Jolesz F. A., Kikinis R., Warfield S. K., Registration of 3-D intraoperative MR images of the brain using a finite-element biomechanical model IEEE Transactions on Medical Imaging 2001 20 12 1384 1397 (Pubitemid 34125146)
Jebkov L., Kuhlen T., Stable cutting of deformable objects in virtual environments using XFEM IEEE Computer Graphics and Applications 2009 29 2 61 71
Devalkeneer A. A., Robe P. A., Verly J. G., Phillips C. L. M., Generalized expectation-maximization segmentation of brain MR images 6144 Medical Imaging 2006: Image Processing February 2006 San Diego, Calif, USA Proceedings of SPIE
Mangin J.-F., Frouin V., Bloch I., Régis J., Lpez-Krahe J., From 3D magnetic resonance images to structural representations of the cortex topography using topology preserving deformations Journal of Mathematical Imaging and Vision 1995 5 4 297 318
Warfield S. K., Kaus M., Jolesz F. A., Kikinis R., Adaptive, template moderated, spatially varying statistical classification Medical Image Analysis 2000 4 1 43 55
Geuzaine C., Remacle J.-F., Gmsh: a three-dimensional finite element mesh generator with built-in pre- and post-processing facilities International Journal for Numerical Methods in Engineering 2009 79 11 1309 1331
Miller K., Wittek A., Neuroimage registration as displacementzero traction problem of solid mechanics Workshop Computational Biomechanics for Medicine at the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '06) 2006
Kass M., Witkin A., Terzopoulos D., Snakes: active contour models International Journal of Computer Vision 1988 1 4 321 331
Xu C., Pham D. L., Prince J. L., Fitzpatrick J. M., Sonka M., Medical image segmentation using deformable models Handbook of Medical Imaging 2000 2 chapter: Medical Image Processing and Analysis Bellingham, Wash, USA SPIE Press 129 174
Zienkiewicz O. C., Taylor R. L., The Finite Element Method 2000 Woburn, Mass, USA Butterworth Heinemann
Sukumar N., Mos N., Moran B., Belytschko T., Extended finite element method for three-dimensional crack modelling International Journal for Numerical Methods in Engineering 2000 48 11 1549 1570 (Pubitemid 30617347)
Dolbow J. E., An extended finite element method with discontinuous enrichment for applied mechanics, Ph.D. thesis 1999 Northwestern University
Sukumar N., Prévost J. H., Modeling quasi-static crack growth with the extended finite element method Part I: computer implementation International Journal of Solids and Structures 2003 40 26 7513 7537 (Pubitemid 37418359)
Sukumar N., Chopp D. L., Mos N., Belytschko T., Modeling holes and inclusions by level sets in the extended finite-element method Computer Methods in Applied Mechanics and Engineering 2001 190 46-47 6183 6200 (Pubitemid 32961904)
Lunn K. E., Paulsen K. D., Lynch D. R., Roberts D. W., Kennedy F. E., Hartov A., Assimilating intraoperative data with brain shift modeling using the adjoint equations Medical Image Analysis 2005 9 3 281 293 (Pubitemid 40613526)
Belytschko T., Liu W. K., Moran B., Nonlinear Finite Elements for Continua and Structures 2000 New York, NY, USA John Wiley Sons
Miller K., Joldes G., Wittek A., New finite element algorithm for surgical simulation Proceedings of the 2nd Workshop on Computer Assisted Diagnosis and Surgery 2006
Dolbow J. E., Devan A., Enrichment of enhanced assumed strain approximations for representing strong discontinuities: addressing volumetric incompressibility and the discontinuous patch test International Journal for Numerical Methods in Engineering 2004 59 1 47 67 (Pubitemid 38078483)
Legrain G., Mos N., Verron E., Stress analysis around crack tips in finite strain problems using the eXtended finite element method International Journal for Numerical Methods in Engineering 2005 63 2 290 314 (Pubitemid 40659666)