Lecture series: Particularity and Challenges of Machine Learning for Intra-operative Imaging

Particularity and Challenges of Machine Learning for Intra-operative Imaging

Towards precision and Intelligence in high intensity, dynamic environments

Lecture in English

Over the past decade, the rapid advancements in machine learning (ML) have revolutionized various fields, significantly impacting our lives. In this talk, we will delve into the realm of medical applications and explore the challenges and opportunities associated with integrating these cutting-edge technologies into computer-assisted interventions. Our primary focus will be on fostering acceptance and trust in machine learning and robotic solutions within the medical domain, which often necessitates the path through Intelligence Amplification (IA). Augmented Reality (AR) allows us to leverage IA to augment human intelligence and expertise, ultimately paving the way for the seamless integration of Artificial Intelligence (AI) and robotics into clinical solutions.

Drawing from some groundbreaking research conducted at the Chair of Computer-Aided Medical Procedures at both TU Munich and Johns Hopkins Universities, I will present a series of novel techniques developed to address the unique demands of medical applications. Specifically, we will explore their practical implementations in diverse areas, including Robotic Ultrasound Imaging, Multimodal Data Analysis, and Semantic Scene Graphs for Holistic Modeling of Surgical Domain. Furthermore, I will showcase compelling examples of how AR-solutions can serve as catalysts for embracing AI in computer-assisted surgery. By harnessing the power of IA, we can unlock the full potential of AI technologies, bolstering acceptance and driving the future of computer-assisted interventions. Join me on this enlightening journey as we navigate the intricate intersection of machine learning, medical advancements, and the path from intelligence amplification to artificial intelligence in healthcare.

About Prof. Dr. Nassir Navab

Prof. Dr. Nassir Navab is a full professor and director of the Laboratories for Computer Aided Medical Procedures (CAMP) at Technical University of Munich (TUM) and an adjunct Professor at Johns Hopkins University. He is also the director of biannual Medical Augmented Reality school series at Balgrist Hospital in Zurich. He is a Member of Academia Europaea and received the prestigious MICCAI Enduring Impact Award in 2021 and IEEE ISMAR 10 Years Lasting Impact Award in 2015. In 2001, while acting as distinguished member of technical staff at Siemens Corporate Research (SCR) in Princeton, he received the prestigious Siemens Inventor of the Year Award for the body of his work in interventional imaging. He also received the SMIT Technology Innovation Award in 2010. He is also honored as Medical AR Pioneer in AWE XR hall of fame in 2024. His students have received many paper awards including 15 awards at the prestigious MICCAI events, 5 at IPCAI, 2 at IPMI and 4 at IEEE ISMAR. He is Fellow of the MICCAI Society and acted on its board of directors from 2007 to 2012 and from 2014 to 2017. He is also an IEEE Fellow and Fellow of Asia-Pacific Artificial Intelligence Association (AAIA) and one of the founders of IEEE Symposium on Mixed and Augmented Reality (ISMAR) and has been serving on its Steering Committee since 2001. He is an Area Chair for ECCV 2024. He is the author of hundreds of peer reviewed scientific papers and over 100 granted US and international patents. As of April 2024, his papers have received over 76,600 citations and enjoy an h-index of 117.