News!

You can find more previous news and highlights.

Research Projects

Fluoroscopic Navigation for Continuum Manipulator

- TBME 2021 paper
- IPCAI 2019 paper
- Oral slide
- Recorded oral presentation

Brief Intro: We present an image-based navigation solution for a surgical robotic system with a Continuum Manipulator~(CM). Our navigation system uses only fluoroscopic images from a mobile C-arm to estimate the CM shape and pose with respect to the bone anatomy. The CM pose and shape estimation is achieved using image intensity-based 2D/3D registration. A learning-based framework is used to automatically detect the CM in X-ray images, identifying landmark features that are used to initialize and regularize image registration. We also propose a modified hand-eye calibration method that numerically optimizes the hand-eye matrix during image registration. The proposed navigation system for CM positioning was tested in simulation and cadaveric studies.

ProST: Projective Spatial Transformers

- MICCAI2020
- Oral Video
- Github

Brief Intro: We propose a novel Projective Spatial Transformer module that generalizes spatial transformers to projective geometry, thus enabling differentiable volume rendering. We demonstrate the usefulness of this architecture on the example of 2D/3D registration between radiographs and CT scans. Specifically, we show that our transformer enables end-to-end learning of an image processing and projection model that approximates an image similarity function that is convex with respect to the pose parameters, and can thus be optimized effectively using conventional gradient descent.

Robot-Assisted Femoroplasty

- TMRB paper
- SPIE2020 paper
- Oral slide
- Recorded oral presentation

Brief Intro: Femroplasty is a proposed therapeutic method for preventing osteoporotic hip fractures in elderly. Patient-specific femoroplasty requires accurate 3D pose estimation of the proximal femur and injection device positioning. We proposed a fiducial-free 2D/3D registration method for robot-assisted femoroplasty system navigation.

SyntheX

- ArxiV Preprint

Brief Intro: We proposed a synthetic training data generation pipeline for machine learning X-ray image analysis tasks, which we refer to as SyntheX. We demonstrated the clinical applications of SyntheX on two downstream tasks, namely hip imaging and surgical robotic tool detection. Through conducting precisely controlled experiments on a unique pelvic benchmark dataset, we isolated and quantified the role of domain shift in the deterioration of machine learning model performance from training in simulation to deployment on real data.

Autonomous Spinal Robot

- Global Spine Journal

Brief Intro: We present an autonomous robotic spine needle injection system using fluoroscopic image-based navigation. Our system includes patient-specific planning, intra-operative image-based 2D/3D registration and navigation, and automatic robot-guided needle injection. We performed intensive simulation studies to validate the registration accuracy. During injections, all needle tips were placed within the defined safety zones for this application. The results suggest the feasibility of using our image-guided robotic injection system for spinal orthopedic applications.

Surgical Force Prediction

- MICCAI 2018 CARE workshop paper - Best Paper Award! (second place)
- Oral slide
- Github

Brief Intro: Robotic surgery has been proven to offer clear advantages during surgical procedures, however, one of the major limitations is obtaining haptic feedback. Since it is often challenging to devise a hardware solution with accurate force feedback, we propose the use of “visual cues” to infer forces from tissue deformation. We employ deep learning to infer forces from video as an attractive low-cost and accurate alternative to typically complex and expensive hardware solutions with RGB-Point Cloud Temporoal Convolutional Networks.

Publications

Conference

  • Gao, C., Liu, X., Gu, W., Armand, M., Taylor, R., Unberath, M. (2020) Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registration. International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2020.
    [bibtex] [publisher]
  • Gao, C., Grupp, R., Unberath, M., Taylor, R., Armand, M. (2020) Fiducial-Free 2D/3D Registration of the Proximal Femur for Robot-Assisted Femoroplasty. Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, SPIE2020. Oral.
    [bibtex] [publisher] [pdf] [slide] [video recordings]
  • Gu., W, Gao, C., Grupp, R., Fotouhi, J., Thies, M., Navab, N., Armand, M., Unberath, M., (2020) Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients. MIML2020.
  • Zaech, J.N., Gao, C., Bier, B., Taylor, R.H., Maier, A., Navab, N. and Unberath, M. (2019) Learning to Avoid Poor Images: Towards Task-aware C-arm Cone-beam CT Trajectories. International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2019. Oral, NIH Travel Award!.
    [bibtex] [publisher] [pdf]
  • Gao, C.*, Unberath, M.*, Taylor, R.H. and Armand, M. (2019) Localizing dexterous surgical tools in X-ray for image-based navigation. Information Processing in Computer-Assisted Interventions, IPCAI 2019. Oral.
    [bibtex] [publisher] [pdf] [slide] [poster] [video recordings]
  • Gao, C., Liu, X., Peven, M., Unberath, M., and Reiter, A. (2018) Learning to See Forces: Surgical Force Prediction with RGB-Point Cloud Temporal Convolutional Networks. Computer Assisted and Robotic Endoscopy, MICCAI workshop 2018. Oral, Best Paper Award! (second place).
    [bibtex] [publisher] [pdf] [ slide]
  • Alambeigi, F., Wang, Y., Sefati, S., Gao, C., Murphy, R.J., Iordachita, I., Taylor, R.H., Khanuja, H. and Armand, M. (2017) A curved-drilling approach in core decompression of the femoral head osteonecrosis using a continuum manipulator. IEEE Robotics and Automation Letters, ICRA 2017.
    [bibtex] [publisher] [pdf]
  • Du, H., Ouyang, M., Gao, C., Hong, B., Yang, H., Wang, Y. and Huang, H. (2016) Line Propagation Based On FDT Probabilistic Tracking (LP-FPT) Organization for Human Brian Mapping Poster, OHBM 2016. [pdf]
  • Shen, W., Wang, B., Feng, J., Gao, C. and Ma, J., 2015, May. Differential CSIT acquisition based on compressive sensing for FDD massive MIMO systems. In 2015 IEEE 81st Vehicular Technology Conference, VTC Spring. [pdf]

Journal

  • Gao, C., Phalen, H., Sefati, S., Ma, J.H., Ma, L., Taylor, R. H., Unberath, M., & Armand, M. (2021). Fluoroscopic Navigation for a Surgical Robotic System including a Continuum Manipulator. IEEE Transactions on Biomedical Engineering, Jul. 2021, doi: 10.1109/TBME.2021.3097631
    [bibtex] [publisher]
  • Gao, C., Farvardin, A., Grupp, R., Bakhtiarinejad, M., Ma, L., Thies, M., Unberath, M., Taylor, R., Armand, M. (2020) Fiducial-Free 2D/3D Registration for Robot-Assisted Femoroplasty IEEE Transactions on Medical Robotics and Bionics, vol. 2, no. 3, pp. 437-446, Aug. 2020, doi: 10.1109/TMRB.2020.3012460.
    [bibtex] [publisher]
  • Unberath, M., Gao, C., Hu, Y., Judish, M., Armand, M. & Unberath, M. (2021). The Impact of Machine Learning on 2D/3D Registration for Image-guided Interventions: A Review and Perspective. Frontiers in AI and Robotics.
    [bibtex]
  • Sefati, S., Gao, C., Iordachita, I., Taylor, R.H. and Armand, M. (2020) Data-Driven Shape Sensing of Continuum Manipulators in Constrained Spaces Via Deep Neural Networks Using Fiber Bragg Grating. IEEE Sensors Journal (2020).
    [bibtex] [publisher]
  • Thies, M.*, Zaech, J.N.*, Gao, C., Taylor, R.H., Navab, N., Maier, A. and Unberath, M. (2020) A Learning-based Method for Online Adjustment of C-arm Cone-Beam CT Source Trajectories for Artifact Avoidance. Int J CARS (2020). https://doi.org/10.1007/s11548-020-02249-1. Special Issue Best Paper Nominee
    [bibtex] [publisher]
  • Grupp, R., Unberath, M., Gao, C., Hegeman, R., Murphy, R., Alenxander, C., Otake, Y., McArthur, B., Armand, M., Taylor, R. (2020) Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration. Int J CARS 15, 759–769 (2020). https://doi.org/10.1007/s11548-020-02162-7. IPCAI2020 Special Issue
    [bibtex] [publisher] [pdf]
  • Margalit, A., Phalen, H., Gao, C., Ma, J., Suresh, K., Jain P., Farvardin, A., Taylor, R.H., Armand, M., Chattre, A., & Jain, A. (2021). Autonomous Spinal Robotic System for Transforaminal Lumbar Epidural Injections: A Proof of Concept of Study. Global Spine Journal (2022): 21925682221096625
    [bibtex] [publisher]
  • Unberath, M.*, Zaech, J.N.*, Gao, C.*, Bier, B., Goldmann, F., Lee, S.C., Fotouhi, J., Taylor, R.H., Armand, M. and Navab, N. (2019) Enabling Machine Learning in X-ray-based Procedures via Realistic Simulation of Image Formation International journal of computer assisted radiology and surgery, IJCARS 2019. Invited Special Issue
    [bibtex] [publisher] [pdf]
  • Chen, F., Zhao, Z., Gao, C., Liu, J., Su, X., Zhao, J., Tang, P. and Liao, H. (2017) Clustering of morphological features for identifying femur cavity subtypes with difficulties of intramedullary nail implantation. IEEE journal of biomedical and health informatics, 22(4), pp.1209-1217.
    [bibtex] [publisher] [pdf]

Peer Review

  • Gao, C., Hu, Y., Killeen, B., Taylor, R. H., Armand, M. & Unberath, M. (2021). SyntheX: Scaling UpLearning-based Interventional X-ray Image Processing. Nature Machine Intelligence - Under Review.
  • Gao, C.*, Phalen, H.*, Margalit, A., Ma, J., Ku, P., Unberath, M., Taylor, R. H., Jain., A. & Armand, M. (2021). SFluoroscopy-Guided Robotic System for Transforaminal Lumbar Epidural Injections. TMRB - Under Review.