Fidelity imposed network edit (FINE) for solving ill-posed image reconstruction.

TitleFidelity imposed network edit (FINE) for solving ill-posed image reconstruction.
Publication TypeJournal Article
Year of Publication2020
AuthorsZhang J, Liu Z, Zhang S, Zhang H, Spincemaille P, Nguyen TD, Sabuncu MR, Wang Y
JournalNeuroimage
Volume211
Pagination116579
Date Published2020 May 01
ISSN1095-9572
KeywordsAdult, Brain, Cerebral Hemorrhage, Computer Simulation, Deep Learning, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Multiple Sclerosis, Neuroimaging
Abstract

Deep learning (DL) is increasingly used to solve ill-posed inverse problems in medical imaging, such as reconstruction from noisy and/or incomplete data, as DL offers advantages over conventional methods that rely on explicit image features and hand engineered priors. However, supervised DL-based methods may achieve poor performance when the test data deviates from the training data, for example, when it has pathologies not encountered in the training data. Furthermore, DL-based image reconstructions do not always incorporate the underlying forward physical model, which may improve performance. Therefore, in this work we introduce a novel approach, called fidelity imposed network edit (FINE), which modifies the weights of a pre-trained reconstruction network for each case in the testing dataset. This is achieved by minimizing an unsupervised fidelity loss function that is based on the forward physical model. FINE is applied to two important inverse problems in neuroimaging: quantitative susceptibility mapping (QSM) and under-sampled image reconstruction in MRI. Our experiments demonstrate that FINE can improve reconstruction accuracy.

DOI10.1016/j.neuroimage.2020.116579
Alternate JournalNeuroimage
PubMed ID31981779
PubMed Central IDPMC7093048
Grant ListR01 LM012719 / LM / NLM NIH HHS / United States
R01 AG053949 / AG / NIA NIH HHS / United States
S10 OD021782 / OD / NIH HHS / United States
R01 NS105144 / NS / NINDS NIH HHS / United States
R21 AG050122 / AG / NIA NIH HHS / United States
R01 NS095562 / NS / NINDS NIH HHS / United States
R01 NS090464 / NS / NINDS NIH HHS / United States
R01 CA181566 / CA / NCI NIH HHS / United States

Weill Cornell Medicine Neurology 525 E. 68th St.
PO Box 117
New York, NY 10065 Phone: (212) 746-6575