Multiple imaging modalities are commonly jointly used for investigating biological phenomena or diagnosis purposes. In this study, we propose a deep-learning-based cross-modality imaging technique that utilizes one imaging modality to computationally predict another. A novel neural network architecture, featuring recurrent multi-stage refinement controlled by gated activation, was developed for this purpose. To demonstrate the effectiveness of the proposed method, we conducted experiments on predicting organelle fluorescence images from stimulated Raman scattering (SRS) imaging. The results of the experiments indicate that our method outperforms the current state-of-the-art techniques across multiple datasets, in terms of both accuracy and efficiency. The neural network architecture was able to produce high-quality predictions with clear boundaries and high prediction accuracy through the multi-stage refinement process. The proposed method presents a versatile framework that addresses the limitations of current deep-learning-enabled cross-modality image prediction techniques and has potential applications in the field of medical and biological imaging.
|