当前位置: X-MOL 学术Nat. Methods › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Pretraining a foundation model for generalizable fluorescence microscopy-based image restoration
Nature Methods ( IF 48.0 ) Pub Date : 2024-04-12 , DOI: 10.1038/s41592-024-02244-3
Chenxi Ma , Weimin Tan , Ruian He , Bo Yan

Fluorescence microscopy-based image restoration has received widespread attention in the life sciences and has led to significant progress, benefiting from deep learning technology. However, most current task-specific methods have limited generalizability to different fluorescence microscopy-based image restoration problems. Here, we seek to improve generalizability and explore the potential of applying a pretrained foundation model to fluorescence microscopy-based image restoration. We provide a universal fluorescence microscopy-based image restoration (UniFMIR) model to address different restoration problems, and show that UniFMIR offers higher image restoration precision, better generalization and increased versatility. Demonstrations on five tasks and 14 datasets covering a wide range of microscopy imaging modalities and biological samples demonstrate that the pretrained UniFMIR can effectively transfer knowledge to a specific situation via fine-tuning, uncover clear nanoscale biomolecular structures and facilitate high-quality imaging. This work has the potential to inspire and trigger new research highlights for fluorescence microscopy-based image restoration.



中文翻译:

预训练基于通用荧光显微镜图像恢复的基础模型

基于荧光显微镜的图像恢复在生命科学领域受到了广泛关注,并得益于深度学习技术取得了重大进展。然而,当前大多数特定任务的方法对于不同的基于荧光显微镜的图像恢复问题的通用性有限。在这里,我们寻求提高通用性并探索将预训练基础模型应用于基于荧光显微镜的图像恢复的潜力。我们提供了一种通用的基于荧光显微镜的图像恢复(UniFMIR)模型来解决不同的恢复问题,并表明 UniFMIR 提供更高的图像恢复精度、更好的泛化性和增强的多功能性。对涵盖广泛显微镜成像模式和生物样本的五项任务和 14 个数据集的演示表明,预训练的 UniFMIR 可以通过微调有效地将知识转移到特定情况,揭示清晰的纳米级生物分子结构并促进高质量成像。这项工作有可能激发和引发基于荧光显微镜的图像恢复的新研究亮点。

更新日期:2024-04-12
down
wechat
bug