Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

Abstract

Fluorescence lifetime imaging microscopy (FLIM) provides detailed information about molecular interactions and biological processes. A major bottleneck for FLIM is image resolution at high acquisition speeds due to the engineering and signal-processing limitations of time-resolved imaging technology. Here, we present single-sample image-fusion upsampling, a data-fusion approach to computational FLIM super-resolution that combines measurements from a low-resolution time-resolved detector (that measures photon arrival time) and a high-resolution camera (that measures intensity only). To solve this otherwise ill-posed inverse retrieval problem, we introduce statistically informed priors that encode local and global correlations between the two “single-sample” measurements. This bypasses the risk of out-of-distribution hallucination as in traditional data-driven approaches and delivers enhanced images compared, for example, to standard bilinear interpolation. The general approach laid out by single-sample image-fusion upsampling can be applied to other image super-resolution problems where two different datasets are available.

People
Kapitany, Valentin
Author

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

See full publications list
Fatima, Areeba
Author

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

See full publications list
Zickus, Vytautas
Author

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

See full publications list
Whitelaw, Jamie
Author

Nikolaou, Savvas and Juin, Amelie and Whitelaw, Jamie A. and Paul, Nikki R. and Fort, Loic and Nixon, Colin and Spence, Heather J. and Bryson, Sheila and Machesky, Laura M. (2024) CYRI-B-mediated macropinocytosis drives metastasis via lysophosphatidic acid receptor uptake. eLife, 13: e83712. ISSN 2050-084X

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

See full publications list
McGhee, Ewan
Author

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

See full publications list
Insall, Robert
Author

Farndale, Lucas and Insall, Robert and Yuan, Ke (2025) TriDeNT: Triple deep network training for privileged knowledge distillation in histopathology. Medical Image Analysis, 102: 103479. ISSN 1361-8415

Mandrou, Elena and Thomason, Peter A. and Paschke, Peggy I. and Paul, Nikki R. and Tweedy, Luke and Insall, Robert (2024) A reliable system for quantitative g-protein activation imaging in cancer cells. Cells, 13 (13): 1114. ISSN 2073-4409

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

See full publications list
Machesky, Laura
Author

Nikolaou, Savvas and Juin, Amelie and Whitelaw, Jamie A. and Paul, Nikki R. and Fort, Loic and Nixon, Colin and Spence, Heather J. and Bryson, Sheila and Machesky, Laura M. (2024) CYRI-B-mediated macropinocytosis drives metastasis via lysophosphatidic acid receptor uptake. eLife, 13: e83712. ISSN 2050-084X

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

Juin, Amelie and Spence, Heather J. and Machesky, Laura M. (2024) Dichotomous role of the serine/threonine kinase MAP4K4 in pancreatic ductal adenocarcinoma onset and metastasis through control of AKT and ERK pathways. Journal of Pathology, 262 (4). pp. 454-466. ISSN 0022-3417

See full publications list
Faccio, Daniele
Author

Kapitany, Valentin and Fatima, Areeba and Zickus, Vytautas and Whitelaw, Jamie and McGhee, Ewan and Insall, Robert and Machesky, Laura and Faccio, Daniele (2024) Single-sample image-fusion upsampling of fluorescence lifetime images. Science Advances, 10 (21): eadn0139. ISSN 2375-2548

See full publications list
Texts
281:289
lightbox image
324532.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB) | Preview
Information
Library

View Item