Multimodal cell foundation models require synergistic integration beyond alignment
Biologists have AI models trained on single kinds of cell data, such as microscope images of tissue or readouts of which genes are active.
Why it matters Combining tissue images with gene activity data helps only when the pair reveals what neither shows alone, and common methods often miss exactly that.
Datasets pairing both kinds are scarce, so a common shortcut joins two ready-made models. Does the pair reveal anything the stronger model did not know? The authors introduce a score for the information that appears only when the two kinds of data are considered together. They show that the usual way of joining models mostly picks up what the two already share and misses what only the pair reveals. Across ten joining methods, a single model was enough for simple tasks, while defining complex cell neighbourhoods gained from methods built for the extra information.
Richter et al., Nature Machine Intelligence, 9 November 2026. doi:10.1038/s42256-026-01328-3
Read the paper: Multimodal cell foundation models require synergistic integration beyond alignment


















