GitHub

Rethinking Multi-modal Object Detection from the Perspective of Mono-Modality Feature Learning

This repository is the official Pytorch implementation for the paper Rethinking Multi-modal Object Detection from the Perspective of Mono-Modality Feature Learning. If you have any questions, please ...
IEEE

RingMoE: Mixture-of-Modality-Experts Multi-Modal Foundation Models for Universal Remote Sensing Image Interpretation

Abstract: The rapid advancement of foundation models has revolutionized visual representation learning in a self-supervised manner. However, their application in remote sensing (RS) remains ...
GitHub

MINIMA: Modality Invariant Image Matching

1 Huazhong University of Science & Technology, 2 Wuhan University. Image matching for both cross-view and cross-modality plays a critical role in multimodal perception. In practice, the modality gap ...
IEEE

Multi-Sensor Learning Enables Information Transfer Across Different Sensory Data and Augments Multi-Modality Imaging

Abstract: Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is ...