Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matching

Published in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024

Lennart Bastian, Yizheng Xie, Nassir Navab, Zorah Lähner

Teaser Image

Abstract

With the wide adaption of deep learning and pre-trained models rises the question of how to effectively reuse existing latent spaces for new applications. One important question is how the geometry of the latent space changes in-between different training runs of the same architecture and different architectures trained for the same task. Previous works proposed that the latent spaces for similar tasks are approximately isometric. However, in this work we show that method restricted to this assumption perform worse than when just using a linear transformation to align the latent spaces. We propose directly computing a transformation between the latent codes of different architectures which is more efficient than previous approaches and flexible wrt. to the type of transformation used. Our experiments show that aligning the latent space with a linear transformation performs best while not needing more prior knowledge.

Resources

[arxiv]

Bibtex

@inproceedings{bastian2023hybrid,
    author 	= {Lennart Bastian and Yizheng Xie and Nassir Navab and Zorah Lähner},
    title 	= { Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matching },
    booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
    year 	= 2024,
}