paper
arXiv cs.CV
November 9th, 2026 at 5:00 AM

Emergence of a Shared Canonical Object Frame from In-the-Wild Videos

arXiv:2606.30058v2 Announce Type: replace Abstract: Comparing object orientations and positions across different instances requires their poses to be expressed in a shared canonical frame. Establishing such frames has traditionally required manual annotation, creating a scaling bottleneck that limits category and instance diversity. We show that a shared canonical frame can instead emerge from self-supervised training on object-centric videos of rigid objects captured in the wild, using only noisy camera poses from Structure-from-Motion. Our key idea is to route all training sequences through a shared geometric bottleneck: a coarse canonical mesh that carries no category-specific detail. By learning dense correspondences from image pixels to this mesh, and estimating per-sequence alignments from noisy SfM geometry, a common canonical frame emerges from multi-view consistency and the semantic priors of the feature extractor, without any canonical pose labels or category conditioning. Trained in a self-supervised manner on ${\sim}160{,}000$ in-the-wild object videos, our method achieves competitive accuracy on category-level pose estimation benchmarks compared to methods that rely on canonical pose supervision. The code and checkpoint are available on \href{https://github.com/Fischer-Tom/Emergent-Canonical-Frame/}{github.com/Fischer-Tom/Emergent-Canonical-Frame/}.

#ai
#open_source

Get stories like this every Monday

The week's most important AI news in one email. Free, unsubscribe anytime.

Score: 2.88

Engagement proxy: 0

Canonical link: https://arxiv.org/abs/2606.30058