360-DFPE: Leveraging Monocular 360-Layouts for
Direct Floor Plan Estimation

Bolivar Solarte*1 , Yueh-Cheng Liu*1 , Chin-Hsuan Wu1 , Yi-Hsuan Tsai2 , Min Sun1

1 National Tsing Hua University, 2 Phiar Technologies

Accepted to IEEE RA-L 2022

NTHU - VSLAB

Abstract

We present 360-DFPE, a sequential floor plan estimation method that directly takes 360-images as input without relying on active sensors or 3D information. Our approach leverages a loosely coupled integration between a monocular visual SLAM solution and a monocular 360-room layout approach, which estimate camera poses and layout geometries, respectively. Since our task is to sequentially capture the floor plan using monocular images, the entire scene structure, room instances, and room shapes are unknown. To tackle these challenges, we first handle the scale difference between visual odometry and layout geometry via formulating an entropy minimization process, which enables us to directly align 360-layouts without knowing the entire scene in advance. Second, to sequentially identify individual rooms, we propose a novel room identification algorithm that tracks every room along the camera exploration using geometry information. Lastly, to estimate the final shape of the room, we propose a shortest path algorithm with an iterative coarse-to-fine strategy, which improves prior formulations with higher accuracy and faster run-time. Moreover, we collect a new floor plan dataset with challenging large-scale scenes, providing both point clouds and sequential 360-image information. Experimental results show that our monocular solution achieves favorable performance against the current state-of-the-art algorithms that rely on active sensors and require the entire scene reconstruction data in advance. Our code and dataset will be released soon.

This is the teaser of this project

Paper & Code

arXiv Code & Dataset

Method Overview

Real World Result

Citation

@ARTICLE{9772341,
    author={Solarte, Bolivar and Liu, Yueh-Cheng and Wu, Chin-Hsuan and Tsai, Yi-Hsuan and Sun, Min},
    journal={IEEE Robotics and Automation Letters}, 
    title={360-DFPE: Leveraging Monocular 360-Layouts for Direct Floor Plan Estimation}, 
    year={2022},
    volume={7},
    number={3},
    pages={6503-6510},
    doi={10.1109/LRA.2022.3173730}}
}