Ranulfo Bezerra
プロジェクト

初期の研究·2019 — 2021

大規模セマンティックマッピング

カメラとLiDARを反復測量にわたり統合し、日々変化する現場のセマンティック地図を構築する。

ワールドモデルを共有する前に、そもそもそれを構築しなければならない。しかも、毎朝異なる姿を見せる建設現場の規模で。本研究ではカメラとLiDARのデータを統合して大規模セマンティックマッピングを行い、日次の航空LiDAR測量を複数回用いて稼働中の建設現場のセマンティック地図を生成した。当時も今も本質的な困難は、地図と世界が食い違うこと、そしてその食い違い自体が情報であることにある。

01/代表的な業績

3

2021

Semantic Mapping of Construction Site From Multiple Daily Airborne LiDAR Data

Thomas Westfechtel, Kazunori Ohno, Tetsu Akegawa, Kento Yamada, Ranulfo Bezerra, Shotaro Kojima, Taro Suzuki, Tomohiro Komatsu, Yukinori Shibata, Kimitaka Asano, Keji Nagatani, Naoto Miyamoto, Takahiro Suzuki, Tatsuya Harada, Satoshi Tadokoro

IEEE RA-L·論文誌

概要 +

Semantic maps are an important tool to provide robots with high-level knowledge about the environment, enabling them to better react to and interact with their surroundings. However, as a single measurement of the environment is solely a snapshot of a specific time, it does not necessarily reflect the underlying semantics. In this work, we propose a method to create a semantic map of a construction site by fusing multiple daily data. The construction site is measured by an unmanned aerial vehicle (UAV) equipped with a LiDAR. We extract clusters above ground level from the measurements and classify them using either a random forest or a deep learning based classifier. Furthermore, we combine the classification results of several measurements to generalize the classification of the single measurements and create a general semantic map of the working site. We measured two construction fields for our evaluation. The classification models can achieve an average intersection over union (IoU) score of 69.2 during classification on the Sanbongi field, which is used for training, validation and testing and an IoU score of 49.16 on a hold-out testing field. In a final step, we show how the semantic map can be employed to suggest a parking spot for a dump truck, and in addition, show that the semantic map can be utilized to improve path planning inside the construction site.

DOI

2019

Large Scale Semantic Mapping Through Multi-modal Sensor Fusion

Thomas Westfechtel, Kazunori Ohno, Ranulfo Bezerra, Shotaro Kojima, Satoshi Tadokoro

RSJ 2019·国内会議