Fusion or Confusion? Potential and Challenges in Fusion of Onboard Sensors and V2X Data in Cooperative Perception

Amir Mohammadisarab, Miguel Sepulcre, Luca Lusvarghi, Sergei S. Avedisov, Mohammad Irfan Khan, Takayuki Shimizu, Onur Altintas, Javier Gozalvez

Connected Automated Vehicles (CAVs) utilize their onboard sensors to perceive the environment. The perception range and accuracy can be affected by adverse weather or non-line-of-sight conditions. Cooperative perception or sensor sharing can overcome these limitations by enabling CAVs to exchange sensor data, thus collectively enhancing their perception capabilities. Previous studies have shown the potential of cooperative perception, but limited attention has been given to the fusion of V2X data received through cooperative perception messages with onboard sensor information. The fusion process can be influenced by the quantity and quality of the V2X data. An increased volume of V2X data can reduce uncertainty in the perceived environment; however, when the data is noisy, it may compromise the accuracy of the fusion results. This study investigates the fusion of onboard sensor and V2X data in cooperative perception, and demonstrates that while perception can significantly improve as the V2X penetration rate increases, it can introduce a significant number of false positives if V2X data is not highly accurate. False positives result in the detection of ghost objects that do not actually exist. These ghost objects can, in turn, compromise safety and driving efficiency. Our analysis found that false positives or ghost objects can appear even with accurate V2X data. These findings highlight the challenges in cooperative perception and the importance of developing robust data fusion methods to enhance the reliability of cooperative perception. This is particularly relevant in light of ongoing standardization efforts, such as ETSI TS 103 324 on collective perception.