AUTONOMOUS VEHICLES AND bad WEATHER
Sensor fusion for robust obstacle detection
The effects of weather on Sensible 4’s positioning and navigation are, in the end, rather minor. Positioning is based on measuring large, stationary shapes like buildings, which is rather straight-forward even in low visibility.
Generating an accurate snapshot of the traffic situation, specifically obstacle detection and tracking (ODTS), is the biggest challenge caused by weather.
ODTS plays a significant role in autonomous driving. For example, it tells the vehicle computers the position and direction of other cars around the autonomous vehicle. It also warns of any obstacles, such as pedestrians, suddenly appearing in the car’s trajectory.
Read more about ODTS from Sensible 4 blog.
The more there is rain, sand, fog, or other materials in the air hindering detection, the harder it becomes for the sensors to classify or even detect smaller, moving objects.
Sensor fusion combines the powers of the various sensors
The best way to enable autonomous driving in bad weather is to combine sensor data, technology known as sensor fusion. When the cameras see one thing, LiDAR sensors see another thing, and the radar generates a third image, sensor fusion combines these partial information streams into an image that is more than the sum of its parts.
When dealing with sensor fusion, engineers often end up dealing with neural networks and the constraints of machine learning. For example, if ODTS-classifier – a piece of machine vision software doing the classifying of detected objects around the vehicle – is taught with pictures taken in good weather and lighting conditions, it may not perform well in bad weather or darkness.
Then again if this camera-based classification is aided with proper information of the size of the object provided by LiDAR, the classification is easier to do, but this increases the computational requirements.
Also whatever methods are being used for sensor fusion, they need to be fast for the vehicle to do real-time decisions based on the traffic situation.
In the end, bad weather always makes driving difficult, whether there’s a human or a machine behind the wheel. The reliability of made decisions decreases. When the weather is bad, everyone should simply slow down and be more careful in traffic.
About Sensible 4
Sensible 4 is a Finnish Self-Driving Technology Company that develops full-stack autonomous driving software (AD-Kit) that turns any vehicle into self driving and allows it to operate in any weather and environment.