This Is How Self-Driving Cars “See” The World

Modern cars bear little resemblance to their early ancestors, but the basic action of steering a vehicle has always remained the same. Whether you’re behind the wheel of a Tesla or a vintage Model T, turning the wheel dictates the direction of movement. However, as Visual Capitalist’s Nick Routley details below, this simple premise, which places humans at the center of control, may be ripe for disruption as tech giants and car companies race toward a future that would render human-controlled vehicles obsolete.

How does this next generation of self-driving cars “see” the road? Today’s video from TED-Ed explains one of the mind-bending innovations making autonomous vehicles a reality.

[youtube https://www.youtube.com/watch?v=PRg5RNU_JLk]

Eye of the Laser

Safely getting a vehicle and its passengers from point A to B is no simple matter.

First, weather and time of day can create a wide variety of challenging situations, affecting things like visibility, braking distances, or speed. Next, other vehicles, bikes, and pedestrians are constantly moving through the transportation network, sometimes in unpredictable ways. To further complicate matters, the road network is rarely in optimum form. Road lines fade and construction can throw ambiguous detours into the mix.

Sensing and analyzing the world at a granular level is crucial in making self-driving cars a viable transportation option. To solve this problem, new generations of autonomous vehicles are using photonic integrated circuits, as well as light detection and ranging (LiDAR) to generate an extremely nuanced picture of the road ahead.

How self-driving cars see the world. (Source: Hesai)

LiDAR – which is related to RADAR – uses short laser pulses to sense the depth and shape of objects. Essentially, scattered bursts reflect off objects around the vehicle, painting a detailed 3D picture of its surroundings. LiDAR’s depth resolution is so accurate that it could eventually see details at the millimeter scale.

A Dissenting Opinion

While most companies in the autonomous vehicle space have fully embraced LiDAR, Tesla has a divergent point of view. The company employs a combination of GPS, cameras, and other sensors to help its cars visualize the world.

LiDAR is a fool’s errand. Anyone relying on LiDAR is doomed.

– Elon Musk

Society and Self-Driving Cars

While companies like Uber and Waymo determine the functional mechanics of self-driving cars, the rest of society is left to ponder how this new technology will affect employment, privacy, and personal autonomy.

In the U.S., more than 70% of goods are moved by truck, and over 80% of commuters take a private vehicle to work on any given day. Even partial automation of the nation’s transportation network will have wide-sweeping impacts on the economy.

As AI-powered cars and trucks hit the streets at scale, how cars see the road will be a detail most of us will overlook. The bigger question will be whether we are ready for a society where we’re no longer in the driver’s seat.