MILPITAS, Calif. — Amazon is bringing delivery details directly to drivers’ eyeballs.
The e-commerce giant on Wednesday confirmed that it’s developing new augmented reality glasses for delivery drivers, using AI and computer vision to help them scan packages, follow turn-by-turn walking directions, and capture proof of delivery, among other features.
Amazon says the goal is to create a hands-free experience, making the job safer and more seamless by reducing the need for drivers to look down at a device.
Scenarios shown by the company make it clear that the devices activate after parking, not while driving, which could help to alleviate safety and regulatory concerns. But the devices play into larger questions about the workload on drivers, and a history of technology efficiencies at Amazon’s fulfillment hubs pushing workers to the limits of human capacity and safety.
It’s also another opportunity for the company to track and monitor the work done by drivers, adding more pressure to a job that already comes with demanding delivery targets.
The wearable system was developed with input from hundreds of drivers, according to the company. It includes a small controller worn on the driver’s vest that houses operational controls, a swappable battery for all-day use, and a dedicated emergency button.
The glasses are also designed to support prescription and transitional lenses. Amazon says future versions could provide real-time alerts for hazards, like pets in the yard, or notify a driver if they are about to drop a package at the wrong address.
According to Amazon, the smart glasses are an early prototype, currently in preliminary testing with hundreds of drivers in North America. The company says it’s gathering driver feedback to refine the technology before planning a broader rollout.
The announcement at Amazon’s Delivering the Future event in the Bay Area today confirms a report by The Information last month. That report also said Amazon is developing consumer AR glasses to compete with Facebook parent Meta’s AI-powered Ray Ban smart glasses.
The enterprise AR market is in flux, with early mover Microsoft pivoting away from HoloLens hardware, creating an opening for players like Magic Leap and Vancouver, Wash.-based RealWear.
A demo video released by Amazon shows a delivery driver using augmented reality (AR) glasses throughout their workflow. It begins after the driver parks in an electric Rivian van, where the glasses overlay the next delivery address directly onto a view of the road.
“Dog on property,” the audio cue cautions the driver.
Upon parking, the driver moves to the cargo area. The AR display then activates to help with sorting, with green highlights overlaid on the specific packages required for that stop. As the driver picks each item, it’s scanned and a virtual checklist in their vision gets updated.
After retrieving all the packages from the cargo hold, the driver begins walking to the house. The glasses project a digital path onto the ground, guiding them along the walkway to the front door.
Once at the porch, the display prompts the driver to “Take photo” to confirm the delivery. After placing the items, the driver taps a chest-mounded device to take the picture. A final menu then appears, allowing the driver to “Tap to finish” the stop before heading back to the van.
