When you tap an accepted card, a shopping session begins. Just Walk Out technology uses computer vision, sensor fusion, deep machine-learning models, and generative artificial intelligence to determine which products are selected during the session.
Overhead cameras view the shopping area from different angles. Computer vision is software that studies the camera images and video. It can detect when a shopper reaches toward a product and whether the product is picked up or put back.
The system also uses a 3D map to understand where the shelves, coolers and other fixtures are located. The product catalogue provides information about the products sold in the store.
The system also utilizes, sensor fusion. Sensor fusion is where the system checks all of this information together instead of depending on only one camera or sensor. It compares the shopper's movement, the shelf location, and the product information. This helps the system decide which product was handled and which shopping session should be updated.
Products that are picked up are added to a virtual cart. Products that are put back are removed from the virtual cart. When the shopping session ends, the accepted payment method used to enter is charged for the products taken out of the store.