The process of shopping in a cashierless store can be broken down into four phases: the before-purchase phase, the check-in phase, the product selection phase, and the check-out phase.^[1] In the before-purchase phase, an app may need to be downloaded.^[1] In the check-in phase, a bar code from the store’s app may need to be scanned in order to enter the store.^[1] In the product selection phase, products can usually be selected without taking any preceding actions, but some stores require customers to scan a bar-code on the product or tap a screen to select products.^[1] In the check-out phase, stores utilize sensor fusion and deep learning for computer vision to allow customers to walk out with their products without waiting in line at a register.^[1]

Sensor fusion edit

In cashierless stores, most systems mark each customer with defining features and use cameras and pressure sensors together to keep track of where each customer goes and takes from the shelves.^[2] Sensor fusion gathers information from different sensors and compiles it to create an accurate representation of what is happening and the relative positions of objects in an area at a specific time. Sensor fusion is often more accurate than single sensors since the separate measurements can be used to double-check and narrow the margin of error.

Deep learning for computer vision edit

Deep learning for computer vision is used in cashierless stores to track customers and products. Computer vision is the computer’s ability to interpret real-life images and video feeds.^[3] Computer vision uses deep learning to make interpretations of the real world.^[4] Deep learning allows computers to learn from large amounts of data similarly to how the human brain would.^[4] Deep learning for computer vision tracks customers and products using object detection, multitarget tracking, and pose estimation.^[5] Object detection is the process of identifying objects within an image.^[5] Object detection is useful in identifying instances when a customer picks up and puts down an object, or for identifying the products on each of the shelves.^[5] Multitarget tracking approximately locates a moving person within consecutive frames of images.^[5] Multitarget tracking allows stores to keep track of each customer and their actions, like what products they picked up and put back and when they entered and exited the store.^[5] Pose estimation is the process of using an image to track a person using the positions of their body parts, like their head, hands, and wrists.^[5] Similar to multitarget tracking, pose estimation allows stores to keep track of customers providing information for the computer to determine which customer interacted with the store, like when a product is grabbed.^[5]

United States edit

In 2016, Amazon announced the opening of its first cashierless store, Amazon Go, which opened in 2018. To shop, customers were required to have the Amazon app (formerly a specific Amazon Go app) so that they could be billed for their purchases afterward through their accounts.^[6] Amazon introduced its cashierless technology in two Whole Foods stores located in Washington, D.C., and Sherman Oaks, California in 2022.^[7]

In January 2021, the Hudson Group, a travel retailer, announced that it would be implementing Amazon's Just Walk Out technology in select airport convenience stores, branded as Hudson Nonstop.^[8]

In June 2021, San Diego’s first fully automated and cashierless store, Valet Market, was opened to the public.^[9] Valet market is powered by the technology company Accel Robotics which utilizes an advanced machine learning AI platform that optimizes efficiency in local markets.^[10] There are three ways of shopping at Valet Store: Hub Store, Satellite Store, and Last Step Delivery.^[11]

Cashierless stores have also been established in sporting and event arenas. In March 2021, Delaware North opened two cashierless MRKT convenience stores at TD Garden in Boston (only open during arena events).^[12] With the opening of Seattle's Climate Pledge Arena in October 2021, four stores were equipped with Amazon's cashierless technology.^[13] In April 2022, Minute Maid Park in Houston, Texas became the first Major League Baseball stadium to incorporate cashierless stores, installing Amazon's technology at two of its concession stands.^[14] Minor league Polar Park in Worcester, Massachusetts launched similar technology from startup Standard AI in April 2022.^[15]

Asia edit

Japan introduced cashierless shopping to their country by implementing New Zealand start-up, Imagr’s, scalable autonomous checkout technology. However, Imagr’s technology in Japan is not fully cashierless. Customers have to go to a checkout operator to accommodate Japanese customers’ shopping behavior of paying with cash and having a cashier.^[16] Cashierless stores can also be found at a subway station in Tokyo. In addition, other convenience store chains are implementing their cashierless stores. Stores like 7-Eleven and Lawson are working towards creating cashierless stores.^[17]

In Singapore, the first cashierless convenience store named Cheers launched in 2017, where it saves 180 man hours per week through their autonomous format.^[18] Cheers is the first convenience store that allows customers to pay with Nets by QR code.^[19]

Europe edit

In 2019, Sainsbury's opened the first cashierless store in the United Kingdom. However, it closed a few months later due to customer dissatisfaction with the lack of additional payment options.^[20] In September 2021, Aldi UK announced its first cashierless store in Greenwich.^[21] In October 2021, Tesco introduced its cashierless store called the GetGo store in central London, following a small trial of a similar store at the Tesco head office in Welwyn Garden City.^[22]

A Finnish company called Korttelikauppa opened a cashierless store in Helsinki in 2020, followed by six more stores in 2021 in Helsinki, Espoo, and Vantaa. Also in 2021, another Finnish convenience retailer, R-kioski, opened a cashierless store called R-kioski Go! in Helsinki.^[23][24]

In the Netherlands, Aldi Nord opened the first cashierless store in Utrecht as a 12-month trial in 2022.^[25]

Middle East edit

In September 2021, French conglomerate Carrefour opened the first cashierless store in the Middle East called Carrefour City+, located in the Mall of the Emirates in Dubai.^[26][27]

In 2019, Israel opened their first cashierless store Nowpet, a cashierless pet shop, which uses the technology developed by startup Cyb-Org.^[27] Cyb-Org’s sensor technology differentiates from Amazon Go’s implementation of computer vision by detecting the weight of the shelf whenever customers grab products.^[28] Cyb-Org has also collaborated with Rami Levy, a popular grocery chain store in Israel, to implement cashierless technology of scanning fingerprints as a method of purchase, which costs much less compared to Amazon Go’s checkout mechanism on its shopping carts.^[29]

Africa edit

South Africa’s first cashierless food store, Checkers, is in the process of testing a store without checkout counters, from the technology of Shoprite Holdings.^[27]

• Amazon Go
• Automated convenience store
• Automated retail
• Cashless society
• Technological unemployment