New Amazon A.I. robot can pick 4x faster than a human operator
New Amazon warehouse robot can handle over one thousand random items per hour using 'pinch-grasp' technology to mimic human workers.
Amazon's new pinch-grasping robot can handle and stow 1,000 items per hour, which is significantly faster than human workers
The prototype uses cameras, algorithms and machine learning to mimic how human hands grasp items of varying sizes and shapes
A video posted to the retail giant's science blog showed the machine moving 19 items of varying size and shape in one minute
'We’re able to identify a specific item in the scene and use machine learning to know how best to pick it up and to move it quickly and without damage'
In 2019, Amazon founder Jeff Bezos predicted that within a decade, robotic systems will be advanced enough to grasp items with the dexterity of a human hand. Three years later, Amazon looks to be making progress toward that goal.
A recent video published on the company’s science blog features a new “pinch-grasping” robot system that could one day do a lot of the work that humans in Amazon warehouses do today. Or, potentially, help workers do their jobs more easily.
The new 'pinch-grasping' robot system unveiled by Amazon shows the machine deftly grabbing and stowing a wide range of items - moving at a rate of 1,000 items per hour, which is far faster than a human worker could.
Although humans don't spend much time figuring out how to grasp a bottle from the back of the fridge that might fall and break open, teaching a robot to deal with cluttered spaces, locate a wide range of items and deftly move them is a challenge for the retail giant's robotics division.
In the video posted to Amazon's science blog, the robot prototype can be seen using its finger-like pinchers to move and stow 19 items - including small bags, a broom, a spice container and a small box - in 60 seconds.
“In robotics, we don’t have the mechanical ability of a five-finger dexterous hand”
'But we are starting to get some of the ability to reason and think about how to grasp. We’re starting to catch up. Where pinch-grasping is really interesting is taking something mechanically simple and making it highly functional.'
Amazon uses a combination of multiple cameras, motion algorithms and machine learning models to give the robots a three-dimensional understanding - so that they are able to correctly grasp different items without causing damage, dropping anything or bumping them into other items.
In preliminary tests, the pinch-grasping robot achieved a 10-fold reduction in damage on certain items, including books, without having to reduce its speed in comparison to robots that use suction cups.
'They not only showed they could grip a lot of objects, but they did it really fast — they got to 1,000 units per hour,' said Parness, who oversees the project.
The robot's ability to carefully and quickly move a wide variety of objects make it a suitable candidate for wider deployment in Amazon's fulfillment centers. The company has 110 active fulfillment centers in the U.S. and 185 globally.
Amazon founder Jeff Bezos in 2019 predicted that commercial robots able to grasp items as well as human hands would be available within ten years.
'What’s interesting about e-commerce, as opposed to manufacturing, is it’s much more dynamic,' Parness said. 'It’s a pen, and then it’s a teddy bear, and then it’s a light bulb, and then it’s a t-shirt, and then it’s a book.'
Warehouse automation isn't a new topic, as the company's own internal research earlier this year estimated that it could run out of workers to hire in the U.S. by 2024 if it did not make a series of major changes that included more automation.
In addition, the current push for unionization at two different fulfillment centers has led some labor activists to speculate that Amazon may speed up its automation efforts in response.
Ultimately, Amazon may need to develop a model that combines elements of the pinch-grasping technology and the suction - because the latter is more suited to flat items such as cards.
'As a person, you pick up a book differently than if you pick up a coin or a t-shirt,' Parness explained. 'We need robots to be intelligent about the items they’re manipulating. If I’m picking up a hammer to hammer a nail in, I want to grasp it in a certain way. But if I’m picking up a hammer to go put it in a box to ship it to you, I want to grasp it in a different way. That’s the future of item intelligence.'
'Not only are we able to build robust three-dimensional models of the scene, we’re able to identify a specific item in the scene and use machine learning to know how best to pick it up and to move it quickly and without damage,' Siddhartha Srinivasa, director of Amazon Robotics AI, said in a statement.
The topic of warehouse automation is more relevant than ever in the retail and e-commerce industries, especially for Amazon, which is the largest online retailer and the second-largest private sector employer in the US. Recode reported in June that research conducted inside Amazon predicted that the company could run out of workers to hire in the US by 2024 if it did not execute a series of sweeping changes, including increasing automation in its warehouses.
At the same time, the company is facing the prospect of US workers starting to unionize after the victory by the Amazon Labor Union in the historic Staten Island vote, and another upcoming union election in October in Upstate New York. Labor activists have long speculated that Amazon might ramp up automation efforts in response to unionization activity.
In a statement provided by an Amazon spokesman, the company’s director of Robotics AI, Siddhartha Srinivasa, said: “[W]e have an incredible opportunity to help advance the science of robotic manipulation in ways that meaningfully benefit our employees and our customers. Our investments in robotics and technology are helping make jobs in our facilities better, easier, and safer, as well as creating new career opportunities for our people.”
The robotic arm in question does not look as futuristic as you might imagine. The proof-of-concept machine uses an off-the-shelf metal pincher rather than some novel grasping device. But it can pick up a new item and deposit it on a metal chute every three seconds. At the rate it’s going in the video, Amazon says the robot could handle more than 1,000 items an hour, meaning it could pick and stow items at rates several times faster than a human worker could. From a box of crayons to a container of what looks like garlic powder to a whisk broom, each item is grasped and moved with no human direction. The robot utilizes multiple cameras to help it “see” the assortment of items in front of it, as well as machine learning to help it decide the best way to pick up a given item, and motion-planning algorithms to help the robot navigate the crowded scene without bumping or damaging any of the goods. Preliminary tests also found that the robot damages certain products at a much lower rate than other manipulation robots Amazon has tested.
The video and the robotic system in it were created late last year in a controlled lab test by Amazon technologists. This robot prototype can only move items weighing less than two pounds. In testing, the robot was asked to handle hundreds of different items in this weight group and successfully grasped and moved around 95 percent of them, according to Amazon spokesman Xavier Van Chau. On a larger scale, the two-pound weight restriction would still allow the robot to grasp a selection of items making up about half of Amazon’s total product assortment. But the company is working on grasping solutions that would be able to handle any and every type of item that could fit inside an Amazon box, perhaps by combining a pincher attachment with a popular suction method, and having the system trained to know which “hand” should be used for which item.
How long it will take for Amazon to create a single robot that can handle the vast majority of products is up for debate, but it’s a question of “when,” not “if.” And when the “when” becomes “now,” we’ll have an answer to one of the great unknowns of this era of automation: Will a new generation of warehouse robots that can grasp goods almost as well as human hands make work better or easier for the people doing these jobs? Or will the technological evolution eliminate the need for these workers and their jobs?
An Amazon spokesperson said the company is betting on the latter, based on the way it has utilized other types of robots in its warehouses up to now. In June, Amazon announced a prototype of a robotic system called Cardinal that lifts and sorts already-packaged orders and, the company claims, “reduces the risk of employee injuries by handling tasks that require lifting and turning of large or heavy packages or complicated packing in a confined space.” The company says it expects to introduce the system into an unspecified number of fulfillment centers in 2023. And last year, the company unveiled another robot arm that it calls Robin, which handles a similar task with lighter packages. Van Chau, the company spokesperson, declined to provide details on the deployment of either the Cardinal or Robin robots.
Amazon’s history in robotics dates back to when it bought a company called Kiva for $775 million. In the decade since, it has rolled out more than 500,000 roaming warehouse robots. During the same period, the company says it has hired more than a million workers and points to this fact to try to dispel the notion that warehouse advancements are leading to worker elimination.
“From the early days of the Kiva acquisition, our vision was never tied to a binary decision of people or technology,” the company said in a recent blog post. “Instead, it was about people and technology working safely and harmoniously together to deliver for our customers. That vision remains today.”
The Kiva robots did make some Amazon warehouse jobs easier. For those workers in picker or stower roles, robots now transport shelves to them at a stationary workstation, where they stand for 10 hours a day with padding beneath their feet. In Amazon’s pre-Kiva days, these workers would walk 10 to 20 miles a day, plucking merchandise from, or adding goods to, aisle after aisle of inventory shelves.
Kiva robots also brought downsides. Before the robots arrived, a picker might have had a goal to handle 100 items an hour; Amazon tripled those expectations when the robots, not the workers, did the traveling. And with the addition of robots, injury rates increased as workers were forced to move faster to keep up with higher quotas.
The tasks being completed by Amazon test robots like the “pinch-grasping” one in the new video potentially have more direct overlap with existing worker tasks. The robot, like an Amazon picker or stower, is retrieving a piece of merchandise from one location and moving it to another, as quickly as possible without damaging it. That said, while the robot prototype is picking items at a rate of more than 1,000 an hour — around triple the typical rate of human pickers in Amazon warehouses — it’s not an apples-to-apples comparison. Amazon pickers in warehouses with robots have to pull each item out of a cluttered shelving unit, and sometimes have to use a step stool to reach merchandise at the top. Similarly, Amazon stowers have to fit each piece of merchandise into an open space on the mobile shelving unit, versus the robot that is simply moving it from one open space to another. Van Chau, the Amazon spokesperson, said the prototype in the video was neither tested nor designed to pick items from shelves as workers do in the company’s current robotic warehouses.
Still, robotics experts are paying attention. Martin Ford, the author of multiple books about robotics including Rule of the Robots, said while it’s unclear how Amazon’s most recent robot prototype would perform in a high-volume warehouse, it still seems to show “remarkable progress.” With advancements like Amazon’s, as well as those of many well-funded startups building robotic systems to try to solve for challenge of grasping with the dexterity of humans, “it’s inevitable that the problem will be solved — perhaps sooner than many of us expect,” Ford told Recode.
“And once that happens,” Ford added, “there’s little doubt that Amazon warehouses, as well as many other environments, are going to become a lot less labor intensive.”
Amazon maintains that robots and people will continue to work together inside its warehouses. But robotics experts say that one day, the company may have a real option to depend on robots to do a lot of the work it currently depends on human employees to do.
