Referenzprojekt

AI-based grasping of delicate and deconstructable objects using robotic grip

In the field of intralogistics for retail goods, automated grasping and picking objects from mixed goods containers is an important factor for efficiency and growth. Helbling worked with the client to develop an AI-based solution that allows picking robots to work with objects that are difficult to grasp.

In Simulation (Isaac Sim), the gripping of random objects is simulated in parallel on hundreds to thousands of robot stations and the respective results are evaluated. This data is then used as training data for a neural network, which predicts the quality of a grip based on image data before the actual execution.
 

Key Figures

Close, agile collaboration between the various involved parties:

  • Mechanical, software, and research teams of client
  • Five of Helbling Technik’s robotics and AI specialists in Zurich
  • Two research specialists under Prof. Dr. Siegwart from ETH Zurich’s ASL lab.

Our Contribution

Picking objects such as books with dust jackets or boxes with loose lids is very challenging for a robot. The goal was therefore to develop a machine learning-based grasp generation model for a new type of pinch-suction gripper. The success of the project was based on:

  • Effective combination of real training data (manual annotation of expected grasp outcome) and synthetic training data (grasp outcome from simulating picks of articulated objects)
  • The combination of state-of-the-art neural networks to predict the grasp outcome for grasp candidates of different type and with varying width
  • The effective selection of the best next grasp from all candidates over all objects and grasp types

Outcome

The grasping system, which is integrated into an early product version, significantly exceeds the performance of the original system when it comes to emptying containers (90% of the articles that are normally damaged were successfully picked). As a result, management has approved an evaluation in a distribution center.

Future relevance for our clients
The project demonstrates the capacity of AI methods to implicitly learn even complex problems, but also emphasizes the pragmatic know-how required to succeed. Generating useful training data, either from the real world or pertinent simulations, and managing the much larger quantities of data are challenging because the physics and the effects of robotic manipulation need to be taken into account.

Contact

Guido Brunecker

Hohlstrasse 614
8048 Zürich

Ueli Schläpfer

Hohlstrasse 614
8048 Zürich

Weitere Referenzprojekte

Get in touch with us

Contact now