There are a variety of desktop-level robotic arms currently on the market. In addition to cameras, they are also equipped with a variety of sensors so that they can behave more "intelligent." But we discovered that no matter how they increased the number of sensing modules, they could not solve a common problem today with desktop-level robotic arms: it is difficult to break through the limitations of a two-dimensional plane.
I’d been wondering about the relative merit of mounting a camera on the base of a robot arm vs next to the effector.
Does it make the algorithm simpler having it move with the effector?
I wonder if with colour and depth (like this, or the maixsense sensors) you could use colour masking or object recognition to pick out relative coordinates, then pid loop to have it centre and at a specific depth before closing grips and lifting?
The integration of depth cameras and advanced sensing technologies can indeed offer exciting possibilities, as these sensors enable the arm to “see” and interpret the 3D space around it.
