Tracking small metallic balls in the "bush"

HI GUYS !
I'M NEW HERE ON THE BLOG BUT INTERESTED IN ROBOTICS AND I HAVE A PROBLEM I NEED TO SOLVE SOMEHOW :
- THERE IS A NOT MOVING SPACE : 600CM LONG 100CM X 60CM DEEP LIKE A BRICK ABOVE THE SURFACE, LET'S SAY IS A PLANT WITH A FEW LEAFS
- IN THIS SPACE I HAVE APPROX. 60 PLASTIC OR METAL STICKS OR BALLS
- I NEED TO RECOGNIZE THEM SOMEHOW AND PICK THEM BY ANY ROBOT ARM
- ALL OF THIS PROCEDURE MUST BE DONE IN DIFFERENT ENVIROMENTS
- I ALSO COULD MAKE A FRAME FOR THE SENSORS AND ARMS ABOVE THIS SPACE TO MAKE THE WHOLE PROJECT EASIER
MY QUESTIONS ARE :
- WHAT IS THE BEST RECOGNITION DEVICE TO TRACK EITHER METAL OR PLASTIC STICKS OR BALLS IN 3D IN DIFFERENT ENVIROMENTAL SETS / E.G. DARKNESS OR IF A BALL COVERED FROM AN ANGLE/
-HOW SHOULD I DESCRIBE THE EGZAKT POSITION FOR THE RECOGNIZED ITEMS IN ORDER TO PICK THEM BY THE ARMS /ESPECIALLY TO GIVE THE COORDINATES OF THE SMALL BALLS/STICKS FOR THE GRIPPER HAND /
- WHAT IS THE BEST SENSOR SET FOR THE ARMS TO FIND AND GRIP THE STICKS/BALLS ONE BY ONE
MY IMAGINE TO MAKE A KIND OF MAP WITH ANY SENSORS OF THE WHOLE SPACE I DESCRIBED, AND GIVE GROUPS OF ITEMS FOR EVERY ARM MORE OR LESS EQUALLY, THAN EACH ARM SUPPOSE TO LOCALIZE EACH GIVEN ITEMS, PICK THEM THAN PLACE THEM SOMWHERE ELSE
I'M REALLY DESPERATE FOR ANY SOLUTIONS PRIMARY TECHNICALLY, THE MATHEMATICAN TRANSLATION IS NOT IN MY WIEV AT THE MOMENT.
IN CASE ANY ONE OF YOU COULD HELP ME WOULD BE APPRECIATED.
EXCUSE ME FOR MY ENGLISH, IS ANYTHING IS NOT CLEAR, PLS WRITE ME.
THANK YOU FOR YOUR HELP TAMAS

Please dont type in all CAPS
Please dont type in all CAPS it makes it very hard to read. If you format your questions to make them easier to read you should get better answers. Is this a school project? Have you made any robots before? If this is your first please start with an easier project. This sounds advanced for a beginner.

| tr [:upper:] [:lower:]
hi guys !
i’m new here on the blog but interested in robotics and i have a problem i need to solve somehow :
- there is a not moving space : 600cm long 100cm x 60cm deep like a brick above the surface, let’s say is a plant with a few leafs
- in this space i have approx. 60 plastic or metal sticks or balls
- i need to recognize them somehow and pick them by any robot arm
- all of this procedure must be done in different enviroments
- i also could make a frame for the sensors and arms above this space to make the whole project easier
my questions are :
- what is the best recognition device to track either metal or plastic sticks or balls in 3d in different enviromental sets / e.g. darkness or if a ball covered from an angle/
-how should i describe the egzakt position for the recognized items in order to pick them by the arms /especially to give the coordinates of the small balls/sticks for the gripper hand /
- what is the best sensor set for the arms to find and grip the sticks/balls one by one
my imagine to make a kind of map with any sensors of the whole space i described, and give groups of items for every arm more or less equally, than each arm suppose to localize each given items, pick them than place them somwhere else
i’m really desperate for any solutions primary technically, the mathematican translation is not in my wiev at the moment.
in case any one of you could help me would be appreciated.
excuse me for my english, is anything is not clear, pls write me.
thank you for your help tamas

sorry ! Ihave never made a
sorry ! Ihave never made a robot yet, i am planning to do so, and as i sad i’m not skilled at all.I read many things about robotics and this 3d scanning and localising problem were interesting to deal with.Please tell me where should post my questions.

This is certainly the place

This is certainly the place to post it

The first step is to find a way to make the object stand out from its environment (color, IR light, sound, etc). Then you need to make the robot able to search for something with that characteristic. Once it sees that then find a way for it to reach out until it has made contact and grab it. The key is making the object stand out to the robot.

different challenges, different questions

Helo Tamas,

You have many challenges to overcome. My advice: try to start with the easiest part and build your way up.

Could you post a drawing of your idea or of the situation? That would help us to understand the issues.

Ask separate questions in our forum with each problem you encounter. We will help you wherever we can. This is our nature here on LMR. We will show patience if you do. We help those who help themselves. I mean this: keep us posted on your progress and you shall receive much more enthusiastic responses.

And about your English: Nem problem!

8ik

 

There seem to be two

There seem to be two distinct parts to this problem. First,as Joe pointed ou, finding the objects in the space; and second picking the objects up.

Do you have a choice of object - that is can you choose if it is a stick or a ball? Could you choose metal balls so that you could pick them up with an electro-magnet? Or do you just have to pick up whatever is there be it sticks or balls.

Is the number 60 significant? Do you have to pick them all up, or does it just make it easier to find one to pick up?

I don’t understand the “like a plant with a few leafs” thingy.

Do you actually have to pick the balls up, or could you just sweep them to a particular place/point? If so, could you forget about locating balls and just sweep the box?

Do you actually have to build/make this, or is it a theoretical question?

Mike

Bin-picking ?

Thanks for the attention you pay to me.

The number of objects are not significant, stick or ball does not matter and the material of the object if is plastic it would be better but still metal will do .Yes, i would like to pick the objects with no leftovers at all.The size of the object could varie : somewhere about 1-2 cm long if sticks and 1-2 cm dia if balls.The weight could differ of the material that we use./thanks OddBot /The few leafs in my example serves something that could sade the object of the view of the sensor(s).My idea is to use an optical and an inductional sensor to locate the objects/ first to make 3-3-3 pictures of each angle to position the balls or sticks since it would be enough if neither of the object is shaded of any angle - but if so - i am not sure that the inductional sensor would be enough to solve the problem since it is not possible to detect more than one object at the same time.Do you think x-ray could help me ?More or less but bin picking could be helpful with the cameras and x-ray on my believe, also at conturising.

Next time i will post a drawing of the whole thing to make it clearer.

thanks