Developing an autonomous assistant robot for the Robocup@Home challenge
All our software we've developed is open source and can be found at : https://github.com/WalkingMachine.
Our robot is currently using ROS kinetic on Ubuntu 16.04 LTS.
Hardware Description
| Base | Custom base with fully holonomic platform |
|---|---|
| Vertical column | TiMOTION TL5 |
| Right arm | 7 DoF custom made arm made of 5x Kinova motors and 2x Dynamixels (MX-64R) |
| Neck | Tilt and pan unit using 2x Dynamixels MX-64R servo actuator |
| Gripper | Robotiq 2 finger 140mm. |
| Dimensions | Base : 0,61m X 0,77m Height : 1,22m (min.) 1.78m. (max.) |
| Weight | ~70kg |
| Additional sensors | Hokuyo UTM-30LX |
| Microphone | Rode microphone VideoMic |
| Batteries | 2x 20V Dewalt drill battery 5aH |
| Computers | 1x Lenovo P50 32GB of RAM, Nvidia Quadro M2000 4GB 1x Nvidia Jetson TX2 2x Raspberry Pi 3 (Touch interface and sound localization) |
Software description
| Operating system | Ubuntu 16.04 with ROS kinetic |
|---|---|
| Navigation, localization and mapping | Gmapping, AMCL |
| Face recognition | ros_face_recognition |
| Speech recognition | Google speech API |
| Speech comprehension | wm_nlu |
| Sound localization | wm_odas_ros_wrapper |
| Speech synthesis | Svoxpico and Google text-to-speech |
| Object recognition | YOLO V2 |
| Arm motion planning | MoveIt |
| Task executor | FlexBe |
| World representation | wonderland |
Objects recognition using YOLO V2

Vertical motion to reach objects on the floor and on the higher shelves of a cupboard.

Environment representation directly in Rviz

Our website : https://walkingmachine.ca
Facebook : https://www.facebook.com/WalkingMachine/
Flick for more pictures : https://www.flickr.com/photos/walkingmachine/albums
More informations to come