fbpx
  • LAMBTON, NSW, AUSTRALIA, 2299

Search and Rescue Tank

A Telepresence Control System allows for a more natural approach to controlling a complex robotic system. This is made possible by using a Virtual Reality headset and controllers. Virtually Reality technology is used to immerse a user into different worlds such as in games and 360° recorded videos. Telepresence control takes the technology one step further by using the parameters collected from the headset and hand controllers within a 3D space and mathematically modelling the position of each servo motor.

The Search and Rescue Robot Eric developed has two manipulator arms and a camera arm. The camera arm gives the pilot a first-person view of the position of the robot via live low latency video feed. The VR headset roll, pitch and yaw sensors are used to determine the angles in which to move the servo motors for positioning the camera.  The Robots two manipulator arms are controlled via VR hand controllers. The hand controllers are tracked relative to the headsets position which produces data that can be used in a mathematical model of the manipulators. The model determines the angle in which 16 servo motors need to move to in real-time. The manipulators have a set of pincers which are used to interact with the environment around the robot. The pincers position can be varied by the amount of pressure placed on triggers that are located on each hand controller. Haptic feedback pressure from the amount of torque being applied to the pincers is also fed back to the hand controllers in the form of vibration. The more pressure being placed on the item being pressed, the more the controller will vibrate.

The benefits of such a control system being used in a rescue situation include;

  • Removing rescue personnel from dangerous situations
  • Intuitively allow rescue personnel to interact with the environment surrounding the robot with minimal training

Eric implemented a complete end to end solution by using a broad range of skills within the areas of Control System Design, Embedded Systems, Power Systems, Robot Kinematics, User Interface Design, Wireless Communications.

 

Completion Date: 2018
Newcastle, NSW, Australia
School: University of Newcastle