Smart Robotic Arm – Part 2: Programming

Click here to read Part 1 of this article >

Table of Contents

• Intro
• Step 1: Making the App
• Step 2: How to Make Demo App
• Step 3: Properties of the App & Step 4: Face Recognition
• Step 5: Weather API & Step 6: Text-to-Speech

In Smart Robotic Arm – Part 1: Mechanics and Wiring, we’ve put together a body of the robotic arm. The arm featured a web camera and a microphone for face & object and voice recognitions. Developed in just under 15 hours, the robotic arm was placed in the Top 10 at MakeMIT Hardware Hackathon.

The main functions of the robotic arm are to detect colored objects (e.g. red or blue balls), pick up the object, recognize face(s) and hand over the object to the specified person/user, combined with voice commands. In order to successfully achieve such features, we’ve integrated multiple platforms, such as OpenCV, Microsoft Cognitive Services Speech and Speaker Recognition API, and Open Weather API.

Hardware

From Part 1:

• Arduino UNO
• Microphone
• Web Camera
• Servo Motors

Software

• Arduino IDE
• Visual Studio
• JARVIS [https://github.com/isacandrei/Jarvis-Rocket]