logo-mobile

ROHM

ROHM
Menu
  • Arduino –
  • Raspberry Pi –
  • Trending –
  • Others –
  • About –
  • Contact –

Arduino

Smart Robotic Arm – Part 2: Programming

Tiberia Todeila
Published by Tiberia Todeila at August 14, 2017
Categories
  • Arduino
Tags
  • Arduino
  • robotic arm
  • robotics
  • smart robotic arm
robotic arm

Table of Contents

  • Intro
  • Step 1: Making the App
  • Step 2: How to Make Demo App
  • Step 3: Properties of the App & Step 4: Face Recognition
  • Step 5: Weather API & Step 6: Text-to-Speech

Step 3: Properties of the App

Using features from the .NET, OpenCV and Microsoft APIs, we were able to make an complete app. For the app, we needed buttons, serialport, and text box.

In the black window, it will display the image from the webcam where it adds a frame with the name of the person within the frame.

In the white window from the left, it will add the text from the TTS API (Text-to-Speech), providing feedback to check the work and see if the spoken words are in compliance with the displayed ones.

robotic arm

Figure 8: The app for the robotic arm

Step 4: Face Recognition

In the training mode, you need to add multiple recordings of your faces in order to achieve better results from the program. The training is formed from taking pictures in multiple face positions for an optimal recognition (different angle shots, light conditions, etc).  You need to record with the app by pressing the button Record 10 Faces.

In the code, this was made with the Face = Parent.faceClassifier; using the EmguCV platform. Face detection is made with complex algorithms based on Principal Component Analysis (PCA), making multiple comparisons between the detected face and the one stored after the training.

robotic arm

Figure 9: Face detection

The image that will be stored is the one in the blue rectangle, because it contains the distinct features of the face.

We need to take more sets of the face characteristics in different positions and under different light:

robotic arm

Figure 10: Add more faces for the training

After a session of face detection shots, if you think that recorded faces were not good for the algorithm, Restart 1 Face button can delete the saved files and it will no longer detect your face.

Delete Data is used to delete the photos when you want to record more than one person, so the robotic arm can distinguish between many people.

robotic arm

Figure 11: Restarting the training mode

After you made more recordings, the algorithm should be able to detect your face and the name will be shown above the blue frame. Features like glasses can be good in a precise detection because those are distinctive characteristics.

robotic arm

Figure 12: The result after the training

1 2 3 4 5
Tiberia Todeila
Tiberia Todeila
Tiberia is currently in her final year of electrical engineering at Politehnica University of Bucharest. She is very passionate about designing and developing Smart Home devices that make our everyday lives easier.

Check us out on Social Media

  • Facebook
  • Twitter

Recommended Posts

  • Smart Robotic Arm – Part 1: Mechanics and WiringSmart Robotic Arm – Part 1: Mechanics and Wiring
  • Guide to Connecting Arduino & Raspberry Pi + DIY Arduino and Raspberry Pi Camera Robot!Guide to Connecting Arduino & Raspberry Pi + DIY Arduino and Raspberry Pi Camera Robot!
  • Arduino Explorer Rover Part 3 – ProgrammingArduino Explorer Rover Part 3 – Programming
  • Insect-Inspired “Arthrobots” Made of Drinking StrawsInsect-Inspired “Arthrobots” Made of Drinking Straws
  • Exploring Robotics with the Hedgehog Robotics ControllerExploring Robotics with the Hedgehog Robotics Controller
  • Manta Ray-Inspired Soft Robotic FishManta Ray-Inspired Soft Robotic Fish
Receive update on new postsPrivacy Policy

Recommended Tutorials

  • How to integrate an RFID module with Raspberry Pi How to integrate an RFID module with Raspberry Pi
  • How to Use the NRF24l01+ Module with Arduino How to Use the NRF24l01+ Module with Arduino
  • How to Run Arduino Sketches on Raspberry Pi How to Run Arduino Sketches on Raspberry Pi
  • Setting Up Raspberry Pi as a Home Media Server Setting Up Raspberry Pi as a Home Media Server

Recommended Trends

  • SewBot Is Revolutionizing the Clothing Manufacturing Industry SewBot Is Revolutionizing the Clothing Manufacturing Industry
  • All About The Sumo Robot Competition And Technology All About The Sumo Robot Competition And Technology
  • 5 Interesting Tips to Calculating the Forward Kinematics of a Robot 5 Interesting Tips to Calculating the Forward Kinematics of a Robot
  • Go Inside the Drones That Are Changing Food Delivery Go Inside the Drones That Are Changing Food Delivery
Menu
  • Arduino –
    Arduino Beginner’s Guide
  • Raspberry Pi –
    Raspberry Pi Beginner's Guide
  • Trending –
    Updates on New Technologies
  • Others –
    Interviews / Events / Others

Check us out on Social Media

  • Facebook
  • Twitter
  • About
  • Company
  • Privacy Policy
  • Terms of Service
  • Contact
  • Japanese
  • 简体中文
  • 繁體中文
Don’t Forget to Follow Us!
© Copyright 2016-2023. Device Plus - Powered by ROHM
© 2023 Device Plus. All Rights Reserved. Muffin group

istanbul escort istanbul escort istanbul escort