In present times, industries face common obstacles like shortage of time and workers which leads to inefficient production. A feasible solution for this problem can be achieved using robotics. Robots save a lot of time and robots are designed for specific tasks according to one's needs. Furthermore, we can make use of image processing methods for better results. This paper presents a way to control a robotic arm through detection of a specific color. In this paper, we have proposed a method by which a webcam detects a particular colored-patch attached to a human arm using the color coding techniques in MATLAB. The coordinates of that colored-patch with respect to the video output screen are sent to the microcontroller, which in turn results in the movement of the robotic arm. The process is quick and inexpensive, for individual and industrial applications, thereby increasing the growth of the industry. The robot can be interfaced using various micro-controller, here we have used the Arduino Uno which is a microcontroller board based on the ATmega328. Arduino controlled robot is interfaced with the computer which mimics hand gestures according to the movement of the colored-patches present on the human arm. The movement of the arm is detected on the basis of the movement of the colored object present on it, using a webcam and MATLAB functions. According to the movement of the arm, the robot, which is being interfaced with the computer, is also moved in desired directions. This results in an inexpensive and effective way for controlling the robot via an interface between the human and the machine.