This paper proposes sanewapproachforcontrolling mouse movement using a real-time camera. Most of the existing approaches involve changing mouse parts such as adding more buttons or changing the position of the tracking ball. Instead, it proposes to change the hardware design. The method uses a camera and computer vision technology, such as image segmentation and gesture recognition, to control mouse tasks (left-click and right-click, selection, scroll, and drag). Hand gestures are acquired using a Web camera based on color detection. In this research work, three colourtapes are used on fingers. The tapes will be used for clicking events on the mouse.ThroughaWebcamera, the real-time video is captured. Image processing is performed in each frame of that video to detect the color and mouse tasks are performed.