Skin color is a robust cue in human skin detection. In the development of Human-Computer Interface (HCI) applications, information that are relative to skin color is extensively utilized. Human skin color shows resemblance with non-skin materials like wood, wall paint etc. So an accurate human-computer interaction system is required to be designed which can distinguish between them. Although several methods have been proposed, skin color detection still remains a challenge mainly due to problems such as illumination conditions, camera characteristics, and ethnicity.