Handwritten recognition is the ability of the system to receive and interpret the input taken from various sources like paper documents, touch screen devices, photographs, etc. In this paper, we will be designing a handwritten recognition expert system using different classification algorithms to recognize the handwritten characters like Support Vector Machine(SVM), K-Nearest Neighbour(KNN), Random Forest Classifier and Neural Networks. This application is useful for recognizing all characters and digits given as in the input image. The main objective of the project is to increase the accuracy of the recognition characters through various algorithms and choose the best algorithm for recognizing characters or digits.