In order to attain energy saving with efficiency and supply good services automatically for users, the design of a sensible energy observance and management system using the Microsoft neural network and computationally non tolling formula is projected in this paper. By monitoring the ability consumption data, surroundings data and users’ scenario data, the system supported the design will calculate the proportion of wasted energy consumption supported the energy consumption data point, give sensible services based on the person-device interaction, and forecast the energy consumption supported the user energy consumption behaviors. The system is combined with cloud computing for data storage and processing. This document illustrates the propose and execution of the system structural design.