In the last few decades, it has been perceived that Soil-Structure Interaction (SSI) changed the reaction attributes of a structural system due to huge and firm nature of structure and frequently, soil softness. In the current study, to depict the influence of soil structure interaction on the seismic response of a structure due to earthquake loading, a 5 storied (G+4) simple square building supported on pile foundation resting on stratified soil was selected. The building sections were modeled and analyzed for different configurations (i.e., with and without slab and infill) using finite element method SAP2000. The deformations under seismic loading in the structure and piles by incorporating the effect of soil-structure interaction and fixed base condition were extracted, compared and discussed. Impact of variety of the parameters on different soil conditions like variation in soil profile and number of soil layers, influence of slab and infill are considered for which the buildings are modelled by alternate approaches, namely, (1) bare frame with fixed supports, (2) frames including slab and infill with support accounting for soil-flexibility. The results indicate that the roof displacement varies significantly for different soil layer combinations if included the soil structure interaction compared to that of fixed base analysis. Thus considering the effect of SSI is essential. The horizontal displacement of the structure is maximum for a bare frame with slab when compared to the bare frame and in fill frame.  When infill wall is added to the structure, the horizontal displacement is decreased due to the stiffness of the infill wall.