The Fenna-Matthews-Olson (FMO) complex of green sulfur bacteria has been serving as a prototypical light-harvesting protein for studying excitation energy transfer (EET) dynamics in photosynthesis. The most widely used Frenkel exciton model for FMO complex assumes that each excited bacteriochlorophyll site couples to an identical and isolated harmonic bath, which does not account for the heterogeneous local protein environment. To better describe the realistic environment, we propose to use the recently developed multistate harmonic (MSH) model, which contains a globally shared bath that couples to the different pigment sites according to the atomistic quantum mechanics/molecular mechanics simulations with explicit protein scaffold and solvent. In this work, the effects of heterogeneous protein environment on EET in FMO complexes from Prosthecochloris aestuarii and Chlorobium tepidum , specifically including realistic spectral density, site-dependent reorganization energies, and system-bath couplings are investigated. Semiclassical and mixed quantum-classical mapping dynamics were applied to obtain the nonadiabatic EET dynamics in several models ranging from the Frenkel exciton model to the MSH model and their variants. The MSH model with realistic spectral density and site-dependent system-bath couplings displays slower EET dynamics than the Frenkel exciton model. Our comparative study shows that larger average reorganization energy, heterogeneity in spectral densities, and low-frequency modes could facilitate energy dissipation, which is insensitive to the static disorder in reorganization energies. The effects of the spectral densities and system-bath couplings along with the MSH model can be used to optimize EET dynamics for artificial light-harvesting systems.