Agricultural ecosystems are facing increasing environmental changes. Revealing ecological stability of belowground organisms is key to developing management strategies that maintain agricultural ecosystem services in a changing world. Here, we collected soils from adjacent pairs of maize and rice fields along large spatial scale across Eastern and Southeast China to investigate the importance of core microbiota as a predictor of resistance of soil microbiome (e.g. bacteria, fungi and protist) to climate changes and nutrient fertilization, and their effect on multiple ecosystem functions, representing key services for crop growth and health in agro-ecosystems. Soil microbiome in maize soils exhibited stronger resistance than that in rice soils, by considering multiple aspects of the resistance index, for example, community, phylogenetic conservation and network complexity. Community resistance of soil microbiome showed a geographic pattern, with higher resistance at lower latitudes, suggesting their stronger resistance in warmer regions. Particularly, we highlighted the role of core phylotypes in enhancing the community resistance of soil microbiome, which was essential for the maintenance of multifunctionality in agricultural ecosystems. Our results represent a significant advance in linking core phylotypes to community resistance and ecosystem functions, and therefore forecasting agro-ecosystems dynamics in response to ongoing environmental changes. These suggest that core phylotypes should be considered a key factor in enhancing agricultural sustainability and crop productivity under global change scenarios.