The microbiome has emerged as a crucial modulator of host-immune interactions and clearly impacts tumor development and therapy efficacy. The microbiome is a double-edged sword in cancer development and therapy as both pro-tumorigenic and anti-tumorigenic bacterial taxa have been identified. The staggering number of association-based studies in various tumor types has led to an enormous amount of data that makes it difficult to identify bacteria that promote tumor development or modulate therapy efficacy from bystander bacteria. Here we aim to comprehensively summarize the current knowledge of microbiome-host immunity interactions and cancer therapy in various mucosal tissues to find commonalities and thus identify potential functionally relevant bacterial taxa. Moreover, we also review recent studies identifying specific bacteria and mechanisms through which the microbiome modulates cancer development and therapy efficacy.