Bacterial vaginosis (BV) is a common disease among women of reproductive age, with a serious impact on their daily life and health. At present, the most common treatment for BV is to take antibiotics, which results in good short-term treatment effects, but poor long-term effects. Traditional Chinese medicine (TCM) has been used to treat BV for over a millennium, with little risk of triggering drug resistance and adverse effects. Based on syndrome differentiation, there are three oral TCM treatment strategies for BV, including invigorating spleen, clearing dampness and heat, and nourishing kidney. The oral TCM prescriptions, such as Yi Huang decoction, Longdan Xiegan decoction, Zhibai Dihaung decoction, and so on are commonly used. Topical TCM treatment is also popular in China. According to the research results of pharmacological effects of active TCM ingredients, the most potential mechanisms of TCM for BV treatment are immune-enhancement effects, antibacterial activity, and estrogen-liked effects. Nonetheless, the multi-constituent of herbs may result in possible disadvantages to BV treatment, and the pharmacological mechanisms of TCM need further study. Here, we provide an overview of TCM compounds and their preparations used for BV, based on the pathogenesis and the potential therapeutic mechanisms, therefore providing a reference for further studies.