The unique architectural form and religious background of Taoist buildings can lead to a special acoustic environment, but there is a lack of research on the soundscape evaluation of Taoist buildings. Laojundong Taoist Temple was selected as the research site. The psychological and physiological responses of Taoist priests and ordinary people, and strategies for soundscape renovation were investigated by conducting field measurements, interviews, soundwalks, and audio-visual experiments. There was significant negative linear regression between the L Aeq,5min and soundscape comfort ( p < 0.01). The visual landscape comfort of ordinary people was notably correlated with landscape diversity ( p < 0.01), whereas their soundscape comfort was markedly correlated with the degree of natural soundscape and audio-visual harmony ( p < 0.01). The soundscape evaluation by Taoist priests was affected by their belief, activity types, social factors, and spatial positions. With the increasing proportion of the natural elements in the visual landscape in the temple, the acoustic comfort of Taoist priests and ordinary people significantly increased with the addition of bird sounds ( p < 0.01). However, with the increasing proportion of Taoist scenes, Taoist music only significantly improved the acoustic comfort and heart rate of ordinary people ( p < 0.01).