The COVID-19 pandemic has exerted unprecedented impacts on travel behaviors because of people's increased health precautions and the presence of various COVID-19 containment measures. However, little research has explored whether and how people changed their travel with respect to their perceived local infection risks across space and time. In this article, we relate elasticity and resilience thinking to the changes in metro travel and perceived infection risks at the station or community level over time. Using empirical data from Hong Kong, we measure a metro station's elasticity as the ratio of changes in its average trip length to the COVID-19 cases' footprints around that station. We regard those footprints as a proxy for people's perceived infection risks when making trips to that station. To explore influencing factors on travel in the ups and downs of perceived infection risks, we classify stations based on their elasticity values and examine the association between stations' elasticities and characteristics of stations and their served communities. The findings show that stations varied in elasticity values across space and different surges of the local pandemic. The elasticity of stations can be predicted by socio-demographics and physical attributes of station areas. Stations serving a larger percentage of population with higher education degrees and certain occupations observed more pronounced trip length decrease for the same level of perceived infection risks. The number of parking spaces and retail facilities significantly explained variations in stations' elasticity. The results provide references on crisis management and resilience improvement amid and post COVID-19.