Plant virus genome replication and movement is dependent on host resources and factors. However, plants respond to virus infection through several mechanisms, such as autophagy, ubiquitination, mRNA decay and gene silencing, that target viral components. Viral factors work in synchrony with pro-viral host factors during the infection cycle and are targeted by antiviral responses. Accordingly, establishment of virus infection is genetically determined by the availability of the pro-viral factors necessary for genome replication and movement, and by the balance between plant defence and viral suppression of defence responses. Sequential requirement of pro-viral factors and the antagonistic activity of antiviral factors suggest a two-step model to explain plant-virus interactions. At each step of the infection process, host factors with antiviral activity have been identified. Here we review our current understanding of host factors with antiviral activity against plant viruses.