Here, we summarize the literature reporting genetic modifier effects in HD, FTLD, AD, and PD. We further contextualize reported genetic modifier effects in these diseases in terms of insight they may lend to the concept of a polygenic landscape for the major neurodegenerative diseases.