Neurodevelopmental classifications and the collective idea of neurodivergence can be seen as a 'moving target'. In our understanding, this means that it responds to the needs of society as well as potentially infinite neurological differences between humans. Therefore, rather than assume that neurodiversity exists according to the existing clinical categories of autism and related conditions (that are often centred around autism as the exemplary kind of neurodivergence), we leave the possibility open that there are other forms of difference that have yet to be defined. In the paper we explore how neurodiversity has been described as a collective property of brains, as we try to negotiate between us what it is to be human and how we can work together to ensure our flourishing and to alleviate suffering. We consider implications of this understanding of neurodiversity for autism research, and propose that we unpick the analogy between neurodiversity and biodiversity.