We consider small networks of instantaneously coupled theta neurons. For inhibitory coupling and fixed parameter values, some initial conditions give chaotic solutions while others give quasiperiodic ones. This behaviour seems to result from the reversibility of the equations governing the networks' dynamics. We investigate the robustness of the chaotic behaviour with respect to changes in initial conditions and parameters and find the behaviour to be quite robust as long as the reversibility of the system is preserved.