We investigate the ability of the neocognitron to perform shift-invariant pattern recognition. Both an intuitive analysis and a more formal investigation show that the performance of the neocognitron is not intrinsically shift invariant and that certain model parameters must be chosen appropriately to obtain approximate shift invariance. It is shown how these parameters should be chosen to reach a compromise between invariance and classification sensitivity.