This paper presents a method to track multiple non-rigid objects in a cluttered scene. First, the particularities of non-rigid objects are shown. To cope with them a tracked target is defined as a moving region tracked individually or as a group of moving regions tracked globally. Then we explain how to compute the trajectory of a target and how to compute the correspondences between known targets and moving regions newly detected. In the case of an ambiguous correspondence a compound track is defined to freeze the associations between targets and moving regions until a more accurate information is available. The paper concludes by giving some results on the tracking algorithm implemented for a video-surveillance application.