In this paper, we propose a method for detecting abnormal driving of vehicles, such as meandering, transverse motion and acceleration/deceleration. In particular, we extract abnormal vehicle motions in the sense of group behavior by using multilinear relationship in space-time images. The multilinear relationship in space-time images holds when multiple cameras move with translational motions in different direction with different speed. Therefore abnormal drivings, which are not translational motion with uniform velocity, do not meet the requirement, and the multilinear relationship in space-time images does not hold. We focus on this property, and define the degree of abnormality, which is used for detecting abnormal drivings. The efficiency of the proposed method is shown by real image experiments.