R. Mann, A. Jepson, and J.M. Siskind, The Computational Perception of Scene Dynamics, Proc. 4th European Conf. on Computer Vision, Cambridge, April 1996, pp. 528-539.

Abstract: Understanding observations of interacting objects requires one to reason about the force-dynamic relations between objects. We present an implemented computational theory that derives force-dynamic interpretations directly from camera input. Interpretations are expressed in terms of assertions about the kinematic and dynamic properties of objects. The feasibility of interpretations can be determined relative to Newtonian mechanics by a reduction to linear programming. Multiple feasible solutions are compared using a preference hierarchy to select plausible interpretations. We provide computational examples to demonstrate that our ontology is sufficiently rich to describe a wide variety of image sequences.